ricbra/robots-txt-bundle
Composer 安装命令:
composer require ricbra/robots-txt-bundle
包简介
Simple Symfony2 which generates robots.txt based on config setting
README 文档
README
After solving the same problem for the fifth time I thought it was time to create a Bundle for this problem. I did again an extensive search on any other available material but I guess everybody is solving this problem on his own. On KnpBundles.com and Packagist.org I couldn't find any Bundle for this. So I created this one instead.
The problem: your staging environment indexed in Google
We all have some different environments for your apps (staging, test, dev) and we all have experienced this in the past: Google indexed your staging environment and every now and then a real visitor ends up there. Of course you can IP-block the staging but this isn't always feasible.
Solution for Symfony2: configurable robots.txt
Update your config.yml:
ricbra_robots_txt:
allow_robots: %allow_robots%
In your parameters.yml file for production:
allow_robots: true
In your staging|dev|test parameters file:
allow_robots: false
Not really rocket science, but it works.
Installation
Composer ftw:
$ composer require ricbra/robots-txt-bundle
Then enable the bundle:
<?php // app/AppKernel.php $bundles = array( ... new Ricbra\Bundle\RobotsTxtBundle\RicbraRobotsTxtBundle(), ... );
Update routing:
// app/config/routing.yml
ricbra_robots_txt:
resource: "@RicbraRobotsTxtBundle/Resources/config/routing.yml"
prefix: /
ricbra/robots-txt-bundle 适用场景与选型建议
ricbra/robots-txt-bundle 是一款 基于 PHP 开发的 Composer 扩展包,目前已累计 5.49k 次下载、GitHub Stars 达 3, 最近一次更新时间为 2014 年 10 月 29 日, 在 PHP 生态内属于活跃度较高的组件。
它主要适用于以下技术方向: 「robots.txt」 「robots」 「crawlers」 「spiders」 等业务场景。在实际项目中,围绕这些方向常见需要落地的问题包括:接口对接、性能调优、并发安全、与既有框架(Laravel / ThinkPHP / Yii / Webman 等)的兼容适配,以及生产环境的日志埋点与稳定性保障。
我们在过去多个企业项目中使用过 ricbra/robots-txt-bundle 或与其功能相近的方案,如果你在选型或落地过程中遇到问题,例如 版本兼容、二次改造、私有化封装、与内部系统对接、生产 BUG 排查,欢迎联系我们协助评估。
基于 ricbra/robots-txt-bundle 在你已有业务上做功能扩展、字段裁剪、UI 适配、与内部账号 / 权限 / 日志系统的深度对接。
线上偶发问题、内存泄漏、慢查询、并发异常等排查修复;针对高流量场景做缓存、队列、索引层面的调优。
承接完整的项目从需求 → 设计 → 开发 → 上线 → 长期运维;也可按月提供技术保姆服务。
与 ricbra/robots-txt-bundle 相关的其它包
同方向 / 同关键字的高下载量 PHP Composer 包推荐,方便对比选型:
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
A simple plugin that adds a twig tag to obfuscate email addresses (by rot13) in text fields.
Robots.txt Generator
A route for serving a basic robots.txt in Laravel 5.1+, based on configuration settings.
Agnostic model to efficiently query and scroll any kind of data (SQL, Search engine, HTTP API, CSV, ...) and push them anywhere with a ETL
Laravel 5.x helpers for a semi-automated robots.txt and meta tags
统计信息
- 总下载量: 5.49k
- 月度下载量: 0
- 日度下载量: 0
- 收藏数: 4
- 点击次数: 15
- 依赖项目数: 0
- 推荐数: 0
其他信息
- 授权协议: MIT
- 更新时间: 2014-10-29