spatie/laravel-robots-middleware
Add an `all` or `none` robots header to your requests via a middleware in Laravel
时间：2016-01-05 15:36
evheniy/robots-txt-bundle
The RobotsTxtBundle adds the ability to generate robots.txt file to your application.
时间：2015-11-03 19:53
hofff/contao-robots-txt-editor
Editor for auto creation and modification of robots.txt.
时间：2015-10-26 21:42
webdl/crawltrack-bundle
This bundle is used to track crawlers and robots in a Symfony app. It is based on Crawltrack
时间：2015-10-05 15:36
nikmauro/dissalowed-words-list
cms39 dissalowed words list
时间：2015-09-25 13:39
php-middleware/block-robots
PSR-15 middleware to avoid search engine indexing with PSR-7
时间：2015-09-22 19:14
mgargano/non-production-robots-ignore
Non Production Robots Ignore is a simple WordPress plugin that is used with vlucas/phpdotenv (or similar) that sets environment variables to set robots.txt to ignore all on all environments except production.
时间：2015-09-16 12:21
beeg99/phpcrawl
PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.
时间：2015-09-14 14:23
dawid-z/phpcrawl
PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.
时间：2015-09-12 13:48
fourlabs/robots-bundle
Symfony2 bundle to control X-Robots-Tag HTTP header via annotations
时间：2015-08-27 16:52
nawarian/php-bot
A PHP library for creating automation robots
时间：2015-08-01 22:35
samkitano/seo-gen
Generate sitemap.xml and robots.txt files in Laravel 4.2 with support for multi-language. Based on Hettiger/SeoAggregator
时间：2015-06-15 21:28