Block User Agents
Peter Apokotos - July 28, 2005 - 19:41
| Project: | Troll |
| Version: | HEAD |
| Component: | Miscellaneous |
| Category: | feature request |
| Priority: | normal |
| Assigned: | Unassigned |
| Status: | won't fix |
Jump to:
Description
block user agents
| Project: | Troll |
| Version: | HEAD |
| Component: | Miscellaneous |
| Category: | feature request |
| Priority: | normal |
| Assigned: | Unassigned |
| Status: | won't fix |
block user agents
#1
Not really interested in this. Apache is way better for doing a sweeping block by user agent. If spiders are what you are after spiders should be blocked with robots.txt. If not, its very easy to spoof user agent anyway, so someone who wants to play with you will still be able to.
#2
Only is the spider respects the robots.txt file. And I know this can also be done with htaccess file.
But with a large enough list and on a shared server. It can really slow things down.
Peter Apockotos
http://www.apockotos.com
http://www.knightrider.org
http://www.macmariner.com
#3
#4
#5
...and I'm locking the thread.