Posted by kjholla on September 7, 2009 at 9:08pm
| Project: | Browscap |
| Version: | 7.x-1.x-dev |
| Component: | User interface |
| Category: | feature request |
| Priority: | normal |
| Assigned: | Unassigned |
| Status: | needs review |
Issue Summary
I find that my site is being crawled by agents such as:
Mozilla/5.0 (compatible; Google Desktop)
bitlybot
Mozilla/5.0 (compatible; Feedtrace-bot/0.2; bot@feedtrace.com)
Mozilla/5.0 (compatible; GurujiBot/1.0; +http://www.guruji.com/en/WebmasterFAQ.html)
Mozilla/5.0 (compatible; mxbot/1.0; +http://www.chainn.com/mxbot.html)
These are obviously crawlers and not browsers. However, the browscap data seems to treat these as Browsers.
Would it be possible to add a feature wherein the webmaster can override the browscap data and ask the module to treat specific "Browsers" as crawlers and specific "Crawlers" as browsers?
Regards,
KH
Comments
#1
Would be pretty neat to edit this stuff in the interface itself. Currently, all you can do is edit in the MySQL table. The next update, however, you'll loose your changes.
#2
Yeah, we would need an "overrides" table to store this admin-entered-information that gets merged whenever the browscap.ini file iupdate or is used first in PHP or something.
#3
Auto Admin might make providing administration around the Browscap data easy.
#4
Auto Admin unfortunately doesn't provide support for editing BLOB data. Maybe if we extend Auto Admin to support external handling of special fields? Hmmm.
#5
Hi I am the author of Auto Admin. Adding support for Blobs is a _really_ quick fix. Let me now if you still need it!
Cheers
_rune
#6
Great idea. I've created an issue here: #656016: Support for BLOBs
#7
Another thought on this: There are two ways to mark them as bots.
1st: Mark them as crawlers locally. This needs some kind of override to the official data and some interface to manage those overrides.
2nd: Tell Gary about them and mark them as crawlers globally. IMHO the better solution, because the everyone, who use browscap will profit from it. So you need a button "tell" and some infrastructure to actually let Gary know about it.
#8
In my experience Gary is really quick to figure out stuff himself. Perhaps some documentation to explain that?
#9
subscribe
#10
Marked #909532: iPad recognition as a duplicate.