Adding rel="nofollow" to refining links
pacesie - May 3, 2007 - 07:48
| Project: | Refine by taxonomy |
| Version: | 5.x-1.x-dev |
| Component: | Code |
| Category: | feature request |
| Priority: | normal |
| Assigned: | Unassigned |
| Status: | active |
Jump to:
Description
I have found that this module makes the search engine traffic increases exponentially with the number of tag due to the vast amount of tag combinations. With a large site such traffic may create noticeable impact. These traffics are usually unnecessary since contents are already listed by main directories. Is it a good idea to provide an option to add rel="nofollow" to the refining links?
#1
IMO we should simply document how to add refine bt links to robots.txt. rel=nofollow so far only is supporte by Google; and is not an official standard. And Google yahoo and MSN and ask behave quite nice on the RBT links. More obscure bots don't. Therefore robots.txt is really the best place to put this.
#2
AFAIK robots.txt doesn't allow regular expression and I don't know how to exclude only the refining links with the current refining url form. Can you post instruction?
nofollow attribute is cleaner and is now supported by google, MSN, yahoo and perhaps others.
what is "RBT"?
#3
refine by taxonomy
Do you mean the drupal search engine,
or extern search engines (like google, MSN, Yahoo, ...)?
If extern search engines - is this a problem for your site?