Not really a problem but your robots.txt isn't uptodate with the robots_2.txt file you show at http://drupal.org/files/issues/robots_2.txt easy to manualy fix but *Shrug* be nice to be fixed by defalt and those that don't see the thread ;) btw it's ausom tyvm!

Also it should probably contain an install.txt saying somthing to the effect of coppy robots.txt & robotstxt.module into the modules directory.. and the permission on the files should probably be set to 644 to match the other default modules..

again thank you :)

Comments

robertdouglass’s picture

robertdouglass commented

I agree and will do all this as soon as the robots.txt patch hits core. Thnx.

david strauss’s picture

david strauss
he/him
commented
Status: Active » Closed (fixed)

I've updated the robots.txt file with the linked one.