Remove robots.txt from the module directory
kiamlaluno - December 29, 2008 - 11:02
| Project: | RobotsTxt |
| Version: | 6.x-1.x-dev |
| Component: | Code |
| Category: | task |
| Priority: | normal |
| Assigned: | Unassigned |
| Status: | by design |
Jump to:
Description
The copy of the robots.txt file present in the module directory should be removed.
The user should receive instructions to copy the robots.txt from the Drupal root directory to the module directory. In this way, the user would have the most recent version of that file (in the case it gets changed from the latest release he is using), and at the same time the file which would cause the module to not work (its menu callback is not called if the file is being kept in the Drupal root folder) would be moved.

#1
No, we need at least one file for the default settings. We try to keep the one in the module up-to-date as possible with core and users having a multisite installation wouldn't have a core robots.txt in Drupals root and therefore cannot import anything if you don't have a fall back. Therefore every additional installation in this multisite installation would end with a blank default robots.txt.
We'd really like to prevent this and import the core defaults from the modules robotx.txt file.
#2
DEV robots.txt is up-to-date since November 4, 2008...
#3
I replied to the wrong issue report. I am sorry.
#4