Firstly many thanks for your efforts with this module!!!!

I have installed the module and deleted the orginal robot file from my site root.

Quoting the comments in the readme.txt:

"This module generates the robots.txt file dynamically and gives you the chance to
edit it, on a per-site basis."

I have looked for the new version of the file in the site root and cannot find it. So I am a little confused as to how Google sees this file.

Can you explain a little more as to how this module works?

once again many thanks for this great module

regards

Peter

Comments

hass’s picture

hass commented
Status: Active » Fixed

There is no file generated on disk... it's virtual... simply access robots.txt and you see the content of this file. There is also a link in the configuration page.

rodenp’s picture

rodenp commented
Status: Fixed » Closed (fixed)

Many thanks hass, i also finally managed to figure this out myself.

cheers

Peter

dave reid’s picture

dave reid
he/him
Primary language English
Location Nebraska USA
commented

@rodenp

Drupal's menu system will allow us to run Drupal code on paths that look like files. But here's the key, the web server always gives priority to files that actually exist. In this case, we provide a Drupal menu path of 'robots.txt' which then we can in Drupal as long as a file called 'robots.txt' does *not* exist in the Drupal folder.