Just turned on the module, removed the robots.txt file from the webroot. Where is robots.txt now? Shouldn't it be at /robots.txt?

Comments

dave reid’s picture

dave reid
he/him
Primary language English
Location Nebraska USA
commented
Status: Active » Fixed

Since there's no actual file, Drupal is free to handle the request for robots.txt. Just like the node.module defines 'node' as a path for Drupal to list content, the robotstxt.module defines 'robots.txt' as a path as well. The module then outputs text instead of a Drupal page.

kevinquillen’s picture

kevinquillen commented

Nevermind, there was an htaccess rule for txt files. All better.

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.