This module allows you to add additional lines to each domain's robots.txt file. The most frequently used scenario is probably to exclude a certain domain from being indexed by search engines entirely. You would use:
Disallow: /
Requirements:
The admin settings form is at:
admin/structure/domain/robotstxt
Project information
- Project categories: Developer tools, Administration tools
89 sites report using this module- Created by branana on , updated
Stable releases for this project are covered by the security advisory policy.
There are currently no supported stable releases.
