Please, add to the form '{host}admin/settings/robotstxt' an option "UNpublished nodes in robot.txt" with following values:
"automatically filter" (selected by default for security reasons) or
"automatically disallow" or
"leave unchanged".

Comments

not_Dries_Buytaert’s picture

not_Dries_Buytaert commented
Title: Add option on how to handle UNpublished nodes in robot.txt » Add option to content types on how to handle UNpublished nodes in robot.txt
Status: Active » Closed (won't fix)

Merged with this feature request: http://drupal.org/node/821410