Index: robots.txt =================================================================== RCS file: /cvs/drupal/drupal/robots.txt,v retrieving revision 1.13 diff -u -p -r1.13 robots.txt --- robots.txt 29 Nov 2008 09:33:50 -0000 1.13 +++ robots.txt 7 Mar 2009 14:45:44 -0000 @@ -41,21 +41,33 @@ Disallow: /UPGRADE.txt Disallow: /xmlrpc.php # Paths (clean URLs) Disallow: /admin/ +Disallow: /comment/reply Disallow: /comment/reply/ Disallow: /contact/ +Disallow: /node/add Disallow: /node/add/ Disallow: /search/ +Disallow: /user/register Disallow: /user/register/ +Disallow: /user/password Disallow: /user/password/ +Disallow: /user/login Disallow: /user/login/ +Disallow: /user/logout Disallow: /user/logout/ # Paths (no clean URLs) Disallow: /?q=admin/ +Disallow: /?q=comment/reply Disallow: /?q=comment/reply/ Disallow: /?q=contact/ +Disallow: /?q=node/add Disallow: /?q=node/add/ Disallow: /?q=search/ +Disallow: /?q=user/password Disallow: /?q=user/password/ +Disallow: /?q=user/register Disallow: /?q=user/register/ +Disallow: /?q=user/login Disallow: /?q=user/login/ +Disallow: /?q=user/logout Disallow: /?q=user/logout/