Posted by rahamatganz on December 16, 2009 at 10:31am
I am using Drupal 6. In my Google Webmaster tools account the following HTTP error shows. Google says 3 Http errors and shows the following 3 urls!!!
1) http://www.musicdownloadsbd.com/admin
2) http://www.musicdownloadsbd.com/node/add
3) http://www.musicdownloadsbd.com/sitemap.html
i wonder why Google is crawling the listed firs two urls? as they are restricted by ROBOTS.txt file
Please someone help me.