By kellyllek on

I've being using a directory to work on a production site but it's not in it's correct location and it's not ready. However it's already been indexed by the search engines (namely Google). My plan is simply to move it to another location, but is there a way I can not open it to indexing to begin with? I'm assuming there is a 'no robot' type code but I'm not sure what it is or where to put it.

Also, I don't suppose there is an easy way to remove the already indexed site completely from Google?

Please send an solution or point to another discussion that covered this. Thanks.

⋅ Categories: Drupal 6.x

Comments

gausarts’s picture

gausarts commented

Have you tried this: http://www.robotstxt.org/orig.html

This example indicates that no robots should visit this site further:

# go away
User-agent: *
Disallow: /

love, light n laughter

kellyllek’s picture

kellyllek commented

Not yet. Thanks. So where do I put this? Is there a way to put it on every page of the pre-production drupal site?

gausarts’s picture

gausarts commented

In your robots.txt in the ROOT directory. It ships with drupal.

love, light n laughter