By Vc Developer on

I'm running multiple websites, and I have only one active for the internet at the moment. So I don't ever need to enable my default drupal right? Because, I notice in the log "page not found" for the robots.txt.

⋅ Categories: Drupal 6.x

Comments

choster’s picture

choster commented

I'm a little unclear what you're asking about-- enable your default Drupal? Default what?

Well-behaved crawlers will look for robots.txt on every host they encounter. It's not required, but if a crawler looks for it and doesn't find it, your web server will record a Not Found code.

You can provide different robots.txt files for multi-site installations using the http://drupal.org/project/robotstxt module.

Vc Developer’s picture

Vc Developer commented

I mean running multiple sites under my default install folder. I'm not using this portion of Drupal, but just the six websites in the sites folder. I left it as is after installation. Is this something normal you would do using this kind of setup? My company website is in the sites folder along with others. Should I use the default install as my own company site?