Hello,

I have installed this module in order to have a different theme for a subdomain, such as mobile.domainname.com to have a mobile theme. I intend for everything, other than the theme to be the same for the subdomain.

I am curious how i can prevent mobile.domainname.com from being crawled by search engines. I tried the SEO feature of Domain Access but that won't work for my purposes since it points to the original domain url, thus going back to the other theme.

Is there a way i can edit the robot.txt in domainname.com to affect mobile.domainname.com? If not is there another way to do it? I am okay with completely removing mobile.domainname.com from search engines since it is just a copy (with a different theme).

Thanks for any help. BTW this module is amazing! i never thought such domain control was possible from a module!!

Comments

akolahi’s picture

akolahi commented
Category: feature » support

makes more sense as a support request

agentrickard’s picture

agentrickard
he/him
Primary language English
Location Georgia (US)
commented

I think you have to do this at the server level. I think robots.txt might get picked up, but do not really know.

Wouldn't the theme of the mobile domain tip off crawlers not to spider it? Check google's webmaster tips, they probably have a better answer.

bribiz’s picture

bribiz commented

I am also looking into robots.txt for each domain. I would like to be able restrict search engines from crawling some of my domains at all. It's content that isn't password protected, yet I don't want it to be indexed. Here's my idea...insert a meta tag into the head of certain domains.

To let Google know that you do not want a page crawled, you can create the following meta tag on a per page basis instead of using robots.txt:

<META NAME="GOOGLEBOT" CONTENT="NOINDEX, NOFOLLOW">

See the article at: http://www.webpronews.com/topnews/2004/03/31/disabling-google-and-other-... and http://www.robotstxt.org/meta.html

Currently is there any easy way to insert a meta tag on a per domain basis?

bribiz’s picture

bribiz commented

To tell all robots and not just googlebot the code would be:

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
agentrickard’s picture

agentrickard
he/him
Primary language English
Location Georgia (US)
commented

Yes. In your theme template.php, just add the code to a theme_preprocess_page() function. Since you are using different themes for the domains, this should be fairly straitforward.

Otherwise, check the value of the global $_domain variable, and respond accordingly.

global $_domain;
if ($_domain['domain_id'] == 3) { // assuming 2 is the mobile domain...
  print meta tag....
}
akolahi’s picture

akolahi commented

#3: yes, the Meta Tag module will do just that, and more: http://drupal.org/project/nodewords

akolahi’s picture

akolahi commented

agentrickard: very clever solution :D thanks!

agentrickard’s picture

agentrickard
he/him
Primary language English
Location Georgia (US)
commented
Status: Active » Closed (fixed)

Great!

Richardson06’s picture

Richardson06 commented

Hi,

Search Engine Optimization is the method of improving both the quantity and value of traffic to a certain website. The key aspect of a successful SEO strategy is achieved the good balance between the number of people who view a site and ensuring that the people who are interested in the exact product, service, or information that the site is offering.

_________________________________________________________________
[URL=http://www.Hi-TechInformatics.com]Search Engine Marketing[/URL]