Please, give me the correct steps to configure the CDN and CDN module to avoid duplicate content.
Right now I've used example.com in CDN module, and example.com in CDN mirror, and when I go to example.mycdnmirror.com I can access whole my website.
I am using simplecdn.com for CDN.

Comments

math0ne’s picture

I'm looking for an answer to this as well.

math0ne’s picture

FYI I figured out you have to add this to your .htaccess and serve a different robots.txt to your mirror server:

RewriteCond %{HTTP_USER_AGENT} SimpleCDN
RewriteRule ^robots\.txt$ /robots_simplecdn.txt [L]

Just create a robots_simplecdn.txt and block all robots:

User-agent: *
Disallow: /