Active
Project:
Simple CDN
Version:
6.x-1.1
Component:
Miscellaneous
Priority:
Normal
Category:
Support request
Assigned:
Unassigned
Reporter:
Created:
23 Feb 2010 at 13:21 UTC
Updated:
20 May 2010 at 17:22 UTC
Please, give me the correct steps to configure the CDN and CDN module to avoid duplicate content.
Right now I've used example.com in CDN module, and example.com in CDN mirror, and when I go to example.mycdnmirror.com I can access whole my website.
I am using simplecdn.com for CDN.
Comments
Comment #1
math0ne commentedI'm looking for an answer to this as well.
Comment #2
math0ne commentedFYI I figured out you have to add this to your .htaccess and serve a different robots.txt to your mirror server:
RewriteCond %{HTTP_USER_AGENT} SimpleCDN
RewriteRule ^robots\.txt$ /robots_simplecdn.txt [L]
Just create a robots_simplecdn.txt and block all robots:
User-agent: *
Disallow: /