I'm using the default Drupal robots.txt file which includes the line 'Disallow: /sites/' yet the file click.php of the clickheat library is currently being indexed by Google.

The path to the file is 'sites/all/modules/contrib/click_heatmap/clickheat/click.php'

Is this a problem with the robots.txt file, the click_heatmap module, the clickheat library, or something else?

Thanks.

Comments

elvis2’s picture

elvis2 commented

You might want to add a new disallow rule:
Disallow: /*click.php

langworthy’s picture

langworthy commented

Google is probably finding this via the Javascript the module embeds (the full path to the file click.php).

Using the default Drupal robots.txt would be ideal; in the meantime I'll add a new rule.

I hope the module maintainer can comment on the best course of action.