Hi,

As it is said in the mentioned blog posts, default meta tag 'robots' should look like this:

... to provide instruction for all the robots to NO INDEX our site.

And then, after checking that we have *for sure* a good spider on site, send him 'index, follow' set. OK.

But I have installed the module and I see, that it works in reverse way: the default tags are 'yes index', 'yes follow'. So, if a bad spider will come to us, the module will do nothing with him?

No, no, I can't be right. So, where is the clue, that I haven't understood?

Szy.

Comments

szy’s picture

szy commented

As it is said in the mentioned blog posts, default meta tag 'robots' should look like this:

... to provide instruction for all the robots to NO INDEX our site.

As it is said in the mentioned blog posts, default meta tag 'robots' should look like this:
<meta name="robots" content="NOindex,NOfollow" />
... to provide instruction for all the robots to NO INDEX our site.

- now sounds correct, forgot about the code tags.

Szy.

szy’s picture

szy commented
Title: Confused... how does the module work? » Default: INDEX or NOINDEX? Nodewords? Altavista, Lycos?

Is there any problem with working Nodewords module in the system?

And:

There are also in Altavista, Lycos, Wisenut in antiproxyhack_cloak_data table. But they have no checking boxes in Drupal admin. So, do they work, or not?

Thanks,
Szy.