If you have set the robots Meta tag to ALL:INDEX,FOLLOW all pages including those generated by the pager will be indexed by search engines. This results in duplicate title tags and meta descriptions. To avoid this only the first page of a node listing should be set to index,follow and the pages 1,2,… to noindex,follow.

I attached a patch for the current release candidate of the Meta Tags module for Drupal 6. Hope you agree that this is useful .

Best regards
Ramiro

Support from Acquia helps fund testing for Drupal Acquia logo

Comments

calebgilbert’s picture

Status: Needs review » Reviewed & tested by the community
FileSize
531 bytes

Bumping this important patch. Apparently, yaph is really on to something big here. Ted Serbinski who makes the blueprint theme even took yaph suggestions and committed it there, as I found out by visiting this post.

Submitting Drupal 5 patch to go along with the Drupal 6 patch.

Robrecht Jacques’s picture

Status: Reviewed & tested by the community » Fixed

Committed to CVS (D6).
Committed to CVS (D5).

Thanks!

VladSavitsky’s picture

Here is a discussion (http://drupal.ru/node/25027) of this new feature on russian language and many of people want's to turn this feature off. So can you, please, do a checkbox at settings page which will be ON by default.
Thanks

calebgilbert’s picture

Well, people are glad to do what they want, but I can attest to this cleaning up my report at google's webmaster tools *considerably*. I can't fathom why anyone would want to go against that, but then again I can't read Russian. ;-)

VladSavitsky’s picture

This is right behaviour to set "noindex" but all who wan't to have a posibility to turn this feature off have paid links at those pages. So if this pages could not be indexed they will lose the money.
All who have paid links at their sites will use a hacks to remove this "noindex" (you can see a code at one of comments which will turn off "noindex"). Do you understand?

So, I'm asking for a checkbox for this. This checkbox will be turned ON by default but if this needed it can be turned OFF. Thanks.

calebgilbert’s picture

I see - a bit of an edge case, but that makes a lot sense. I'm not the maintainer, but I'm sure they'd be open to a patch.

Jean-Philippe Fleury’s picture

subscribing

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.

FlemmingLeer’s picture

Status: Closed (fixed) » Active
Issue tags: +SEO, +Drupal 5.x, +pagination, +Drupal 6.x

Google is still indexing despite of

<meta name="robots" content="noindex,follow" />
patch above.

Changing it to:
<meta name="ROBOTS" content="NOINDEX,FOLLOW">

may hopefully stop indexing of the ?page=x urls.

Mentioned here:
http://www.robotstxt.org/meta.html

At present I have 1500 pages in google with ?page=x urls.

apaderno’s picture

Status: Active » Fixed
Issue tags: -SEO, -Drupal 5.x, -pagination, -Drupal 6.x

The suggested change has been implemented in the development snapshot, and probably is also present in version 6.x-1.0.
As Drupal CVS works, the code for 6.x-1.0-rc1 cannot be changed; it is useless to re-open a report for version 6.x-1.0-rc1, as the code for that version cannot be changed.

The content of the meta tag description is used whenever you write NOINDEX, or noindex; the meta tag content is not case sensitive.

FlemmingLeer’s picture

Version: 6.x-1.0-rc1 » 5.x-1.13
Status: Fixed » Active

Oh, I mistakenly added it for a wrong version for nodewords

I'm using nodewords 5.x-1.13

I'm also using Meta tags node type 5.x-1.4

on
Drupal 5.19
CAPTCHA Already 21262 blocked form submissions
Cron-opgaver Sidst kørt for 40 minutter 50 sekunder siden
Du kan køre cron manuelt.
Database-schema Updatered
Drupal core update status No update data available
No information is available about potential new releases for currently installed modules. To check for updates, you may need to run cron or you can check manually. Please note that checking for available updates can take a long time, so please be patient.
Filsystem Skrivbar (Public download-metode)
Job queue There are no queued jobs.
Konfigurationsfil Beskyttet
Memcache admin Memcache included
MySQL database 5.1.26
PHP 5.2.6
PHP register globals none
Unicode-bibliotek PHP mbstring-udvidelse
webserver Apache/2.0.54

apaderno’s picture

Status: Active » Closed (won't fix)

Drupal 5 branch is not supported anymore; such feature is not going to be implemented.

Z2222’s picture

I don't think this is a good idea unless it's off by default. I generally don't want to noindex my pagination.

IMHO, a better idea is to fix the module to make the titles and descriptions different, not noindex them.

giorgio79’s picture

Version: 5.x-1.13 » 6.x-1.x-dev
Assigned: yaph » Unassigned
Status: Closed (won't fix) » Active

Hello,
Has this feature been removed?

I am not seeing noindex on pager pages.

apaderno’s picture

Title: Set robots Meta Tag to noindex on pages generated by the pager » Allow to use a different set of meta tags for the pager pages

Rather than limiting the feature to only a meta tag, I would prefer to make the feature more generic.
There is already a setting page for the front page meta tags, for the error 403 (and 404) pages, and for the tracker page; adding a setting page for the pager pages would not be difficult.

apaderno’s picture

Status: Active » Fixed

The code has been changed, and committed in CVS.

Jean-Philippe Fleury’s picture

Hi KiamLaLuno,

Is it possible to describe a little the changes implemented?

Thanks.

giorgio79’s picture

Status: Fixed » Needs work

Hi Kiam,

The pager setting page seems to be missing from the latest dev version.

apaderno’s picture

FileSize
75.28 KB

Are you sure you downloaded the correct archive? I see the settings page, as it is visible in the attached screenshot.

giorgio79’s picture

Status: Needs work » Fixed

Thanks Kiam :) I can see it now.

elyobo’s picture

As mentioned above, preventing the other pages from being indexed sounds like massive overkill to me; I want the content indexed, not because they're paid links, but because it's (potentially) important content on my site.

A more useful suggestion would be for the pager to amend the title of the page instead.

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.

couturier’s picture

Just as a September 2012 update for people who may find this issue through a highly-indexed blog post on this topic, Nodewords is now the Meta Tags module, and applying different page titles to paginated Views can now be done through the Page Title module. However, Meta Tags is incorporating most of the functionality of the Page Title module, and a request for this function has been added to the Meta Tags queue here: Using views with [current-page:page-number] to avoid duplicate page titles

DamienMcKenna’s picture

@Couturier: please note - Nodewords is still called "Nodewords", Meta tags (aka "Metatag") is the new rewrite for D7 - they are separate modules, what works for one will not work for another.

prakharcse’s picture

Issue summary: View changes

I have a view whose results are about 20 pages with pager. URLs are like xyz?page=1. Now, I want to implement different meta description for each page so that xyz?page=1 and xyz?page=2 have different meta descriptions.
I have Metatag module installed in my installation.