Allow to use a different set of meta tags for the pager pages

yaph - August 13, 2008 - 21:02
Project:Nodewords
Version:6.x-1.x-dev
Component:Code
Category:feature request
Priority:normal
Assigned:Unassigned
Status:closed
Description

If you have set the robots Meta tag to ALL:INDEX,FOLLOW all pages including those generated by the pager will be indexed by search engines. This results in duplicate title tags and meta descriptions. To avoid this only the first page of a node listing should be set to index,follow and the pages 1,2,… to noindex,follow.

I attached a patch for the current release candidate of the Meta Tags module for Drupal 6. Hope you agree that this is useful .

Best regards
Ramiro

AttachmentSize
nodewords-6.x-1.0-rc1-meta-robots.patch645 bytes

#1

Caleb G - January 22, 2009 - 02:50
Status:needs review» reviewed & tested by the community

Bumping this important patch. Apparently, yaph is really on to something big here. Ted Serbinski who makes the blueprint theme even took yaph suggestions and committed it there, as I found out by visiting this post.

Submitting Drupal 5 patch to go along with the Drupal 6 patch.

AttachmentSize
nodewordsD5.patch 531 bytes

#2

Robrecht Jacques - February 6, 2009 - 13:08
Status:reviewed & tested by the community» fixed

Committed to CVS (D6).
Committed to CVS (D5).

Thanks!

#3

VladSavitsky - February 17, 2009 - 22:26

Here is a discussion (http://drupal.ru/node/25027) of this new feature on russian language and many of people want's to turn this feature off. So can you, please, do a checkbox at settings page which will be ON by default.
Thanks

#4

Caleb G - February 21, 2009 - 02:47

Well, people are glad to do what they want, but I can attest to this cleaning up my report at google's webmaster tools *considerably*. I can't fathom why anyone would want to go against that, but then again I can't read Russian. ;-)

#5

VladSavitsky - February 21, 2009 - 21:15

This is right behaviour to set "noindex" but all who wan't to have a posibility to turn this feature off have paid links at those pages. So if this pages could not be indexed they will lose the money.
All who have paid links at their sites will use a hacks to remove this "noindex" (you can see a code at one of comments which will turn off "noindex"). Do you understand?

So, I'm asking for a checkbox for this. This checkbox will be turned ON by default but if this needed it can be turned OFF. Thanks.

#6

Caleb G - February 24, 2009 - 18:41

I see - a bit of an edge case, but that makes a lot sense. I'm not the maintainer, but I'm sure they'd be open to a patch.

#7

jpfle - February 27, 2009 - 18:10

subscribing

#8

System Message - March 13, 2009 - 18:20
Status:fixed» closed

Automatically closed -- issue fixed for 2 weeks with no activity.

#9

FlemmingLeer - August 31, 2009 - 02:16
Status:closed» active

Google is still indexing despite of

<meta name="robots" content="noindex,follow" />
patch above.

Changing it to:
<meta name="ROBOTS" content="NOINDEX,FOLLOW">

may hopefully stop indexing of the ?page=x urls.

Mentioned here:
http://www.robotstxt.org/meta.html

At present I have 1500 pages in google with ?page=x urls.

#10

KiamLaLuno - August 31, 2009 - 13:41
Status:active» fixed

The suggested change has been implemented in the development snapshot, and probably is also present in version 6.x-1.0.
As Drupal CVS works, the code for 6.x-1.0-rc1 cannot be changed; it is useless to re-open a report for version 6.x-1.0-rc1, as the code for that version cannot be changed.

The content of the meta tag description is used whenever you write NOINDEX, or noindex; the meta tag content is not case sensitive.

#11

FlemmingLeer - September 1, 2009 - 20:05
Version:6.x-1.0-rc1» 5.x-1.13
Status:fixed» active

Oh, I mistakenly added it for a wrong version for nodewords

I'm using nodewords 5.x-1.13

I'm also using Meta tags node type 5.x-1.4

on
Drupal 5.19
CAPTCHA Already 21262 blocked form submissions
Cron-opgaver Sidst kørt for 40 minutter 50 sekunder siden
Du kan køre cron manuelt.
Database-schema Updatered
Drupal core update status No update data available
No information is available about potential new releases for currently installed modules. To check for updates, you may need to run cron or you can check manually. Please note that checking for available updates can take a long time, so please be patient.
Filsystem Skrivbar (Public download-metode)
Job queue There are no queued jobs.
Konfigurationsfil Beskyttet
Memcache admin Memcache included
MySQL database 5.1.26
PHP 5.2.6
PHP register globals none
Unicode-bibliotek PHP mbstring-udvidelse
webserver Apache/2.0.54

#12

KiamLaLuno - September 1, 2009 - 21:21
Status:active» won't fix

Drupal 5 branch is not supported anymore; such feature is not going to be implemented.

#13

J. Cohen - September 8, 2009 - 07:38

I don't think this is a good idea unless it's off by default. I generally don't want to noindex my pagination.

IMHO, a better idea is to fix the module to make the titles and descriptions different, not noindex them.

#14

giorgio79 - October 11, 2009 - 04:48
Version:5.x-1.13» 6.x-1.x-dev
Assigned to:yaph» Anonymous
Status:won't fix» active

Hello,
Has this feature been removed?

I am not seeing noindex on pager pages.

#15

KiamLaLuno - October 11, 2009 - 09:16
Title:Set robots Meta Tag to noindex on pages generated by the pager» Allow to use a different set of meta tags for the pager pages

Rather than limiting the feature to only a meta tag, I would prefer to make the feature more generic.
There is already a setting page for the front page meta tags, for the error 403 (and 404) pages, and for the tracker page; adding a setting page for the pager pages would not be difficult.

#16

KiamLaLuno - October 11, 2009 - 12:03
Status:active» fixed

The code has been changed, and committed in CVS.

#17

jpfle - October 17, 2009 - 23:29

Hi KiamLaLuno,

Is it possible to describe a little the changes implemented?

Thanks.

#18

giorgio79 - October 20, 2009 - 08:21
Status:fixed» needs work

Hi Kiam,

The pager setting page seems to be missing from the latest dev version.

#19

KiamLaLuno - October 20, 2009 - 09:43

Are you sure you downloaded the correct archive? I see the settings page, as it is visible in the attached screenshot.

AttachmentSize
Voila_Capture_39.png 75.28 KB

#20

giorgio79 - October 20, 2009 - 13:33
Status:needs work» fixed

Thanks Kiam :) I can see it now.

#21

elyobo - November 1, 2009 - 14:01

As mentioned above, preventing the other pages from being indexed sounds like massive overkill to me; I want the content indexed, not because they're paid links, but because it's (potentially) important content on my site.

A more useful suggestion would be for the pager to amend the title of the page instead.

#22

System Message - November 15, 2009 - 14:10
Status:fixed» closed

Automatically closed -- issue fixed for 2 weeks with no activity.

 
 

Drupal is a registered trademark of Dries Buytaert.