Hello:

I've read every issue and post related to this and I don't know how people is doing this in their production sites...

I've included a view page in my sitemap using a menu link: /blog
The problem is that /blog?page=1 /blog?page=2 etc. are not added. I know that this can be difficult because it's related with exposed filters, arguments and the like. But pagination is far more common and I don't know how you are dealing with it in your sitemaps. Maybe the solution is forgetting about it and letting google follow the page links.

What do you think?

Thanks.-

Comments

Anonymous’s picture

Status: Active » Closed (won't fix)

Maybe the solution is forgetting about it and letting google follow the page links.

Yes, that is the solution.

neurojavi’s picture

Status: Closed (won't fix) » Active

Hello:

I've thinking about this and there's a problem with this approach nad SEO.

I think that a lot of people disallow robots to follow urls with exposed filters in them because they will cause lots of indexed pages with no very much value and duplicated content.

For example, I have a view with 3 exposed filters and several pages. The combinations of exposed filters values and pages is in the range of thousands. I don't want bots to waste my crawl budget crawling this pages so I've set my robots.txt to filter them.

The problem is that I want the no filtered pages to be indexed so I need to put them in the sitemap... Do I need to write each page as a custom URL (blog?page=1, blog?page=2, etc.)? And have I to remember to add page=34 when the number of posts grows? I don't think that this is a viable solution for a real site... I don't know if I've explained myself properly.

If you doesn't mind I'll reopen the issue for some time so we get more ideas.

Thanks.-

Anonymous’s picture

Status: Active » Postponed (maintainer needs more info)

Isn't each blog a node entry that is added to the sitemap? You certainly only want the content once in the sitemap.xml file. And perhaps you want a no-follow for the /blog view so you may want to add the robots.txt module for that. What purpose is adding the pages of view for the /blog link?

neurojavi’s picture

Well, sometimes is useful to have the blog view pages indexed. If you have summaries of post content and not the first X characters of the post, your content is going to be different. If this pages are not indexed we lost an opportunity of being find.
I like to have this pages indexed and, since they don't have a description metatag, the description google shows is going to be an excerpt from the relevant post teasers. This way people can find my site with keyword combinations from different posts that are not going to happen within a single post.

I've read posts from experts in SEO (not like me :-) and it seems to be an agreement in that it's worth to have one version of this listing indexed (but not all combinations from input filters). I don't have any reference about this posts now but I can look for them again if you need them.

Thanks.-

Anonymous’s picture

Check out drupal.org/project/metatag to get post relative metatag descriptions. I still don't see how we can help the issue with xmlsitemap.

neurojavi’s picture

Hello again:

I think my previous explanation was not clear enough... I know metatag project and it doesn't have anything to do with this issue. I'll try again:

USE CASE A:
- You have your blog posts listed in a paged view where you show each post teaser.
- In your posts you write a summary in each body field so the teaser display will show this summary and not the first sentences of the body. This is useful when you want to use some other, more generic keywords, that can't be used in the main text. For example I have some posts about poverty and education in some countries I'm visiting. In the summaries I can write something like "In this text we talk about education in country X. We tell the story of a young boy that... This text can be used in education for development courses and..."
- You want people to be able to find your summaries in google when they search for .education for development courses, but this keywords may not appear in the main text...

USE CASE B:
- You have your blog posts listed in a paged view where you show each post teaser.
- You want people to find your site using one word from a post A and one word from a post B... (for example, I have a post about "education in India" and another about "women in India". If some one searches for "education women India" my views page (which is showing both posts on same page) is going to have better ranking for this search than the individual pages.
- This is only possible in views list pages. If you exclude them then you lost lots of possible visitors.

Thanks again.

Anonymous’s picture

So you want the ability to add the links created to support a view?

Does #1461670: Generalize to work with any Entity Type make this a duplicate?

You have the ability to add a "custom" link with the xmlsitemap_custom module. Everything else about your two scenarios point to meta tags. See Dave's sandbox for Metatag Views. http://drupal.org/sandbox/davereid/1281614