Posted by webchick on May 2, 2009 at 12:32am
86 followers
| Project: | XML sitemap |
| Version: | 7.x-2.x-dev |
| Component: | Code |
| Category: | feature request |
| Priority: | normal |
| Assigned: | Dave Reid |
| Status: | postponed |
| Issue tags: | Google image sitemap, image, Sitemaps, video sitemaps |
Issue Summary
This was brought up by netaustin at #448000-9: Big, Over-Arching Sitemap Architecture Discussion (tm):
"# Google News provides a namespace to extend the Sitemaps.org XML file for their purposes. Can we address this?"
I looked more into this and according to http://www.google.com/support/webmasters/bin/answer.py?answer=34654&topi..., there are actually four "sitemap extensions" that Google supports:
The news one in particular would be useful to a lot of Drupal sites out there.
Comments
#1
As I told webchick in #drupal, I actually do have a basic xmlsitemap_news module coded for creating Google News sitemaps. Just a matter of cleaning it up and integrating it with the current xmlsitemap code base. For now though, I'm marking as postponed to focus on the major issues (the base xmlsitemap modules).
#2
I would put the code for generating different type of site maps in a module that can be enabled when needed.
#3
Oh, yes. Definitely an optional sub-module. It'd only be necessary for sites that specialize in this sort of content.
#4
I guess that the site map URL for those site maps would be different from the one actually used, and the project would handle more than one site map.
#5
Subscribing.
I'd love to see the additional functionality of being able to have a Google News sitemap (http://www.google.com/support/news_pub/bin/topic.py?topic=11666) in addition to the normal web sitemap.
#6
Integrating Google News is a big plus for me. BTW, absent from the current GN module are keywords which has been a simple hack:
$content .= '<news:keywords>key words ...</news:keywords>';Of course, this approach assigns the same key words to each item. The better approach is probably to tie it into a vocabulary.
As an aside, people should realize that having a Google News sitemap does not mean inclusion in Google News. We had to jump through hoops. The site was once (incorrectly) suspended and it took six weeks to get back in. It does create a great deal of traffic.
#7
I was thinking that it would be nice for the XML sitemap news module to automatically install a taxonomy vocabulary based on http://www.google.com/support/webmasters/bin/answer.py?answer=42993 but also allow the user to select which vocabularies are included.
#8
Oh man that would be cool. :-) Our site is currently accepted into Google news, but I don't have a sitemap for them anymore since we moved our site to Drupal. Anxiously awaiting the update to XML site map that will incorporate even a minimal news sitemap. We need the traffic it generates.
#9
If you need news sitemap support now, you can use the Google News sitemap module which I took over and willl be integrating back into XML sitemap in this issue.
#10
Will it migrate nicely after you integrate it into XML Sitemap? No database incompatibilities now or then?
#11
I don't anticipate there being any problems on the migration. There's only one setting in the current module and I don't plan on making it any more complex before migrating it over.
#12
Great! Thanks. :-)
#13
.
#14
I think that you should leave these separate. I run my news sitemap every half hour. Due to overhead, I could not do that if the two are combined. Actually, I am using Elysia Cron. If the two had separate cron hooks - no problem.
#15
Phased cron runs would be an excellent feature for Drupal-8. I'll open a feature request if there isn't one already.
#16
@eyecon: They'd remain two separate modules, so that's not a concern.
#17
My site primarily consists of my videos/movies, so it would be great if we could support video sitemaps as well. If you'd like to take a look- http://CinemaSaville.com
Thanks.
#18
Oh... Subscribing.
#19
subscribing
#20
This would be great for our site! Has there been any recent developments?
-Kerry
http://www.41nbc.com
#21
Priority has been finishing the main module and its APIs. Probably after we get our official 2.0 release out I can focus on the views integration for accomplishing this.
#22
just subscribing, I am very interested in the video sitemap. I will write my own module to do the deed until then. It would however be much nicer if it were a submodule of xml sitemap which i already use.
#23
subscribe!
#24
subscribing
#25
Google rejects this site map, while it accepts normal RSS. What is the reason?
#26
Google usually gives a reason. Can you tell us?
#27
So the tough part about this feature is how do we get the data? Do we support only certain video modules to start out with?
#28
Wow... good question. There are a lot of modules that have "video capability" which aren't dedicated video modules, too. I use Lightbox2 to display videos in a lightbox, so there really wouldn't be any way for your sitemap to get that info I wouldn't think. I don't have a dedicated "video" content type either...
Maybe you should just have an added selector in the "Content Types" settings that will allow people to make any content type strictly a "video" type, or let them make the Content Type have a "Per Node" setting that will transfer the checkbox to the node/add stage. That would allow the greatest customization capability for any sitemap type you wish to add as well — video, news, image, etc. You also wouldn't have to worry about the next big video module every time one comes along. You could also designate any node to be in multiple kinds of sitemaps that way as well. :-)
(I could even possibly select each node that contains a lightbox-fed video to be in the video sitemap, etc)
#29
If the module would implement its own content type, then the suggested way to proceed would be to allow the user to select the content type, which by default would be the content type added by the module; as XML sitemap doesn't implement any content types, it should have an option to select which content type add in the particular sitemap.
#30
I think it should be rather like it is for the current sitemap settings, only now the user could select which kinds of sitemaps to "include" or "exclude" the node from as well.
#31
With all the special meta data that's optional, but most people would want in their sitemaps, I'm thinking a specialized module-integrated solution is necessary. I can't see a general solution working.
#32
The error said that this site is not in our database. The site is in their Google News programme. If I submit RSS feed its validates it. But when I submit News Site Map created by the module it gives the above error. What could be the reason? Same is with normal Site Map created by the Site Map module.
#33
@arnieswap: XML sitemap doesn't output news sitemaps, at the moment. If you have any problems with the sitemap created by XML sitemap, then you should open a new support request (after you verified there is not already a report with the same topic).
#34
What happens when you create a correct news sitemap.xml file manually and place it in the document root? Does Google accept it then? If it doesn't, then there may be something going on with your Google acct or hosting setup.
#35
subscribing
#36
I'm also interested about a video sitemap.
Any developments?
#37
Dave, unfortunately I'm not a programmer but how can I help you with implementing this feature? Can I?
#38
As Domain XML Sitemap is ready (and marvellous), new *maps should be domain aware also.
At least Google News sitemap module will have been assimilated for good then.
Subscribing.
#39
subscribed
#40
Ok so awesome news is this is going to be very possible with the new concepts of XML sitemap contexts that are currently in place for domain access and/or language integration.
If you want to help move this along, I could use some reviews and testing on #764658: Use XMLWriter class instead of fwrite().
#41
#42
Widening concept a little bit to merge some issues into this one:
#739246: Mobile sitemap generation
#769794: Adding Images to Sitemap
#43
subscribe
#44
Is there a module for video sitemap? if not, how I can create the sitemap for videos on my website? Thanks
#45
subscribe
#46
subscribe
#47
I want to share my thougts about linking one or more images to a story node type visible in the sitemap.
You could have a situation with a story node type and the following node fields:
According to the google specification, you can set one or more significant images of a specific page. For example you could want to add a specific imagefield (main_image) to the sitemap.
But how? An interface would be necessary to specify that the imagefield needs to be added (without forgiving the title and the caption which could be the "alt" and "title" settings of the image or the title and description if any).
IMHO the most reasonable way is to add a checkbox on the imagefield settings page in order to allow/disallow the inclusion of the imagefield on the sitemap.
What do you think about? Is this a valid idea?
#48
+1.. looking at adding images to sitemap now.
i don't think the current API really supports adding fields to the xml node unless possible doing a complete new module similar to xmlsitemap_node - but just started looking at this so hopefully simpler than that.
#49
This was my approach for D6 to add an image from a specific node type to the sitemap. Unless i am wrong the current API does not allow this, as the function xmlsitemap_generate_chunk() hard codes the XML nodal structure and does not allow any other module to modify this.
so my approach was the smallest hack/patch i could think of was simply to add a module_invoke_all of a new hook called xmlsitemap_modify_link in to that function to allow my module to add content to the xml node.
i then used the existing query_xmlsitemap_generate_alter hook which is within the same function to modify the sql used to query the xmlsitemap table and tack on the image data to this.
my test case is this:
- need to add field_image from node type "product" to product entries in the sitemap
- other node types also use field_image so i am joining off the content_field table not the content_type table
i have a module called cs
in the folder for that module i have a file called cs.xmlsitemap.inc (which the xmlsitemap module auto loads)
in that module i simply call the 2 hooks mentioned:
function cs_query_xmlsitemap_generate_alter(&$data, $sitemap) {
$data['SELECT'] .= ', f.filepath, n.title, n.type ';
$data['FROM'] .= ' LEFT JOIN {node} n ON x.id = n.nid LEFT JOIN {content_field_image} i ON i.vid = n.vid AND x.type = "node" LEFT JOIN {files} f ON f.fid = i.field_image_fid ';
}
function cs_xmlsitemap_modify_link($link_output, $link) {
global $base_url;
if (!($link['type'] == 'product' && $link['filepath'])) return null;
$link_output .=
'<image:image>
<image:loc>' . $base_url . "/" . $link['filepath'] . '</image:loc>
<image:title>' . $link['title'] . '</image:title>
</image:image>';
return $link_output;
}
next to no performance hit and seems to work just fine; but please let me know if there is a better way of doing this.
also, for consistency, i would think the query array structure used in xmlsitemap_generate_chunk() should likely have a 'JOIN' key.. just a thought.
#50
I'd like to +1 this.
As Google and Bing add new supported elements to their sitemaps, it is becoming increasingly important that developers be able to support more flexible sitemap formats.
While the most flexible route would be to use the theming system, that may introduce a substantial performance penalty. Liquidcms's solution above gives enough flexibility to accomplish things, but with no substantial negative performance implications.
#51
+1'ing this issue does nothing. Please help review/test #764658: Use XMLWriter class instead of fwrite() and also see #786510: Contexts should be able to alter the XML header output (and possibly link output?).
#52
I would love to have both video sitemaps and news on my site. video is particluarly important as a vide sitemap is the only way to identify it in the meta data. subscribing
#53
I like the poster above want video and news, subscribing
#54
As there is now support for video sitemaps in google, should this no longer be marked "postponed"?
#55
It's not postponed because google now supports video sitemaps. It's postponed because of the reasons outlined in #51.
#56
Fixed the two issues in #51, and now only #787578: Figure out how to handle the global 'type' context is a blocker on this issue.
#57
subscribe
#58
+1 for video sitemap.
#59
+1 news!
#60
Sub (news)...
#61
subscribing
#64
subscribe
#65
subscribing
#66
+1 for video sitemap.
#67
subscribing
#68
image sitemap :P
http://www.google.com/support/webmasters/bin/answer.py?answer=178636
#69
LPCA - the problem is it needs to be done by hand. I had to do a video sitemap that way. Very annoying for 4 videos.
#70
subscribing
#71
Thanks for all of your excellent work in developing and refining this module. Like many others, I am really grateful for all of your efforts.
I am very curious about the status of adding image information to the sitemap.xml files. At this point, the number of images on one of my sites has grown to be more than 200. I would really like to be able to automatically add these images to the sitemap.xml file(s). So my first and general question is what is the status of the xmlsitemap module adding images to the resulting sitemap.xml file(s)?
Assuming that this is still on the postponed list of features that will be added at some point, I am wondering whether it might be appropriate to add an xmlsitemap hook of the alter variety that gets called to alter (or enhance) the information that gets written to sitemap.xml file for a particular entry. If such a hook existed, myself and others could add code in other custom modules that would add image or video image information to the sitemap.xml file without having to make any changes to the still developing xmlsitemap module.
Thoughts?
#72
+1 for video sitemaps. Hopefully backported to D6 :)
#73
Could the maintainers please provide a roadmap/schedule, when to expect new sitemap formats or just an API to allow to implement this for D6?
#74
@digi24: I've already linked to the issues that I've been working on that are blocking this issue. Once those are completed, I can start working on this one. The best thing I have for a roadmap is "yes I'll be working on this and it will be put into both 7.x-2.x and 6.x-2.x, and at least the API will be available by the 2.0 official version.
#75
Hi Dave
I have tried to contact you by your contact form and also through facebook.
As I stated in former emails, I'm working at Google, specially assigned to Video Search Team, where we have the task to help everyone who has a site or tool for publishing videos to accomplish the creation of well-formed sitemaps, in this case video sitemaps.
I was wondering if you need any sort of help on the xml sitemaps module. I have little experience in Drupal but I have 5+ years of experience in PHP.
Let me know if you need some help with it
Thanks in advance
#76
subscribing
I need a image XML Modul.
#77
Subscribing (Google News).
#78
@J0nathan:
There's another module for Google News.
#79
Hi kentr,
From the project page of the module "googlenews", it says:
This is why I subscribed here.
#80
+1 for video sitemap
#81
subscribing
#82
I'm trying to get a bead on the development of this module and the original Google News Map. Should I use the original module for now or is this addition nearing completion. I have installed the dev version to see your progress but it did not build a function site map and I saw no inclusion of an interface to generate a google news sitemap.
Any information that would help me build a site launching at the end of the month.
#83
+1 for video sitemaps
#84
I've been using Google News Sitemap 6.x-1.4 and XML Sitemap 6.x-2.0-beta1 together for about a year now with no problems. Should be easy enough to uninstall the Google News Sitemap and upgrade XML Sitemap when the functionality becomes available.
#85
Subscribed.
#86
Subscribe. Video sitemap is something important, as GN too.
#87
Subscribing for information on Google News Sitemap integration
#88
+1 for video sitemaps
#89
As with #82, it would be great to see the code mentioned in #1 in -dev, regardless of its current state, so that those of us who are motivated to get the extended sitemap functionality going can help out.
#90
I upgraded to 7. This was the one module i forgot to check. Oh noes
Any news on the Google News sitemap module integration for 7?
#91
sub
#92
sub
#93
Hi - very keen to use this module. Any help in terms of testing? I'm fairly experienced Drupaler but not a programmer - would be available if you I could be of any use to you. How is the module progressing and is there any type of time frame on it?
#94
I have created a video sitemap generator module that has pending review.
I think it could be integrated with this one too in the future
#95
#96
#1040798: D7 Patch for googlenews now has a patch to allow the old (deprecated) googlenews module to be used with D7. Use at your own risk and please report your experiences back in that issue.
#97
subscribing
#98
subscribing
#99
subscribing
#100
Hi Vascordoba, any news on your video sitemap generator module? Would be great to start using this. Thanks! Cheers, Els
#101
subscribing
#102
Hey Guys, A co-worker just found this Drupal Module for Video Sitemaps:
http://code.google.com/p/video-sitemap-drupal/downloads/detail?name=vide...
Has anyone used it before? Would someone take a look at it?
#103
Hi erikwagner, I've downloaded this but it's way to complex for me to start. E.g. I've created a content type, called portfolio, and each portfolio node has a video. But it's not clear to me if I can use this content type with al its fields (text + video). I need more explanation to use it. I hope Vascordoba (the developer) gets in touch!
#104
subscribing
#105
Here is a patch for D6-2.x version, for image support within imagefield only.
This patch does not provide a correct and reliable way to handle images (as said above, contexts should be used and database tables should be modified, which represents a heavy work).
This patch may only help those who need a workaround for images support, awaiting a real and correct implementation of this feature.
#106
Subscribe
#107
Subscribing
#108
Anyone reading this is more than capable of seeing that #787578: Figure out how to handle the global 'type' context is still a blocker for this issue. That's where this needs help.
#109
I created little module for generate Google Image sitemaps in Drupal 7.
This module based on Google News sitemap module by Webopius Ltd.
Maybe this module can come in handy to someone, as long as this type of sitemap is not made in xmlsitemap.
#110
subscribe
#111
subscribing
#112
subscribing, great to see this is being worked on.
#113
Subscribing
#114
+1
#115
+1
#116
+1
#117
+1
#118
i need it for drupal 6, we want to do a video sitemap like this example http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=80472 thanks!!!!
#119
subscribe
#120
This is the beginning of a set of modules and modifications to the XML Sitemap module that I have started to writing in order to provide the video sitemap protocol extension. My example is incomplete, but works for media_youtube video fields and some locally hosted video items.
The xmlsitemap_video module attempts to show how it might be possible to add extension modules to add and include additional xml data into the sitemap. The thoughts here is that it would be the responsibility of the extending module to determine what additional information gets included into the sitemap based on a loaded xmlsitemap link. XML sitemap is only responsible for calling the right extensions based on link type (node, menu, etc...).
I have included a patch file that makes slight modifications to the xmlsitemap.xmlsitemap.inc and xmlsitemap.generate.inc files, though a lot of what should be added has been for the time being living within the xmlsitemap_video module. This would include the HOOK_xmlsitemap_extension_info() and XML sitemap element classes and interface (found in includes/xmlsitemap_elements.inc in the xmlsitemap_video module).
The video_props (video properties) module attempts to retrieve and capture the necessary data for the video information. This module is currently unfinished, but does properly support embedded youtube video provided by the media_youtube module and fakes a bit of support for locally hosted files. This is probably less important to the sitemap specifically as this data could potentially be provided in other ways, but it was part of my working example.
I confess that I am fairly new to both the XML Sitemap code and the sitemap protocols. Hopefully am helping progress the project toward a real solution to the current problem of adding sitemap extensions. I would be happy to keep tinkering in this area, or expand on any ideas developed here.
#121
Opps attached the wrong patch file above. My apologies for the mistake. It seems like I am unable to edit files attached to my comments?
#122
do you have a drupal 6 version??
#123
The point was merely to demonstrate an idea for providing sitemap extensions. The intention is to share some ideas that hopefully could get this issue moving. Anyone interested in how this extension works, the highlights would be in the xmlsitemap_video module, specifically the HOOK_xmlsitemap_extension_info() and the include/xmlsitemap_elements.inc file.
I do not recommend anyone use the code or patch that I put here for production purposes. It's merely a partially working example. Once the xmlsitemap maintainers and community agree on a solution (whatever it might be), I would be happy to create an actual module (if someone doesn't beat me to it). I do plan on doing a significant refactoring of the code posted here (and know of some bugs already), but that won't come until I know the official API to build from.
#124
Has anybody successfully used this module from google for video sitemap?
http://code.google.com/p/video-sitemap-drupal/
_________________
I followed the installation steps but get the following error message in Drupal (6.22):
The import data is not valid import text.
This happened after the following described steps (regardless if the video content type existed or not (tried both):
"...
3) In the Administer / Content management / Content types => Import menu option, select Create from the selection box (or select Video(video) if you do have a Video content type already).
Then, copy the contents of the video_content_type.txt file (located in the installation folder), and paste it in the Import data field. After that, hit in the Import button below the field.
..."
I successfully exported my previously made video content type, deleted it, creeated a new video content type with pasting your text file as Import resulting in the above error message
"The import data is not valid import text." and no new content type "video" has been imported.
Importing my previously made video content type succeeded. So there is no HTML Editor interference (no WYSIWYG Editor for the import form field). I used Netbeans IDE, Editor, Wordpad for copy & paste the plain text file, no success.
All of my dependency modules are newer than the ones mentioned in your list (CCK: 6.x-2.9; Video: 6.x-4.2; FileField: 6.x-3.10)
______________
It looks pretty promising but I cannot get it run :-(
Looking at the posts there I have seen that Dave has alreaddy tried to get in contact w/ the google coders of this module but it looks he never got a reaction from there.
Sounded like a good idea to bring the 2 streams together.
Thx for all the contributors here.
Stort
#125
sub
#126
sub for google news integration
#127
Sub for extensions for images, news and video.
#128
Subscribe
#129
Subscribe
#130
Yes, it's nice module and works, but with unaliased urls.
#131
I successfully used the module. Just be sure to import the right code. Don't import commendts in the beginning, copy the import file from the first command to the last command without spaces or empty lines in the beginning and in the end.
The problem with this module is that it disables the auto thumnail feature of Video module, so I enable it, make sitemap and when I need to upload new video, I need to disable the module and then after uploading to enable it again.
I try to modify this module to catch information from Embedded Field, it looks easy task, but I am stuck on the db_query code...
#132
Sub for extensions for images. drupal 6.x
#133
Temporary, valid solution. See this example.
Modules needed:
Views
Views PHP
Views Datasource
<?php
$loc = $data->field_field_photo[0]['rendered']['#path']['path'];
$tit = $data->_field_data['nid']['entity']->title;
print "<image:loc>" . $loc . "</image:loc>";
print "<image:title>" . $tit . "</image:title>";
?>
YOU WILL NEED TO CHANGE THE NAME OF YOUR FIELD IF IT ISN'T field_field_photo. Use Devel module if you need.
Grab a beer. Stay thirsty, my friends.
#134
+1
#135
thank you bensnyder
when i add label video:video for create video sitemap .
This page contains the following errors:
error on line 6 at column 17: Namespace prefix video on video is not defined
Below is a rendering of the page up to the first error.
#136
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"xmlns:video="http://www.google.com/schemas/sitemap-video/1.1">
Probably because you didn't declare the extended namespace.
The link Webchick gave in the body of this thread doesn't exist any longer. It is now http://support.google.com/webmasters/bin/answer.py?hl=en&answer=80472
The other question that needs answered is will the other search engines deal with Google's extension to the sitemap?
#137
Hi one and all ....
I thought the followers of this, may be interested in my post.... It expands on comment 133 (many thanks bensnyder) in this post but works around needing to write php ... (embarrassingly, I've still not written a line...)
How to create a Video/ Image sitemap for Google?
:)
Bye for now,
Guy
#138
Hi again...
I took the trouble of detailing the process I've come up with, to make a video sitemap for my Drupal 6 sites. I've included a screen demo too. It doesn't require writing PHP for every site map. It does require adding some modules and a patch though...
http://onlinebusinessbuilders.co.uk/video-tutorials/how-create-google-vi...
Hope others find it useful :)
Guy
#139
@guyd: If the patch is against this module please upload it here for review.
#140
@earnie: The patch is against Views datasource.... You can see it here http://drupal.org/node/903528
My method doesn't use this module. It does allow point and click creation of a video sitemap via Views :)
I just wanted to share how I've achieved the end result for the time being...
Bye for now,
Guy