I updated my version of XML Sitemap (Feb 20) and now all my XML files are "empty". Any idea what could be happening? For a few of my sites, I get the front page (I think that happens for those that use the default [unnamed] Drupal front page.)

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9
  http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">
</urlset>

Thank you.
Alexis Wilke

P.S. I thought I posted that yesterday and cannot find it, so I'm posting it "again"...

CommentFileSizeAuthor
#201 working-xmlsitemap.tar_.gz30.82 KBAlexisWilke
#155 xmlsitemap-issue-379854.patch2.76 KBAnonymous (not verified)
#152 xmlsitemap-issue-379854.patch3.42 KBAnonymous (not verified)
#144 xmlsitemap-issue-379854.patch2.3 KBAnonymous (not verified)
#53 xmlsitemap-6.x-1.x-dev.tar_.gz30.78 KBmikeytown2

Comments

avpaderno’s picture

You cannot find it because it has been set like duplicate of #376032: How to insert old nodes into the sitemap?. Both the reports are about an empty site map (that is implicit in the other report).

avpaderno’s picture

Title: XML Sitemap is empty » Site map is empty

I cannot reproduce it in my web site.
I installed the last version, I went to /admin/reports/status where a warning of XML Sitemap told me the database needed to be updated, I clicked on the link reported, I clicked on the Next button; after I did that, the xmlsitemap table was still empty, so I forced the module to update the site map by visiting http://avpnet.org/sitemap.xml from a browser I didn't use to log in into my web site.

The result is that the site map of my web site is not empty, as you can verify.

AlexisWilke’s picture

Hi Kiam,

I checked your site sitemap.xml file and indeed the files are in the XML loc tags.

On my end, I ran the instructions as defined in #376032: How to insert old nodes into the sitemap? and I can see that it works, that is, it adds the nodes and terms in my database (and it is not unlikely that they were already there). But when I read that XML file, it does not include all of these files.

I will check a little closer and see what I find.

-- later:

Okay, there is what I have found: the sitemap.xml is created from the xmlsitemap table. You have a set of tests in your WHERE clause that go like this:

  changefreq <> 0 AND changed <> 0 AND (priority >= 0 AND priority <= 1)

After running all the instructions as defined in #376032: How to insert old nodes into the sitemap? you need to run cron too. Then it works.

Okay, also not related, I still get your terms error:

* warning: pg_query() [function.pg-query]: Query failed: ERROR: invalid input syntax for integer: "tags" in /usr/clients/www/drupal/includes/database.pgsql.inc on line 139.
* user warning: query: UPDATE xmlsitemap_term SET previously_changed = changed, changed = 1235352538 WHERE tid IN('tags','194','191','81','193','195','192') in /usr/clients/www/drupal/sites/all/modules/xmlsitemap/xmlsitemap_term/xmlsitemap_term.module on line 133.

As you can see, I still have a word in the list ('tags' here). I'll apply my fix again...

Now, I thought that this hand procedure should be automated by the installation process. So I'm surprised that I had to do it by hand... What do you have to say about that one?! 8-)

Thank you.
Alexis

avpaderno’s picture

The string you see (tags) is the array key used by Drupal for the vocabulary terms of tags type. That is what Drupal passes to hook_nodeapi(), and it's not what the module is expecting.
Like I reported on a task report I opened (see #376868: Change implementation of hook_nodeapi()), I am going to change that, and make possible for the module to handle the tags vocabulary terms too.

The procedure is half automated, as I am not able to make a batch operation start automatically after an update function is executed. I know there is the locale importing batch operation that starts automatically after a module is installed, but I really not know how that is implemented, nor if that is something possible to do for third party projects like XML Sitemap.

avpaderno’s picture

Status: Fixed » Active

About making the database update automatic, I opened a task report (#380636: The update of the database should start in automatic). I will implement it in a few minutes.

AlexisWilke’s picture

Status: Active » Closed (fixed)

Cool we can close this one now.

Thank you.
Alexis

avpaderno’s picture

Status: Closed (fixed) » Fixed

I prefer to set it to fixed, so it will still be visible for the next 2 weeks, and this will avoid somebody else reports the same problem.

zwoop’s picture

Status: Active » Fixed

I've tried everything mentioned on these tickets, to no avail. My sitemap is always empty. I even tried uninstalling all xmlsitemap modules, which left my DB with no tables named "xmlsitemap*". After I added a bunch of nodes via /admin/content/node, I do see entries showing up in the xmlsitemap_node table, but the table named xmlsitemap has only one entry in it (for the "frontpage"). Fetching the XML via wget gives this:

loki (08:38) 271/0 $ curl http://www.ogre.com/sitemap.xml
<?xml version="1.0" encoding="UTF-8"?>
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9
http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">

avpaderno’s picture

Status: Fixed » Active

If you are having problems with the site map being empty, then you are free to re-open the report.

zwoop’s picture

Alright, yeah, I'm still having this problem :). I've tried all the suggestions here, and see my previous post on what I'm seeing in the DB (xmlsitemap has one entry, and xmlsitemap_node has one for each node in the sistemap. But, the xmlsitemap is always empty.

eule’s picture

hi

same here ..new update...sitemap.xml is empty

Last updated: March 1, 2009 - 12:22
same

grub3’s picture

Same problem here : March 1, 2009 - 14:17

msiemens’s picture

Same problem here - just updated to last version : March, 1st, 2009, 15:55 MEZ

lammertsm’s picture

same here with the 1 march version

cgrant3d’s picture

same here w/mar 1st version.

mikeytown2’s picture

ditto, sitemap.xml only gives

  <?xml version="1.0" encoding="UTF-8" ?> 
  <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd" /> 

I think the feb 28th one is where the problem appeared. using latest dev (march 1).

avpaderno’s picture

Priority: Critical » Normal

Uhmmm... Mine is almost empty.

<urlset xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">
<url>
<loc>http://avpnet.org/users/kiam</loc>
<lastmod>2009-03-01T13:08:41+00:00</lastmod>
<changefreq>monthly</changefreq>
<priority>0.5</priority>
</url>
</urlset>

I am lowering the priority, as the issue doesn't block Drupal or any third-party modules.

tw176’s picture

Same problem as listed in #17. The dev version from 2/20 worked fine. Once I updated to the 2/28 version, it stopped working, generating just a single node (like #17's listing). I had the same problem for the 3/1 version.

Note, I get the same problem when I uninstalled the 2/28 version, and re-installed a backup copy of the code from the 2/20 version. So, despite properly de-activating, uninstalling, re-installing, and running update.php, I can't get the 2/20 version working again after having tried the 2/28 and 3/1 versions.

AlexisWilke’s picture

Hi guys,

I had to go to the admin/content AND run CRON manually to get the sitemap.xml filled up.

If CRON does not run, then you don't get the pages updated.

Now there may be a problem with the update flags (from what I've seen in the code). Something like: if the node was not modified, do not send it in the XML sitemap again. But that may not be what the code is doing, just what I have seen.

Thank you.
Alexis

GavinC’s picture

I'm getting the same issue. Updated to recent dev version and sitemap.xml is only showing newly created nodes.

I did have over 12,000. But have created 8 new products. Now the sitemap shows only 8 url's

avpaderno’s picture

@AlexisWilke: Yes, there is a problem for the update flags; its content is not reset, but I would think that would give the opposite effect.

The project uses a Drupal variable that contains the name of the modules for which the links present in the xmlsitemap database table must be updated; each implementation of hook_xmlsitemap_links() verify if the list of modules that require to update their links includes the module the hook is defined in, or a module that is related to such module.
To make an example, xmlsitemap_node_xmlsitemap_links($modules) verifies that $modules contains a 'xmlsitemap', or 'xmlsitemap_node' key; if that is true, then it deletes all the links added from xmlsitemap_node.module from the xmlsitemap table.
The problem is that that Drupal variable is not reset to an empty array, after all the implementation of hook_xmlsitemap_links() are called.

I noticed it while I was re-writing the code which generates the cached content of the site map, and I cannot commit new code into CVS until I am not done with that.

temp’s picture

i'm download new 2009-Mar-01 version install modules: XML Sitemap,XML Sitemap: Engines, XML Sitemap: Menu
my menu system based on taxonomy witch taxonomy_menu module
i'm run cron
but my sitemap.xml empty..
when i look in my datebase i find that table "xmlsitemap" contains full of my menu stucture witch rows like :
lid:3628, loc:category/2/739/749, module:category/2/739/749, type:menu, id:2322, sid:0, language:<EMPTY>, changed:0, changefreq:0, priority:0.5...etc.
but my sitemap.xml empty..

Roulion’s picture

i've got the same problem too

avpaderno’s picture

Status: Postponed (maintainer needs more info) » Active

@temp: May I ask you to report more of the content you see in your xmlsitemap table? I notice there is something wrong in that; the module field should not contain something like category/2/739/749, but it is supposed to contain values like xmlsitemap, xmlsitemap_node, etc... In other words, that should be the name of the module which inserted the link.
That field is used to select just the links inserted by modules that are enabled; if the content of the field is not the name of a XML Sitemap module, then the site map will surely not contain anything.

I checked the code contained in xmlsitemap_menu_xmlsitemap_links(), and the code is correct.
As you can see, the code sets the module field to the correct value (xmlsitemap_menu).

        $row = new stdClass();
        $row->module = 'xmlsitemap_menu';
        $row->type = 'menu';
        while ($mlid = db_result($result)) {
          $link = menu_link_load($mlid);
          // Avoid external links, or links to the front page;
          // both have $link['external'] set to 1.
          if (!$link['external'] && !$link['hidden'] && $link['access'] == 1) {
            $row->loc = $link['href'];
            $row->id = $mlid;
            $row->priority = min(max(round(($link['weight'] + 10) / 20, 1), 0.0), 1.0);
            if (db_result(db_query("SELECT loc FROM {xmlsitemap} WHERE loc = '%s'", $row->loc)) != $row->loc) {
              drupal_write_record('xmlsitemap', $row);
            }
          }
        }
temp’s picture

Component: xmlsitemap.module » Code

sorry!! big sorry!!
i'm make mistake when paste, in my post, row from table
correctly it have look:
lid:3628, loc:category/2/739/749, module:xmlsitemap_menu, type:menu, id:2322, sid:0, language:<EMPTY>, changed:0, changefreq:0, priority:0.5...etc.

AlexisWilke’s picture

FYI,

I did not update since Feb 20. So it could also be something new...

Thank you.
Alexis Wilke

avpaderno’s picture

Actually, there is something new.
I changed the primary key of the xmlsitemap, and used an auto-incremental field (lid). Because the code that should have set the value of the new primary key in the existing rows didn't work, the xmlsitemap table has been emptied from the update function. This should not be a problem, as each XML Sitemap module has its own table to save the link data.

dman’s picture

Same problem here. Fresh XML Sitemap revision 1.1.2.20 on fresh site (CVS DRUPAL-6--1 dev - is that bad? I do checkouts CVS on dev versions to make updates - and fixes to feed back - easier.)
Added my 'Primary Menu' and 'Nodes' (did not enable term, file or user)
No data.
Went into content, tried both 'add to sitemap' and 'change the priority' on all (only a dozen pages)
ran cron a few times.
no data.
Went into a few nodes, found they had an xml sitemap weight field. Saved them so they are tagged as 'updated'
no data
ran cron a few more times
no data.
Checked the status report - no warning. Ran module update script. No actions to be done.
Disabled them all. Uninstalled them all. ran update.php. re-enabled them. ran update.php.
re-enabled 'primary links'
ran cron.
no data

o_O

temp’s picture

sorry!! big sorry!!
i'm make mistake when paste, in my post, row from table
correctly it look like this:

lid:3628, loc:category/2/739/749, module:xmlsitemap_menu, type:menu, id:2322, sid:0, language:<EMPTY>, changed:0, changefreq:0, priority:0.5
...etc.
avpaderno’s picture

Status: Active » Postponed (maintainer needs more info)

There is nothing to be sorry, temp. I was worrying, if you would see such thing, because in that case it would have mean that some other module was messing with XML Sitemap database tables.

A question to all people having this issue. Did you visit the User settings page, and changed the value of User posts threshold? It would be better to change it for each users (in the user profile pages), but still that value should be changed for the users you trust.
That option has been introduced to avoid that a user who registers himself just to add spam would see his spam content grabbed by the search engines; it also avoids that a node created by error would be included in the site map (with Google Webmaster Tools complaining that it cannot find it anymore, once the node is removed).

The value shown in the User settings page is used when there isn't a value set for a specific user; if you already visited a user profile, and edited it, the value is not used anymore for that user.

GavinC’s picture

Is there going to be an update to fix? or can you release a roll back until the issue is resolved?

temp’s picture

i don't have "User posts threshold" item on my User settings page.
But i did not switch on module [XML Sitemap: User]

dman’s picture

I'm not using the user module either.

msiemens’s picture

Hi Kiam - changed "user posts threshold" to 1 - and we are back again - sitemap comes up - perfect!!!!

jase951’s picture

Ditto problems, my sitemaps are empty after this latest March update. Google Sitemap shows "Your Sitemap does not appear to be in a supported format. Please ensure it meets our Sitemap guidelines and resubmit."

GavinC’s picture

just installed the 03/03/09 dev and still no better :(

Google Sitemap shows "Your Sitemap does not appear to be in a supported format. Please ensure it meets our Sitemap guidelines and resubmit."

eule’s picture

Drupal 6.10
XML Sitemap 6.x-1.x-dev (2009-Mär-03)

.?xml version="1.0" encoding="UTF-8" ?.
.urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd" /.

thats all ..no nodes again

msiemens’s picture

GUYS READ THE POSTS!!!!!

VISIT /admin/user/settings page and change the value of 'User posts threshold' to 1 - in words ONE - AND YOUR SITEMAP will be in PLACE AGAIN!!!!
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

temp’s picture

i don't have this option on my /admin/user/settings

mista_k’s picture

I had same problem as described in #28. Comments #30 and #38 doesn't solve it. Is any other suggestions?

eule’s picture

@msiemens ....not working for me

i set it to ONE in

.user/1/edit?destination=admin%2Fuser%2Fuser
.admin/user/settings

clean cache and run cron---sitemap still empty

lammertsm’s picture

No nodes in my sitemap.xml. After enable terms into sitemap, the will appear in my sitemap.xml. Nodes still not!.

Solution #39 not works for me.

tw176’s picture

As a temporary fix, what tables can we populate to generate a default sitemap.xml?

I tried populating the xmlsitemap table with the following, and it seemed to work. Is this a safe work around?

insert into xmlsitemap (loc, `changed`, module, type, language, changefreq)
select concat("http://www.mywebsite.com/node/", nid) as nid,
`changed`,
"xmlsitemap",
"frontpage",
'',
1
from node

Note, populating xmlsitemap_node didn't change the output of sitemap.xml

Is it safe to manually populate the xmlsitemap table like this, or will it get overwritten at some frequency?
Does it matter what the values are for the module and type entries?

dman’s picture

Debugging I trace the code and find xmlsitemap:

"lid";"loc";"module";"type";"id";"sid";"language";"changed";"changefreq";"priority"
"8";;"xmlsitemap";"frontpage";"0";"0";;"1236136385";"1";"1"
"14";"node/10";"xmlsitemap_menu";"menu";"171";"0";;"0";"0";"0.8"
"13";"node/8";"xmlsitemap_menu";"menu";"159";"0";;"0";"0";"0"
...

vs a Query that boils down to

SELECT xsm.loc, xsm.module, xsm.type, xsm.changed, xsm.changefreq, xsm.priority
FROM xmlsitemap xsm
INNER JOIN system s ON s.name = xsm.module
WHERE s.type = 'module'
AND s.status =1
AND xsm.loc <> ''
AND xsm.changefreq <>0
AND xsm.changed <>0
AND (
xsm.priority >=0
AND xsm.priority <=1
)
ORDER BY xsm.changed DESC , xsm.changefreq, xsm.priority DESC , xsm.loc

... so my problem is that neither AND xsm.changefreq or xsm.changed are getting set by anything I do to the nodes. The priority=0 is also a worry, as my node types should be setting that to at least .5 when I ran the updates.
Making a minor text edit I think was what got node/10 with a priority, but it still didn't list until I manually (through the DB) set 'changed' and 'changefreq' to something.

I tried to truncate the table and the results came back the same.
It seems that xmlsitemap_menu_xmlsitemap_links() doesn't even try to set a 'changed' or 'changefreq' when adding rows. Is there any place it gets updated later?

I experimented with turning off the menu version and just using nodes individually. They make it into xmlsitemap_node - but don't get transferred to xmlsitemap table (which I guess was supposed to happen? based on inspection of the chunk builder later.)

:-\
Maybe I can fix it on a dev site. Right now I'm hampered from breaking anything as it's a simple, but live site that I thought I could just install on.
I'm trying to help track it down here...
(And 'obsessively' hitting cron every time I make a change ;-)

dman’s picture

---
In the meantime I added hard-coded values to to n xmlsitemap_menu_xmlsitemap_links()

        while ($mlid = db_result($result)) {
          $link = menu_link_load($mlid);
          // Avoid external links, or links to the front page;
          // both have $link['external'] set to 1.
          if (!$link['external'] && !$link['hidden'] && $link['access'] == 1) {
            $row->loc = $link['href'];
            $row->id = $mlid;
            $row->changefreq = 1;
            $row->changed = 1;
            $row->priority = min(max(round(($link['weight'] + 10) / 20, 1), 0.0), 1.0);
            if (db_result(db_query("SELECT loc FROM {xmlsitemap} WHERE loc = '%s'", $row->loc)) != $row->loc) {
              drupal_write_record('xmlsitemap', $row);
            }
          }
        }

... and I finally get results.

However, since you've just recently confirmed http://drupal.org/node/379854#comment-1310372 that that function is actually correct ... I must be doing something wrong.
Just WHERE does the required update to that table happen if not there?

GavinC’s picture

Have tried the User Post set to 1 and still doesnt work.

grub3’s picture

I upgraded to 2009-03-03, set post and user threashold to 1. Still no result.

GavinC’s picture

@dman:

Where did you put the code for it to work? I cannot find xmlsitemap_menu_xmlsitemap_links()

farbkonstrukt’s picture

@Squidge:
The function is in xmlsitemap_menu.module inside the xmlsitemap_menu directory.

Replace the lines 47 to 59 with the code snippet from http://drupal.org/node/379854#comment-1315054.

Unfortunately this also doesn't work for me.

GavinC’s picture

@farbkonstrukt:

Thank you. I'll give it a go and see if it works for me. Will update.

EDIT:
Didn't work for me either :(

josh@pixael.com’s picture

same here... i set user_threshold to 1 but no nodes appear in my sitemap :-(

grub3’s picture

Maybe we should revert to an old code. What is the SVN command to fetch an older version?

mikeytown2’s picture

StatusFileSize
new30.78 KB

Here's one from the 19th

Anonymous’s picture

Not sure if what I write here is of help but I updated just after the 1st March dev was posted. On running update, a large number of nodes were seen to being scanned, before i was offered the option to return to admin.

Afterwards, I had just 1 entry in my sitemap. I changed the user setting from 100 to 1, and added several nodes through "Content" But with 8000+ nodes, I Didn't fancy updating 1 page of nodes at a time, so stopped after about 200

I have since updated to dev from 3rd March 2009 and I have a very big sitemap, that causes my IE7 to appear to crash, but i am putting that down to the 8000+ nodes :)

My Module settings are only XMLSitemap, Engines and Nodes

If their is any info from teh database that might help let me know

EDIT: Correction i can see the sitemap, but Google reports

General HTTP error: 404 not found
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

mikeytown2’s picture

Until DrupalCon is over (thats my guess on where Kiam is), I'm using the one from the 19th. It's working great for me. Haven't run a database update yet, but the sitemap shows up now. Nuked the files and re-uploaded; it works.
My Module settings are also only XMLSitemap, Engines and Nodes and the latest dev doesn't work. The one I posted above(http://drupal.org/node/379854#comment-1317792) should work for everyone.

avpaderno’s picture

GavinC’s picture

I have removed the latest dev, and installed the 19 dev. But still not working for me :(

Google is still syaing there are errors:

Unsupported file format
Your Sitemap does not appear to be in a supported format. Please ensure it meets our Sitemap guidelines and resubmit.
farbkonstrukt’s picture

Same here, no content in the sitemap.

The xmlsitemap table is still empty with the older dev version from Feb 19th.
Maybee an existing sitemap in the table is not affected, but drupal won't generate a new one.

GavinC’s picture

UPDATE: I appear to now have content in my sitemap :)

I flushed the database tables for xmlsite map, then deleted them from MySQL.
Unticked the modules, ran updates, ran cron, removed the xmlsitemap module from /sites/all/modules.
Installed xmlsitemap from 19th, re ticked all areas, ran cron, ran updates. Error was presented by sitemap about updating tables. Ran that. And bingo

maximus007’s picture

Have the same problem with latest dev version, have tried reinstalling, flushing, deleting tables, cron etc. to no avail.

GavinC’s picture

@maximus007:

Flush the xml tables and remove from db. Uninstall from drupal. Run cron and updates. remove xmlsitemap from /modules.

then use http://drupal.org/node/379854#comment-1317792. Run cron and updates. Worked for me.

Also when you run the update, change all the xml site map versions, right back. For me it was v6000 or v6101.

grub3’s picture

>I flushed the database tables for xmlsite map, then deleted them from MySQL.
>Unticked the modules, ran updates, ran cron, removed the xmlsitemap module from /sites/all/modules.
>Installed xmlsitemap from 19th, re ticked all areas, ran cron, ran updates. Error was presented by sitemap about updating tables. Ran that. And bingo

I did the same and still nothing. This is hell.

GavinC’s picture

Dont forget to change the versions:

change all the xml site map versions, right back. For me it was v6000 or v6101.

When you run the updates

grub3’s picture

Okay thanks. I am using advanced forum. Only the files that were modified recently appear in the sitemap. For example, forum files or pages. Should I run an SQL query to include all nodes?

robertmaynord’s picture

I was able to get the newest XML Sitemap up and running by doing all the suggestions - including changing the number of required user postings from 500 back to 1, and running cron. I now get a full sitemap listing - with one exception. The sitemap does not list my main page (the home page of the domain)! In previous versions it did. I have checked the priorities, and all pages are at 0.5. The default for the main page is 1.0. But it is not in the sitemap.

Any ideas?

florian’s picture

The same code, same actions but different results. I am not able to make the sitemap.xml to show the links for smokersassociation.org:
http://www.smokersassociation.org/sitemap.xml -> empty map
http://www.asociatiafumatorilor.ro/sitemap.xml -> this is ok

florian’s picture

SOLVED!

Chunk size seems to be the problem. I have just red the last comment and changed the chunk size to 1 and then back to 200 .. and now it works. Strange :)

farbkonstrukt’s picture

After I manually deleted every entry in the database where "xmlsitemap" was found, reinstalled the module, ran cron, resaved a few pages and ran cron again the sitemap came up again.

Just uninstalling the module didn't delete all related entries.

All done with the dev version from Feb 19th.

mgearr’s picture

I've been deleting the module, reinstalling it, re-saving the topics, changing the chunk size, running cron and so, so, so, so on and on and all of it in any order that I could imagine, but my sitemap still doesn't contain my pages. It's non-production site yet with the two articles only, but, the Heaven, why? The module is 6.x-1.x-dev, dated March, 3, and Drupal is 6.10, the modules switched on are XML Sitemap, XML Sitemap: Engines and XML Sitemap: Node.

What I'm doing wrong? Where the records get to?

my `xmlsitemap_node` dump

INSERT INTO `xmlsitemap_node` VALUES (12,1236467300,1235952366,0,-2);
INSERT INTO `xmlsitemap_node` VALUES (3,1236467306,1232313982,0,-2);

but after running cron for 3-4 times I still get an empty `xmlsitemap` table and, of course, sitemap.xml is empty

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9
  http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">

Can anybody explain the EXACT WAY how to get the sitemap working with all the pages included from scratch? I mean "from scratch" that I'm deleting all the XML Sitemap modules and tables.

By the way, once I could get some records in the `xmlsitemap` but I'm not able to repeat what I've been doing.

mikeytown2’s picture

@mgearr Use this version (from feb 19th)
http://drupal.org/node/379854#comment-1317792

mgearr’s picture

mikeytown2, thanks, but just the same non-working issue. The nodes are in the `xmlsitemap_node` but they don't get into `xmlsitemap` even after running cron 5 times.

The module worked fine some time ago, but I've decided to upgrade, and, of course, I've deleted the working version :) I wonder how it works today in somebody's hands, but not in mine.

May it all be because of the synonims? I have no other ideas.

farbkonstrukt’s picture

@mgearr

Copy the Version from Feb 19th in your modules direktory, manualy delete all xmlsitemap* tables and all related entries in variable, system, menu_router and menu_links table, clear (not delete!) the cache tables. (Just do a search for "xmlsitemap" e.g. in phpmyadmin)

Then reinstall the module, read http://drupal.org/node/376032 and update (edit & save) e few nodes, run cron and i'm sure, your sitemap will come up again.

grub3’s picture

yes, it is back. I had to manually add pages to sitemap.

mgearr’s picture

I don't know why, but the sitemap contains the pages now, while yesterday it didn't. Cron's been run repeatedly yesterday. I'm all at sea... However it's working now. Thank you

P.S. It seems like the records become visible some time after, not immediately and without reference to how much times you've run cron manually. So be patient and be waiting...

yo-1’s picture

I'm struggling with an (almost) empty sitemap also. Tried all the suggested moves, completely removed xmlsitemap module and related database-content.

But, my sitemap only keeps showing the home-page, the 3 terms. But no nodes at all, none of the menu's, no users.

Can it be that the fact that my site is completely multilanguage has anything to do with it, and that this actually is the result of what is discussed in http://drupal.org/node/327273 ??

By the way, I'm running today's version (march 10th)

eidolon night’s picture

I too am using the latest dev version from March 10th, and the sitemap is completely empty. The tables look fine, and I've tried everything stated above (yes, everything), except waiting a day or two (I just installed this module today). Can anyone give a reason as to why simply waiting would work? I'm more than willing to wait, but I'd like to understand why that would work.

Also wanted to note that this is an issue with both new content as well as old content that is manually added from the content page. The nodes are added to the table, but never appear on the sitemap.

tsi’s picture

With the latest version from March 10th I get only the home page in the sitemap.
Updating content will put it in the sitemap.
I too have tried everything suggested here, so subscribing.

hd25’s picture

Latest Version (March 10th) - everything (!) tried - nothing works. Only an empty XML :( So many people have problems but nothing happens...

yo-1’s picture

Well, an interesting observation was made by ikae in following bug-report: http://drupal.org/node/398072

Quote: "I found that only type "node" is not output to xml file."

If his English is correct and indeed that bug causes type "node" NOT to be output to the XML sitemap, it might clarify why the sitemaps turn up empty on so many sites.........

hd25’s picture

Tried #79 - XML still empty!

avpaderno’s picture

The answer to why the node links are not included in the site map has been already given. xmlsitemap_node.module has a setting to limit the nodes added to the site map; therefore the nodes will be added in the site map only when its author creates 100 nodes.
The default value of 100 nodes can be changed globally, or it can be changed for each users. That setting has been introduced so that, if you have some problematic users who keeps to add spam content, you can avoid his nodes get included in the site map.

hd25’s picture

@ #81: Sorry, your answer does not solves the problem. Also when all values (nodes created by user) set to 1 - the XML is emtpy!

yo-1’s picture

Tried #81:

- found and adjusted the submission treshold for all users to 1
- updated a few nodes
- ran cron

No result. Sitemap still only contains the homepage and reference to the terms/categories. No nodes. No Menus, nothing usefull.

Then
- found the global treshold and adjusted to 1
- updated a few nodes
- ran cron

No result again. Same as above.

When checking through phpmyadmin, I do notice some thing that make me wonder:

- table xmlsitemap: contains homepage, terms, menus.
But: in the menu rows, fields /changed/ and /changefreq/ are empty (zero) -->> isn't this strange???
- table xmlsitemap_node: seems populated properly with all nodes
- table xmlsitemap_term: seems populated properly with all terms
- table xmlsitemap_node: seems populated properly with all nodes
- table xmlsitemap_user: seems populated properly with all users
- table xmlsitemap_user_role: empty

avpaderno’s picture

xmlsitemap_menu.module doesn't set any values for the changed, and changefreq fields because it's not able to give them a meaningful value.

hd25’s picture

Status: Postponed (maintainer needs more info) » Active
Issue tags: -Issue needs confirmation +empty

My opinion: The bulk of this module(-thread) is waste.... I tried everything and nothing worked. I only feel frustration now ;) I hope for a solution :)

summit’s picture

Subscribing, please keep the positive site and help the module owner to get this working!
I am not using the newest version yet, but awaiting results of this thread.

greetings,
Martijn

avpaderno’s picture

Status: Active » Postponed (maintainer needs more info)
Issue tags: -empty +Issue needs confirmation

As result of fixing the issues listed in #398072: Errors in the code, the site map should now be populated with node links.
Wait 12 hours before the new archive get generated by Drupal, and you will get the fixed code.

dman’s picture

Status: Active » Postponed (maintainer needs more info)
Issue tags: -empty +Issue needs confirmation

I tried a direct CVS checkout of the DRUPAL-6--1 (dev) branch onto a totally new, separate site.
// $Id: xmlsitemap.module,v 1.1.2.48 2009/03/11 12:28:25 kiam Exp $

Set the user post threshold down
(- Isn't 100 really high?)
(- Can't we have posts by the admin override that by default?)

Used
XML Sitemap: Menu
XML Sitemap: Node
and the (new?)
XML Sitemap: Helper

Enabled the menu to be added
Ran cron etc. Just the front page :-(
As I reported above, some items appear in the xmlsitemap table, but they have both changed and changefreq set to 0. And this is what seemed to be preventing them from getting listed. However, touching those values in the DB now does NOT solve the problem like it did last time.

BUT adding some nodes via the content management screen DID get in! YAY!

On further testing, I found that I really really have to TRUNCATE cache often when testing, as it doesn't seem to get flushed when items are added or removed through the content admin, or when menu changes are added or removed from the sitemap.
I'd been using the devel.module 'flush cache' ... but that wasn't making a difference, meaning that most tests I've been trying may have had no effect due to over-aggressive caching and the results just not showing up.

Maybe a 'rebuild now' button may be a useful addition to the UI, because currently you have to manually flush cache, run cron, log out, sacrifice a chicken and turn around three times to get a 50:50 chance of seeing the sitemap as it should be.
Heck, do what menu.module did and just rebuild the cache in the background any time an admin visits the menu admin page. It can't hurt that much. I really think the cache is making testing impossible.

Still no menu items. Only nodes added from content management. Maybe I should try using a goat instead of a chicken.

avpaderno’s picture

Actually, the last commits changed the cache system used by the project code; therefore, flushing the Drupal cache doesn't have any effect on XML Sitemap.

I will open a report about the idea to use a permission that would allow a user role to by-pass the check on the authored posts (see #398452: Add a new permission to allow to by-pass the checking on the number of nodes authored).

lmw94002’s picture

First I had an error about an undefined function. I've finally gotten everything working (eg, admin/modules page doesn't crash, update.php will run), but I end up with blank sitemaps. I have all the modules enabled.

Rolling back to the previous release which was working... doesn't seem to be working anymore.

Seems like there needs to be a big step back to get things working again before we can add the new stuff we all want.

yo-1’s picture

@dman: you can leave the goat at peace..... (at least for now)

In my case there is some progress:

Installed this mornings version (12th march):
During update.php, got following messages:
warning: array_merge() [function.array-merge]: Argument #2 is not an array in ....................../www/update.php on line 174.
warning: Invalid argument supplied for foreach() in ............................/www/update.php on line 339.

Have no idea if this is a problem causes by the sitemap installer, but after this update, my sitemap did start to get populated.
Huray!!!

However, still no menu's, and only part of the nodes appear:
- my NL and DE-language nodes do NOT appear at all,
- not all EN-language (the site's default) nodes are there.

avpaderno’s picture

Status: Postponed (maintainer needs more info) » Active
Issue tags: -Issue needs confirmation
carvalhar’s picture

hi,
The only way to make this module show all nodes is deleting it from database, e re-installing?
this fix is sure to work for ever or i will need to reinstall the module everytime i have new nodes?
thanks

lmw94002’s picture

I installed the download from late last week and still had the blank sitemap. I went home for the weekend and magically the most recently created node (and a term associated with it) magically appeared in the sitemap. Not sure why, as the node was created prior to the latest install of the sitemap module.

I had previously went to the content area and selected to add the nodes to my sitemap and set the user setting for post count back to 1. Guess I'll do it again and see what happens.

eidolon night’s picture

I'm using the dev version from the 14th and it seems to work. Wish we could get more info in the release notes. One day this thing works, and the next day it doesn't.

lmw94002’s picture

I've noticed on one of my sites hosted with the same installation, it all seems to be updated now. That particular site is the most "active" site though.

Yeah, I am scared to update again to any new version while this is sorta working.

avpaderno’s picture

As reported in another comment, the cause of the site map not being populated could be the line of code that verify if a database row with the same value for the loc field is already present.

For xmlsitemap_node.module the code is the following:

if (db_result(db_query("SELECT loc FROM {xmlsitemap} WHERE loc = '%s'", $row->loc)) != $row->loc) {

Similar code is present in all the modules.

For xmlsitemap_node.module the code can be removed, while for the other modules could be changed to

if (!db_result(db_query("SELECT COUNT(loc) FROM {xmlsitemap} WHERE loc = '%s'", $row->loc))) {
avpaderno’s picture

Issue tags: +custom hooks

The code has been changed in CVS. For xmlsitemap_node.module and xmlsitemap_user.module the check has been removed; for the other modules, the code has been rewritten like

if (!db_result(db_query("SELECT COUNT(loc) FROM {xmlsitemap} WHERE loc = '%s'", $row->loc))) {

This should resolve the problem.

chourmovs’s picture

Didn't worked for me with the very last dev version
My sitemap is empty
I changed my threshold to 1

http://www.chourmovs.power-heberg.com/drupal/?q=sitemap.xml

... so i did it manually

unitec’s picture

I've the same problem.
My site map is empty with the version I've just downloaded.

With the previous version I was able to repair the sitemap for some sites by selecting "Add the selected posts to the XML site map" in Content management and clicking on update.
This will not realloy help with sites with about 50,000 nodes.
However this method no longer work with the newest version.

avpaderno’s picture

Drupal.org has not created the new tarball archive, yet.

avpaderno’s picture

Drupal.org has not created the new tarball archive, yet.

avpaderno’s picture

Drupal.org has not created the new tarball archive, yet.

avpaderno’s picture

Drupal.org has not created the new tarball archive, yet.

avpaderno’s picture

Drupal.org has not created the new tarball archive, yet.

avpaderno’s picture

Drupal.org has not created the new tarball archive, yet.

(Never add a comment using iPod Touch: it can create collateral effects)

AlexisWilke’s picture

Yeah! The -dev take about 12h to be regenerated. 8-)

916Designs’s picture

If your nodes existed before you installed xmlsitemap, they will not be added until they are updated (edited and saved), or added to the sitemap using the checkboxes at /admin/content. I read this thread for way to long before I realized this was by design.

See http://drupal.org/node/376032

dman’s picture

Still no joy at all using menus on brand new sites. Up-to-date checkout.

I'd love to help get this sorted out, but the many levels of caching and queuing are really confusing without explanations.

Even after I succeded in making sure I was able to force a rebuild on demand, I just can't see how the menu entries are expected to get in. I had to make all 4 changes just to make rows from menu items get in and get read out again.

I've gotta be missing something, but I can't understand the flow. I've been trying for hours, but I don't understand why a lot of things are done the way they are.
I can only help out testing and fixing code with a few more API docs. I mean, why is 'modules' an argument to this hook? What is $modules supposed to mean anyway?

/**
 * Implementation of hook_xmlsitmap_links().
 */
function xmlsitemap_menu_xmlsitemap_links($modules) {
#watchdog('xmlsitemap menu', "Fetching links ". print_r(get_defined_vars(),1));
  if (isset($modules['xmlsitemap']) || isset($modules['xmlsitemap_menu'])) {
    db_query("DELETE FROM {xmlsitemap} WHERE type ='menu'");
    $menus = variable_get('xmlsitemap_menu_menus', array());
    $mlid = 0;
    foreach ($menus as $menu) {
      if (is_string($menu)) {
        $result = db_query("SELECT ml.mlid
          FROM {menu_links} ml
          LEFT JOIN {menu_router} m ON m.path = ml.router_path
          WHERE  ml.menu_name = '%s'
            AND ml.mlid > %d
          ORDER BY ml.mlid ASC",
          $menu, $mlid
        );
        $row = new stdClass();
        $row->module = 'xmlsitemap_menu';
        $row->type = 'menu';
        while ($mlid = db_result($result)) {
          $link = menu_link_load($mlid);
          // Avoid external links, or links to the front page;
          // both have $link['external'] set to 1.
          if (!$link['external'] && !$link['hidden'] && $link['access'] == 1) {
            $row->loc = $link['href'];
            $row->id = $mlid;
            $row->priority = 1.0 - min(max(round(($link['weight'] + 10) / 20, 1), 0.0), 1.0);
##############################################
// That priority was just coming in at zero
// I think the above formula assumed menu weights were limited to +/- 10
// menu weight does NOT = priority. What's that about?
// menu *depth*, maybe.
            $row->priority = 0.1;

// Nothing happens with no dates - row goes in, but is basically 
// marked as 'ignore' by setting changefreq = 0, changed = 0
            $row->changefreq = 1;
            $row->changed = TRUE;

// What is this query doing?
// How can this ever be false?
// Is it just checking if row exists?
#            if (db_result(db_query("SELECT loc FROM {xmlsitemap} WHERE loc = '%s'", $row->loc)) != $row->loc) {
              drupal_write_record('xmlsitemap', $row);
#            }
##############################################
          }
        }
      }
    }
  }
}
AlexisWilke’s picture

For the menu, I have a patch here #408066: Wrong SQL query for retrieving the menu item links

Changed should be set to the date and freqchange to a non-zero (positive) value.

I did not have problems with the priority however.

Thank you.
Alexis Wilke

P.S. there is also a problem with the $mlid variable. 8-)

avpaderno’s picture

I added more calls to xmlsitemap_helper_update_sitemap() which should force xmlsitemap.module to update the content of the site map when the nodes, the taxonomy terms, or the user data is changed.

I hope this resolve the issue.

mikeytown2’s picture

Tip for anyone upgrading from the feb 19th dev to the latest one.
Disable this module first!

mikeytown2’s picture

Status: Active » Reviewed & tested by the community

I think you got it

avpaderno’s picture

Status: Reviewed & tested by the community » Active
cakka’s picture

I got the same problem, when i install the latest version... it was error
So, installed the old version.

I do this step :
1. Remove all table xmlsitemap and clear cache
2. Install the old module
3. Run cron.php
4. Update same node (edit and save)

But my sitemap is still blank :(
This is my error warning that i got :

    * user warning: Unknown column 'lastmod' in 'field list' query: INSERT INTO ck_xmlsitemap (loc, lastmod, changefreq, priority) VALUES ('http://www.ckcybers.com/', 1238393092, 1, 1) in /home/ckcybers/public_html/sites/all/modules/xmlsitemap/xmlsitemap.module on line 469.
    * warning: array_merge() [function.array-merge]: Argument #2 is not an array in /home/ckcybers/public_html/sites/all/modules/xmlsitemap/xmlsitemap_node/xmlsitemap_node.module on line 342.
    * user warning: Unknown column 'xn.previous_comment' in 'group statement' query: SELECT n.nid, n.type, n.promote, n.changed, xn.previously_changed, xn.priority_override, COALESCE(ua.dst) AS alias FROM ck_node n LEFT JOIN ck_node_comment_statistics s ON n.nid = s.nid LEFT JOIN ck_url_alias ua ON ua.src = CONCAT('node/', CAST(n.nid AS CHAR)) LEFT JOIN ck_xmlsitemap_node xn ON n.nid = xn.nid WHERE n.status > 0 AND (n.type NOT IN ('') AND xn.priority_override IS NULL OR xn.priority_override >= 0) AND n.nid <> 0 GROUP BY n.nid, n.type, n.promote, n.changed, xn.previously_changed, xn.priority_override, s.comment_count, s.last_comment_timestamp, xn.previous_comment in /home/ckcybers/public_html/sites/all/modules/xmlsitemap/xmlsitemap_node/xmlsitemap_node.module on line 342.
    * user warning: Unknown column 'lastmod' in 'order clause' query: SELECT * FROM ck_xmlsitemap ORDER BY lastmod DESC, changefreq, priority DESC, loc LIMIT 0, 50000 in /home/ckcybers/public_html/sites/all/modules/xmlsitemap/xmlsitemap.module on line 396.
    * user warning: Unknown column 'lastmod' in 'order clause' query: SELECT * FROM ck_xmlsitemap ORDER BY lastmod DESC, changefreq, priority DESC, loc LIMIT 0, 50000 in /home/ckcybers/public_html/sites/all/modules/xmlsitemap/xmlsitemap.module on line 396.
    * user warning: Unknown column 'lastmod' in 'order clause' query: SELECT * FROM ck_xmlsitemap ORDER BY lastmod DESC, changefreq, priority DESC, loc LIMIT 0, 50000 in /home/ckcybers/public_html/sites/all/modules/xmlsitemap/xmlsitemap.module on line 396.

Please tell me the solutions.
Thanks

cakka’s picture

Sorry, i forgot to tell my site.
This is my site url : http://www.ckcybers.com/sitemap.xml

Thanks

avpaderno’s picture

Title: Site map is empty » The site map is not being populated

I am changing the title to avoid duplicate reports.

cakka’s picture

Hello, any body know what the solutions ?
Thanks

avpaderno’s picture

@#116: It seems you are using an old version of the project modules, as the XSL style sheet is not used anymore in the last commits.
The error messages are caused by the fact you probably didn't run update.php.

Anonymous’s picture

avpaderno’s picture

It's not exact; the site map is not being populated means the site map is not being populated from links, whatever the type of link is, or whatever the link refers to old content. The two reports are different.

Anonymous’s picture

Re: #115

What do you mean you "installed the old module"? What version did you install? I seem to remember a similar issue that I resolved by running update.php.

giorgio79’s picture

Hi Guys,

I have a lot of nodes as well 10 000 and I am getting php out of memory for the view bulk ops trick of adding all nodes to the sitemap. Could not this be managed form an sql script somehow instead of all these arrays? :)

It would be nice if xml sitemap would add old nodes at install, and just like pathauto we could configure that it should add x amount per cron run.

UPDATE: #61 seems to have worked for me.

Did the update, then followed the admin link, it warned me there that some updates are required. Followed the link, it showed that xmlsitemap db needs an update, followed the link, and was taken to xmlsitemap db update page which started inserting the records via batch api it seems :)

mdlueck’s picture

Seems my bug report belongs on this thread then, was: http://drupal.org/node/376032#comment-1404996

I installed xmlsitemap-6.x-1.x-dev, it showed 2009-Mar-23 as the last update. This is the first version of the module I have had installed on this copy of Drupal.

Table dumps, things tried, etc... are all in a couple of posts starting at the post linked to.

If anyone has suggestions of "what else to try" on a clean Drupal 6 install with a clean install of that build of this mod, please advise and I will test and report the results. Thanks!

mdlueck’s picture

#123 Did you install that older version in post #61?

I just followed those steps, but installed the "Mar 28 20:27 xmlsitemap-6.x-1.x-dev.tar.gz" version which cron alerted me was available. Did not fix the lack of nodes showing up.

Tried also going to content management and adding the four nodes to the sitemap. Tried the other xmlsitemap choice from the content management screen as well. Getting late, I best call it a day.

giorgio79’s picture

#125 yes, I used that older version! At the moment I am still struggling with term table which is empty. Might just write a freakin sql script to copy the things over from term tables :)

cakka’s picture

@119
@122
I have update the tabel on update.php, but it still not created on sitemap.xml
What the problems ?
Thanks

Anonymous’s picture

Enough with older versions already. When installing a newer version of http://ftp.drupal.org/files/projects/xmlsitemap-6.x-1.x-dev.tar.gz then you need to following these steps:

  • Deactivate all the xmlsitemap modules (admin/build/modules).
  • Uninstall all the xmlsitemap modules (use the Uninstall tab at the top of admin/build/modules).
  • Make sure that the database no longer contains any xmlsitemap% tables. (SELECT * FROM `information_schema`.`TABLES` WHERE TABLE_NAME LIKE 'xmlsitemap%';)
  • Remove the xmlsitemap from your modules directory (e.g.: rm -rf sites/all/modules/xmlsitemap;).
  • Download the new -dev version (e.g.: cd /tmp; wget http://ftp.drupal.org/files/projects/xmlsitemap-6.x-1.x-dev.tar.gz ;).
  • Install the new -dev version (e.g.: cd sites/all/modules; tar -zxf /tmp/xmlsitemap-6.x-1.x-dev.tar.gz;).
  • Activate the xmlsitemap modules you use (admin/build/modules).
  • Visit admin/settings/performance and click "Clear cached data" near the bottom of the page.
  • Adjust the xmlsitemap settings; especially the cache directory. (admin/settings/xmlsitemap)
  • Execute cron.php. (Make sure you set the cron limit first.)
  • Logout.
  • Visit http://sample.com/sitemap.xml in your browser.

You must follow these steps because the directory structure has changed and this is the only way to guarantee that your using the correct module functions.

giorgio79’s picture

Dear Ernie,

Based on your instructions I can confirm, that my

1. node term was populated before logging out and visiting as anonymous, YEEAY :)

2. term table was not populated! and it is still empty.

3, sitemap.xml exists and can be loaded

The only thing not working for me is terms. Any ideas?

Anonymous’s picture

@giorgio79: Are the terms accessible by the anonymous user? A silly question, do you have the terms module active?

giorgio79’s picture

@earnie: Yes I have an extensive free tagging vocabulary that is accessible by anons and parsed by search engines. My sitemap term table had 22000 entries before uninstall (I have a backup) and now it is empty.

Also I notice, new terms are added fine to the table and sitemap.xml file as I create nodes with free tagging terms...Only old terms are missing.

Anonymous’s picture

@giorgio79: Check the admin/reports/dblog for php errors. In particular are you exceeding the memory_limit during the processing of the taxonomy?

mdlueck’s picture

Trying the steps in #128. Upon trying to uninstall the mod, I still get the following error with the build downloaded a day or two ago...

Fatal error: Call to undefined function xmlsitemap_helper_sitemap_query() in /homepages/35/d157794216/htdocs/sites/somesite.com/www/sites/all/modules/xmlsitemap/xmlsitemap/xmlsitemap.module on line 596

Shall I log this as a separate / new bug?

giorgio79’s picture

@earnie Thanks, I went through the logs but nothing like it happened. An allowed memory error would be fatal, so probably the script would have stopped.
Re the nodes table, it has 10 000 entries so that is quite big but it processed that without any issues in a couple seconds :) Tthere was no memory issue during the node processing.

cakka’s picture

@128
Thanks , i am going on suggestion

Anonymous’s picture

@giorgio79: See my comments at #376032-24: How to insert old nodes into the sitemap? but in your case you want xmlsitemap_term instead. Execute the file as admin, logout, visit the sitemap.xml and see what happens.

Anonymous’s picture

Re: #133

Yes, please open a new issue. You don't say when you received this error please detail what you were doing when the error occurred.

giorgio79’s picture

@earnie: Thanks, but no luck. Even added a bit of error reporting. It just runs once but the table does not change. I can see new terms in there from nodes that were added after xmlsitemap install, but not the ones before the install. Am I the only one with this term issue? Does it work for you? Could the issue be with the xmlsitemap term module?

<?php
ini_set('error_reporting', 'E_ALL');
require './includes/bootstrap.inc';
drupal_bootstrap(DRUPAL_BOOTSTRAP_FULL);
xmlsitemap_helper_update_sitemap('xmlsitemap_term');

echo ('OK');
?>
cakka’s picture

@128
Wow... thanks :) it was success for me :)

Anonymous’s picture

@cakka: Glad to hear you have success.

@giorgio79: I'm inclined to think that it is an environment issue. Something is causing your terms not to process to completion. Perhaps you need to tune your database so that the connections don't time out on the query. Or perhaps the data size limits are too small. Look at your system log files. I happen to know the terms are working so now it becomes what is different for you. One thing is the number of terms.

Anonymous’s picture

@giorgio79: You may need to run cron.php after executing the script. And make sure you visit the sitemap.xml as an anonymous user.

giorgio79’s picture

@earnie: Thanks, I double checked the error log file, nothing. Ran cron and called sitemap.xml anonymously but no help. I double checked my term data table and it is actually only 10 000 terms, which should not be a serious issue for a database...Will try to poke around more but at the moment it definitely seems to me it is not working.

mdlueck’s picture

Re: #137

Someone kindly solve the problem with a patch. I applied it to the version that was installed, got it uninstalled, then installed a version dated April 1.

Followed the steps in #128, additionally once the new files were unpacked on the server, I ran the update.php followed by cron.php. (I also applied the diff to the April 1 version)

Then followed the instructions exactly. I enabled:

1) XML Sitemap
2) XML Sitemap: Engines
3) XML Sitemap: Helper
4) XML Sitemap: Node

all at once.

Logged out, no nodes on the sitemap.

Logged back in, when to content administration, selected all nodes, picked Add to Sitemap, logged out, nadda
Logged back in, when to content administration, selected all nodes, picked Change Sitemap settings to default, logged out, nadda

Suggestions?

Anonymous’s picture

Status: Active » Needs review
StatusFileSize
new2.3 KB

The attached patch fixes mdlueck's problem. Kiam, we need to import existing data to the batch process but should this be done by the cron job instead of the interactive process during install/update?

This patch only addresses nodes and terms; the users module probably needs a similar patch.

avpaderno’s picture

Status: Needs review » Needs work

It's not clear to me why the patch includes a call to drupal_load('module', 'xmlsitemap_helper') when the required function is defined in the xmlsitemap_helper.install.inc file.

The batch operations can be only executed interactively, when a form is being submitted to Drupal; differently, batch operations could cause a PHP timeout, if the web site contains too much links to put in the module database tables.

Anonymous’s picture

I included it because it is included in xmlsitemap_term_update_6111() already and I was making the code consistent. I will test without it and report back.

The timeout issue is my concern with operating interactively if a timeout occurs will a second run add to the list or will the files be refreshed from the start? Would it be better to install and update the module without the refresh of the tables and add a status report that can be used to execute an external script to refresh the tables. Then those with ``lots of nodes'' and ``too many terms'' can have a chance to install the module. Otherwise the attempt may destroy someones database.

avpaderno’s picture

An interactive batch operation should never cause a timeout, especially if the batch operation operates on single table rows like it happens with the XML Sitemap modules.

The batch operations have been introduced in Drupal 6 to avoid PHP timeouts on long operations executed during the update of Drupal modules. The functions that handle the batch operations have been coded to be generic enough to be used in many other situations where a module executes long operations as a result of data submitted from a form.

mdlueck’s picture

#144 / earnie: So why did my extra steps at the bottom of #143 not add the nodes to the sitemap? I thought surely doing so was the purpose of at least one of those steps...??? If not, then what are they suppose to do?

giorgio79’s picture

@earnie: Thanks for this patch, I tried uninstalling xmlsitemap terms, and reinstall it with the patch, but when it jumped to the batch op screen it was giving me Access Denied.

Anonymous’s picture

@giorgio79: Were you installing as UID 1 or some user with permissions to do the install?

Anonymous’s picture

@mdlueck: I don't have time to research the cause for your question.

Anonymous’s picture

Status: Needs work » Needs review
StatusFileSize
new3.42 KB

Yes, it works without the drupal_load. I've added a similar update for the users module.

Kiam, in update_6116 you also add

  drupal_load('module', 'xmlsitemap_helper');
  xmlsitemap_helper_update_sitemap('xmlsitemap_node');
  $ret[] = array(
    'success' => TRUE,
    'query' => 'FORCE SITEMAP UPDATE',
  );

why is it necessary? Should the same happen in the install process?

avpaderno’s picture

I added the drupal_load('module', 'xmlsitemap_helper') line to be sure the module would be loaded during the updating of the project modules; as xmlsitemap_helper.module didn't exist before that update, it's rather impossible it was already enabled before the update.

The same code is not required during installation because the administrator must select xmlsitemap_helper.module, in order to enable and install the other modules of the XML Sitemap project.

avpaderno’s picture

Status: Needs review » Postponed (maintainer needs more info)

@#152: It's not required to enable xmlsitemap_helper.module during the installation because the module need to be enabled, in order to be able to install the other modules; as the other modules declare their dependency from that module, Drupal doesn't allow you to enable (and install), i.e., xmlsitemap_node.module without to enable (and install) xmlsitemap_helper.module.

It seems that the report is missing its original topic that should be the site map not being populated. Is the site map still not populated, with the last code commits?

Anonymous’s picture

Status: Postponed (maintainer needs more info) » Needs review
StatusFileSize
new2.76 KB

There are no nodes, terms or users for existing data without this patch on a fresh install. Patch refreshed with current CVS.

avpaderno’s picture

Status: Needs review » Postponed (maintainer needs more info)

Obviously, I was missing the point. The code has been changed to populate the database module tables during the installation phase.

The committed code will be available in the tarball archive Drupal.org generates between 9 hours. With the new code, is the issue still present?

mdlueck’s picture

I just pulled down the April 6 build, installed / tested it per #143, same results.

What further details could I provide to assist in solving this problem?

Anonymous’s picture

You're too early, try again on the next update.

mdlueck’s picture

#158 earnie: OK, please someone update this thread when I should try again. Thanks!

avpaderno’s picture

The development snapshot tarballs are generated at 12:00 AM, and 12:00 PM GMT; this mean that now Drupal.org has already generated the new tarball archive.

mdlueck’s picture

#160 Thanks, I pulled it down. This build seems to be dated: Apr 7 20:29

Followed the same steps as in #143, same results.

I will note, each time after the two extra steps:

Logged back in, when to content administration, selected all nodes, picked Add to Sitemap, logged out, nadda
Logged back in, when to content administration, selected all nodes, picked Change Sitemap settings to default, logged out, nadda

I ran cron before I logged out and checked.

Also I (using FF) held down the shift key while pressing the reload button to make sure the browser cache was not coming into play.

Still no nodes. Suggestions? Do you need me to check something in the DB?

Anonymous’s picture

@mdlueck: When you installed the modules were you UID 1 (always install modules as UID 1)? Is the anonymous user allowed to see your nodes? Did you do "Uninstall all the xmlsitemap modules (use the Uninstall tab at the top of admin/build/modules)."? Do you have data in the xmlsitemap_node table; if the previous answers were yes and this one is no then something is wrong with your environment or the actions you are taking. Which Drupal version are you using?

Edited comment.

Anonymous’s picture

Today's -dev release works for me. Executing the update.php upgrade path must be from a 5.x version. Upgrading from a previous 6.x -dev version must follow the steps at #379854-128: The site map is not being populated to insure you do a fresh install.

Kiam, I suggest we mark this as fixed and ask mdlueck to open a support request; do you agree?

avpaderno’s picture

Let us see if somebody has still this problem; differently, we can declare the report fixed.

giorgio79’s picture

Thanks Earnie, I just installed the latest, and it seems to be working fine. Terms are added, nodes are added for me as per the steps you gave at #128. Those steps are even worthy to be posted on the frontpage :)

UPDATE: Umm, I just checked the tables but it seems only a fraction of the terms were added. Investigating now why. Probably will open a new ticket for that :)

UPDATE2:Yes, so it seems I was calling success a bit early. those tables were the old ones, somehow they were not deleted at uninstall. So I started a blank install now, with no tables, and when the install takes me to the update.php batch screen I get an access denied message with admin user, number 1.

avpaderno’s picture

It's not clear what you exactly mean saying that you get an access denied message when you visit the update.php page.
If I understand correctly what you mean, then that is not an issue caused by XML Sitemap.

Anonymous’s picture

Re: #165 - UPDATE 2.

This sounds like another environment issue. Are you sure your DB user listed in settings.php has drop table rights? I've seen this update.php issue before due to old cookies, sessions and cache data. Clearing the cookies, sessions and cache data helps but only after a time lapse or opening a different browser brand.

Anonymous’s picture

Re: #165 - UPDATE 2.

If update.php is run and you followed #128 then something is very wrong with your environment. Following #128 ensures that a fresh install is completed. Perhaps you need to increase your memory_limit; but this isn't a fault of xmlsitemap.

giorgio79’s picture

Hi Guys,

Yes this definitely looks like something else.

I can confirm that the module handles perfectly well the nodes.

When it comes to terms (I tried to separately uninstall terms module and reinstall) I Am taken to
http://mydrupalsite/batch?op=start&id=62
and it is giving access denied. So this seems like something else, thanks for all your help, I will troubleshoot now this. I have seen such issues elsewhere reported in Drupal forums...I am sure it is not related to xmlsitemap but to Drupal in general.

UPDATE: Thanks Earnie for the cache and session tips, I have probably an overly hacked Firefox from Foxyproxy to Live HTTP Headers and Tab Mix Plus, so what I did was went to Internet Explorer, and ran the update.php there only for Sitemap Terms 6100 update, and now it is nicely populating the term table. phew :D weird, but it works.

Thanks again for all your efforts.

mdlueck’s picture

@#162 earnie

1) Yes to install / uninstall I am logged in as UID 1
2) Yes, while not logged in using FF I can view nodes
3) Yes, I uninstalled all of the submodules prior to upgrading. I used to get an error so I opened a separate bug and that has now been resolved. (So on this copy of Drupal, a couple of upgrades to this mod had been done not uninstalling the one submod that was getting the error.)
4) Here is a dump of the table is question:

nid changed previously_changed comment_ratio priority_override
1 1238117185 1231767477 0 -2
2 1238117243 1236036855 0 -2
3 1238117216 1236696093 0 -2
4 1238117260 1236701944 0 -2

5) 6.10 presently

Anonymous’s picture

@mdlueck: I don't know that I can help further. I added a step at #128 after the uninstall step.

Make sure that the database no longer contains any xmlsitemap% tables. (SELECT * FROM `information_schema`.`TABLES` WHERE TABLE_NAME LIKE 'xmlsitemap%';)

mdlueck’s picture

@#171 earnie: I just ran through those steps uninstalling / reinstalling the Apr 7 build.

In PHPMyAdmin, once I had completed the uninstall of the mods, I find the following:

MySQL returned an empty result set (i.e. zero rows). (Query took 0.6633 sec)
SQL query: 
SELECT *
FROM `information_schema`.`TABLES`
WHERE TABLE_NAME LIKE 'xmlsitemap%'
LIMIT 0 , 30

I went through the steps, plus did the two Content Management / XML Sitemap specific operations and once those operations were completed ran Cron. Nadda.

The xmlsitemap_node table currently has the following records:

nid   	  changed   	  previously_changed   	  comment_ratio   	  priority_override
1 	1238117185 	1231767477 	0 	0.5
2 	1238117243 	1236036855 	0 	0.5
3 	1238117216 	1236696093 	0 	0.5
4 	1238117260 	1236701944 	0 	0.5

The sitemap only shows the following:

<urlset xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9   http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">
−
<url>
<loc>http://www.client-domain-abcdefg.com/</loc>
<lastmod>2009-04-09T22:26:22+00:00</lastmod>
<changefreq>hourly</changefreq>
<priority>1.0</priority>
</url>
</urlset>

I do have the following modules enabled related to xmlsitemap:

  1. XML Sitemap
  2. XML Sitemap: Engines
  3. XML Sitemap: Helper
  4. XML Sitemap: Node

Suggestions please...

avpaderno’s picture

Status: Postponed (maintainer needs more info) » Active
Anonymous’s picture

@mdlueck: What other modules do you have installed? What are the node types that aren't being populated? Can you mysqldump (I assume your DB vendor is MySQL) your tables and put them up in a download for me? You can send me a link privately. I'm at a loss here.

mdlueck’s picture

@#174 earnie:

Other modules: captcha and nodewords

Node type: All of the Drupal core "Page" type

I will contract you via your email address in a couple of hours to provide a link to a full MySQL 5 backup file.

Thanks! :-)

Anonymous’s picture

@mdlueck: What versions of captcha and nodewords are you using?

Anonymous’s picture

@Kiam: I'm thinking the issue that mdlueck demonstrates is he is not promoting the nodes but instead creating menu links that the anonymous user can view. One of the pages has a url_alias and that is displayed in the report while the other three (he has only created four pages) do not. The xmlsitemap_node table is correct, only the report is wrong. I thought maybe adding xmlsitemap_menu might help but it didn't. I don't have time anytime soon to chase down the issue but thought maybe this might help you to know where to look.

coupet’s picture

Works as follows:

Step 1
--------
Enable XML Sitemap:
- creates xmlsitemap table; xmlsitemap table is empty. OK
- creates xmlsitemap folder; xmlsitemap folder is empty. OK

Step 2
------------
Enable XML Sitemap User:
- creates xmlsitemap_user table; xmlsitemap_user is populated OK
- creates xmlsitemap_user_role table; xmlsitemap_user_role is empty (?)

Step 3
-------------
Enable XML Sitemap Node:
- creates xmlsitemap_node table; xmlsitemap_node is populated.
- Message: Processing 0-100% OK ... fast

Step 4
---------------
Enable XML Sitemap Term
- creates xmlsitemap_term table; xmlsitemap_term is populated.
- Message: processing 0-100% OK.
- Note: Wait until process is finished! ... slow ?
- xmlsitemap folder is removed after activating XML Sitemap Term (?) (not sure)

Step 5
---------------
Enable XML Sitemap Menu
- No table created OK

Step 6
------------
Home » Administer » Site configuration » XML Sitemap - Save configuration
- folder sites/default/files/xmlsitemap is created. (empty) OK

Step 7
---------
Logout.

Step 8
------------------
Visit http://sample.com/sitemap.xml in your browser. (Anonymous)
- xmlsitemap table is populated. (OK)
- xmlsitemap folder is populated. (OK)
- xmlsitemap_user_role table is empty (empty) (?)

EDIT
------
@ earnie (#179):
Table: users_roles: 53
Comment ratio weight - users: 0.2 (default did not change)

Anonymous’s picture

@coupet: The obvious question here is do you have users assigned to roles and did you modify the priority based on role?

@Kiam: If I edit a role I would expect the value to save and it doesn't. The default 0.5 value persists.

mdlueck’s picture

@#176 earnie: Meta tags 6.x-1.0 / Image CAPTCHA 6.x-1.0-rc2

Should be the latest available for both of them.

Anonymous’s picture

I've created #433368: User role priority changes are not saved for the bug discovered at #178 - #179.

CharlieHipHop’s picture

Database tables are created and populated but there is no sitemap.xml file.

Anonymous’s picture

Did you follow #128?
Did you visit admin/settings/xmlsitemap and enter the cache directory settings?
Did you visit the sitemap.xml file as an anonymous user?

mdlueck’s picture

@#183 earnie: For me, the cache directory setting is correct / valid. The xml file in there has the site header tags only... exactly what viewing /sitemap.xml as anonymous shows.

Anonymous’s picture

@mdlueck: I detailed your problem already in #177. It has to do with unpublished nodes without an alias. If you were to create an alias for the other three of your four pages you would find them in the sitemap.xml file.

mdlueck’s picture

@#185 earnie: I apologize, I missed that response.

So you are saying that the xmlsitemap now has a requirement of creating an alias for every node on the site, else it will not list the node in the sitemap?!!?!?

It used to at least list the node as "node/##" in the sitemap. In fact some a while ago on D5 were still showing "node/##" on nodes that really had a valid alias. I found those, resaved the nodes, then the xmlsitmap changed to advertising the alias name.

The nodes have always been in published status as long as I have been trying to get the sitemap to work.

	Title	Type	Author	Status	Operations
	News new	Page	userid	published	edit
	Services updated	Page	userid	published	edit
	Projects updated	Page	userid	published	edit
	Welcome to XYZ 	Page	userid	published	edit

So I am still confused... hhhmmm....

Anonymous’s picture

So you are saying that the xmlsitemap now has a requirement of creating an alias for every node on the site, else it will not list the node in the sitemap?!!?!?

Not one that is purposed. It is a bug somewhere and probably in a table JOIN. I should be able to research more next month.

mdlueck’s picture

A point of clarification: It seems we already had a url alias on the home page node. We added two more, so now only one remains without, I ran cron, still no nodes show up on the sitemap. Earnie, since you know the domain name, feel free to check.

Was the logic bug you found not satisfied unless all nodes had a url alias?

avpaderno’s picture

Do you mean that you have more than one path alias for the home page node?
If this is the case, one node appears in the site map only once, indipendently from the number of aliases it has.

Then, the module saves the relative URL of a node in the node/<nid> form in the database table; only when the site map content is generated a path alias is looked for.

mdlueck’s picture

@#189 Kiam@avpnet.org: No, just when earnie in #177 stated that it was due to not having URL aliases on the nodes, one node already had a URL alias. He must have not see that the one node already had an alias. We added two additional ones, so three nodes with URL Aliases, one left without. No nodes show up in the sitemap, however.

Thus the query problem he thought was to blame 1) is not the entire problem or 2) EVERY node on the site must have a URL Alias to satisfy it, perhaps?

Better?

Anonymous’s picture

Maybe I assumed it was because the one node had an alias that it showed up. Maybe it was because you specified the node as the <front> node. So the problem is only with nodes not published alone.

coupet’s picture

Tried the latest dev version with following result:

Step 1
--------
Enable XML Sitemap Helper:

Step 2
--------
Enable XML Sitemap:
- creates xmlsitemap table; xmlsitemap table is empty.

Step 3
------------
Home » Administer » Site configuration » XML Sitemap - Save configuration
- creates xmlsitemap folder; xmlsitemap folder is empty.

Step 4
------------
Enable XML Sitemap User:
- creates xmlsitemap_user table; xmlsitemap_user is empty
- creates xmlsitemap_user_role table; xmlsitemap_user_role is empty

Step 5
-------------
Enable XML Sitemap Node:
- creates xmlsitemap_node table; xmlsitemap_node is empty.

Step 6
---------------
Enable XML Sitemap Term
- creates xmlsitemap_term table; xmlsitemap_term is empty.

Step 7
---------------
Enable XML Sitemap Menu
- No table created OK

Step 8
------------------
Visit http://sample.com/sitemap.xml in your browser. (Anonymous)

Result
------------------
xmlsitemap has 1 row
xmlsitemap_node is empty
xmlsitemap_term is empty
xmlsitemap_user is empty
xmlsitemap_user_role is empty s

- xmlsitemap folder has one file: xsm-10014638.xml.

Note: the previous dev version worked per post #178.

Anonymous’s picture

There is no reason to continue to post these lengthy results. Follow the development by subscribing to "All issues" at http://drupal.org/project/issues/subscribe-mail/xmlsitemap. If you can help code or answer questions feel free to jump in. Otherwise be patient, we'll update this and other issues.

dman’s picture

?
That's actually a pretty helpful set of steps to repeat the problem. Above average as bug reports go. Most of the time issues die because they can't be repeated on the developers machine. This illustrates what is going wrong, and hopefully that can illuminate to someone - *where* the current problem is.

I don't know the answer myself, I've looked at the code, several times now, but can't understand enough of what it's trying to do to help with what it's not doing. I want to, need to, help everyone patch this, but the current code is just not clear enough to my limited capacities. And I've not been able to find or receive any roadmap or documentation or clarification that would help me to help the team.

I Know this particular thread is now much too long to get good resolution on, but if the symptoms have been narrowed down enough to define a new issue to track ... which is it? I don't see it in http://drupal.org/project/issues/xmlsitemap
So the thread is still alive.

Currently there is a big elephant in the room called "the site map is not being populated". Posting here is the only way to avoid further "xmlsitemap doesn't work" threads being called duplicates. Subscribing to all other unrelated issues is not currently a solution to solving this big one.

I'd love to know there was a fix in the works. but if it's not in this list already .. where can we subscribe?

Anonymous’s picture

My point is that -dev is known to be in a massive rewrite (thanks to the helpfulness of webchick) and is broken at the moment. Patches for the issues raised are welcome. Reporting I have this problem too and this is what I did and what I got aren't that helpful to getting the same problem reported resolved unless the maintainer marks that he needs more information.

coupet’s picture

I followed the steps as instructed in Post #128 and stated the results obtained.
Post #195 is stating that module is broken at the moment.

AlexisWilke’s picture

earnie,

Note that it would have been a good idea to create a version 1.0 whenever the -dev was working okay, before the complete re-write. Then the complete re-write could have been done a little more behind the scene. Although I like the module and my version works for me, I have not updated it for a while simply because each release comes with new quirks!

Also I offered to help Kiam (several times,) but so far all he told me is that he's doing a big code overhaul and did not want other people to be part of it. I think the management of the code is not at the top and that's what this issue is reflecting. I'm still open to help in v1.x and Kiam can be working with a new entry called 2.x-dev

Thank you.
Alexis Wilke

avpaderno’s picture

My answer can depend on the particular moment the question is being asked.

webchick is helping right now, and as you can see there has not been a ceremonial for her investiture on the rank of person helping in the developing of the project.
Also earnie is helping in the developing of the project.
Everybody can help in the same way they are doing.

Anonymous’s picture

Note that it would have been a good idea to create a version 1.0 whenever the -dev was working okay, before the complete re-write.

I disagree since the code wasn't functioning completely.

Then the complete re-write could have been done a little more behind the scene. Although I like the module and my version works for me, I have not updated it for a while simply because each release comes with new quirks!

The rewrite is due to webchick's thorough code review and her knowledge of Drupal internals plus a need for a client she has. The refactoring is for performance as much as it is to get the module working out the door. I'm very excited with the work she is putting into the module.

Also I offered to help Kiam (several times,) but so far all he told me is that he's doing a big code overhaul and did not want other people to be part of it. I think the management of the code is not at the top and that's what this issue is reflecting. I'm still open to help in v1.x and Kiam can be working with a new entry called 2.x-dev

Yea, I offered to help to. Still I have helped as much as possible even to the detriment of other priorities. Testing, offering comment, review, suggestion and patches is as much help as one can give an active maintainer. Too many cooks can spoil the beans; so one hand in the pot is a good thing. If you want to check the commits then please watch http://drupal.org/project/cvs/190839 for a review. You can even have a feed of all of them via http://drupal.org/cvs?rss=true&nid=190839. If you have a comment about the patch then goto the revealed issue and make a comment or if there isn't one open a new support issue.

coupet’s picture

Alexis,

Can you upload the 6.x ver. that works for you? I can use until a stable dev is released. Thanks.

AlexisWilke’s picture

StatusFileSize
new30.82 KB

coupet,

I'm glad someone makes sense here 8-)

There is an attachment.

Of course, it is a bit old, but it works okay for me for now.

Thank you.
Alexis Wilke

mdlueck’s picture

@Kiam@avpnet.org / earnie: Could you please give this thread an update of "please test again" when ever you have uploaded a new build you would like us to test to see if it makes a difference? Otherwise I will ignore the "me too's" and not update. Thanks.

EvanDonovan’s picture

The Apr. 27 dev seems to have this issue, also. I followed the instructions in #128 and set the user posts to 1.

stillcut’s picture

Got just the first post I've published in the sitemap.
Everything else is missing.

http://soulfulbits.com/sitemap.xml

I'm using 6.x-1.x-dev 2009-Apr-28
Where can I find a stable version ?

EvanDonovan’s picture

The version in #201 works, but you have to add nodes to the sitemap through the admin/content/node page (unless there's another way that I missed).

avpaderno’s picture

The version officially developed uses cron maintenance tasks to populate the site map. It's up to you what version to use, but if you don't use the officially developed one, then you should not ask for support here.

EvanDonovan’s picture

Sorry, I was just replying to #204, since according to stillcut's testing the Apr. 28th dev version wasn't working. I understand that the latest dev version is intended to use the cron to populate the site map, but if it isn't working (b/c of webchick's on-going review, etc.), then we have to look to other options, such as the earlier version of the module posted in #201.

Anonymous’s picture

The -dev module should be working within a couple of days. I just reopened an issue that prevents that case but if Kiam checks it in soon the -dev file created after that will be populating the data again. Other issues may arise though.

SimonV’s picture

#204 - Have this same issue, but yours appears to be working now... what did you do?

EvanDonovan’s picture

Thanks, earnie. Now that I see issues #447912: Change the default value for the cron limit and #448000: Big, Over-Arching Sitemap Architecture Discussion (tm), I feel much better about how this module's doing. I promise I'll stop posting in this issue now :)

Anonymous’s picture

I can report that the file dated April 29, 2009 - 07:41 still isn't operational. However, I'm reporting all bugs I find and the fixes should be in CVS today; so the file created by at least tomorrow should be operational (fingers and toes crossed behind my back ;). The 448000 issue should be for 6.x-2.x but there isn't a version like that yet.

Anonymous’s picture

I can report that the file dated April 29, 2009 - 19:38 creates data for sitemap.xml. There is a known issue #449284: Setting priority to 'Not in Sitemap' does not remove link from sitemap that prevents a release. Please test again and open issues as you find them.

mdlueck’s picture

@#212 earnie: Applied via the usual steps, no nodes on the site map. :-( Sorry! (shrug)

Anonymous’s picture

@mdlueck: You have some @#$% stubborn data. I'm still shrugging with a data mining shovel at the moment. You've a really perplexing set of 4 nodes. It doesn't matter if I promote them or not. It doesn't matter if I move the items back to the navigation menu. It doesn't matter if I change the front page back to node. It's in the xmlsitemap table correctly, it doesn't report to sitemap.xml for what ever reason. Still researching.

Anonymous’s picture

AlexisWilke’s picture

earnie,

There are a lot of tests for why the URLs will be included (or not) in your sitemap.xml file. One of those returns false. I suggest you add some log in each "failure" cases and see which one fails on you. You could also look at the DB and look at the tests one by one.

When I did that, I could fix the problem with the menus within minutes.

Thank you.
Alexis Wilke

Anonymous’s picture

@AlexisWilke: Thanks for trying to tip an old fart on how to debug. ;p The @mdlueck bug was buried a little further than a few minutes though.

rick hood’s picture

Reporting that I had same issues as above and your latest dev ($Id: CHANGELOG.txt,v 1.1.4.172 2009/04/29 12:25:49 kiam Exp $) works for me. I uninstalled other version, cleaned out tables per #72 above (I only had entries in system table) and reinstalled. Don't forget to go to admin/user/settings and set user threshold to 1.

Anonymous’s picture

Don't forget to go to admin/user/settings and set user threshold to 1.

This will be the default in the future. You can also admin/user/permissions and set ``by-pass the authored nodes check'' permission. Either of these would work for @mdlueck.

mdlueck’s picture

@#219 earnie: So were the nodes in a "strange" state that usually nodes would not be in? They looked fine to us. (shrug)

dave reid’s picture

@mdlueck: Basically, there was an option in XML Sitemap Node where nodes would be rejected from the sitemap unless their authors had already written more than 100 nodes. For those of us with smaller sites or wanting to test out the module, none of our content is going to show sitemap. We are changing the default value of this setting so that all content should show up by default.

Anonymous’s picture

So were the nodes in a "strange" state that usually nodes would not be in?

No. There is a limit at admin/user/settings at the bottom of the page that has a "User posts threshold" title that defaults to 100. If the number of posts made by a user is less than that value it will not list in sitemap.xml. Changing this value to 1 will cause your nodes to list. In the future the default will be 1.

mdlueck’s picture

@#222 earnie: Thanks for the concise explanation.

Fixed! Now the site has nodes! :-)

Anonymous’s picture

Status: Active » Postponed (maintainer needs more info)

Are there still issues of the sitemap not being populated in the 6.x-1.x-dev code?

Anonymous’s picture

Status: Postponed (maintainer needs more info) » Fixed
sgriffin’s picture

Latest Dev version as of May 07 results in page not found + get priority errors on install.
Fixing typos still results in page not found.
admin/user/settings does not contain a threshold setting as well.

The cache IS being created however I had created in a public place..... and reset to defaults, finally got it going..
Perhaps the next dev version may work tomorrow

avpaderno’s picture

Status: Fixed » Active

And it's good it doesn't contain it: it has been removed to put it in a completely different module. :-)

sgriffin’s picture

Status: Active » Fixed
mdlueck’s picture

Status: Fixed » Active

Frazzle Razzle! I just updated my build to "6.x-1.0-beta3 2009-May-13" via the steps in #128 and I see a couple of issues:

1) Sitemap has no longer has nodes.

I went to /admin/content/node trying to flag nodes as needed to be added to the sitemap and would cron after that...

2) Gone are the Sitemap options @ /admin/content/node

So I chose "Publish" and all nodes, did that, ran cron, Nodes did not come back to the sitemap.

<><><><>

On a side topic, it is really silly to require a complete dump of the sitemap data when updating the module. Can there be a way around a COMPLETE uninstall?

avpaderno’s picture

Status: Active » Fixed

For the problems with the beta releases of the project there is already an issue open (see #458546: Cache files are not created). This is an old issue that has nothing to share with the beta3, or any other beta release.

mdlueck’s picture

Oh, by switching to the beta version, did I somehow end up with older code than what I had been trying with the -dev version?

I assumed since the date was newer, said "beta3" now, that surly everyting in the -dev version I had finally had success with would be there. No?

avpaderno’s picture

I simply mean that for the beta3 version you must follow #458546: Cache files are not created.

swduncan’s picture

Status: Fixed » Needs review

I'm finding that the xmlsitemap node (300+ rows), term (300+ rows) and user (1 row, for me) tables are populated, but the sitemap.xml file is empty. I've reviewed the suggestions above and still no sitemap. I'm currently using 6.x-1.x-dev.

The user threshold seems like it may be a cause, but I'm not finding any way to set it anywhere in my admin pages.

avpaderno’s picture

Status: Needs review » Fixed

If you would have checked the last comment I posted, which is actually the one before yours, you should have noticed I already gave an answer.

The user threshold feature has been removed from the code; therefore, you are not using the latest 6.x-1.x-dev. Normally, a project doesn't give support to who uses a 6.x-1.x-dev version dated 1 week ago, when there is a newer 6.x-1.x-dev version.

EDIT: See #456430: Remove unnecessary features from xmlsitemap_node, which is declared fixed on May 9th. This means you are using a version dated before that day, but not the latest version, which is dated May 16th.

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.

wwwoliondorcom’s picture

Hi,

I just installed XML sitemap 6.x-2.0-beta1 and Sitemap is not populated, and after reading 1 millions posts here i still wonder if there is a solution ?!

What can i do ?

Thanks for help.

cealtun’s picture

solution is very very easy. just go to /admin/content/node-type/ set Inclusion: included

than go to /admin/settings/xmlsitemap/settings

click rebuild links

its done! you have a full sitemap now!

it will solve everything.

MakeOnlineShop’s picture

Issue summary: View changes

Sorry i just had the same problem and I do not see INCLUSION at this page:

admin/content/node-type/

Maybe things have changed after so long time ?

Thank you.