I have a fairly huge number of nodes. About 225.000 plus.

The system tells me that I need to rebuild the sitemap but when I do it begins to add new pages instantly and not in the background. When it has imported around 50-60.000 nodes it stops.

If I click away from this page it tells me that I need to rebuild again.

Any ideas.

Comments

Anonymous’s picture

Anonymous (not verified) commented
Category: bug » support
Status: Active » Postponed (maintainer needs more info)

Execute cron more often and install Elysia Cron to help control your hook_cron implementations in modules. There is a total of 240 seconds for all hook_cron implementations to execute per cron execution. Elysia Cron will help give more time to xmlsitemap if you configure it correctly. It will take a good amount of time to read 225K plus of nodes.

As for why your environment doesn't allow the batched processes to complete beyond 50K is most likely a host time limit or perhaps your browser timed out. This isn't something we can control.

madeby’s picture

madeby commented

Here is the problem.

It says I have to rebuild it. When I do it goes into the "batched processes" page and stops after a number of nodes. I cannot rebuild and only let it do so in the cron progress. Which leaves my status report RED saying I have to rebuild.

Why can't I rebuild it using cron?

madeby’s picture

madeby commented

Now I tried to exclude the content type with many nodes so I could make a full sitemap. For some reason it seems to not register this. When I rebuild it still tries to import 225K nodes.

When I check settings it says that they are not included. Strange.

Any idea?

Anonymous’s picture

Anonymous (not verified) commented
Version: 7.x-2.0-beta3 » 7.x-2.x-dev

Same problem here with latest devx. Manual rebuild, the batch API stops around 40% of the progress bar. Just stops and halts, nothing happens after that. And it keeps saying that my vocabs and nodes are "Excluded" even though the node/vocab settings pages say "included".

madeby’s picture

madeby commented

ANY help here will be greatly appreciated. In the middle of a site move and need this mighty bad.

Anonymous’s picture

Anonymous (not verified) commented

If I let cron rebuild the sitemap, after 40% it starts to "time out" (my limit is 240s), just crashing the cron. With 100 items per cron-run.

j0rd’s picture

j0rd commented
Status: Postponed (maintainer needs more info) » Closed (duplicate)

I have a similar problem myself.

XMLSitemap is hardcoded to stop after 240 seconds, and disregards what your max_exection_time is set to.

Comment #9 here gives a solution
#502744: PHP timeout while executing xmlsitemap.pages.inc

Code was changed in this patch
http://drupalcode.org/project/xmlsitemap.git/commitdiff/195b668?hp=fc45a...