add cron creation option to prevent timeouts on long lists
mudanoman - October 8, 2006 - 18:22
| Project: | URL list |
| Version: | HEAD |
| Component: | Code |
| Category: | task |
| Priority: | normal |
| Assigned: | Unassigned |
| Status: | won't fix |
Jump to:
Description
Have problems getting it to load...timesout. Could be an issue because of larger site?

#1
It probably is because of a large site. Perhaps actually generating a urllist.txt file on the filesystem in a cron hook will be better than dynamic on every page load? I'm wide open to alternate ideas since many cron configs wget to apache and would probably timeout there anyway, too.
#2
I took a look at what gsitemap.module does as a workaround and committed the same thing to urllist.module in CVS HEAD version 1.11. Please review and close this if it's resolved.
#3
#4
XML Sitemap fixes this problem by splitting up the URL list over many pages. This module is deprecated.