Better url_alias behavior in crawler
Froggie - October 25, 2009 - 09:18
| Project: | Boost |
| Version: | 6.x-1.x-dev |
| Component: | Cron Crawler |
| Category: | feature request |
| Priority: | normal |
| Assigned: | Unassigned |
| Status: | closed |
Description
It would be nice to enable the Admin to pause the crawler temporarily during heavy traffic or high CPU/RAM usage and the ability to resume crawling when required.
Thanks!
#1
Added it to the roadmap.
#2
Thanks!
#3
I think the better option is have the url_alias grab be smarter. Check against the database to see if that entry exists in the boost cache table. If it's not in the table then add it to the url crawler. This would make that setting be smarter and would make the stop crawler setting not as destructive on large runs of the url_alias. Doing a bulk insert for the sql should make it run faster as well.
#4
Works how it should, just not how I envisioned the first time. This way is a lot faster then before. I need to check the finer points of the SQL before this gets committed.
#5
this patch actually works
#6
committed
#7
@Mikeytown: Thanks!
#8
Automatically closed -- issue fixed for 2 weeks with no activity.