It would be nice to enable the Admin to pause the crawler temporarily during heavy traffic or high CPU/RAM usage and the ability to resume crawling when required.
Thanks!

CommentFileSizeAuthor
#5 boost-613926.1.patch9.17 KBmikeytown2
#4 boost-613926.patch8.97 KBmikeytown2

Comments

mikeytown2’s picture

mikeytown2 commented

Added it to the roadmap.

Froggie-2’s picture

Froggie-2 commented

Thanks!

mikeytown2’s picture

mikeytown2 commented
Title: Allow Admin to pause crawler during high CPU or RAM usage. » Better url_alias behavior in crawler

I think the better option is have the url_alias grab be smarter. Check against the database to see if that entry exists in the boost cache table. If it's not in the table then add it to the url crawler. This would make that setting be smarter and would make the stop crawler setting not as destructive on large runs of the url_alias. Doing a bulk insert for the sql should make it run faster as well.

mikeytown2’s picture

mikeytown2 commented
Status: Active » Needs review
StatusFileSize
new boost-613926.patch8.97 KB

Works how it should, just not how I envisioned the first time. This way is a lot faster then before. I need to check the finer points of the SQL before this gets committed.

mikeytown2’s picture

mikeytown2 commented
StatusFileSize
new boost-613926.1.patch9.17 KB

this patch actually works

mikeytown2’s picture

mikeytown2 commented
Status: Needs review » Fixed

committed

Froggie-2’s picture

Froggie-2 commented

@Mikeytown: Thanks!

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.