Hi,
I was just wondering if it is possible to have the boost crawler prime up and cache the pages even when the site is in maintenance mode.
It would then be possible for the site administrator to put the site in maintenance mode (say during night time) and have all the new nodes/pages crawled and primed before delivering the new pages to search engines and other anonymous users.
This way one can make sure that the crawler visits the pages earlier than the search engine bots and thereby avoid getting penalized by search engines for high page load timings.

Comments

mikeytown2’s picture

mikeytown2 commented
Status: Active » Closed (works as designed)

Doing it while in maintenance mode would be very hard... another option would be to overwrite the files. So instead of flushing when it's expired, it queue's it up to be crawled. I have an idea on how this could work here #541658: Bypass cron expiration & load to be expired urls into crawler. Going to mark this "by design", since you can not generate pages anonymously when the site in in maintenance mode.

Froggie-2’s picture

Froggie-2 commented

Thanks Mikey! The alternate option sounds promising...

mikeytown2’s picture

mikeytown2 commented
Status: Closed (works as designed) » Closed (duplicate)

moving this to a dup of #541658: Bypass cron expiration & load to be expired urls into crawler