Boost crawler did not get a 200 response.
404 returned. Crawler URL (http://cooperpointjournal.com/boost-crawler?nocache=1&key=ff7932f242d709...) is not available

CommentFileSizeAuthor
#12 boost-567748.patch656 bytesmikeytown2

Comments

mikeytown2’s picture

Try flushing your caches. At the bottom of the performance page there is a "Clear cached data" button, try that and let me know if it works. Issue might have to do with the menu_router cache (cache_menu table).

mikeytown2’s picture

Note to self, don't include the cron key in the error report output.

mikeytown2’s picture

Status: Active » Postponed (maintainer needs more info)

fixed so error doesn't output crawler key. Postponed until I hear back from seth.vincent in regards to the cache flush.

seth.vincent’s picture

thanks for your response!

flushing caches did not work on two different sites. what other information could i offer that would be helpful?

mikeytown2’s picture

Try the latest dev, a bunch of errors where identified and fixed. Once #567808: Write update function to change .js to .json goes in, RC5 should be out the door, and hopefully people won't be getting these errors. Let me know what # it gave (if not 404) you just in case it's something else.

dbeall’s picture

Version: 6.x-1.0-rc4 » 6.x-1.0

Was going to run the newest dev yesterday, but never got to it.. work got in the way.
Version Updated from allow_url_fopen to current stable, could this be the reason?

All seems to normal, cleared cache, regenerate as expected.

error:
Boost crawler did not get a 200 response.
0 returned. Crawler URL (http://www.davebeall.com/boost-crawler) is not available, please report this issue

steps:
Upload 6.x-1.0, ran update.php, no database changes, run cron, received error on status page.

DbLog looks ok:
cron Sep 13 2009 - 17:32 Cron run completed. dave
boost Sep 13 2009 - 17:31 Crawler Start ... dave
update Sep 13 2009 - 17:25 Attempted to fetch information about all available ... dave view
boost Sep 13 2009 - 17:25 Flushed ALL files from static page cache. dave

After looking at DbLog, then return to status page minutes later, error is gone:
Boost Boost Installed correctly, should be working if properly configured.

maybe nothing...

EDIT: URL davebeall.com

mikeytown2’s picture

must have been some random error since a 0 for a http status code is not standard.
http://en.wikipedia.org/wiki/List_of_HTTP_status_codes

seth.vincent’s picture

I'm testing the latest version and still getting the same error.

When I run cron I get this:
Boost: Crawler is already running. Attempt to start crawler failed.

mikeytown2’s picture

@seth.vincent
Testing the url at the top, I get a 200 response. Go to
admin/settings/performance/boost
Boost crawler
and under live info, press the "stop crawler" button.

seth.vincent’s picture

I disabled the cron crawler and now my status report says that Boost should be working properly.

Cron is currently set to run every minute, which seems unnecessary. Maybe cron crawler kept trying to run and kept running into itself? Like the old snake game?

Is there a way to tell about how long cron crawler takes to finish?

mikeytown2’s picture

Run this; will let you know how long it will take the crawler to finish, if its crawling every page.

$time = db_result(db_query("SELECT SUM(timer_average) FROM {boost_cache}"))/1000;
echo format_interval($time);
mikeytown2’s picture

Status: Postponed (maintainer needs more info) » Needs review
StatusFileSize
new656 bytes

for #8
Crawler has a variable timeout, that guesses when a thread should be considered dead, and needs to be restarted. I forgot to change this to seconds instead of milliseconds.

mikeytown2’s picture

Title: Boost crawler did not get a 200 response. » Thread is dead logic timing out
Status: Needs review » Fixed

committed

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.