After pushing the crawlers stop-button, waiting about 10 minutes, then disabling the crawler and again waiting the crawler does not stop. An excerpt of the log file shows

172.16.0.3 - - [28/Sep/2011:10:15:54 +0200] "GET /coupons HTTP/1.0" 200 8089 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:15:57 +0200] "GET /en/node/25915 HTTP/1.0" 200 20972 "-" "Drupal (+http://drupal.org/)" <DOMAIN> 
172.16.0.3 - - [28/Sep/2011:10:15:59 +0200] "GET /en/biblio/author/22 HTTP/1.0" 200 17263 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:15:59 +0200] "GET /de/biblio/author/1370 HTTP/1.0" 200 36887 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:16:00 +0200] "GET /de/biblio/author/747?sort=type&order=asc HTTP/1.0" 200 41360 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:15:12 +0200] "POST /boost-crawler?nocache=1&key=1ad0e90b8009e13a452e7e8b11bd32bf&thread=1&total=0&expire=0 HTTP/1.0" 200 441 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:15:12 +0200] "POST /boost-crawler?nocache=1&key=1ad0e90b8009e13a452e7e8b11bd32bf&thread=1&total=0&expire=0 HTTP/1.0" 200 441 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:15:13 +0200] "POST /boost-crawler?nocache=1&key=1ad0e90b8009e13a452e7e8b11bd32bf&thread=1&total=0&expire=0 HTTP/1.0" 200 441 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:15:13 +0200] "POST /boost-crawler?nocache=1&key=1ad0e90b8009e13a452e7e8b11bd32bf&thread=1&total=0&expire=0 HTTP/1.0" 200 441 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:15:14 +0200] "POST /boost-crawler?nocache=1&key=1ad0e90b8009e13a452e7e8b11bd32bf&thread=1&total=0&expire=0 HTTP/1.0" 200 441 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:16:14 +0200] "GET /files HTTP/1.0" 301 539 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:16:14 +0200] "GET /files/ HTTP/1.0" 404 20500 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:16:23 +0200] "GET /search/luceneapi_node/bebauungsplan%20k%C3%BCrten%2C%20enkeln HTTP/1.0" 200 410648 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:16:22 +0200] "GET /en/biblio/author/2297?sort=year&order=desc HTTP/1.0" 200 18977 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:16:22 +0200] "GET /en/node/5257 HTTP/1.0" 200 19793 "-" "Drupal (+http://drupal.org/)" <DOMAIN>
172.16.0.3 - - [28/Sep/2011:10:16:24 +0200] "GET /en/node/26829 HTTP/1.0" 200 21227 "-" "Drupal (+http://drupal.org/)" <DOMAIN>

In the listing above the actual domain name is exchanged by "DOMAIN"

CommentFileSizeAuthor
#1 crawler1.png45.13 KBschildi

Comments

schildi’s picture

schildi commented
StatusFileSize
new crawler1.png45.13 KB

additional information:
After pressing the stop button a second time I see a couple of "Crawler - Thread 1 stopped" messages in the log (see attached image).

Now there are no more crawler messages coming up.

bgm’s picture

bgm commented
Category: bug » support
Priority: Critical » Normal
Status: Active » Postponed (maintainer needs more info)

That button won't interrupt ongoing threads, it will only set the crawler to off, and the number of threads to zero. In other words, it does not do much.

It's not clear from the log:
* at what time the button was pressed, and whether new threads were launched after it was pressed
* did you mean 10 minutes, or 10 seconds?

schildi’s picture

schildi commented

* sorry, I can't examine now if there were threads launched after pressing the button
* yes, I mean 10 minutes