Currently boost.install always checks for the boost_stats.php line in robots.txt

However this is only relevant is the user actually copied that file to the drupal root folder.
Therefor a check if that file exists would make sense in my opinion.

Additionally I would like to suggest reading the robots.txt not from the current directory but from $_SERVER['DOCUMENT_ROOT'] . 'robots.txt'. As a robots.txt is only requested from the domain root, and never from a sub folder.

CommentFileSizeAuthor
#2 boost-653098.patch1.2 KBmikeytown2

Comments

mikeytown2’s picture

mikeytown2 commented

No, it is relevant because Boost has a menu hook called boost_stats.php. I do agree though that its kinda annoying, but I had one report of the stats block getting picked up by in google index.

Being smarter about where I get robots.txt is a good idea; I should probably download it via the url to do this check correctly.

mikeytown2’s picture

mikeytown2 commented
Status: Active » Needs review
StatusFileSize
new boost-653098.patch1.2 KB
helmo’s picture

helmo commented
Status: Needs review » Active

OK, I'll keep adding it to my robot.txt files.

Downloading from the site url might indeed be the safest option.

mikeytown2’s picture

mikeytown2 commented
Status: Active » Needs review
helmo’s picture

helmo commented

Comments #2 and #3 must have passed each other somehow since I don't remember seeing your patch or changing back the status.

I applied the patch on my dev server and it works like I would expect.

Thanks

mikeytown2’s picture

mikeytown2 commented
Status: Needs review » Fixed

committed

dbeall’s picture

dbeall commented

Just passin by with my big mouth..
"I do agree though that its kinda annoying, .... "(mikeytown2)
well, maybe.
However, Boost is such a great module and works better and better with each meticulous release, I would be more than willing to modify any file necessary to make the package work in an optimum fashion.
I just added Boost to a multi-site and it works like a charm. ! Life is good, Boost is great.
I had to do two quick little file modifications to make it work properly, htaccess and robots.txt
@mikeytown2, you just keep after every little detail, we wish other module maintainers would follow your fine example.
nice job, Thanks again

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.