Hi,
this happened both on drupal 5 and 6, on two completely different hosts:

all my the pages from my site became "page not found", and the only way to solve this was to clear the cache.

It happens randomly, and is a serious problem. Any clue why this? And how to fix it ?

Comments

Robardi56’s picture

I had to disable the cache now because the problem keeps hapening !

Robardi56’s picture

Now even with cache disabled, most of my pages return 406.shtml page not found !!!
My site is getting dead, what is this ??? I don't have a 406.shtml anywhere !

Robardi56’s picture

Ok,
in case this happens to you,
here is what happens:

http://drupal.org/node/353830
http://drupal.org/node/110219

ModSecurity will load a 406 page not found error, when certain terms are in your drupal page.
Visitors might not trigger this error, but some spiders do. When this coincides with page re-caching, caching will cache the error page instead of real content which is what will your regular visitor see ! This can ruin you business and get into google instead of your real page.

Solution from my host: whitelisted my domain in phase2 of ModSecurity. Result is that nothing seems to trigger those absurd 406.html and thus cache doesn't risk to cache the error page again. This solves the problem .

Brakkar

Robardi56’s picture

More from my host: the pattern that triggered rejection from modsecurity was:

"compatible \\; MSIE"

Don't know where it is as it doesn't show up on the pages, but it might affect your drupal site with you not being aware.

brak'