By kiev1.org on

Hello.
There is a problem:
Some search servers or simply users open to a site many http queries hanging up hosting, apache, mysql, etc...
What module it is possible to limit quantity of inquiries up to one for 10 seconds on one user?
The user it is possible to trace on ID sessions.

Help to find or write.

⋅ Categories: Drupal 4.7.x, Drupal 5.x

Comments

yelvington’s picture

yelvington commented

You could take a look at some of the Apache modules that can throttle access by IP address, et cetera.

Other things to consider:

Take a close look at your access and error logs. Are you serving large numbers of 404s? Find out why. You may need to reconfigure Apache so that Drupal is not invoked as a 404 error handler. With Drupal handling 404s, a few missing jpegs or bad image paths can bring your server to its knees when it is hit by bots and spiders.

Make sure your access logs record the HTTP referer, and look through the logs for referer strings containing references to casino, poker, and the usual assortment of drugs. If you see that, reconfigure Apache to block any requests containing those strings. See Wikipedia's referer spam page for details.

Watch your server's load using a utility such as "top" and install the Drupal devel module. These tools could help you discover whether your bottleneck is httpd or mysql. You might have a corrupted database table, or a dropped index, et cetera. If httpd turns out to be the problem, install APC.

Configure Drupal to throttle some of your sidebar blocks under high load conditions.

Buy more servers. :-)

dkruglyak’s picture

dkruglyak commented

Here is a good way you can reproduce the problem:

1) Install Firefox Session Manager extension: https://addons.mozilla.org/firefox/2324/

2) Create a session with many open tabs (5-10) and pick several pages that take many queries to load (e.g. /admin/logs/referrers) at the same time.

3) Save the session, close Firefox, then open it and pick that session to load

4) All queries will hit Drupal simultaneously and often lock up MySQL

5) You can view which tables lock up with MySQL Administrator (e.g. access_log)

To go deeper, my knowledge of the core is lacking....