I have noticed that when I install a new module, it runs a Clear cache and boost cache clearing functions.

This in turns blocks the system for a little while and thus any other request coming to the server often get blocked.

My server loadavg will generally go from the usual 0.8 or less to a huge 3.5 or more.

I was thinking that since deleting over 1,000 files on a hard drive takes a long time, maybe that this task could be offloaded to a separate process? I'm not 100% sure that this is the problem, but when I install another file, the server does not go as bad (loadavg will go to 1.8 to 2.0 instead of 3.5).

Thank you.
Alexis Wilke

Comments

mikeytown2’s picture

mikeytown2 commented

Open to ideas; correctly identifying the bottle neck is the first step.

AlexisWilke’s picture

AlexisWilke commented

Today, I tried to delete all the files by hand (a little over 3,000) before running a new install. It still went to a little over 3.0 on the loadavg. In other words, it was not much different.

I'm thinking that the core cache clearing and installation scripts are more likely the cause... (especially because they read all the .info files and my install has a large number of those!)

If someone has an idea on how I could look into where the time is being spent, I'd appreciate... (PHP profiling?)

Thank you.
Alexis Wilke

AlexisWilke’s picture

AlexisWilke commented

Hmmmm... Well! Maybe not. 8-(

I have a multi-site installation and have now a little over 11,000 static pages saved after a few days. And it looks like the problem I have is when all those files get deleted. The problem here is that it deletes files from other sites!?!

It seems to me that this button at the very bottom is "not really compatible" to a multi-site installation.

What's your take?

Thank you.
Alexis

P.S. It does not break the output since new pages will be generated, but all of a sudden I have my 20+ sites all regenerating pages all at the same time!

mikeytown2’s picture

mikeytown2 commented
Title: loadavg climbing fast on Clear cache » loadavg climbing fast on Clear cache - clear cache kills all in multisite install
Priority: Normal » Major

That is most likely what's going on...