I have a site with pretty much the same structure as popurls.com - but with more feeds on one page (50). Approx 20 feeds are to be updated every 15 minutes and the rest every 3 hours. The feeds are mostly text feeds that are not updated terribly often (but I don't want the site to be updated - thus so many feeds with 15 mins intervalls between updates). I only download 3 feeds at a time. My site is hosted on siteground.com.

My problem is that every time cron runs the aggregation job, users cannot access the site. Even if it is only for a short period of time it occurs quite often. What should I do to get around this (no, I don't want to cut down on updates or the number of feeds on the same page)?

Could I solve the problem by asking siteground to open up another hosted account for me and somehow run the aggregation from there, thus not affecting server resources allocated to the site. If that it is the way, would such a setup be difficult to arrange? Or should I go about solving my problem some other way?

I'd really appreciate help on this one. :)

Petter

Comments

Ashraf Amayreh’s picture

Ashraf Amayreh commented
Status: Active » Postponed (maintainer needs more info)

I'd say a site like this needs a dedicated or a VPS server. You'll need to get someone to do an analysis of the problem. But it just can't be answered with this much info provided.

Ashraf Amayreh’s picture

Ashraf Amayreh commented

hmm... you could try out the cooldown option in the aggregation settings, although I have no idea if that's going to help or not.

Another option is for me to consider implementing an item cooldown which is a delay between item aggregation. Might slow down aggregation considerably but may also solve the overload... Won't do that unless I think it'll really be helpful though.

PWG’s picture

PWG commented
Status: Postponed (maintainer needs more info) » Closed (fixed)

Thanks, mistknight. Yes, that's the road I chose.

Petter