Found this neat php class that seems to have an intelligently written daemon layer : http://trac.plutonia.nl/projects/system_daemon

Should be able to write a simple wrapper for hosting dispatch pretty simply to allow it to run at higher frequency, and adjust the parameters as to how frequently things should happen.

Dispatch already makes sure to only create new processes once the previous ones are finished, and how frequently to create them,
so this should be pretty easy to implement.

Comments

adrian’s picture

Started work on this using node.js : http://github.com/Vertice/node_aegir

Once you have installed ndistro it's ridiculously simple.

ndistro is kind of like drush_make for node apps, and will fetch node.js itself and the libs we make use of.
the script i wrote calls 'drush @hostmaster status' to retrieve the db credentials, then makes a new connection and spins off
new tasks as they become relevant.

it is _blistering_ fast, but could need some better error handling (ie: if db connection dies, re-connect). We might also need
to tune the javascript refresh time because it takes FAR longer for the page to refresh than it does for the task to be dispatched.

adrian’s picture

Status: Active » Needs work
anarcat’s picture

Version: 5.x-0.1-beta2 » 6.x-0.4-alpha3

darthsteven has done some work in this area too here:

https://drupal.org/sandbox/darthsteven/1107004

crea’s picture

Subscribing

helmo’s picture

subscribe, the sandbox project from darthsteven seems to work nicely.

helmo’s picture

Status: Needs work » Needs review

The sandbox has been promoted to a full project and with anarcat there as a co-maintainer this looks in good shape.

http://drupal.org/project/hosting_queue_runner

Any plans to add the to the default documentation? Otherwise this issue could be considered fixed.

anarcat’s picture

Status: Needs review » Needs work

This will not be fixed until this is in core, which could be done in the 2.x branch.

steven jones’s picture

Status: Needs work » Closed (duplicate)

This issue is now a duplicate of #1189556: Pull the queue runner into Aegir 2