DataSync
DataSync for Drupal 6 is now in a usable state. It needs testing!
The DataSync module was written to schedule and execute jobs and import data in a much more scalable and reliable way than with cron.php and hook_cron. It allows you to schedule and run module-definable types of jobs on multiple servers in a centralized way. It uses database transactions in order to ensure that no data is corrupted while running multiple jobs at the same time. DataSync keeps track of the status of jobs and what phase they are in, so that if a job fails it can intelligently decide how to proceed. Almost all of DataSync's default behavior is overridable when you create your own job types.
DataSync has run over 180,000 jobs on our production servers already.
Some of what DataSync does:
- Runs scheduled jobs at any interval or as fast as possible
- Provides an API for you to define those jobs
- Handles job errors and timeouts gracefully
- Provides an API to make sure data synchronization causes no duplicates or invalid updates (Drupal 5 only)
- Allows you to run many jobs in parallel using database transactions (Drupal 6 only)
- Allows you to specify which jobs, which phases of jobs, and how many parallel processes for each phase of jobs you want to run on each server (Drupal 6 only)
I am looking for people who are interested in testing this module on their own setups. Please read the README.txt and INSTALL.txt and then contact me if you need help.
Originally contributed by Sony Music.
Releases
| Official releases | Date | Size | Links | Status | |
|---|---|---|---|---|---|
| 6.x-1.0-alpha1 | 2009-Apr-05 | 24.06 KB | Download · Release notes | Recommended for 6.x |  |
| 5.x-1.0 | 2008-Aug-26 | 18.89 KB | Download · Release notes | Recommended for 5.x | |
| Development snapshots | Date | Size | Links | Status | |
|---|---|---|---|---|---|
| 6.x-1.x-dev | 2009-May-13 | 32.26 KB | Download · Release notes | Development snapshot |  |
