Pipeline (simultaneous) record fetching
janusman - January 7, 2009 - 16:44
| Project: | Millennium Integration |
| Version: | 6.x-2.x-dev |
| Component: | Code |
| Category: | feature request |
| Priority: | normal |
| Assigned: | Unassigned |
| Status: | closed |
Jump to:
Description
Allow the admin to configure the module to open 1-5 (?) simultaneous requests for records to import, to make import faster.
Bonus points: different settings for different times/days (e.g. when library is closed) (or set up a separate URL to call from another cron process?)

#1
Added to DEV. In benchmarks the number of record fetched per minute went from about 17 to 85 per minute (500% increase). It remains to be determined how this would affect the III server; however this would probably depend on the implementation.
#2
Automatically closed -- issue fixed for 2 weeks with no activity.