Pipeline (simultaneous) record fetching

janusman - January 7, 2009 - 16:44
Project:Millennium Integration
Version:6.x-2.x-dev
Component:Code
Category:feature request
Priority:normal
Assigned:Unassigned
Status:closed
Description

Allow the admin to configure the module to open 1-5 (?) simultaneous requests for records to import, to make import faster.

Bonus points: different settings for different times/days (e.g. when library is closed) (or set up a separate URL to call from another cron process?)

#1

janusman - February 25, 2009 - 18:29
Status:active» fixed

Added to DEV. In benchmarks the number of record fetched per minute went from about 17 to 85 per minute (500% increase). It remains to be determined how this would affect the III server; however this would probably depend on the implementation.

#2

System Message - March 11, 2009 - 18:30
Status:fixed» closed

Automatically closed -- issue fixed for 2 weeks with no activity.

 
 

Drupal is a registered trademark of Dries Buytaert.