We have a need to integrate with Drupal Queue for import processing. The use-case is importing hundreds of thousands (or millions) of submissions, which would exceed the memory and time limits imposed by PHP. I will attach a patch to integrate Drupal Queue in the 6.x-1.x-dev branch, but we expect to also add this to the 7.x-1.x-dev branch in the not-too-distant future.

Support from Acquia helps fund testing for Drupal Acquia logo

Comments

pdrake’s picture

pdrake’s picture

pdrake’s picture

And, apparently, using the -w flag removed some necessary whitespace changes. Trying again.

pdrake’s picture

Fixed a few log messages.

tomhung’s picture

let us know when you want to roll this patch into a release.

pdrake’s picture

Status: Active » Needs review

We've tested it successfully with a 100k line import, so I think it is good to go and ready for review.

pdrake’s picture

Spoke too soon. Found a bug in the line count as output during logging.

scottalan’s picture

Status: Needs review » Reviewed & tested by the community

We are running this in production.

travist’s picture

We ran into a problem with the import where it was not honoring the Select and Grid widgets options parameters. This patch adds those fixes to this patch.

travist’s picture

Status: Reviewed & tested by the community » Fixed

Merged in the latest 6.x-1.x branch.

travist’s picture

Status: Fixed » Patch (to be ported)

Need to port this to 7.x. pdrake will most likely take care of this.

gobinathm’s picture

Assigned: Unassigned » gobinathm
Issue summary: View changes
gobinathm’s picture

Status: Patch (to be ported) » Closed (outdated)

Working on D7 port

gobinathm’s picture

Version: 6.x-1.x-dev » 7.x-1.x-dev
Status: Closed (outdated) » Patch (to be ported)