Early Bird Registration for DrupalCon Portland 2024 is open! Register by 23:59 PST on 31 March 2024, to get $100 off your ticket.
We have a need to integrate with Drupal Queue for import processing. The use-case is importing hundreds of thousands (or millions) of submissions, which would exceed the memory and time limits imposed by PHP. I will attach a patch to integrate Drupal Queue in the 6.x-1.x-dev branch, but we expect to also add this to the 7.x-1.x-dev branch in the not-too-distant future.
Comments
Comment #1
pdrake CreditAttribution: pdrake commentedComment #2
pdrake CreditAttribution: pdrake commentedMinor fix.
Comment #3
pdrake CreditAttribution: pdrake commentedAnd, apparently, using the -w flag removed some necessary whitespace changes. Trying again.
Comment #4
pdrake CreditAttribution: pdrake commentedFixed a few log messages.
Comment #5
tomhung CreditAttribution: tomhung commentedlet us know when you want to roll this patch into a release.
Comment #6
pdrake CreditAttribution: pdrake commentedWe've tested it successfully with a 100k line import, so I think it is good to go and ready for review.
Comment #7
pdrake CreditAttribution: pdrake commentedSpoke too soon. Found a bug in the line count as output during logging.
Comment #8
scottalan CreditAttribution: scottalan commentedWe are running this in production.
Comment #9
travist CreditAttribution: travist commentedWe ran into a problem with the import where it was not honoring the Select and Grid widgets options parameters. This patch adds those fixes to this patch.
Comment #10
travist CreditAttribution: travist commentedMerged in the latest 6.x-1.x branch.
Comment #11
travist CreditAttribution: travist commentedNeed to port this to 7.x. pdrake will most likely take care of this.
Comment #12
gobinathmComment #13
gobinathmWorking on D7 port
Comment #14
gobinathm