When importing a large set of users from a CSV file (2000+) the batch process from /import/$feed_importer does not advance, rather it stays at "Initializing" and eventually times out.

The batch process does behave correctly for nodes.

CommentFileSizeAuthor
#7 feeds-816206-7.patch3.1 KBcaktux
#4 feeds-816206.patch8.53 KBelliotttf
#1 feeds-816206.patch3.41 KBelliotttf

Comments

elliotttf’s picture

elliotttf commented
StatusFileSize
new feeds-816206.patch3.41 KB

Here's a patch to make this work. It's basically a copy of the code from the FeedsNodeProcessor plugin.

elliotttf’s picture

elliotttf commented
Status: Active » Needs review
alex_b’s picture

alex_b commented
Version: 6.x-1.0-alpha15 » 6.x-1.x-dev
Status: Needs review » Needs work

This looks good.

Will need a test for importing 50+ users.

elliotttf’s picture

elliotttf commented
Status: Needs work » Needs review
StatusFileSize
new feeds-816206.patch8.53 KB

Same patch with the tests updated to successfully import 52 users, with one failure. The imports are tested across two pages to ensure that more than 50 users were imported; however, this does not confirm that every user was correctly imported. I can certainly make that change but it will add a lot of code to the test files.

alex_b’s picture

alex_b commented

however, this does not confirm that every user was correctly imported

That's fine.

Will review as soon as I get a chance. Other people's reviews welcome.

muhleder’s picture

muhleder commented

Looks to be working well here, imported 12k users yesterday onto a dev site. The site is set to launch in a month or so, so we'll hear by then if there are any problems for us, and we've got some more testing lined up before launch.

caktux’s picture

caktux commented
StatusFileSize
new feeds-816206-7.patch3.1 KB

I couldn't get the batch process to work even with these patches, went back and checked on FeedsNodeProcessor and came up with something that did the trick. Here's the patch but haven't updated the tests though...

summit’s picture

summit commented

Hi,
Would this patch also work on D7? Having the same situation..
greetings, Martijn

steve_adams’s picture

steve_adams commented

I'm having the same issue with Feeds while trying to import nodes from an RSS feed...any patch for that?

twistor’s picture

twistor commented
Issue summary: View changes
Status: Needs review » Closed (outdated)