Currently there doesn't seem to be any batch support in FeedsDataProcessor's process() function. Maybe that's because compared to node processing, it's much more lightweight and faster?

Anyway, I've got quite a large dataset and I was running into PHP timeout issues.

CommentFileSizeAuthor
#3 batch_data_processor-985852-3.patch2.75 KBnicolash
#1 feeds-985852_batch_data_process.patch2.03 KBnicolash

Comments

nicolash’s picture

nicolash commented
StatusFileSize
new feeds-985852_batch_data_process.patch2.03 KB

Patch

nicolash’s picture

nicolash commented
Status: Active » Needs review

Pls review....

nicolash’s picture

nicolash commented
StatusFileSize
new batch_data_processor-985852-3.patch2.75 KB

Against latest dev and increased batch size to 1000.

chingis’s picture

chingis commented

Do not work for me :( batch always start from the same position, i.e. from 0

techninja’s picture

techninja commented

Last patch at #3 works for me. Seems a bit silly that the processor wasn't made this way in the first place. Now if only we can find someone else to help test...

twistor’s picture

twistor commented
Assigned: nicolash » Unassigned
Issue summary: View changes
Status: Needs review » Closed (outdated)