Maybe I am missing something here, but it seems to me that I can only batch on the initial running of the import for the feed.
and then after that it only imports one piece of data per cron.

That is good for small sites, but I need to crawl 6000 pages and to ask my client to have a content feed for 6000 minutes (cron can only be run once a minutes max) is there a way to batch say 10 pages per cron provided I don't have a php time out?

Do I need to patch this my self?

thanks

JOsh

Comments

PatchRanger’s picture

PatchRanger commented
Status: Active » Closed (works as designed)

Yes, you are right, this is how it works.
I had the same problem.
The solution is simple : just uncheck "Process in background" checkbox on admin/structure/feeds/[your_importer]/settings page. This makes it working with BatchAPI rather than cron in opposite case (see FeedsSource::startImport).

If you find that this solution is not enough in your case - feel free to reopen this issue.