I try to migrate a big site, and get: Fatal error: Allowed memory size of 2147483648 bytes exhausted (tried to allocate 31 bytes) in on my localhost. It means, 2GB memory is not enough.
The batch process does everything in one step. (table creation, get all values, insert all values) I think, it should be limited. e.g. one batch steps select/insert 100 data.

Comments

btmash’s picture

btmash commented

Very interesting. I hadn't thought of it. I **thought** I was moving X number of items at a time but I suppose something like this would be possible. Let me think about how to split this up some more.

btmash’s picture

btmash commented

Also...to get more info, did you do this via the web ui or via drush? If not via drush, would you be able to see if you still run into the issue?

btmash’s picture

btmash commented
Version: 7.x-1.x-dev » 7.x-2.x-dev

I'm making this a 2.x issue. It will be broken into 4 steps - create temp table, move data to temp table, create field (and field instances), and move data back to field. My understanding is that batches should run in order so I'm hoping the above is feasible. I'll be testing this out to make sure that is the case. But please let me know if that is *not* the case so I can figure out an alternative approach.

btmash’s picture

btmash commented
Status: Active » Needs review

This has now been committed to the 2.x branch of the module - I have done testing locally and it all seems to work (though ... I have taken whatever minimal views conversion I was doing so that would need to be done manually unless someone wants to provide patches). But please test it out and let me know if it works and I'll push out the 2.x release for folks to use.

btmash’s picture

btmash commented
Status: Needs review » Fixed

Had not heard back on this issue - I'm marking it as fixed. Please reopen or create a new issue if this comes up again.

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.