imports done at once or incrementally [#152441]

How are imports done? In a loop, incrementally or all at once?

Looking at the api it seems that it is done all at once, which means that all the data needs to fit in memory. This would be a total no-go for large tables.

Comments

Comment #1

Sunil Mohan commented 18 June 2007 at 05:39

I saw the code and imports are done at once. Not only does it all have to fit into memory but also its storing the data in memory in an inefficient way, IMHO.

There is an old bug that discussed the issue here: http://drupal.org/node/81037