Our site has 100 000+ nodes and one node has approxx 150+ fields (Field collection). Nodes also have relations.
Nodes were created via Feeds module using multiple XML files (each file 100M+) without any problems. It took about 1,5 hour/file.

PROBLEM: Updating the content of existing nodes using the same XML via Feeds is awfully slow. 100Mb XML file ran 1 week and was only 20% complete.
We are using Feeds with the replace option. We also tried the update option but that has other issues (data was not updated correctly).

Have anyone of you ever run into similar problems? Any alternative methods / modules / tips?

Comments

asghar’s picture

Hi zeeland

Recently I have done same job and you shop import the xml data in most reasonable format in db table e.g store raw data in serialiaze form and then read that data and imported records into drupal.

chrislabeard’s picture

Did you ever figure this out? I'm facing a similar issue.

Ideas by Nature
www.ideasbynature.com

TheodorosPloumis’s picture

Please check this answer on the question "How can I speed up import process?".

https://www.drupal.org/node/1551246#comment-7746079

It works!

TheodorosPloumis.com - Drupal developer @ eworx.gr.