Seriously cool module this!

I was wondering if there is an option to create multiple files during a single export, each containing a fixed set of rows so that its easy to open multiple small files individually rather than consume heavy memory and cpu to open a really large export.

I would like to export users of my site into a csv. There are close to a million records (still a fancy). But if I have that many records, filling it into one gigantic csv file may not be optimal I would think. Instead it would be cool to have an option in the plugin to create multiple files of X rows each. The naming convention for the files could also take that into effect and show %x as a token for each file produced.

What do you think?

Cheers.

Comments

klonos’s picture

klonos
he/him
Primary language English
Location 90% Melbourne, Australia - 10% Larissa, Greece
commented

...or you can simply create smaller views of the whole data set. In your case it could be a set per alphabet letter for users' last names' first letter. I don't know, but that would make the list say... 1mil-records divided by 26* letters = an average of ~38k records. That would be reasonable for an csv file wouldn't it?

Of course you can divide the data set by any other criteria like date of birth or class/year in the case of university students.

*English 26, German 30, Irish 20, Greek 24 etc.

greggadsdon’s picture

greggadsdon commented
Issue summary: View changes
Status: Active » Closed (won't fix)

As Drupal 6 nears the end of its life and support period, the 6.x version of Views Data Export will not be supported either. To that end, this issue has been closed, and will not be resolved in the 6.x branch of Views Data Export.

If this issue is still relevant to 7.x branch of Views Data Export, then please re-open and move to a relevant 7.x version.