Node import inconsistently imports data

sphopkins - September 1, 2009 - 17:35
Project:Node import
Version:6.x-1.0-rc4
Component:Code
Category:bug report
Priority:normal
Assigned:Unassigned
Status:active
Description

#1

sphopkins - September 1, 2009 - 17:38

It did not like the text I had included... here it is again (maybe a copy/paste of the debug info is a bad idea;-) ).

I have been trying to import a csv file that is causing problems. I have included the debug info below. I have tested it with a 1000 line csv file and a 2 line csv file. The 2 line csv file was one that had all of the information in the two rows (with a header row) but only one column was imported.

The import does not error out - zero errors occurred. In fact, when previewing the import the data appears properly formatted in the preview, and downloading the rows shows that node_import actually thinks that the data makes its way in.

Any ideas where to start looking to fix? Node_import is a centrepiece of what I am doing (building an electronic health record) so I am hoping to get this fixed.

AttachmentSize
node_import-node_referral-20.txt 56.07 KB

#2

sphopkins - September 1, 2009 - 18:48

Here is a structure of a csv that presents the problems:

"MRN","Reg Date","New Dis Date","Ref to Med","Ref to Rad","DxDate","Surg Only","Referring Hospital","Diagnosing Hospital"
9999999,25/09/08,25/09/08,,07/01/08,07/01/08,"N","Quebec All Acute Care Facilities","TOH - Civic Campus AM"
9999999,16/09/08,,16/09/08,07/01/07,07/11/07,"N","Quebec All Acute Care Facilities","TOH - Civic Campus AM"

Here is what node import lets me download:

"Errors","Object","MRN","Reg Date","New Dis Date","Ref to Med","Ref to Rad","DxDate","Surg Only","Referring Hospital","Diagnosing Hospital"
"","108503","9999999","25/09/08","25/09/08","","07/01/08","07/01/08","N","Quebec All Acute Care Facilities","TOH - Civic Campus AM"
"","108504","9999999","16/09/08","","16/09/08","07/01/07","07/11/07","N","Quebec All Acute Care Facilities","TOH - Civic Campus AM"

Node 108504 displays the following in Drupal (with the correct title 9999999):

Date Referred to Medical Oncology: September 16, 2008
Date Referred to Radiation Oncology: January 7, 2007
Date Registered at TOHCC: September 16, 2008

Node 108503 displays nothing (no content at all) in Drupal (with the correct title 9999999)

Any ideas ?

#3

linkovitch - October 27, 2009 - 19:58

I have a similar issue:

Import preview: looks perfect, all data maps correctly.

During import: no errors, all lines import properly.

Imported nodes: blank fields all over the place, only some fields have values.

Any ideas?

#4

sphopkins - October 28, 2009 - 12:57

Have not found out how to fix node_import. I "solved" it by ensuring that the fields were filled with information... not a real fix but it allowed the actual data to make its way in.

#5

linkovitch - October 28, 2009 - 14:47

How did you do this? Do you mean that you placed a "dummy" character into each empty cell of the CSV file?

I noticed that when I first ran the import, it only placed data into the CCK fields that were "required" fields. Does this have anything to do with it?

Please, node_import, why do you have to be such a tease? You show me these beautiful previews and then you give me blank, blank, blank.

#6

sphopkins - October 29, 2009 - 13:22

Basically, yes I added "dummy data" into the cells that were empty, and then had the "dummy data" deleted after import directly from the database.

I am unsure as to what the pattern of good vs bad import is - have noticed that dates cause problems for me as this is not fully "supported" by node_import.

 
 

Drupal is a registered trademark of Dries Buytaert.