RIS batch import fails with drupal_write_record [#1213070]

This is all I get:

PDOException: in drupal_write_record() (line 6859 of /Users/rory/Sites/ppc_dev/includes/common.inc

It does this with batch import on or off. If I take the records individually and paste them into the RIS field, it works fine.

Attached is the file that I'm using that causes the error.

Comment	File	Size	Author
#1	transportation.txt	20.23 KB	rjerome
	transportation.txt	19.93 KB	rory_o

Comments

Comment #1

rjerome commented 8 July 2011 at 19:24

Status	File	Size
new	transportation.txt	20.23 KB

The problem is the file is not in UTF-8 format.

I've attached the same file, saved inn UTF-8 format and it works fine.

Comment #2

rory_o commented 8 July 2011 at 20:42

Status:

Active

» Closed (works as designed)

Oh snap, things got all messed up when going from one export translating to another to another to another... Biblio is solving all of this though, so thank you and thank you for the fast responses!

Comment #3

pheraph commented 30 November 2011 at 09:02

Version:	7.x-1.x-dev	» 7.x-1.0-rc3
Status:	Closed (works as designed)	» Needs review

Would it be possible to check if the import-file is utf8 and if not show a message that helps the user to import its data instead of showing a cryptic message? This would be a helpful addition. Besides that: Biblio is an awesome module, thanks for it!

Raphael

Comment #4

rjerome commented 30 November 2011 at 14:10

I'll look into that (and perhaps automatically converting the file).

Ron.

Comment #5

daggar commented 10 January 2012 at 23:43

#3 described my problem. PHP's utf8_encode function fixed it. Thanks Pheraph.

Comment #6

rjerome commented 11 January 2012 at 01:33

utf8_encode will work fine -- assuming the file/string is not already utf8 encoded AND it's ISO-8859-1, if it is already utf8 or some other character set, then you will likely end up with garbage. The trick is determining the format of the incoming data and appropriately converting it to utf8.

There are ways to do this at both the file level and the string level, but I just haven't had time to do it yet :(

Ron.