when running in an UTF-8 environment there are currently problems handling special characters like german umlaut (äöü ß).
In the indexing process the text is now converted to UTF-8 prior to storing in DB if it is not yet in this format.

When searching for key words these are converted from UTF-8 to ISO-8859-1 (regardless of input character set --> code needs work!)

Regards
Schildi

CommentFileSizeAuthor
swish-UTF8-environment.patch1.19 KBschildi

Comments

populist’s picture

populist commented
Status: Active » Fixed

great contribution and german characters are now on the scene.

schildi’s picture

schildi commented

Could you test this in different environments (UTF-8, ISO-???) ?

Regards

P.S.
I had to disable function swish_update_index

// An experiement
function swish_update_index() {
return;

since it overwrites the results of the core search functionality.

populist’s picture

populist commented

swish_update_index() is a function that has been removed from the module since the 4.7 release I believe. I tested your patch against some items, but will try to get to more thorough testing later since we need to test against mac + linux + windows with ppt, pdf, doc, xls, rtf. i also only have english documents so will need to find some german and other UTF8 documents. if you have any of those or interest in testing the latest release in 5.x that would be really helpful def.

also there is a 6.x version in development!

schildi’s picture

schildi commented

I will check this!

Anonymous’s picture

Anonymous (not verified) commented
Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for two weeks with no activity.