Errors with punctuation in node body and titles

I believe this might have started to happen after upgrading from 4.69 to 4.74 but I am not 100% sure.

Did you do this update recently? Did you run /update.php after replacing the files?

I checked out the database tables and the encoding for the node_revisions table is the same for both 4.69 and 4.74

What encoding is that and what is the collation?

Also,
- Did your MySQL version change lately (form 4.0 or earlier to 4.1 or newer)?
- Did you do any backup/restore lately?

I am having the same problem - on my upgrade test runs.

No change in MySQL version (4.1 before and after), but yes I did backup / restore. Backed up original DB, created a test DB using restore and got this problem after running update on it.

Any suggestions ???

I have had this problem as well, after my 4.6 -> 4.7 conversion. It looks to me like the conversion from unicode stored in latin happened twice. After reading this article: http://www.oreillynet.com/onlamp/blog/2006/01/turning_mysql_data_in_lati... I decided to write an after-the-fact converter. This is complicated by the fact that either my version of php or my editor can't handle the charcters in question. But my browser and phpmyadmin can, so I ran SELECT HEX('–') on all the bad triples, to get the hex values. I put this is a helper module, but it could be run from a page. Also, I just stripped out the unicode, but it shouldn't be too hard to turn this into a bad unicode to good unicode converter.

function bad_unicode_triples_scan() {
  $bad_uni_triples_map = array ( 
    'C3A2E282ACE2809C' => "\'", // ` -> '
    'C3A2E282ACE2809D' => "\'", // ' -> '
    'C3A2E282ACE284A2' => "\'", // ’ -> '
    'C3A2E282ACCB9C' => "\'",   // ‘ -> '
    'C3A2E282ACC593' => "\"",   // “ -> "
    'C3A2E282ACC29D' => "\"",   // ” -> "
    'C382C2BB' => '>>',         // » -> >>
    'C3A2E282ACC2A6' => '...',   // … -> ...
    'C3A2E282ACC2A2' => '*',   // • -> *
  );

  $tables_map = array ();
  $tables_map[] = array( 'table' => 'node', 'field' => 'title' ); 
  $tables_map[] = array( 'table' => 'node_revisions', 'field' => 'title' ); 
  $tables_map[] = array( 'table' => 'node_revisions', 'field' => 'body' ); 
  $tables_map[] = array( 'table' => 'node_revisions', 'field' => 'teaser' ); 
  $tables_map[] = array( 'table' => 'flexinode_data', 'field' => 'textual_data' ); 

  foreach( $bad_uni_triples_map as $badhex => $good ) {
    foreach( $tables_map as $map ) {
      $table = $map['table'];
      $field = $map['field'];
      $sql = "UPDATE {$table} SET $field=REPLACE($field, UNHEX('$badhex'), '$good') WHERE $field REGEXP UNHEX('$badhex')";
//      drupal_set_message( $sql );
      db_query( $sql );
    }     
  }
  return "Done with scan";
}