Clean up duplicate files.filepaths

tag

For future reference, the following tables reference fids. A lot of the duplicates may be orphans.

comment_upload.fid
comment_upload.legacy_fid
content_field_images.field_images_fid
content_type_casestudy.field_mainimage_fid
content_type_organization.field_logo_fid
content_field_project_images.field_project_images_fid
image.fid
project_release_file.fid
project_releases.fid
project_releases_backup.fid
upload.fid

tag

Attached are 43836 files rows that I'm deleting. They have duplicate names with other rows and are not referenced from the fields listed in #2.

That took care of all duplicated files in files/images/*. Only 85 duplicated filenames left. Most have 2, or sometimes 3-4 rows, but 'files/issues/' has 93.

The 15 with filepath like 'files/releases/%' all had bad release nodes creating the duplicates. Things like having one each for CVS and Git tags. I deleted the bad ones and we are down to 70 duplicated filepaths.

I removed the duplicated files which had the wrong size, we just don't seem to have those files, so they are essentially bad uploads. In many cases, these were already re-uploaded by people. All the issues were quite old, I even saw one of mine from 2004.

That gets us down to 31. I'll try going by timestamps next. filepath = 'files/issues/' has 91 rows.

Done!