Upload hangs on second try for same file

I uploaded the WYSIWYG, IMCE and IMCE WYSIWYG bridge on a new install of Drupal 7.2. The first time I uploaded an image, everything seemed to work fine. Then I decided I did not like the way it looked, so I deleted the image from the content, used Filezilla to delete the image and thumbnail from the files folder and tried to upload it again. When doing so, the original image uploads (without any confirmation) and the upload just hangs forever. I get this in the error log for each try:

PDOException: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'public://screenshot_2011_06_13.png' for key 2: INSERT INTO {file_managed} (uid, filename, uri, filemime, filesize, status, timestamp) VALUES (:db_insert_placeholder_0, :db_insert_placeholder_1, :db_insert_placeholder_2, :db_insert_placeholder_3, :db_insert_placeholder_4, :db_insert_placeholder_5, :db_insert_placeholder_6); Array ( [:db_insert_placeholder_0] => 1 [:db_insert_placeholder_1] => screenshot_2011_06_13.png [:db_insert_placeholder_2] => public://screenshot_2011_06_13.png [:db_insert_placeholder_3] => image/png [:db_insert_placeholder_4] => 26818 [:db_insert_placeholder_5] => 0 [:db_insert_placeholder_6] => 1307987244 ) in drupal_write_record() (line 6851 of /home/perssin8/public_html/mydrupaljourney.com/includes/common.inc).

•WYSIWYG (7.x-2.x-dev) using CKEditor (3.6.0.6902)
•IMCE (7.x-1.4)
•IMCE Wysiwyg API bridge (7.x-1.x-dev)