Images incorrectly allowed with Taxonomy Access module

I have been using taxonomy access module in conjunction with the image publishing module, and I have set all images in image galleries to be denied viewing access by anonymous users. However, images uploaded with image_pub were viewable. The reason for this appears to be that the way image_pub was storing the images was first to submit the image, then to add the taxonomy information. At the first stage, the image was cached without a taxonomy being assigned, and this allowed the image to be viewable.