Hide AJAX confirmation after set period (or click outside of the box)

When the AJAX confirmation comes back to confirm that the flag has been applied, there doesn't appear to be a way to remove it. It would be good if it:
a) disappeared of its own accord after, say, 5 seconds, and
b) disappeared when a user next clicked something (either the confirmation itself or outside the confirmation).

Currently the confirmation can overlap with other page elements, so allowing it to disappear somehow is essential.