Is there a way to add a close button for caption

Is there a way to add a close button for caption so users have the option to close it or not. We have the caption laid over the image at the top and it would be nice to provide an option to close the caption to see the full image.

If not, anyone has an pointer to where we can add a snippet to include a close button for caption. The caption will also show each time an image is clicked but has the option to close it when desired just when viewing a particular image.

Thanks,