Very slow page after enabling image block with slideshow

Issue Summary

I am using the views_slideshow in a block right now, which cycles through all my nodes of type image (500 images at the moment).
This is working great, although my users say the page became very slow after enabling this block.

After using some website stress testing tools, it seems that on every pageload, all of my images which conform to the view selection, gets downloaded to the client. So you can imagine why the page is slow (500x 10kb means 5mb to download on every page view).

Someone experiencing the same problem?
It's a great module, but you can't use it this way, without having to load all the imagesand wasting a lot of bandwidth.