Boost and Public Download Count?

I have my site running with boost, it's amazing how fine boost works and makes my site much faster for the Public.
So i would like to have boost running for anonymous public, but will Public Download Count work with this module?
Or do i need to patch boost? are there others that use boost and this module together and how did they got it working?

My guess is that it won't work out of the box...