Views caching breaks pager with exposed filters

I have a page node, with an embedded view (viewfield) that has several exposed filters in a block. The first time the view is loaded, and cached, the pager's links seem to be cached with whatever filter settings happen to be set at the time. From then on, if I change one of the filters and then use the pager, the filters change back to their cached value.

For example, lets say I have an exposed "Color" filter, which can be Red, Blue, or Green. And lets say the filter is on Red the first time the view is loaded. Then, I change the filter to Green and the view changes. Then I click the pager to advance to the second page. Rather than show me the second page of "green" nodes, the filter will change back to Red and the view will go to the second page of "red" nodes. If I change the filter to Green, clear the cache, then change the filter to Red and advance the pager, the filter will now revert to Green.

This happens both with views built-in caching and with Views Content Cache. If I disable views caching all together, the pager works as expected.