When I have page caching enabled, I see that the theme used is changed, but since the cached page is retreived, I don't see any difference.