Clearing caches

Is it necessary to clear the cache each time I change a TAC controlled term on a node, because this is what I'm having to do to propagate changes?

I have 2 terms , public and private in a vocabulary called 'access'.

Switching between the 2 terms has the expected behaviour, but I have to clear the caches to see the change every time, even when logged in?

Any help much appreciated.