Blog & Vocab Taxonomy Terms & Author for a Multi user Blog site - Is this possible with Views?

I have the default blog module, 3 users (A, B, C), each using publishing blog entries.
I have a taxonomy vocab called "Blog Categories" with terms (like iphone, ipod, mp3player).
A blog entry node shows a list of categories that it belongs to at the bottom of the page, they are clickable. You can click there terms and navigate the taxonomy terms for blogs.

One problem, user A write an entry A1 with term iphone, user B writes entry B1 with term iphone. Navigation the taxonomy terms used by blog entries shows entries regardless of the author.

If you click the term iphone, you see "both" A1 and B1..

How can we limit this taxonomy navigation to the author? I was thinking we could use Views to overwrite taxonomy term navigation when the term is from the vocab 'Blog Categories'

In other words, You are at the Main Blog page for User B... You click on one entry to view it... you then click on one of the terms.. and you are taken to a 'modified' taxonomy term page showing blog entries only from user B, not entries by user A.

I am stuck at the moment, any guidance is greatly appreciated..