Limit Fields: Taxonomy Term (or ID) by Vocabulary

This is a node view display. I'm including Fields: Taxonomy Term. Multiple taxonomy vocabularies are on each node.

How do I limit Fields:Taxonomy Term (or ID) by vocabulary?

What I've tried:
1. Relationship with Terms on Node -- kills my query time to exceeding CPU on our server (VPS).
2. Filter by Vocabulary - returns no results
3. Taxonomy: Terms All - if a node has multiple terms selected within the vocabulary, they are grouped together. I need them as independent terms.

Needed Results:
Taxonomy Vocab Color - Term Blue
node title
node title
Taxonomy Vocab Color - Term Red
node title
node title
...Terms from Vocabulary Size and Fit not to be included in the list...