Sorting a view with multiple taxonomy term relationships returns duplicate nodes

I display my search results as a view containing a list of nodes and multiple taxonomy terms that use a relationship on a content_taxonomy field. When I first display the view, everything is fine.

But when I click on any of the taxonomy term colums to sort the view (with Ajax turned off), I get many duplicates. I think it returns the product of all terms in the search result set. Unfortunately I cannot enable 'distinct' in my view because of http://drupal.org/node/376382.