Hiding more than one table column results in duplicated entry

Here's a rundown of what I do to see this issue:

I have a view setup on a content type with many fields. Each field is mapped to a column in the table but on certain pages within the view certain fields aren't used. In trying to create a universal view, I decided to just hide the column if empty rather than editing each view.
When I enable the hide column if empty for a field, the second to last row will duplicate itself and overwrite the last entry.

Now I know the specific entry that is showing twice duplicate in code because when changing the sort on the columns it will still only duplicate the second to last value of the row. So each re-sort of the data still only shows the last 2 duplicated. All the values are queried correctly, since when using other layouts or non-hidden columns they all appear.

I'll see if I can dig in and work on a patch but any help would be great, I'm not that familiar with views core.