Calculations are made against the default display regardless of actual display

There's a line commented out of views_calc_table.inc that's supposed to switch displays before calculating totals and subtotals. If there's a reason to leave this out, there should be a note about it in the code; otherwise, here's a patch.