Column width changing in table view with Fivestar display

I have created a Page View (table style) which contains several fields including "VotingAPI percent vote result (average)" using the "Fivestar Stars (clickable, with text)" option.

In the theme I am using (Garland) this causes the width of the column containing the field to change as the user hovers over the stars. This causes "page jitter" and in some situations this can make it near impossible to register a vote.

Is there a way to prevent this from happening?