Comment form no longer works when changing #value of submit button

This is truly odd. Changing the #value of the default comment form's submit button prevents the form from submitting correctly. I'm making the change via themeing like so:

$form['submit']['#value'] = t('Some value other then save');

Anyone else ever experience something like this?