If the taxonomy 'vocabularies' form item is emptied, it should be removed completely

In beta6 things were changed so that only the terms managed by content_taxonomy were removed from the standard 'vocabularies' fieldset. If all terms are managed, we end up with an empty fieldset right now, so why not unset it if there are no more terms inside? Something like this at the end of content_taxonomy_form_alter?...

    $empty = TRUE;
    foreach ($form['taxonomy'] as $key => &$value) {
      if (is_array($value) && !empty($value)) {
        $empty = FALSE;
      }
    }
    if($empty) unset($form['taxonomy']);