Adding the ability to toggle off breadcrumbs in Toggle display

I started building my first Drupal website using Stark. (Reasons to choose this minimalist theme are beyond the scope of this issue :).) I immediately noticed the link to the front page in the top left corner of every other page. After asking a question here on drupal.org (http://drupal.org/node/1506098), I finally realized this was a breadcrumb, and removed it with an extra module.
Now, however, I see it as an issue. Look: a user installs Drupal, makes some content using a built-in theme, and something is added to that user's content. Every other item of that kind (like logo, as well as "Powered by Drupal" block, etc.) can be toggled on or off from within Drupal. Breadcrumbs (which the user did not expect to be added) cannot, if the theme has no template. So the user would be forced to (a) change the theme (or create a new theme, based on Stark but having a template with div's etc.), or (b) play with the core to prevent Drupal from producing breadcrumbs , or (c) download and use an additional module (like I have done).
I may be wrong (all in all, I am a Drupal newbie :)), but in my view there is something wrong in this situation.