First, kudo for what looks like a very promising installation profile!
Here are a few thoughts and questions regarding MartPlug.
Like others, I did notice that installation was abnormally slow and wondered why. See fix. I'm curious. Could it be the extensive use of Features? It's just a wild guess. I have limited experience with installation profiles. That being said, every new project I work on starts with the production of an installation profile. And I try to use Features more & more even though they tend to make customization more difficult.
For example, I like to use Admin Menu in all my projects. Installing Admin Menu requires that the core Toolbar module be disabled (unless you really want 2 toolbars). But because Toolbar is explicitly listed as a dependency in the 'martplug_defaults' feature, it is not possible to disable it the usual way. Commenting out line 23 & 54 in martplug_defaults.info as well as lines 114 to 121 in martplug_defaults.features.user_permission.inc allows one to disable the core Toolbar module. Works nicely and, as far as I can tell, doesn't break anything.
Here's one BIG question. Do you have plans for a multilingual version of MartPlug ?