Or rather, why isn't it possible to assign a custom role permission to administrate the standard contact form in Drupal? Without abandoning using it and having to hack something together with Webforms?

The only option I can see in permissions is to allow access to the contact form.