I took a look at the source code of Field Group and there is lots of stuff which we should fix. Take a look at this.
Just tracking work, I guess that I should create a new sandbox for that to re-test it.
Everything is in my sandbox now :)
Drupal is a registered trademark of Dries Buytaert.