Userpoint's Add Points additional settings aren't correctly detected

Not sure why, but my Userpoints form isn't correctly detected.

When clicking on Manage form display, the fieldsets are detected correctly, and the group is displayed for each element. But I just have a flat list with all elements, both on the form itself and on the manage fields page.

The only idea I have is that this might be because I already played around with exposing field groups and then deleted them, but I have no clue what I need to clear to fix it.

Also, managing the points settings form works, although the vertical tab summaries get lost and one of the fieldset titles as well..

Any ideas?