Make cancel button optional

Let admin chose, whether the cancel button should be added in the settings