Use administration theme for content editing not working when deleting content

Although the checkbox for "Use administration theme for content editing" is checked, when deleting a content, the Admin theme is not retained and the user is redirected to the site front end theme.