Cannot remove an uploaded file from a node?

How does an administrator remove an uploaded file from a node?

For example, say a user uploads a file with inappropriate content. We don't want to delete the content node itself since it contains valid data, just remove the reference to the invalid file?

Editing the node allows us to change the description and order of the file, add a new file, but doesn't give any option for removing a file.