Doesn't remove the input formats box

I removed access to a field, which worked fine, except that the 'Input formats' dropdown box was left behind.
My guess is that #access = false needs to be set on the parent element, or the tree needs to be navigated to locate the additional field.