Nowhere to specify taxonomy to be used in block

Where can I specify which taxonomy I want to use for the taxonomy block? I don't see it anywhere or a config page.