Is there a way to make the glossary(alpabetical pager) not narrow down the results from the exposed filter?

Thanks