Access denied not redirecting

I'm building a new site. I've gone to the error reporting setting and added a custom page but it's not showing to anonymous users (who do not have access to view content). They still see access denied.

How do I let anonymous users see a custom error page for the whole site without giving them access?

Drupal 6.4