The Comment Mail module allows an email to be sent to the site administrator(s) when new comments are posted. A link in the email allows quick approval, editing, deletion, and/or banning of the poster's IP address.
Drupal 6: This is being worked on in the issue queue currently. The patch in the issue is against the HEAD version of code. It mostly works except the approval and deleteban links aren't correct yet.