Accepting Posts via email from anonymous users

I am trying to allow anonymous users sending an email to automatically post to my blog.
Reading on other issues that this is possible with mailhandler, if proper permissions are set.

However when i try to get this to work (giving anonymous users full create and edit permissions), it does not work.

Creating posts from authenticated/registered users works fine.

What do i have to do (setup) , in order to get anonymous users post to my blog via email?

Thanks for any help in advance.