Different custom date formats for different locales

Is there a way to specify a different custom date format for different locales?

I'd like to have the following:

en = 'd F y'
es = 'd de F de Y'

Thanks for your help.