Issue #1804228 by Jorrit: Fixed robots.txt recommendation wrong when language negotiation is domain based.