Layers of various formats dont show

I have made several overlay layers with tilemill and they are hosted on the mapbox server. The layers work perfect as long as the baselayer is also a mapbox layer. However when using any other baselayer like google maps or any non mapbox baselayer then by default the overlay stops working and just show the pink background. Meanwhile any KML layer I have created would work on either.