Maps won't load everytime

I get some weird random behavior when using this module with Views.

We allow users to tell their study location (user location) and home location (user profile node location). Then we use views and panels to show these two locations in the user profile page. We also have two different pages to show all users on a map, the other showing study locations and the other home locations. These pages don't use panels, only Gmap + Location and Views modules.

The problem is that randomly maps won't load. In a profile page this usually leads to empty blocks, so they are not visible at all (panels doesn't show empty blocks). In the all users pages using only Views, it's either blank white space instead of map, or the famous "Javascript is required to..." error message.

I have followed discussion at #266595: "Javascript is required to view this map", but there doesn't seem to be any real solution and everyone reports different scenarios. This issue I want to relate to using GMap with Views, because the default maps which GMap offer (map/node and map/user) seem to work on every page load.