By Allthegearnoidea on
Hi
I'm seeing something weird in my Access Logs.
Googlebot keeps trying to access pages that I thought were deleted (somewhere there must be a trail that leads Googlebot to think that page URL still exists). It also seems to make things up to try and index for instance I see it tried to access www.myexamplesite.co.uk/fdfdkll.html I have no clue what this URL is or why it would think it could go there.
Anyone any thoughts on these issues?
Comments
me too
I'm also getting hits on fdfdkll.html from googlebot accross several domains where the file has never existed - wierd. (Best guess is they are looking at error responses?)
Strange
At least I'm not the only one! :-)
Support for families with children with medical conditions: http://www.parentsown.co.uk
Buy allergen free foods from http://www.freefromforkids.co.uk
Check if your site generates pages...
I think Googlebot is checking if your site generates automaticly content. They give a keyword and check if you generate a page with this keyword.
404 research
I think it's part of Google research in how the site handles 404 errors. Google on "fdfdkll.html" provides you with some insight.
Also see the recent blog articles by Google on the subject of 404 errors, like:
http://googlewebmastercentral.blogspot.com/2008/08/make-your-404-pages-m...
Thanks
Thank you for shedding light on this.
Is it something reasonably new? When i initially posted this I did the obligatory Google search and it came up with nothing.
Anyway, it's good to know the reason for it and at least I don't have to worry about it.
Support for families with children with medical conditions: http://www.parentsown.co.uk
Buy allergen free foods from http://www.freefromforkids.co.uk
Recent Google 404 research
Yeah, this is a fairly new field, AFAIK.