By rshojo on

I am currently experimenting with a move from wp to drupal - the move has created some issues with urls being referenced by google and other site maps.

I installed xml sitemap module in drupal and am noticing a lot of hits from one IP address 98.215.85.91 - now i can not tel lif thats a search engine crawler - but the urls are being referred to through a google.com search result. Lots of these referals are going to 404 although but I have redirected that to a search page.

Any clues - at the moment its almost one hit per second I think.

⋅ Categories: Drupal 6.x

Comments

vitalis’s picture

vitalis commented

If they are being refered as google, then they should be from google since they have multiple ip addresses all over the world.

rshojo’s picture

rshojo commented

yes - but its the same ip address, same referral from a google search result - just werid.
thinking of banning the ip for what good that will do me (if i start banning the google crawler (if it is the crawler)) ....

tried to lookup who the ip was , no luck - has to be google but cant understand why its one same search result being referrered repeatedly

trunk37’s picture

trunk37 commented

Looks like someone's cable modem.

nslookup 98.215.85.91
Non-authoritative answer:
91.85.215.98.in-addr.arpa name = c-98-215-85-91.hsd1.il.comcast.net.

Scott