Google Crawling By Domain or IP

[Darren B]

OK

Q for you google experts - does google crawl by domain name or ip address?

the reason i ask, i have domains that have moved servers and the ns records have all been updated, now for some reason google is still crawling the old server. No one else finds it just google.

The ns changes were made over 5 days ago (excess of 100 hours) i know there can be a lag but it seemed odd that it was only google

D

[Mike Hughes]

I believe Google keep their own DNS cache that might not be updated as frequently as the rest.

This kind of makes sense given how many sites they must be visiting all the time. That amount of requests would probably crash most dns servers.

Mike

[malbro]

OK

Q for you google experts - does google crawl by domain name or ip address?

the reason i ask, i have domains that have moved servers and the ns records have all been updated, now for some reason google is still crawling the old server. No one else finds it just google.

The ns changes were made over 5 days ago (excess of 100 hours) i know there can be a lag but it seemed odd that it was only google

D

There is evidence on the web that google have their own DNS cache and that they do not always refresh this as specified by the name server hosting your record. But as with anything Google there does not appear to be a definitive answer, though your problem is mentioned in BB posts as early as 2003.

[Darren B]

I believe Google keep their own DNS cache that might not be updated as frequently as the rest.

This kind of makes sense given how many sites they must be visiting all the time. That amount of requests would probably crash most dns servers.

Mike

Hmmmm thanks Mike & Mal sort of confirmed what i thought i guess.

Could be interesting then when this server bites the dust, currently there are redirects on it but of course when the server go's these will. Im guessing google probably updates weekly but who knows.

[pinbrook]

DNS caching issues aside, google crawls by domainmans not IP.
thus if you change server, your listings are normally retained.

[Darren B]

Thanks Jo, it was the fact that on server changes google is still crawling an outdated site. Makes you wonder how many other sites google crawls that are outdated