Possible GoogleBot DNS Issues Causing Indexing Issues at Google.com

Sep 11, 2007 - 8:12 am 4 by

A detailed Google Groups thread is reporting various reports of webmasters claiming GoogleBot is timing out before reaching their pages.

First, these webmasters are noticing a drop in GoogleBot activity on their server. So they login to Google Webmaster Tools and see the error "We can't currently access your home page because of a timeout." Then they drill deeper to see "URL timeout: DNS lookup timeout."

This is happening for several webmasters, all on different hosts and servers.

The question is, is this a Google issue or a host issue outside of Google. Does Google need to clear their DNS cache in order to be able to recrawl these sites?

Here is one concerned Webmaster's story:

This is exactly the same problem I have!

Long time indexed, no problems, then 9/5 suddenly we start getting the 'hompage timeout' errors. Same with the site map-- DNS timeout. But Yahoo! gets the sitemap just fine, and we didn't change anything on our end-- neither in DNS zone files, nor in server setup, nor the sitemap files themselves.

Googlebot is still pulling down other files from our server, just not the sitemap and index (and robots). Indexing is down *significantly*-- so this is not just a funny coincidence.

The last download of robots.txt was: September 5, 2007 3:49:14 PM PDT. Does this match yours?

Google representative, Susan Moskwa, said she is now looking into it:

Just wanted to let you know that we're looking around to see if this is being caused by something on our end. Also, as webado noted, it helps if you post the URL in question.

We will track this thread and report back on the outcome.

Forum discussion at Google Groups.


Popular Categories

The Pulse of the search community


Search Video Recaps

Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 24, 2024

May 24, 2024 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Ranking Volatility, Ads In Google AI Overviews, Sundar Pichai Interview, Heartfelt Helpful Content & More Ad News

May 24, 2024 - 8:01 am
Google Search Engine Optimization

Google: The Site Reputation Abuse Policy Enforcement Not Yet Algorithmic

May 24, 2024 - 7:51 am
Google Search Engine Optimization

Google Search Can Now Index Electronic Publication (EPUB)

May 24, 2024 - 7:41 am

Directory Of Embarrassing Google AI Overviews

May 24, 2024 - 7:31 am
Web Analytics

Google Analytics Real-Time Reports Adds Users In Last 5 Minutes

May 24, 2024 - 7:21 am
Previous Story: Google Now Has The Time After Dropping the Feature