GoogleBot Crawling From Different Locations At Same Time

Aug 24, 2010 - 8:47 am 3 by

The obsessed SEOs at WebmasterWorld have noticed that for the first time in watching how GoogleBot (Google's search crawler) spiders their sites, they are now crawling from a few different IP addresses at the same time.

Long time WebmasterWorld members said this is the first time they have seen GoogleBot crawl their site at the same time from multiple IPs. Several have noticed GoogleBots crawling from three different IPs at the same time. One member said:

We had lots of crawler activity today on a newer site, google hit the site from 3 different ip addresses throughout the day. Hoping it's a good sign, never seen them use different ip addresses in the same day before.

Another senior member added:

Yea they went berzerk on our big site last thursday and friday. their fast activity notified me so I took a peek to see who was scraping the site... I've never seen Google spider so fast and from so many IP addresses, they were all valid Google ip's but there was like 10-20 of them running at once.

Have you noticed this behavior?

Forum discussion at WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Search Ranking Volatility, Site Reputation Abuse Enforcement & Pichai On Search Quality - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 10, 2024

May 10, 2024 - 4:00 pm
Search Video Recaps

Search News Buzz Video Recap: Google Search Ranking Volatility, Site Reputation Abuse Enforcement, Pichai On Search Quality, HCU Recovery & More

May 10, 2024 - 8:01 am
Bing Search

Mikhail Parakhin No Longer Working On Copilot At Microsoft

May 10, 2024 - 7:51 am
Google Search Engine Optimization

Google: Site Reputation Abuse Isn't About Linking

May 10, 2024 - 7:41 am
Google Maps

Google Local Panel With Owner Attribute

May 10, 2024 - 7:31 am
Google Ads

Google: Proximity Not A Relevancy Factor For Local Service Ads

May 10, 2024 - 7:21 am
Previous Story: Reporting Search Spam To Bing