BingBot As GoogleBot? Maybe, If It Crawls Google's PageSpeed Tool

Aug 29, 2014 - 8:21 am 1 by
Filed Under Bing SEO

robot turtleA savvy webmaster was curious when he noticed that BingBot was crawling his site from Google IP addresses. Did Google acquire Bing's crawler? Was it some sort of fake bot trying to rip off content?

The question was brought up at Stack Exchange:

As it shows, user-agent shows it is bingbot. But whois data of IP address(74.125.186.46 and 74.125.187.193) shows it is from google servers.

So is it Google,Bing or any other content scrappers?

John Mueller of Google responded saying both! It was BingBot crawling a URL through Google's PageSpeed tool. John explained:

I double-checked with the team about these requests, and they appear to be for the PageSpeed service, which can act as a cache/proxy for websites. If search engines - like Bing or Google - crawl URLs like that, the service will forward those requests to your website when needed. That can make it look like these requests are coming from Google IP addresses, even though they initially originated elsewhere.

Pretty neat!

Forum discussion at Stack Exchange.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Flux, AdSense Ad Intent, California Link Tax & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: April 23, 2024

Apr 23, 2024 - 4:00 pm
Link Building

Google: Ignore Link Spam Especially To 404 Pages

Apr 23, 2024 - 7:51 am
Google Search Engine Optimization

Google: We Have Taken Action On Some Parasite SEO In Recent Update

Apr 23, 2024 - 7:41 am
Bing Search

Mikhail Parakhin Breaks Silence On Mustafa Suleyman Of Microsoft (Kinda...)

Apr 23, 2024 - 7:31 am
Google Maps

Google Business Profiles Gains Select Preferred Menu Source

Apr 23, 2024 - 7:21 am
Google Search Engine Optimization

Google: Crawl Budget Goes Across All Googlebot Crawling, Not Just Web Search

Apr 23, 2024 - 7:11 am
Previous Story: Google Bringing Back Old Design Or A Bug?