Google Crawler Now Sends English In Accept-Language Request Header

Mar 22, 2016 - 7:50 am 3 by

Map9 Google 1200px

Former Googler, Pierre Far, spotted and posted on Google+ that the Google crawler (GoogleBot) now sends HTTP requests with English setting Accept-Language in the request header. He notes that the documentation specifically says GoogleBot doesn't specify a language in the request header for the Accept-Language, it says it sends it "without."

Pierre wrote:

Googlebot sends an "Accept-Language: en" header, meaning it specifies, by default, it accepts English-language webpages. This is inconsistent with the documentation and I think it's new default behavior. It's certainly different than when I last checked when I was involved in this part of Google Search.

It seems the proper people are notified about the documentation error and either it is a bug with GoogleBot or a bug in the documentation, but it is important to note for those who do international webmastering/SEO.

Forum discussion at Google+.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: January 24, 2025

Jan 24, 2025 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Search Volatility, European Manual Actions, Quality Raters Updated, Bing Hides Google & Yahoo AI Chat

Jan 24, 2025 - 8:01 am
Google Search Engine Optimization

Google Search Quality Raters Guidelines Gain 11 New Pages

Jan 24, 2025 - 7:51 am
Google Ads

New Google Ads Performance‬‭ Max‬‭ Features

Jan 24, 2025 - 7:41 am
Google Search Engine Optimization

Google: Spammers Encourage You To Waste Time Disavowing Links

Jan 24, 2025 - 7:31 am
Google Ads

Google Ads To Drop Certification For Some Advertisers & Reorganizes Verification Docs

Jan 24, 2025 - 7:21 am
Previous Story: Green GoogleBot On The Train