Googlebot Supporting HTTP 1.1 Now

Sep 16, 2004 - 11:12 am 0 by
Filed Under Google

This might not seem like a big deal, and most people won't even notice a difference, but Googlebot seems to be using a slightly different user agent that supports HTTP/1.1 (including support for server-side compression of documents), so it's about a 5x bandwidth saving for servers that have it turned on.

They are still running the old spiders as well, so it might just be a test phase or something. Either way, it's something I've been wishing for, and seem to have now. There is some discussion on it over here.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Updates

Google March 2024 Core Update Finished April 19th (A Week Ago)

Apr 26, 2024 - 4:40 pm
Search Forum Recap

Daily Search Forum Recap: April 26, 2024

Apr 26, 2024 - 4:00 pm
Search Video Recaps

Search News Buzz Video Recap: Google Core Update Updates, Site Reputation Abuse Coming, Links, Ads & More

Apr 26, 2024 - 8:01 am
Google Search Engine Optimization

Google Publisher Center No Longer Allows Adding Publications

Apr 26, 2024 - 7:51 am
Google

Google Tests Placing The Snippet Date Next To URL

Apr 26, 2024 - 7:41 am
Google

Google Breaks Out Googlebot IP Ranges For User-Triggered Fetchers

Apr 26, 2024 - 7:31 am
Previous Story: Suspended from Adwords for Using Brand Name