BingBot Arrives: Microsoft's New Crawler

Sep 29, 2010 - 3:15 pm 0 by
Filed Under Bing Search

The folks over at WebmasterWorld have just started noticing Microsoft's new spider arriving. As expected, the new spider is named BingBot.

BingBot will still obey all the rules of its predecessor, MSNBot, but now has a fancy new name.

The original announcement said this would happen on October 1, 2010, so we are a day or two early. Here is one sample find in a webmaster's log files:

207.46.195.227 Tue Sep 28 20:24:15 2010 "GET /widgets.html HTTP/1.1" 200 4321 "-" "Mozilla/5.0 (compatible; bingbot/2.0 +http://www.bing.com/bingbot.htm)" Connection="Keep-Alive" Accept="*/*" Accept-Encoding="gzip, deflate"

As I said back then... Microsoft said that BingBot will continue to respect and honor the msnbot directives in the robots.txt file, so you do not need to update your robots.txt files yet. But if you are doing more advanced checking, you may need to update your personal scripts. It is also to note that if Microsoft "detect separate sets of directives for bingbot and for any of the older versions of Microsoft search bots (such as msnbot) or a set of directives for all crawlers, the directives for bingbot will take precedence."

Forum discussion at WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Rumbling, Manual Actions FAQs, Core Web Vitals Updates, AI, Bing, Ads & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: March 15, 2024

Mar 15, 2024 - 4:00 pm
Search Video Recaps

Search News Buzz Video Recap: Google Core Update Rumbling, Manual Actions FAQs, Core Web Vitals Updates, AI, Bing, Ads & More

Mar 15, 2024 - 8:01 am
Google Updates

Google March 2024 Core & Spam Update Movement Today

Mar 15, 2024 - 7:51 am
Google

Google Image Search Results Testing Like Button

Mar 15, 2024 - 7:41 am
Google

Google Merchant Center Product Studio With Themed Templates Including St. Patrick's Day

Mar 15, 2024 - 7:31 am
Google Maps

Google Search Dishes Nearby Carousel

Mar 15, 2024 - 7:21 am
Previous Story: Google's The Flintstones Logo