BingBot Arrives: Microsoft's New Crawler

Sep 29, 2010 - 3:15 pm 0 by
Filed Under Bing Search

The folks over at WebmasterWorld have just started noticing Microsoft's new spider arriving. As expected, the new spider is named BingBot.

BingBot will still obey all the rules of its predecessor, MSNBot, but now has a fancy new name.

The original announcement said this would happen on October 1, 2010, so we are a day or two early. Here is one sample find in a webmaster's log files: Tue Sep 28 20:24:15 2010 "GET /widgets.html HTTP/1.1" 200 4321 "-" "Mozilla/5.0 (compatible; bingbot/2.0 +" Connection="Keep-Alive" Accept="*/*" Accept-Encoding="gzip, deflate"

As I said back then... Microsoft said that BingBot will continue to respect and honor the msnbot directives in the robots.txt file, so you do not need to update your robots.txt files yet. But if you are doing more advanced checking, you may need to update your personal scripts. It is also to note that if Microsoft "detect separate sets of directives for bingbot and for any of the older versions of Microsoft search bots (such as msnbot) or a set of directives for all crawlers, the directives for bingbot will take precedence."

Forum discussion at WebmasterWorld.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google Core Update Volatility, Helpful Content Update Gone, Dangerous Search Results & Ads Confusion - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: April 12, 2024

Apr 12, 2024 - 4:00 pm
Search Video Recaps

Search News Buzz Video Recap: Google Core Update Volatility, Helpful Content Update Gone, Dangerous Google Search Results & Google Ads Confusion

Apr 12, 2024 - 8:01 am
Google Search Engine Optimization

Google: Indexing & Algorithm Updates Are Independent

Apr 12, 2024 - 7:51 am
Google Search Engine Optimization

Google Structured Data Carousels Beta Docs Clarifies Feature Availability & Markup Location

Apr 12, 2024 - 7:41 am

Google: Ranking In Shopping, Images & Other Verticals Doesn't Hurt Your Web Rankings

Apr 12, 2024 - 7:31 am

Google Knowledge Panels - Mentioned People

Apr 12, 2024 - 7:21 am
Previous Story: Google's The Flintstones Logo