Bing Masking MSNBot Under Mozilla's UserAgent & Reverse IP Fails

Sep 17, 2009 - 8:31 am 1 by
Filed Under Bing Search

With all the on going issues with MSNBot not behaving, I am not too surprised to see more complaints about the little spider.

New confirmed reports from Bing Forums shows that MSNBot is hiding itself under the UserAgent of Mozilla/4.0. How does this person know that it is MSNBot? Two reason, it is "crawler-acting-like" and also because it is in the same range of IP adresses as MSNBot.

Brett Yount from the Microsoft Bing team confirmed the issue saying:

We've received word from a few other sources concerning this. Our team is reviewing it and will let me know as soon as they have an update. Please be assured that it is not our intention to misrepresent the bot or cause undo problems for webmasters.

In addition to this confirmed report, we have a webmaster in WebmasterWorld complaining that MSNBot fails the best business practices of reverse DNS lookup validating. In November 2006, Microsoft added a method to validate MSNBot is indeed MSNBot by allowing reverse DNS checking of the IP. That began to fail in December 2007, which was confirmed shortly after. Then again, in March 2008 the reverse DNS complaints came back. This is a brand new report after not hearing complaints for a while now. There has not been confirmation of this from Microsoft.

Forum discussion at Bing Forums and WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Updates

Google March 2024 Core Update Finished April 19th (A Week Ago)

Apr 26, 2024 - 4:40 pm
Search Forum Recap

Daily Search Forum Recap: April 26, 2024

Apr 26, 2024 - 4:00 pm
Search Video Recaps

Search News Buzz Video Recap: Google Core Update Updates, Site Reputation Abuse Coming, Links, Ads & More

Apr 26, 2024 - 8:01 am
Google Search Engine Optimization

Google Publisher Center No Longer Allows Adding Publications

Apr 26, 2024 - 7:51 am
Google

Google Tests Placing The Snippet Date Next To URL

Apr 26, 2024 - 7:41 am
Google

Google Breaks Out Googlebot IP Ranges For User-Triggered Fetchers

Apr 26, 2024 - 7:31 am
Previous Story: Google Showing Weird Title for Wikipedia Article