Bing Masking MSNBot Under Mozilla's UserAgent & Reverse IP Fails

Sep 17, 2009 - 8:31 am 1 by
Filed Under Bing Search

With all the on going issues with MSNBot not behaving, I am not too surprised to see more complaints about the little spider.

New confirmed reports from Bing Forums shows that MSNBot is hiding itself under the UserAgent of Mozilla/4.0. How does this person know that it is MSNBot? Two reason, it is "crawler-acting-like" and also because it is in the same range of IP adresses as MSNBot.

Brett Yount from the Microsoft Bing team confirmed the issue saying:

We've received word from a few other sources concerning this. Our team is reviewing it and will let me know as soon as they have an update. Please be assured that it is not our intention to misrepresent the bot or cause undo problems for webmasters.

In addition to this confirmed report, we have a webmaster in WebmasterWorld complaining that MSNBot fails the best business practices of reverse DNS lookup validating. In November 2006, Microsoft added a method to validate MSNBot is indeed MSNBot by allowing reverse DNS checking of the IP. That began to fail in December 2007, which was confirmed shortly after. Then again, in March 2008 the reverse DNS complaints came back. This is a brand new report after not hearing complaints for a while now. There has not been confirmation of this from Microsoft.

Forum discussion at Bing Forums and WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Rumbling, Manual Actions FAQs, Core Web Vitals Updates, AI, Bing, Ads & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: March 18, 2024

Mar 18, 2024 - 4:00 pm
Google Updates

Google Urges Patience As The March 2024 Core Update Continues To Rollout

Mar 18, 2024 - 7:51 am
Google

Official: Google Replaces Perspective Filter With Forums Filter

Mar 18, 2024 - 7:41 am
Google Maps

Google Business Profiles Now Offers Additional Review After Appeal Is Denied

Mar 18, 2024 - 7:31 am
Google Maps

EU Searchers Complaining About Google Maps Features Changes Related To DMA

Mar 18, 2024 - 7:21 am
Google

Google Showing Fewer Sitelinks Within Search

Mar 18, 2024 - 7:11 am
Previous Story: Google Showing Weird Title for Wikipedia Article