BingBot Hiding User Agent?

Dec 20, 2011 - 8:39 am 1 by
Filed Under Bing SEO

BingBotA WebmasterWorld thread has one webmaster complaining that Microsoft is hiding the user agent for the spider, BingBot.

The webmaster said:

I'm not really sure if this is regular practice with MSN (Bing) or not. Since a few weeks back, they've been spidering my website without a proper User Agent (meaning their UA does NOT say anything about bingbot. It's just a regular browser UA). This happens from three different IP ranges. Yes, I've checked thoroughly and the IP rangers are registered under MSN.

I doubt this is manual review, since it doesn't look at all as normal human behavior.

Did they officially stop declaring their bots in User Agent strings?

So either Microsoft has a weird bug, someone is spoofing the crawler in a weird way or Microsoft is doing this on purpose?

I should note, I did not check my log files to verify this on my sites. So I am going with "zerillos" post and with no back up evidence.

However, Microsoft is known for their crawling issues. Most recently, crawling too hard, updating IPs and many more. BingBot is pretty new, coming to us just over a year ago.

Forum discussion at WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Search Ranking Update, Recipe Blogs Drop, Google Hits Reviews & More SEO, PPC and Local - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: February 19, 2024

Feb 19, 2024 - 4:00 pm
Google Search Engine Optimization

Google Investigating Search Issue Where Adult Sites Not Ranking Home Page For Brand Name

Feb 19, 2024 - 7:55 am
Google

Google Search Shop With Google AI Live

Feb 19, 2024 - 7:51 am
Google Search Engine Optimization

More From Google On Helpful Content Update Recovery Time

Feb 19, 2024 - 7:41 am
Google

Google Search Tests New Search Bar Design

Feb 19, 2024 - 7:31 am
Google Ads

Google Ads To Prohibit Using Famous People Or Brands To Part With Money Or Information

Feb 19, 2024 - 7:21 am
Previous Story: IE Error With Google AdWords Billing Tab