Microsoft's Search Bot MSNBot 2 Adding Pound Signs to URLs?

Jul 20, 2009 - 8:54 am 1 by
Filed Under Bing Search

A Bing thread has two complaints from webmasters on Microsoft's newish crawler, MSNBot 2. The bot, in some cases, might be adding a pound sign (#) to the end of the URLs.

Now, this might not be the fault of Microsoft, it might be an issue with links and/or the web site's being crawled. But there are now two people reporting it and MSNBot 2 is a beta bot that may have issues, as Microsoft did allude to.

On June 29th, Brett from the Microsoft team did say, "I'm getting our crawler team to look at this. I'll update you as soon as I've heard back." But since then, we have not heard back.

Of course, there are ways to force the bot to the correct URL. I.e. block the # signs in your robots.txt or 301 redirect those URLs to the main URL.

Forum discussion at Bing Help.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Gvolatility, Bing Generative Search, Reddit Blocks Bing, Sticky Cookies, AI Overview Ads & SearchGPT - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 26, 2024

Jul 26, 2024 - 10:00 am
Search Video Recaps

Google Volatility, Bing Generative Search, Reddit Blocks Bing, Sticky Cookies, AI Overview Ads & SearchGPT

Jul 26, 2024 - 8:01 am
Google

Google Gemini Adds Related Content & Verification Links

Jul 26, 2024 - 7:51 am
Other Search Engines

SearchGPT - OpenAI's AI Search Tool

Jul 26, 2024 - 7:41 am
Search Engine Optimization

Google's John Mueller: Don't Use LLMs For SEO Advice

Jul 26, 2024 - 7:31 am
Google

Google Search With Related Images Carousel Below Image Box

Jul 26, 2024 - 7:21 am
Previous Story: YouTube Testing 3D Videos (YT3D)