MSN Indexing Pages With No Index Commands?

Jan 5, 2007 - 7:07 am 2 by
Filed Under Bing Search

There is a WebmasterWorld thread where folks are reporting that MSN Search is indexing a bit too much. Reports suggest that MSN is crawling and indexing the content found on pages which are excluded via the robots.txt directive.

Normally, if a search engine crawls the page, they may only keep the URL in their index but not the content.

Moderator Receptional adds, "My examples show no snippet. But I can get them by typing unique text into the search query."

So if they are returning results for text found on the page, maybe they are indexing a bit too much?

On the other hand, I have a thread at Search Engine Roundtable Forums suggesting MSN doesn't index enough, specifically new sites...

Forum discussion at WebmasterWorld & Search Engine Roundtable Forums.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Search Ranking Volatility, Site Reputation Abuse Enforcement & Pichai On Search Quality - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 10, 2024

May 10, 2024 - 4:00 pm
Search Video Recaps

Search News Buzz Video Recap: Google Search Ranking Volatility, Site Reputation Abuse Enforcement, Pichai On Search Quality, HCU Recovery & More

May 10, 2024 - 8:01 am
Bing Search

Mikhail Parakhin No Longer Working On Copilot At Microsoft

May 10, 2024 - 7:51 am
Google Search Engine Optimization

Google: Site Reputation Abuse Isn't About Linking

May 10, 2024 - 7:41 am
Google Maps

Google Local Panel With Owner Attribute

May 10, 2024 - 7:31 am
Google Ads

Google: Proximity Not A Relevancy Factor For Local Service Ads

May 10, 2024 - 7:21 am
Previous Story: Idea To Place Google Image Ads Near Google Text Ads As Alternate