's Meta Tags For Crawl & Content Access Control

Oct 6, 2006 - 7:54 am 2 by
Filed Under Bing Search

Sometimes it is hard to find the different supported Meta tags to help control where (MSNbot) can crawl on your site and what content they should cache. I dug up the resource on MSN's Site Owner Help section that details Use metadata tags to control page indexing and link crawling. Here is a summary of those tags.

  • <META NAME="msnbot" CONTENT="noindex" /> will tell MSNbot not to index the page
  • <META NAME="msnbot" CONTENT="nofollow" /> will tell MSNbot not to follow links on that page
  • <META NAME="msnbot" CONTENT="noindex,nofollow" /> will tell MSNbot not to index the page or follow links on that page
  • <META NAME="msnbot" CONTENT="nocache" /> OR <META NAME="msnbot" CONTENT="noarchive" /> will tell MSNbot not to store a local cache of the page

Forum discussion at WebmasterWorld.

This article was written the night before, and scheduled to go live the following morning.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google Volatility, Indexing Bugs, Google Ads Broad Match Default &amp; YouTube SEO Tips - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 17, 2024

Jul 17, 2024 - 10:00 am

Google Search Notes Finally To End

Jul 17, 2024 - 7:51 am
Google Search Engine Optimization

Google Knowledge Panels Tests Store Ratings Reviews

Jul 17, 2024 - 7:41 am

Google Tests Renaming Short Videos To Quick Takes

Jul 17, 2024 - 7:31 am
Google Ads

Google Ads Changed Broad Match To Intent Match In Japan

Jul 17, 2024 - 7:21 am
Google Ads

Google Ads Query Refinements Under Ad Carousel

Jul 17, 2024 - 7:11 am
Previous Story: UK Release of Yahoo!'s Panama No Sooner Than Q2 '07