Should Search Engines Allow You Disallow Specific Content on Pages from Being Indexed?

Jun 12, 2006 - 7:45 am 0 by
Filed Under Search Theory

Should search engines introduce a tag of some sort that enables you to tell the spider not to index and not to use the content for ranking or relevancy purposes? Similar to the nofollow attribute for not counting links, and similar to AdSense Section Targeting, that enables you to specific which content is the relevant content for the AdSense spider to serve up relevant ads.

So why not a tag to tell the Web search spider what content is the content that should be indexed?

Well, right away, you can see how people may abuse it. But besides for that, there may be a way for search engines to deploy it safely.

Danny Sullivan says that Yahoo! had plans on introducing such a tag. But for some reason, has yet to do so. I believe they had plans on introducing something like it about a year ago.

Forum discussion at Search Engine Watch Forums.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: June 13, 2025

Jun 13, 2025 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google AI Mode Search, Apple Intelligence Updates, Google Live Search, AI Content, SEO & Google Ads

Jun 13, 2025 - 8:01 am
Google

Google Is Now Rolling Out AI Mode In The US

Jun 13, 2025 - 7:51 am
Google Search Engine Optimization

Google Drops Support For Seven Existing Structured Data Markups

Jun 13, 2025 - 7:41 am
Google Ads

Google Ads Shows Audience Size For Custom Segments

Jun 13, 2025 - 7:31 am
Google

Google Search Autocomplete With Back To All

Jun 13, 2025 - 7:21 am
Previous Story: Google Payments (GBuy) Coming Soon to Public?