Spam Checking Tool

Jul 14, 2004 - 8:15 am 0 by
Filed Under Spam

Imagine that, an army of bots that crawl the Web for pages that look to be spamming the search engines. This kind of makes me scratch my head and want to build this myself.

Some of the downsides or challenges: - Would these bots need to comply with the robot.txt file? So if someone excludes "spam bot" can it crawl anyway? - How is spam defined? I guess we can have some sort of level of spam and chart it from green to red. That can work (thinking out loud). - If the search bots can't pick up the spam, then how can my army of spam bots pick them up? Do the spam bots need to wear camouflage? :)

This topic is currently being discussed over at the Search Engine Watch Forums.

spam-bot-army.jpg

 

Popular Categories

The Pulse of the search community

Google Search Volatility

More Details

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google

Regional Differences In Google Search Experience Documentation

Sep 8, 2026 - 11:08 am
Search Forum Recap

Daily Search Forum Recap: September 8, 2026

Sep 8, 2026 - 10:00 am
Google

Google: EU DMA Changes Resulted In Largest Reduction In Search Quality

Sep 8, 2026 - 8:01 am
Google Maps

September Data In Google Business Profiles Insights Missing

Sep 8, 2026 - 7:51 am
Google Ads

Google Ads AI Dashboards Live For Some Advertisers

Sep 8, 2026 - 7:41 am
Google

Google AI Mode Tests Paginated Follow Up Responses With Skip Button

Sep 8, 2026 - 7:31 am
Previous Story: SEO Radio Archives Available