Entries from Search Engine Roundtable tagged with 'crawlwall'

Scrape Bots Vs. Search Bots :: Fighting the Battle

A Search Engine Watch Forums thread asks how can one prevent scraping of his site's content by a non-authorized spider, while not hurting his rankings in search engines? This is a serious issue, serious enough that there was a session...


To subscribe to the Search Engine Roundtable, click here