Webmasters Not Happy with Yahoo's New Crawl Behavior

Aug 27, 2007 - 8:05 am 1 by

Last week we reported on a Yahoo update and a new method of crawling. The new crawl behavior is supposed to help the Yahoo bot, Slurp, be more efficient on your site.

It seems that many SEOs and Webmasters are not happy with this change.

A WebmasterWorld thread has several negative comments:

OK, this is completely bogus and helps nobody. The number of IPs that Slurp uses? WHO CARES...

The fact that Yahoo has multiple crawlers for every division that crawl independently and don't share the common cache, now THAT's a problem that needs to be fixed.

We get 50% of our pages crawled every day.

Well Yahoo is a waste of bandwidth on one of my sites (a large directory). It hammers it almost every day and has only sent about 975 referrers this month. That is so low that I wonder if people even use Yahoo in Ireland for anything other than e-mail. I am strongly considering blocking it.

Forum discussion at WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: June 19, 2025

Jun 19, 2025 - 10:00 am
Google

Google Rolls Out Talk & Listen Version Of Search Live In Labs

Jun 19, 2025 - 7:51 am
Google Maps

Google Tests New Report Reviews Options For Local Listings

Jun 19, 2025 - 7:41 am
Google Search Engine Optimization

Google URL Structure Help Doc Updated

Jun 19, 2025 - 7:31 am
Google

Google Tests Swapping Site Name & URL In Search Snippet

Jun 19, 2025 - 7:21 am
Google Ads

Google Ads New Promotion Preview

Jun 19, 2025 - 7:11 am
Previous Story: Microsoft adCenter Takes Step Back on Trademark Disputes