Webmasters Not Happy with Yahoo's New Crawl Behavior

Aug 27, 2007 - 8:05 am 1 — by

Last week we reported on a Yahoo update and a new method of crawling. The new crawl behavior is supposed to help the Yahoo bot, Slurp, be more efficient on your site.

It seems that many SEOs and Webmasters are not happy with this change.

A WebmasterWorld thread has several negative comments:

OK, this is completely bogus and helps nobody. The number of IPs that Slurp uses? WHO CARES...

The fact that Yahoo has multiple crawlers for every division that crawl independently and don't share the common cache, now THAT's a problem that needs to be fixed.

We get 50% of our pages crawled every day.

Well Yahoo is a waste of bandwidth on one of my sites (a large directory). It hammers it almost every day and has only sent about 975 referrers this month. That is so low that I wonder if people even use Yahoo in Ireland for anything other than e-mail. I am strongly considering blocking it.

Forum discussion at WebmasterWorld.

 

Popular Categories

The Pulse of the search community

Google Search Volatility

More Details

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google

Google AI Overviews With Unfaded Citation Block

Nov 17, 2026 - 8:36 pm
Web Analytics

Google Tag & Google Tag Manager Unification

Nov 17, 2026 - 8:16 pm
Search Forum Recap

Daily Search Forum Recap: November 17, 2026

Nov 17, 2026 - 10:00 am
Search Engine Optimization

FBI: SEO Poisoning Led To $28 Million In Ransomware Payments

Nov 17, 2026 - 7:51 am
Google Search Engine Optimization

Google: A Site Move Doesn't Improve A Site's Overall Quality

Nov 17, 2026 - 7:41 am
Google Search Engine Optimization

Google On Why Serving A 200 Status Code When Your Site Is Down Is Bad

Nov 17, 2026 - 7:31 am
Previous Story: Microsoft adCenter Takes Step Back on Trademark Disputes