Webmasters Not Happy with Yahoo's New Crawl Behavior

Aug 27, 2007 • 8:05 am | comments (1) by twitter Google+ | Filed Under Yahoo Search Engine & Yahoo SEO
 

Last week we reported on a Yahoo update and a new method of crawling. The new crawl behavior is supposed to help the Yahoo bot, Slurp, be more efficient on your site.

It seems that many SEOs and Webmasters are not happy with this change.

A WebmasterWorld thread has several negative comments:

OK, this is completely bogus and helps nobody. The number of IPs that Slurp uses? WHO CARES...

The fact that Yahoo has multiple crawlers for every division that crawl independently and don't share the common cache, now THAT's a problem that needs to be fixed.

We get 50% of our pages crawled every day.

Well Yahoo is a waste of bandwidth on one of my sites (a large directory). It hammers it almost every day and has only sent about 975 referrers this month. That is so low that I wonder if people even use Yahoo in Ireland for anything other than e-mail. I am strongly considering blocking it.

Forum discussion at WebmasterWorld.

Previous story: Microsoft adCenter Takes Step Back on Trademark Disputes
 

Comments:

Jaan Kanellis

08/27/2007 03:16 pm

More people crying about crawling bandwidth. Maybe they will allow a feature similar to Google in which you can tune down the crawling level of the spider(s)

blog comments powered by Disqus