Last week we reported on a Yahoo update and a new method of crawling. The new crawl behavior is supposed to help the Yahoo bot, Slurp, be more efficient on your site.
It seems that many SEOs and Webmasters are not happy with this change.
A WebmasterWorld thread has several negative comments:
OK, this is completely bogus and helps nobody. The number of IPs that Slurp uses? WHO CARES...The fact that Yahoo has multiple crawlers for every division that crawl independently and don't share the common cache, now THAT's a problem that needs to be fixed.
We get 50% of our pages crawled every day.
Well Yahoo is a waste of bandwidth on one of my sites (a large directory). It hammers it almost every day and has only sent about 975 referrers this month. That is so low that I wonder if people even use Yahoo in Ireland for anything other than e-mail. I am strongly considering blocking it.
Forum discussion at WebmasterWorld.
