Yahoo! Slurp Now Located at

Jun 8, 2007 • 11:38 am | comments (0) by | Filed Under Yahoo Search Engine & Yahoo SEO

The Yahoo! Search Blog has announced that webmasters will now see Yahoo's spider, Yahoo! Slurp, returning a new domain name in your logs. The same IP addresses now render to the domain name and no longer return the domain name

As of today, the transition is complete and all machines crawling as Slurp are now in You can see this change in your web server logs, where the page accesses from are being fully replaced by contacts. Note that this does not cover other Yahoo! crawlers, such Yahoo! China, and other verticals, like Yahoo! Shopping, Yahoo! Travel, etc., which have their own user-agent.

The good news: you don't have to change your robots.txt file over to prevent Yahoo! from crawling your site (if that's what you're aiming to do) because Yahoo says that the crawler user-agent is still Yahoo! Slurp and the IP addresses have not changed.

Discussion continues at WebmasterWorld.

Previous story: Google Maps: Invading Your Privacy? (Not Anymore!)
Ninja Banner
blog comments powered by Disqus