Yahoo! Slurp China & Yahoo! Search Marketing Crawler

Apr 5, 2006 - 8:12 am 0 by

There are two spiders from Yahoo! that you may have been noticing crawling over pages recently. The first, is named Yahoo! Slurp China has reportedly been around since mid-Novmember of last year. The second, is named Yahoo! Search Marketing Crawler and has just been discovered, I believe.

Yahoo! Slurp China found recent activity as reported at DigitalPoint Forums under the User Agent;

Mozilla/5.0 (compatible; Yahoo! Slurp China; Agent: Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)

WebmasterWorld has an older thread on the topic that IP block is 202.160.178. and 202.160.179. and it resolves to *.inktomisearch.com. If you don't like this spider, the folks at WebmasterWorld say you can just block its user agent and it won't affect the main Yahoo! Slurp. They say block; "User-agent: slurp china"

Yahoo! Search Marketing Crawler is a fairly unknown spider that sprung up some recent concern at WebmasterWorld Forums. It has been reported from the IP address 66.35.192.197 and 64.209.232.29, which is resolving to Savvis and not Yahoo! Senior Member, StupidScript, says that this spider is an automated ad-checker. He also said that Yahoo! has never claimed ownership of this bot and that they blocked it only to stop "receiving mail from SBC-Yahoo subscribers." I am not 100% sure about this so I will do a follow up with Yahoo! Search Marketing on this crawler.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Volatility, Helpful Content Update Gone, Dangerous Search Results & Ads Confusion - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Video Recaps

Search News Buzz Video Recap: Google Core Update Volatility, Helpful Content Update Gone, Dangerous Google Search Results & Google Ads Confusion

Apr 12, 2024 - 8:01 am
Google Search Engine Optimization

Google: Indexing & Algorithm Updates Are Independent

Apr 12, 2024 - 7:51 am
Google Search Engine Optimization

Google Structured Data Carousels Beta Docs Clarifies Feature Availability & Markup Location

Apr 12, 2024 - 7:41 am
Google

Google: Ranking In Shopping, Images & Other Verticals Doesn't Hurt Your Web Rankings

Apr 12, 2024 - 7:31 am
Google

Google Knowledge Panels - Mentioned People

Apr 12, 2024 - 7:21 am
Google Maps

Google Maps Suggest An Edit Flow Updated

Apr 12, 2024 - 7:11 am
Previous Story: Google Adds $20 Per AdWords Referrals To AdSense Referrals Section