Spider User Agent Change

Feb 10, 2004 • 3:37 pm | comments (0) by twitter | Filed Under Other Search Engines

It looks like the user agent for AlltheWeb.com has changed. Noticed this in my web logs today (I did a trace route on the IP to make sure it wasn't a spoofed user agent, and it traces back to overture.com)...

Yahoo-VerticalCrawler-FormerWebCrawler/3.9 crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler

Previous story: Welcome Dan Thies to Represent IHelpYou Forum
blog comments powered by Disqus