Meet the Crawlers

Dec 16, 2004 - 12:45 pm 0 by
Filed Under SES Chicago 2004

Jen Fitzpatrick from Google first explained the insides and out of PageRank, but it can obviously not be published here. :) They say their main index is composed of three main indexes; the news index, the fresh index, and the main index. She then talks about some basic guidelines for webmasters, you know the dos the don'ts. Some more basics on 301s, header commands, and robot.txt slides. She explains that Google prides themselves on telling the user what is paid versus unpaid results, and she explicitly says they do not do paid inclusion for that reason. Detlev sped her up and she had to run through some of the newer technology.

Michael Palka from Ask Jeeves gets right to the relevancy speech, the link community discussion and the other structured data components. :)

Tim Mayer from Yahoo Search starts off with next.yahoo.com and my.yahoo.com. He announced that they launched a new index Tuesday night, so you might see some changes. He goes over same deal as everyone else, but adds in the redirect information which I posted in that session. He explains that paid inclusion has no impact on the free crawl content.

Ken Moss from MSN Search starts off explaining that they use Inktomi for their current search (the Yahoo guys in front of me commented to each other - who owns Inktomi). He then explained that they have MSN Beta and wants our feedback. In addition they have a new beta tool bar for desktop search. They have a 150kb page size limit. MSN has a feature called "near me", that looks for local content and suggests it to the user.

See my past coverage of these sessions, they are pretty much all the same.

Q & A:

Q: I asked Ask Jeeves why they bury the Teoma results way under the Google AdWords results at Ask Jeeves? A: Michael answered that is was not about not being more relevant, they feel Teoma is more relevant than AdWords. But it is set up that way from a monetization standspoint only. Fair answer.

To be honest, the reason I asked was to some how bring Teoma out. It is way to hidden and I find that to be a shame.

Lots of basic questions being asked, I think I will leave and see how Elisabeth is doing in the Site Clinic.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Flux, AdSense Ad Intent, California Link Tax & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Search Engine Optimization

Google: We Won't Change The 301 Redirect Signals For Ranking & SEO

Apr 24, 2024 - 7:51 am
Google

Google Image Search Tests Tablet Like Design Interface

Apr 24, 2024 - 7:41 am
Google Search Engine Optimization

Google: Our Link Best Practices Doc Are Still Good Guidelines

Apr 24, 2024 - 7:31 am
Google Ads

Google Ads Established In Extensions

Apr 24, 2024 - 7:21 am
Bing Search

Bing Tests Lock Icon In New Search Snippet Location

Apr 24, 2024 - 7:11 am
Search Forum Recap

Daily Search Forum Recap: April 23, 2024

Apr 23, 2024 - 4:00 pm
Previous Story: MultiSite and MultiDomain Issues