The Google Search Algorithm Is A Lot Of Trial & Error Coding?

Jun 12, 2019 - 7:31 am 7 by
Filed Under Google

Google Smoothing Out Algorithm

A post from a former Google search engineer, Kevin Lacker, from 2006 recounts a conversation this engineer had with the former head of Google search Amit Singhal. It discusses how sometimes these engineers just tried trial and error to see what works, even if it didn't make logical sense.

Kevin Lacker worked for Google as a software engineer building search algorithms from January 2005 through November 2009, so for almost five years working under Amit. When Amit left the company he posted on Hacker News shortly after that "This is certainly a loss for Google."

But he also added that he was so good at helping engineers keep things simple and not overthink things. He said "One conversation we had about when it made sense to take the square root of things, which I still recall which whiteboard it was on, in my noob-cubicle in building 43, was really the time when I realized, aha I get how to design search algorithms now."

He added not only was using square roots a good method for smoothing but "more so that a it's trial and error thing." "When I started out after dropping out of grad school I was working on search algorithms and a bunch of my coworkers had a background in informational retrieval and I did not, and I was kind of thinking about it in the wrong way. I was thinking about it like it was a math puzzle and if I just thought really hard it would all make sense," he said.

Kevin said "one day I was stumped in how to make this signal useful and Amit suggested, hey why don't you take the square root. I was like, why a square root, it doesn't make much sense, nothing is getting squared ever, and he went up to the whiteboard and just drew a square-root-ish-wiggle-arc-shape and said look you just want something that looks like this. Square root, log, whatever.

I was like, oh... am I allowed to write code that doesn't make any sense? I thought I wasn't supposed to do that. And he was just like, well, just don't worry about it, you are overthinking it, you can take all the square roots you want, multiply by 2 if it helps, add 5, whatever, just make things work and we can make it make sense later."

It was "at that point I realized that real world software engineering was much different than research had been, and also that this was going to be way more fun," he said.

Fascinating isn't it? Hat tip to @fighto bringing up this old topic from the graveyard. Super interesting!

Forum discussion at Twitter and Hacker News.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google Search Ranking Volatility, Site Reputation Abuse Enforcement & Pichai On Search Quality - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Maps

Order with Google For Food Delivery Going Away End Of June

May 17, 2024 - 7:31 am
Google Search Engine Optimization

Two New Googlebots: GoogleOther-Image & GoogleOther-Video

May 17, 2024 - 7:21 am
Google Search Engine Optimization

Google Locks Down Complaints Of Image Thumbnails Not Showing In Search

May 17, 2024 - 7:11 am
Bing Search

Mikhail Parakhin, Former Microsoft Bing Head, Joins Perplexity Advisor Board

May 17, 2024 - 7:05 am
Search Forum Recap

Daily Search Forum Recap: May 16, 2024

May 16, 2024 - 4:00 pm
Google Updates

Continued Heated Google Search Ranking Volatility Through May 16th

May 16, 2024 - 7:51 am
Previous Story: Google: Links & Title Tags Matter To Ranking