Google's Matt Cutts: Bing It On Challenge Was Obviously Flawed

Oct 2, 2013 - 8:53 am 59 by
Filed Under Bing Search

Bing It On ChallengeA little over a year ago, Microsoft launched this campaign named the Bing It On Challenge, which was basically a blind-search taste test pinning Bing against Google, while removing the branding.

Ian from Freakonomics reports that the challenge was not just a "little fishy" but he feels Google may have an "deceptive advertising claim against Microsoft." He details why in his post at Freakonomics.

Matt Cutts, Google's head of search spam, shared this on Google+ and added some more color to his own thoughts on this challenge.

I have to admit that I never bothered to debunk the Bing It On challenge, because the flaws (small sample size; bias in query selection; stripping out features of Google like geolocation, personalization, and Knowledge Graph; wording of the site; selective rematches) were pretty obvious.

It is funny, because when I posted a poll on Who Won In Bing It On Challenge? 60%+ said Google won.

Anyway, well worth a read when you have time.

Forum discussion at Google+.

Update: Here is a statement from Microsoft PR, and also make sure to check out this comment from Microsoft's Matt Wallaert.

The professor’s analysis is flawed and based on an incomplete understanding of both the claims and the Challenge. The Bing It On claim is 100% accurate and we’re glad to see we’ve nudged Google into improving their results. Bing it On is intended to be a lightweight way to challenge peoples’ assumptions about which search engine actually provides the best results. Given our share gains, it’s clear that people are recognizing our quality and unique approach to what has been a relatively static space dominated by a single service. - Attributable to Matt Wallaert, Behavioral Scientist, Bing

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Rumbling, Manual Actions FAQs, Core Web Vitals Updates, AI, Bing, Ads & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: March 18, 2024

Mar 18, 2024 - 4:00 pm
Google Updates

Google Urges Patience As The March 2024 Core Update Continues To Rollout

Mar 18, 2024 - 7:51 am
Google

Official: Google Replaces Perspective Filter With Forums Filter

Mar 18, 2024 - 7:41 am
Google Maps

Google Business Profiles Now Offers Additional Review After Appeal Is Denied

Mar 18, 2024 - 7:31 am
Google Maps

EU Searchers Complaining About Google Maps Features Changes Related To DMA

Mar 18, 2024 - 7:21 am
Google

Google Showing Fewer Sitelinks Within Search

Mar 18, 2024 - 7:11 am
Previous Story: Here Come The White Google Navigation Bar Complaints...