As you know, Bing on their webmaster blog, is offering a series around BingBot and how they crawl the web, they already posted two blog posts on the topic. But at SMX East this week, Frederic Dubut from the Bing search quality team gave a detailed presentation around their crawler, crawl budget, crawl efficiency and more.
In fact, he said on stage that the crawler team at Bing has their bonuses tied directly to how well they maximize crawl efficiency this year. How crazy but logical is that? I mean, at least they didn't tie their bonuses to the success or failure of Google+. :)
I wanted to share their presentation on the topic, because I know many of you super technical SEOs would love to consume it:
Here are some highlights that stood out for me while sitting in on the presentation:
I think @CoperniX said Bing has set their bonus to how much they improve call efficiency #smx
— Barry Schwartz (@rustybrick) October 24, 2018
How Bing handles crawl budget, managing what your serve can support and errors #smx pic.twitter.com/7zVqyku2Jx
— Barry Schwartz (@rustybrick) October 24, 2018
It is very important for crawling efficiency to reduce duplicate content according to Bing's @CoperniX #smx
— Barry Schwartz (@rustybrick) October 24, 2018
Don't have lots of useless pages, 404 pages, etc. secondary files like JS, CSS, etc. m dot URLs are essentially duplicate URLs and impacts crawl budget.
— Barry Schwartz (@rustybrick) October 24, 2018
Fredrick from Bing is on Twitter, but he isn't super active there, but did say if you want to know more:
If there are specific topics you'd like to see addressed I can forward to @facan. We know we want to share more about our crawler work and we're still evaluating which topics, the level of technical details, etc. Your feedback will help us shape this series.
— Frédéric Dubut (@CoperniX) October 25, 2018
Forum discussion at Twitter.
