Google: Don't Blame GoogleBot For Your Slow Database Queries

Jul 17, 2020 - 7:41 am 0 by

Dont Blame Me

GoogleBot is pretty good, actually, very good, at not crawling most sites too much where it actually ends up slowing down the site from loading. GoogleBot is designed to detect that and back off. But if you have a specific set of pages or a page that is super slow because the way you wrote your database query is super inefficient, Google says - don't blame them.

Gary Illyes, the official House Elf and Chief of Sunshine and Happiness at Google, wrote on Twitter, as the official bad guy at Google (he has lots of titles), "if you have a page that uses a considerable amount of server cpu when accessed - maybe because database queries? -, you need to fix/optimize that. if Googlebot uses up your server quota because it fetches that page, that's on you, not on Googlebot."

Now if Google could just help you automatically optimize your queries, add some indexes, or something...

But truth is, yes, Gary is 100% correct here. Make sure your database queries are designed in a way that can handle traffic, not just from GoogleBot but also from your users that Google Search may send you.

Forum discussion at Twitter.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google Core Update Volatility, Helpful Content Update Gone, Dangerous Search Results & Ads Confusion - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Updates

Deepening Google Core Ranking Volatility Hits Yesterday & Today

Apr 17, 2024 - 8:01 am
Google Maps

Google Maps No Longer Will Support Draft Reviews

Apr 17, 2024 - 7:51 am
Google Search Engine Optimization

Google Search Console Adds Unused Ownership Tokens

Apr 17, 2024 - 7:41 am
Google Ads

New Google Ads AI Generated Image Tool For Demand Gen Campaigns

Apr 17, 2024 - 7:31 am

Google Tests Horizontal Lines For Sitelinks & People Also Ask

Apr 17, 2024 - 7:21 am
Google Search Engine Optimization

Google: Should We Explain The Crawl Stats Report in Search Console

Apr 17, 2024 - 7:11 am
Previous Story: Google: Our Algorithm Reviewers Are Different From User Reports Reviewers