Google Explains How 304 (Not Modified) HTTP Status Codes Can Go Very Wrong

Aug 29, 2023 - 7:11 am 1 by

Google Robot Looking In Window

Gary Illyes from Google posted how serving a 304 HTTP server status code can "backfire spectacularly," even though the 304 can be a super useful signal for search engines.

Gary Illyes wrote on LinkedIn, "HTTP 304 (not modified) is super useful to signal crawlers that the content they're accessing hasn't changed since it was last crawled, but it can also backfire spectacularly."

Gary then listed the steps on how this can happen:

  • Crawler requests URL
  • Server encounters some sort of error and serves an empty page with a 200 (ok) HTTP status code
  • Crawler considers that as a transient soft error, schedules a recrawl to verify
  • Since the content (that was not actually served) hasn't changed, the server returns HTTP 304 for the particular URL, without content (as mandated by the HTTP standard RFC 9110)
  • The crawler "learns" the error is persistable and doesn't try to recrawl anymore (it will eventually, but holding your breath is not recommended)

In short, if you have a server or HTML issue where you serve Google a blank page or wrong content and then you tell Google not to come back with a 304 HTTP server status code, that can be bad.

Forum discussion at LinkedIn.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Volatility, Helpful Content Update Gone, Dangerous Search Results & Ads Confusion - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Search Engine Optimization

Google Goes On Defensive On Its Search Quality & Forum Results Statements

Apr 15, 2024 - 7:51 am
Google Search Engine Optimization

Google Responds To The Verge Mocking Its Search Rankings For Best Printer

Apr 15, 2024 - 7:41 am
Google News

Google Threatens California: Tests Removing Links To Publishers & Pauses Investments

Apr 15, 2024 - 7:31 am
Google Search Engine Optimization

Google Crawl Budget Is Allocated By Hostname

Apr 15, 2024 - 7:21 am
Google AdSense

Google AdSense Publishers Reporting Huge RPM Earnings Drops

Apr 15, 2024 - 7:11 am
Google Updates

Weekend Google Core Ranking Volatility Taxing Site Owners

Apr 14, 2024 - 8:15 am
Previous Story: Google Fuel Pump