Google Updates Search Help Docs For Robots.txt & Structured Data

Jun 21, 2021 - 7:11 am 0 by

Google Documentation

Google has released several updates to both the robots.txt documentation and the structured data documentation last Friday. Here is a list of those changes from Google's site.

  • Simplified the introduction page to make it clearer what is robots.txt and what is its intended use.
  • Expanded the instructions about creating and updating robots.txt files.
  • Removed redundant sections from our documentation about how Google handles robots.txt.
  • Simplified sentences across all robots.txt documentation in English. This helps with localization.
  • Removed redundant documentation about how to build, test, and release structured data. Each feature has guidance about this, embedded directly into each guide (for example, the Video structured data guide.
  • Improved the troubleshooting sections across all structured data feature guides (for example, the Product structure data guide.
  • Added more beginner-friendly information about how to get started with structured data.

Here is some clarity on why Google made the changes from Lizzi Harvey and Gary Illyes of Google:

Insane, people sent in 148 comments that the both of them used to revise the robots.txt documents. Lizzi added that they also ended up "fixing issues across 20+ structured data docs."

Forum discussion at Twitter.


Popular Categories

The Pulse of the search community


Search Video Recaps

Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 24, 2024

May 24, 2024 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Ranking Volatility, Ads In Google AI Overviews, Sundar Pichai Interview, Heartfelt Helpful Content & More Ad News

May 24, 2024 - 8:01 am
Google Search Engine Optimization

Google: The Site Reputation Abuse Policy Enforcement Not Yet Algorithmic

May 24, 2024 - 7:51 am
Google Search Engine Optimization

Google Search Can Now Index Electronic Publication (EPUB)

May 24, 2024 - 7:41 am

Directory Of Embarrassing Google AI Overviews

May 24, 2024 - 7:31 am
Web Analytics

Google Analytics Real-Time Reports Adds Users In Last 5 Minutes

May 24, 2024 - 7:21 am
Previous Story: DuckDuckGo Advertisements Even In The Airports