Google Updates Search Help Docs For Robots.txt & Structured Data

Jun 21, 2021 - 7:11 am 0 by

Google Documentation

Google has released several updates to both the robots.txt documentation and the structured data documentation last Friday. Here is a list of those changes from Google's site.

  • Simplified the introduction page to make it clearer what is robots.txt and what is its intended use.
  • Expanded the instructions about creating and updating robots.txt files.
  • Removed redundant sections from our documentation about how Google handles robots.txt.
  • Simplified sentences across all robots.txt documentation in English. This helps with localization.
  • Removed redundant documentation about how to build, test, and release structured data. Each feature has guidance about this, embedded directly into each guide (for example, the Video structured data guide.
  • Improved the troubleshooting sections across all structured data feature guides (for example, the Product structure data guide.
  • Added more beginner-friendly information about how to get started with structured data.

Here is some clarity on why Google made the changes from Lizzi Harvey and Gary Illyes of Google:

Insane, people sent in 148 comments that the both of them used to revise the robots.txt documents. Lizzi added that they also ended up "fixing issues across 20+ structured data docs."

Forum discussion at Twitter.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google News

Google Won't Be Broken Up In Monopoly Case But Required To Share Search Data

Sep 2, 2025 - 5:50 pm
Search Forum Recap

Daily Search Forum Recap: September 2, 2025

Sep 2, 2025 - 10:00 am
Google Search Engine Optimization

September 2025 Google Webmaster Report

Sep 2, 2025 - 7:51 am
Google Ads

New Google Ads Checkboxes To Filter Campaigns

Sep 2, 2025 - 7:41 am
Google Ads

Google Ads AI Max Not Designed To Go More Aggressively After SPN Inventory

Sep 2, 2025 - 7:31 am
Google Ads

Google Ads Search Google Maps For Location Assets

Sep 2, 2025 - 7:21 am
 
Previous Story: DuckDuckGo Advertisements Even In The Airports