Google: You Can Use A Single Robots.txt For All Your International Sites

Dec 22, 2022 - 7:31 am 0 by

Google Sad Robot

Gary Illyes from Google said on LinkedIn that if you want to you can use a single robots.txt file for all your international sites. He added that he is not saying this is a good idea, but rather, technically, you can implement your robots.txt this way.

Gary wrote, "Technically you could have a single central robots.txt for all your international sites (de.example, ch.example, at.example, etc.) that's hosted on your CDN (cdn.example/robots.txt)."

Although, Gary later added, "Not saying it's a good idea, or bad for that matter, just that it's possible."

Now, Ohgm wrote about this several years ago over here if you want a more detailed technical walkthrough.

But this is just another SEO PSA from Gary.

Forum discussion at LinkedIn.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: June 23, 2025

Jun 23, 2025 - 10:00 am
Google

Google Questions AI Overview Click Studies & Says Web Is Thriving

Jun 23, 2025 - 7:51 am
Google

Google Touts Its Index Freshness As A Win For Google AI

Jun 23, 2025 - 7:41 am
Google Ads

Google Ads Tests Compact Segment Dropdown Menu

Jun 23, 2025 - 7:31 am
Google Ads

Google Merchant Center Product Status Changes History Report Returning

Jun 23, 2025 - 7:21 am
Bing Search

Bing Search Tests Updated Image Carousel With More Images

Jun 23, 2025 - 7:11 am
Previous Story: Bing Will Fully Switch To The New BingBot User Agent In Early January