Google: You Can Use A Single Robots.txt For All Your International Sites

Dec 22, 2022 - 7:31 am 0 by

Google Sad Robot

Gary Illyes from Google said on LinkedIn that if you want to you can use a single robots.txt file for all your international sites. He added that he is not saying this is a good idea, but rather, technically, you can implement your robots.txt this way.

Gary wrote, "Technically you could have a single central robots.txt for all your international sites (de.example, ch.example, at.example, etc.) that's hosted on your CDN (cdn.example/robots.txt)."

Although, Gary later added, "Not saying it's a good idea, or bad for that matter, just that it's possible."

Now, Ohgm wrote about this several years ago over here if you want a more detailed technical walkthrough.

But this is just another SEO PSA from Gary.

Forum discussion at LinkedIn.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 12, 2025

May 12, 2025 - 10:00 am
Google

Google Tests AI Mode Button On Google Search Box

May 12, 2025 - 7:51 am
Google

Google Tests AI Overviews In Turkey, Sweden, Netherlands & More Prior To I/O

May 12, 2025 - 7:41 am
Google Ads

Rare Google Ads Reporting Bug Led To Over Reported Click-Through Rates

May 12, 2025 - 7:31 am
Google

Google Tests Recipes With Interactive AI Overviews

May 12, 2025 - 7:21 am
Google

Google Search Discussions Beta May One Day Replace Reddit Results

May 12, 2025 - 7:11 am
Previous Story: Bing Will Fully Switch To The New BingBot User Agent In Early January