Google: You Can Use A Single Robots.txt For All Your International Sites

Dec 22, 2022 - 7:31 am 0 by

Google Sad Robot

Gary Illyes from Google said on LinkedIn that if you want to you can use a single robots.txt file for all your international sites. He added that he is not saying this is a good idea, but rather, technically, you can implement your robots.txt this way.

Gary wrote, "Technically you could have a single central robots.txt for all your international sites (de.example, ch.example, at.example, etc.) that's hosted on your CDN (cdn.example/robots.txt)."

Although, Gary later added, "Not saying it's a good idea, or bad for that matter, just that it's possible."

Now, Ohgm wrote about this several years ago over here if you want a more detailed technical walkthrough.

But this is just another SEO PSA from Gary.

Forum discussion at LinkedIn.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Bing Ads

Bing Testing Bold Sponsored Labels

Jan 13, 2025 - 7:31 am
Bing Search

Bing Tests Updated AI Copilot Answer Which Is More Publisher Friendly

Jan 13, 2025 - 7:21 am
Google Search Engine Optimization

Google Manual Actions For News & Discover Policy Violations Updated

Jan 13, 2025 - 7:11 am
Google Updates

Google Search Ranking Volatility Tools Cool Down

Jan 12, 2025 - 8:16 am
Search Forum Recap

Daily Search Forum Recap: January 10, 2025

Jan 10, 2025 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Local Ranking Bug, Reddit Drops, Microsoft Fools Searchers & More SEO, PPC & Local

Jan 10, 2025 - 8:01 am
Previous Story: Bing Will Fully Switch To The New BingBot User Agent In Early January