Google: You Can Use A Single Robots.txt For All Your International Sites

Dec 22, 2022 - 7:31 am 0 by

Google Sad Robot

Gary Illyes from Google said on LinkedIn that if you want to you can use a single robots.txt file for all your international sites. He added that he is not saying this is a good idea, but rather, technically, you can implement your robots.txt this way.

Gary wrote, "Technically you could have a single central robots.txt for all your international sites (de.example, ch.example, at.example, etc.) that's hosted on your CDN (cdn.example/robots.txt)."

Although, Gary later added, "Not saying it's a good idea, or bad for that matter, just that it's possible."

Now, Ohgm wrote about this several years ago over here if you want a more detailed technical walkthrough.

But this is just another SEO PSA from Gary.

Forum discussion at LinkedIn.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: October 3, 2024

Oct 3, 2024 - 10:00 am
Google Updates

Record-Breaking Google Search Ranking Volatility Continues Into October

Oct 3, 2024 - 8:01 am
Bing Ads

Microsoft Advertising New Ad Experience, Diagnostics & Performance Snapshot

Oct 3, 2024 - 7:51 am
Google

Google Testing Search Instead For Section

Oct 3, 2024 - 7:41 am
Google

Google: SEOs Can Help Shape Client Policies & Decisions On AI Bots

Oct 3, 2024 - 7:31 am
Google Ads

Google Ads With Images & Map Carousel

Oct 3, 2024 - 7:21 am
Previous Story: Bing Will Fully Switch To The New BingBot User Agent In Early January