Google: You Can Restrict XML Sitemaps Access To Search Engines

Jun 8, 2022 - 7:21 am 6 by

Google Sitemap

Google's John Mueller said it is acceptable to restrict access of your XML Sitemaps to just search engines. So you can technically block humans from seeing your XML sitemaps but allow Google to access it.

This came up when Christoph Cemper asked about some sites using Cloudflare to restrict access to their XML sitemap files. Christoph asked "Seen an xml sitemap "protected" by . Cloudflare. Wondering if Googlebot would type in that Captcha, or just retry later, or just ignore the map. Any experiences/guidance @JohnMu on such a case?"

John responded on Twitter saying "That's fine. These sitemap files are for search engines, and some sites prefer to restrict their access accordingly."

Here are those tweets:

This would clearly not be a form of cloaking because humans do not need to see your Sitemap files, because XML sitemap files are designed for search engines, not humans. But this obviously would not apply to HTML sitemap files...

Forum discussion at Twitter.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 11, 2025

Jul 11, 2025 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Helpful Content Recoveries With Core Update, AI Mode Expands, Hidden Ad Terms & Fewer Ad Clicks

Jul 11, 2025 - 8:01 am
Google Maps

Google Local & Business Profiles Drops June 25th - Reporting Glitch?

Jul 11, 2025 - 7:51 am
Google

Google Tests Zoom Effect In On Images Within Search Results

Jul 11, 2025 - 7:41 am
Bing Search

Bing Search Image Box Tests Explore Image & Visual Search Buttons

Jul 11, 2025 - 7:31 am
Bing Search

Microsoft Bing Tests Delivery Truck Icon In Search Ads

Jul 11, 2025 - 7:21 am
Previous Story: Bing Tests Ads Tab Under Search Bar