Google: You Can Restrict XML Sitemaps Access To Search Engines

Jun 8, 2022 - 6:21 am 6 by

Google Sitemap

Google's John Mueller said it is acceptable to restrict access of your XML Sitemaps to just search engines. So you can technically block humans from seeing your XML sitemaps but allow Google to access it.

This came up when Christoph Cemper asked about some sites using Cloudflare to restrict access to their XML sitemap files. Christoph asked "Seen an xml sitemap "protected" by . Cloudflare. Wondering if Googlebot would type in that Captcha, or just retry later, or just ignore the map. Any experiences/guidance @JohnMu on such a case?"

John responded on Twitter saying "That's fine. These sitemap files are for search engines, and some sites prefer to restrict their access accordingly."

Here are those tweets:

This would clearly not be a form of cloaking because humans do not need to see your Sitemap files, because XML sitemap files are designed for search engines, not humans. But this obviously would not apply to HTML sitemap files...

Forum discussion at Twitter.


Popular Categories

The Pulse of the search community


Search Video Recaps

Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Ads

Google Ads Tests New Change History Page

Feb 26, 2024 - 7:21 am
Web Analytics

Google Analytics Referral Spam From Poland - Complaints

Feb 26, 2024 - 7:11 am
Google Updates

Massive Volatility Reported - Google Search Ranking Algorithm Update?

Feb 24, 2024 - 7:43 pm
Search Forum Recap

Daily Search Forum Recap: February 23, 2024

Feb 23, 2024 - 4:00 pm
Search Video Recaps

Search News Buzz Video Recap: Google Helpful Content System, Reddit’s Google Deal, Product Variant Schema, Google Ads, Bing Search & Search Volume Predictions

Feb 23, 2024 - 8:01 am
Google Ads

Google Ad Strength For PMAX To Weigh Assets Quantity & Variety More As AI Expands

Feb 23, 2024 - 7:51 am
Previous Story: Bing Tests Ads Tab Under Search Bar