Tag: robots.txt
Most Recent Entries
Google: Cloudflare Content Signals Robots.txt Directive Has No Effects
Jul 6, 2026 - 7:51 am 3 — by Barry SchwartzGoogle: Using A CDN & Want One Robots.txt File, Redirect Yours To The CDN
Jul 5, 2024 - 7:31 am 1 — by Barry SchwartzGoogle Checks 4 Billion Host Names Each Day For Robots.txt
Dec 27, 2023 - 7:41 am 1 — by Barry SchwartzSearch News Buzz Video Recap: Google Core & Reviews Update Not Done, Google Simple Search, Date Issues, Follower Counts & More
Nov 24, 2023 - 8:01 am 2 — by Barry SchwartzGoogle Removed The Robots FAQs Document
Nov 24, 2023 - 7:11 am 1 — by Barry SchwartzSearch News Buzz Video Recap: Buckle-Up, Google Reviews Update Weak, Hidden Gems Rolled Out, Personalized Google, Follow & Notes, SGE, Bing Chat, Copilot, SEO, Local, Ads & More
Nov 17, 2023 - 8:01 am 0 — by Barry SchwartzOlder Entries
New Google Search Console Robots.txt Report Replaced Robots.txt Tester Tool
Nov 16, 2023Bing Offers Methods To Block Bing Chat From Using Your Content
Sep 26, 2023Google: Very Few Robots.txt Files Are Over 500KB
Sep 12, 2023Search News Buzz Video Recap: Two Google Unconfirmed Updates, Performance Max Experiments & Search Console Data Change
Jan 20, 2023Search News Buzz Video Recap: No More Google Core Updates In 2022, Helpful Content Update Taking Longer, The Impact Of These Updates & More
Dec 23, 2022Google: You Can Use A Single Robots.txt For All Your International Sites
Dec 22, 2022500/503 HTTP Status Code On Robots.txt Can Remove Your Site From Google Search
Dec 14, 2022Google Says URL Case Applies To Robots.txt Directives
Oct 1, 2021Google: Sitemap Location In Robot.txt Inconsequential
Sep 29, 2021Shopify Now Lets You Edit Your Robots.txt File - Yay?!
Jun 23, 2021Google Updates Search Help Docs For Robots.txt & Structured Data
Jun 21, 2021Google Adds More Details To Robots.txt Specifications Help Document
Apr 28, 2021Search Buzz Video Recap: Google Question Hub Expands, Bing Webmaster Tools Crawl & Index Data & Google My Business Performance Reports
Jan 8, 2021Search Buzz Video Recap: Bing Webmaster Tools Relaunched, Links Not Most Important Google Factor & Google Rankings With Negative Reviews
Jul 31, 2020Gary Illyes From Google Quizzes SEOs
Jul 6, 2020Google: Robots.txt Can Be In Any Content Type
Jun 2, 2020Google: URL Parameters Tool Is Not A Replacement For Robots.txt
Jun 1, 2020Search Buzz Video Recap: Google November Update, Recipe Bug During Thanksgiving, Google Ads Overreporting & The Best SEO At Google
Nov 29, 2019Google: Robot.txt Blank Vs Allow Is No Difference
Nov 29, 2019Google: It Is A Bad Sign If Your Robots.txt Or Sitemap File Is Ranking For Normal Queries
Nov 8, 2019Google: Do Not Use Robots.txt To Block Indexing Of URLs With Parameters
Nov 8, 2019Popular Categories
Search Video Recaps
Most Recent Articles
Daily Search Forum Recap: July 10, 2026
Jul 10, 2026 - 10:00 am
0
-
by
Barry Schwartz
Search News Buzz Video Recap: Google Search Breaks Usage Records, Social & Video Platforms Show In Search Console & More Google Ads, ChatGPT Ads & More
Jul 10, 2026 - 8:01 am
0
-
by
Barry Schwartz
Google Ads Now Show AI Creation/Edited Labels
Jul 10, 2026 - 7:51 am
0
-
by
Barry Schwartz
Google Automatically Assigns Product Categories With Evolving Taxonomy
Jul 10, 2026 - 7:41 am
0
-
by
Barry Schwartz
Hack: Google AI Performance Reports For Platform Properties
Jul 10, 2026 - 7:31 am
3
-
by
Barry Schwartz
Google: Canonicalization Issues May Take Up To Two Weeks To Resolve
Jul 10, 2026 - 7:21 am
0
-
by
Barry Schwartz
