Daily Search Forum Recap: July 2, 2019

Jul 2, 2019 - 4:00 pm 0 by

Here is a recap of what happened in the search forums today, through the eyes of the Search Engine Roundtable and other search forums on the web.

Search Engine Roundtable Stories:

  • Google To Drop Any Support For crawl-delay, nofollow, and noindex in robots.txt
    Google posted this morning that they are going to stop unofficially supporting the noindex, nofollow and crawl-delay directives within robots.txt files. Google has been saying this for years actually and hinted this was coming really soon and now it is here.
  • Google Image Search Tests Sticky Image Preview Box
    Google is testing, I believe, another image search design, this time with making the image preview box a sticky box on the right side panel. Google has been testing many variations of these image preview boxes in search for some time but this one is bolder because it sticks.
  • List Of All The GoogleBot Robots.txt Specifications Changes
    With Google aiming to make the robots.txt exclusion protocol a standard, they proposed some changes and submitted them the other day. Now, Google updated their own developer docs around the robots.txt specification to match. Here is a list of what has changed.
  • Google Shares Its Robots.txt Parser Code With Open Source World
    Google announced yesterday as part of its efforts to standardizing the robots exclusion protocol that it is open sourcing its robots.txt parser. That means how GoogleBot reads and listens to robots.txt files will be available for any crawler or coder to look at or use.
  • Search Google For Fireworks & Get A Fireworks Show
    Go to Google.com and search for [fireworks] on desktop or mobile and you will see Google light up the search results page with a fireworks display.
  • Robots.txt Birthday Cake With Martijn Koster At Google
    Here is a photo of the inventor of the robots.txt specification at Google (I think) with a robots.txt 25 years old birthday cake. Next to the cake is the revised proposed specification for the robots

Other Great Search Forum Threads:

Search Engine Land Stories:

Other Great Search Stories:


Industry & Business

Links & Promotion Building

Local & Maps

Mobile & Voice



Search Features

Other Search


Popular Categories

The Pulse of the search community


Search Video Recaps

Google AI Overviews, Ranking Volatility, Web Filter, Google Ads AI Summaries & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 20, 2024

May 20, 2024 - 4:00 pm
Google Search Engine Optimization

Google Working On Surfacing More Content That Comes From The Heart

May 20, 2024 - 7:51 am
Google Search Engine Optimization

Danny Sullivan: We Speak Directly To Engineers Working On Google Ranking Systems

May 20, 2024 - 7:41 am
Google Search Engine Optimization

Comments To Notes In Google Search?

May 20, 2024 - 7:31 am

Google Says Notes On Search Now Ends Soon

May 20, 2024 - 7:21 am
Bing Search

Bing Lets You Turn Off AI Responses But Google Doesn't Let You Turn Off AI Overviews

May 20, 2024 - 7:11 am
Previous Story: Google To Drop Any Support For crawl-delay, nofollow, and noindex in robots.txt