Daily Search Forum Recap: July 2, 2019

Jul 2, 2019 • 4:00 pm | comments (0) by twitter mastodon | Filed Under Search Forum Recap

Here is a recap of what happened in the search forums today, through the eyes of the Search Engine Roundtable and other search forums on the web.

Search Engine Roundtable Stories:

  • Google To Drop Any Support For crawl-delay, nofollow, and noindex in robots.txt
    Google posted this morning that they are going to stop unofficially supporting the noindex, nofollow and crawl-delay directives within robots.txt files. Google has been saying this for years actually and hinted this was coming really soon and now it is here.
  • Google Image Search Tests Sticky Image Preview Box
    Google is testing, I believe, another image search design, this time with making the image preview box a sticky box on the right side panel. Google has been testing many variations of these image preview boxes in search for some time but this one is bolder because it sticks.
  • List Of All The GoogleBot Robots.txt Specifications Changes
    With Google aiming to make the robots.txt exclusion protocol a standard, they proposed some changes and submitted them the other day. Now, Google updated their own developer docs around the robots.txt specification to match. Here is a list of what has changed.
  • Google Shares Its Robots.txt Parser Code With Open Source World
    Google announced yesterday as part of its efforts to standardizing the robots exclusion protocol that it is open sourcing its robots.txt parser. That means how GoogleBot reads and listens to robots.txt files will be available for any crawler or coder to look at or use.
  • Search Google For Fireworks & Get A Fireworks Show
    Go to Google.com and search for [fireworks] on desktop or mobile and you will see Google light up the search results page with a fireworks display.
  • Robots.txt Birthday Cake With Martijn Koster At Google
    Here is a photo of the inventor of the robots.txt specification at Google (I think) with a robots.txt 25 years old birthday cake. Next to the cake is the revised proposed specification for the robots

Other Great Search Forum Threads:

Search Engine Land Stories:

Other Great Search Stories:


Industry & Business

Links & Promotion Building

Local & Maps

Mobile & Voice



Search Features

Other Search

Previous story: Google To Drop Any Support For crawl-delay, nofollow, and noindex in robots.txt
blog comments powered by Disqus