Google Search Discovers New Registered Domains For Indexing

Apr 6, 2023 - 7:41 am 6 by

Robot Google Needle Haystacks

Google's Gary Illyes confirmed that Google does look at domain name records for discovery of new domains to include in the Google Search Index. He said this at the 9:40 mark into yesterday's Search Off The Record podcast.

Gary said, "we are looking at domain records for discovery but that also just means that we would discover the domain name." So if you launch a new domain, since 2005, when Google became a registrar (they didn't start selling domains until 2014), Google will know when about new domain records.

Google wouldn't necessarily know about subdomains or subfolders, Gary said "well, depending how the DNS is set up." Meaning, sometimes Google can pick it up from the CNAME records but often not. Gary wrote:

So for example if you are broadcasting in the DNS records the CNAMEs that you set up for... the CNAMEs are a special record for... in DNS which allows you to map custom authority bits to IP addresses. So you could do subdomain.example.com maps to example.com and then the server would know the authority bit is subdomain.example.com, then serve one specific resource on the server and you can set up your DNS to advertise these CNAME records and then we might be able to discover them.

But if the DNS is set up, I would say properly, then these are not advertised. So basically, you just get the A record, which is the main record for a domain name, basically maps the domain name to the server's IP address. And that's how our domain names typically are set up. Basically, just the A record, when you are asking for the domain record, not all the other subdomains as well.

Since 2004, the SEO community thought Google did find new domains to index through this method anyway. So this is not really new, it is about 20 years old. :)

Here is the embed of the podcast, so you can listen to the full podcast:

Gary updated me with this:

Forum discussion at Twitter.

Note: This was pre-written and scheduled to be posted today, I am currently offline for Passover.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Volatility, Helpful Content Update Gone, Dangerous Search Results & Ads Confusion - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: April 18, 2024

Apr 18, 2024 - 4:00 pm
Google

Google Notes On Search Won't Necessarily Go Away In May

Apr 18, 2024 - 7:51 am
Google Maps

Google Maps Releases New Directions, Travel & EV Features

Apr 18, 2024 - 7:41 am
Google Ads

Google Ads Reminds Advertisers Some Ad Customizers Will Go Away May 31st

Apr 18, 2024 - 7:31 am
Google Search Engine Optimization

Google Drops Video Carousel Markup

Apr 18, 2024 - 7:21 am
Google Maps

Google Business Profiles Register Your Defibrillator (AED)

Apr 18, 2024 - 7:11 am
Previous Story: Google Search "Cheaper Options" In Product Detail Overlay