Google Search Discovers New Registered Domains For Indexing

Apr 6, 2023 - 7:41 am 6 by

Robot Google Needle Haystacks

Google's Gary Illyes confirmed that Google does look at domain name records for discovery of new domains to include in the Google Search Index. He said this at the 9:40 mark into yesterday's Search Off The Record podcast.

Gary said, "we are looking at domain records for discovery but that also just means that we would discover the domain name." So if you launch a new domain, since 2005, when Google became a registrar (they didn't start selling domains until 2014), Google will know when about new domain records.

Google wouldn't necessarily know about subdomains or subfolders, Gary said "well, depending how the DNS is set up." Meaning, sometimes Google can pick it up from the CNAME records but often not. Gary wrote:

So for example if you are broadcasting in the DNS records the CNAMEs that you set up for... the CNAMEs are a special record for... in DNS which allows you to map custom authority bits to IP addresses. So you could do subdomain.example.com maps to example.com and then the server would know the authority bit is subdomain.example.com, then serve one specific resource on the server and you can set up your DNS to advertise these CNAME records and then we might be able to discover them.

But if the DNS is set up, I would say properly, then these are not advertised. So basically, you just get the A record, which is the main record for a domain name, basically maps the domain name to the server's IP address. And that's how our domain names typically are set up. Basically, just the A record, when you are asking for the domain record, not all the other subdomains as well.

Since 2004, the SEO community thought Google did find new domains to index through this method anyway. So this is not really new, it is about 20 years old. :)

Here is the embed of the podcast, so you can listen to the full podcast:

Gary updated me with this:

Forum discussion at Twitter.

Note: This was pre-written and scheduled to be posted today, I am currently offline for Passover.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: December 3, 2024

Dec 3, 2024 - 10:00 am
Google Search Engine Optimization

Google: Just Because You Call Yourself It, It Doesn't Mean You Will Rank For It

Dec 3, 2024 - 7:51 am
Google Ads

New Google Ads Customer Match For Google Analytics Audiences

Dec 3, 2024 - 7:41 am
Google

Google Search YouTube Summary Pilot: Quick Takes & Key Takeaways

Dec 3, 2024 - 7:31 am
Google

Google Tests Underline Title, Link & Domain On Hover In Search Results

Dec 3, 2024 - 7:21 am
Google

Google Gemini Testing New & Improved Link Sources

Dec 3, 2024 - 7:11 am
Previous Story: Google Search "Cheaper Options" In Product Detail Overlay