Google Search Discovers New Registered Domains For Indexing

Apr 6, 2023 - 7:41 am 6 by

Robot Google Needle Haystacks

Google's Gary Illyes confirmed that Google does look at domain name records for discovery of new domains to include in the Google Search Index. He said this at the 9:40 mark into yesterday's Search Off The Record podcast.

Gary said, "we are looking at domain records for discovery but that also just means that we would discover the domain name." So if you launch a new domain, since 2005, when Google became a registrar (they didn't start selling domains until 2014), Google will know when about new domain records.

Google wouldn't necessarily know about subdomains or subfolders, Gary said "well, depending how the DNS is set up." Meaning, sometimes Google can pick it up from the CNAME records but often not. Gary wrote:

So for example if you are broadcasting in the DNS records the CNAMEs that you set up for... the CNAMEs are a special record for... in DNS which allows you to map custom authority bits to IP addresses. So you could do subdomain.example.com maps to example.com and then the server would know the authority bit is subdomain.example.com, then serve one specific resource on the server and you can set up your DNS to advertise these CNAME records and then we might be able to discover them.

But if the DNS is set up, I would say properly, then these are not advertised. So basically, you just get the A record, which is the main record for a domain name, basically maps the domain name to the server's IP address. And that's how our domain names typically are set up. Basically, just the A record, when you are asking for the domain record, not all the other subdomains as well.

Since 2004, the SEO community thought Google did find new domains to index through this method anyway. So this is not really new, it is about 20 years old. :)

Here is the embed of the podcast, so you can listen to the full podcast:

Gary updated me with this:

Forum discussion at Twitter.

Note: This was pre-written and scheduled to be posted today, I am currently offline for Passover.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Core Update Coming, Ranking Volatility, Bye Search Notes, AI Overviews, Ads & More - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 19, 2024

Jul 19, 2024 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Core Update Coming, Ranking Volatility, Bye Search Notes, AI Overviews, Ads & More

Jul 19, 2024 - 8:01 am
Google Search Engine Optimization

Billions Of Google goo.gl URLs Will No Longer Work

Jul 19, 2024 - 7:51 am
Google Search Engine Optimization

Google: ccTLDs & Language Do Help You Rank A Little Better In Local Country Region

Jul 19, 2024 - 7:41 am
Google Search Engine Optimization

Google's On Knowing If Your SEO Team Is Doing Their Job

Jul 19, 2024 - 7:31 am
Google Ads

Google Merchant Center Next Gains Support For Supplemental Feeds

Jul 19, 2024 - 7:21 am
Previous Story: Google Search "Cheaper Options" In Product Detail Overlay