GoogleBot Doesn't Pass A Referrer; Generally Directly Hits URLs

Aug 11, 2017 - 7:34 am 0 by

Greentech Google Bot 1900px

Google's John Mueller confirmed on Twitter that GoogleBot, Google's web crawler, generally does not pass referrer data because it typically only directly accesses URLs. So GoogleBot will not click from page to page on your web site but rather gather the URLs on a web page and visit those URLs at some point directly.

If you visit a page directly, it passes no referrer data.

John did add that "for embedded content (scripts, css, etc) I suspect we include the webpage's referrer." He added you should check your server logs to see if that is true or not.

Here are the tweets:

Forum discussion at Twitter.


Popular Categories

The Pulse of the search community


Search Video Recaps

Google Core Update Volatility, Helpful Content Update Gone, Dangerous Search Results & Ads Confusion - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: April 15, 2024

Apr 15, 2024 - 4:00 pm
Google Search Engine Optimization

Google Goes On Defensive On Its Search Quality & Forum Results Statements

Apr 15, 2024 - 7:51 am
Google Search Engine Optimization

Google Responds To The Verge Mocking Its Search Rankings For Best Printer

Apr 15, 2024 - 7:41 am
Google News

Google Threatens California: Tests Removing Links To Publishers & Pauses Investments

Apr 15, 2024 - 7:31 am
Google Search Engine Optimization

Google Crawl Budget Is Allocated By Hostname

Apr 15, 2024 - 7:21 am
Google AdSense

Google AdSense Publishers Reporting Huge RPM Earnings Drops

Apr 15, 2024 - 7:11 am
Previous Story: Google Logo For Hip Hop History