GoogleBot Doesn't Pass A Referrer; Generally Directly Hits URLs

Aug 11, 2017 - 7:34 am 0 by

Greentech Google Bot 1900px

Google's John Mueller confirmed on Twitter that GoogleBot, Google's web crawler, generally does not pass referrer data because it typically only directly accesses URLs. So GoogleBot will not click from page to page on your web site but rather gather the URLs on a web page and visit those URLs at some point directly.

If you visit a page directly, it passes no referrer data.

John did add that "for embedded content (scripts, css, etc) I suspect we include the webpage's referrer." He added you should check your server logs to see if that is true or not.

Here are the tweets:

Forum discussion at Twitter.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Video Recaps

Search News Buzz Video Recap: Google Core Update Updates, Site Reputation Abuse Coming, Links, Ads & More

Apr 26, 2024 - 8:01 am
Google Search Engine Optimization

Google Publisher Center No Longer Allows Adding Publications

Apr 26, 2024 - 7:51 am
Google

Google Tests Placing The Snippet Date Next To URL

Apr 26, 2024 - 7:41 am
Google

Google Breaks Out Googlebot IP Ranges For User-Triggered Fetchers

Apr 26, 2024 - 7:31 am
Google News

Google Ad Revenue Up 13% & Bing Ads Revenue Up 12%

Apr 26, 2024 - 7:21 am
Google Ads

Google Ads Diagnostic Tool Low Keyword Quality Warning

Apr 26, 2024 - 7:11 am
Previous Story: Google Logo For Hip Hop History