Google: Crawl Budget, GoogleBot, Scheduler & JavaScript

Jul 2, 2021 - 7:31 am 0 by

Observation Google

I read one of those deep thought lines online from Johan Hulsen on Twitter who asked Gary Illyes of Google a question on crawling. In short, Johan asked if the crawl budget looks to the scheduler, which kind of depends on Googlebot, but Googlebot does not render pages, how does it find links within JavaScript pages.

Let me share the tweet, in which even Gary Illyes from Google was impressed (Gary is hard to impress):

This came up when Gary put it out there to submit questions for the Search Off the Record podcast:

So feel free to submit more questions on Twitter but what do you think the answer is to the question above?

Forum discussion at Twitter.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Web Analytics

Google Analytics Real Time Reporting Broken Again

Jul 17, 2025 - 10:40 am
Search Forum Recap

Daily Search Forum Recap: July 17, 2025

Jul 17, 2025 - 10:00 am
Google

Google AI Mode Gets Gemini 2.5 Pro & Deep Search For A Fee

Jul 17, 2025 - 7:51 am
Google

Google Discover Officially Gets AI-Generated Summaries

Jul 17, 2025 - 7:41 am
Google

How The Google Ask For Me Feature Works & New AI Local Calling

Jul 17, 2025 - 7:31 am
Google

Google Tests Much Larger Favicons In Search

Jul 17, 2025 - 7:21 am
Previous Story: Google: Page Experience Update Does Not Have A Whitelist List