Google: Crawl Budget, GoogleBot, Scheduler & JavaScript

Jul 2, 2021 - 7:31 am 0 by

Observation Google

I read one of those deep thought lines online from Johan Hulsen on Twitter who asked Gary Illyes of Google a question on crawling. In short, Johan asked if the crawl budget looks to the scheduler, which kind of depends on Googlebot, but Googlebot does not render pages, how does it find links within JavaScript pages.

Let me share the tweet, in which even Gary Illyes from Google was impressed (Gary is hard to impress):

This came up when Gary put it out there to submit questions for the Search Off the Record podcast:

So feel free to submit more questions on Twitter but what do you think the answer is to the question above?

Forum discussion at Twitter.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google

Google Sued SerpApi Over Scraping Search Results

Dec 19, 2025 - 3:50 pm
Search Forum Recap

Daily Search Forum Recap: December 19, 2025

Dec 19, 2025 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Core Update Status, Gemini 3 Flash In AI Mode, Optimizing For AI Search & Bug Fixes Galore

Dec 19, 2025 - 8:01 am
Google

Google Product Reviews Bug On Product Detail Pages

Dec 19, 2025 - 7:51 am
Google

Google Search Testing New Sports Features

Dec 19, 2025 - 7:41 am
Google Ads

Google Ads Tests Video Assets From Merchant Center

Dec 19, 2025 - 7:31 am
 
Previous Story: Google: Page Experience Update Does Not Have A Whitelist List