Spiders
Most Recent Entries
SpiderDuck: The Realtime Twitter Spider
Nov 18, 2011 - 8:30 am 3 — by Barry SchwartzGoogle: GoogleBot China Crawler A Bug
Mar 10, 2011 - 9:39 am 5 — by Barry SchwartzGoogleBot Caught Masking Around As An iPhone
Feb 23, 2011 - 8:34 am 6 — by Barry SchwartzGoogle On Mobile SEO: GoogleBot & URL Structure
Feb 22, 2011 - 9:20 am 46 — by Barry SchwartzHot In Web Design But Not In SEO? Parallax Effects Design
Feb 16, 2011 - 8:54 am 18 — by Barry SchwartzGoogle Doesn't Use Toolbar Data To Index New URLs
Feb 2, 2011 - 9:11 am 9 — by Barry SchwartzGoogle: Remove The Robots.txt File Completely
Jan 6, 2011 - 8:31 am 29 — by Barry SchwartzOlder Entries
Google: Canonical Tag Slower Than 301 Redirect
Dec 8, 2010Structure Is King With SEO, Not Content
Dec 6, 2010Google Published Detailed Specifications on Robots.txt
Nov 26, 2010Google Fixes Blogspot Indexing Issue: New Content Being Indexed
Oct 25, 2010Google Stop Indexing Blogger (Blogspot) Posts
Oct 22, 2010Why Google May Not Find Your Sitemap File
Oct 11, 2010Google Changes Coming Tomorrow: AJAX Results, 30 Results Per Page, Streaming Results & More?
Sep 7, 2010Microsoft Cloaking MSNBots Again?
Sep 3, 2010GoogleBot Crawling Less or More Efficiently?
Sep 2, 2010GoogleBot Crawling From Different Locations At Same Time
Aug 24, 2010Google: The Robots Meta Tag Is Cumulative (First Come First Serve)
Jul 30, 2010Google Not Sending Referrer Data Again?
Jul 13, 2010GoogleBot Acting Weird
Jun 30, 2010BingBot Is Coming, BingBot Is Coming: Bye MSNBot
Jun 30, 2010GoogleBot Back In Business, Crawling & Crawling
Jun 25, 2010WordPress System Admin Calls Out Google's Evil Spiders
Jun 23, 2010GoogleBot Stop Crawling Your Site On June 15th?
Jun 16, 2010Bing Updates Language Detection After One or Two Crawls
Apr 28, 2010Bing: We Know About Your Images & Choose Not To Show Them
Mar 8, 2010Bing Masking MSNBot As Internet Explorer or a Rogue Bot?
Feb 22, 2010Bing Indexing New Content & Sites Faster?
Feb 17, 2010Google News Page Size Limit Is 256 KB
Jan 13, 2010Popular Categories
Search Video Recaps
Most Recent Articles
Daily Search Forum Recap: September 16, 2025
Sep 16, 2025 - 10:00 am
0
-
by
Barry Schwartz
New (But Old) Google Search Console Achievements
Sep 16, 2025 - 7:51 am
0
-
by
Barry Schwartz
What Is Google Question Fringe Score
Sep 16, 2025 - 7:41 am
0
-
by
Barry Schwartz
Bing Image Search With Ads Mixed Into The Organic Results
Sep 16, 2025 - 7:31 am
0
-
by
Barry Schwartz
Bing Testing Sticky Search Bar Header
Sep 16, 2025 - 7:21 am
0
-
by
Barry Schwartz
Rolling Stone Publisher (Penske) Sued Google Over AI Overviews
Sep 16, 2025 - 7:11 am
1
-
by
Barry Schwartz
