Twitter (X) Now Is Blocking Bing Search

Oct 19, 2023 - 7:51 am 14 by
Filed Under Bing Search

Twitter Bird Fighting Bing Robots

X, well, Twitter.com, is now blocking Bing Search, specifically Bingbot, from crawling and accessing content posted on Twitter.com, on the X platform. Twitter specifically added to its robots.txt file a directive to disallow Bingbot from crawling the content on its platform.

Here is a screenshot of its robots.txt file:

Twitter Robots Txt Bingbot

This was spotted first, I believe, by Mike Ginley who posted this on X, "Twitter blocking Bing is an interesting move..." Glenn Gabe dug into the timeline, noticing this was a fairly recent change by Bing:

In fact, a site command on Bing only shows 180,000 Twitter URLs showing up:

Bing Twitter Site Command

But with Google, a site command shows 422 million URLs.

Google Twitter Site Command

Back in July Twitter blocked Google leading to a huge drop in visibility for Twitter in Google Search. A few days later, Twitter reversed that change.

I guess Twitter / X does not want traffic from Bing Search? I mean, if they want more efficient indexing, just use IndexNow?

Forum discussion at X.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: November 6, 2024

Nov 6, 2024 - 10:00 am
Google Updates

Election 2024 Google Search Ranking Update 🇺🇸

Nov 6, 2024 - 7:51 am
Google Search Engine Optimization

Report: 22% Of Sites Hit By Google's Helpful Content Update Are Up 20%+

Nov 6, 2024 - 7:41 am
Bing Ads

Microsoft Advertising Updates Shopping Audience Campaigns

Nov 6, 2024 - 7:31 am
Google

Google Highlights New Google Shopping With New Label

Nov 6, 2024 - 7:21 am
Google Ads

Google Shopping Ads With Bag Icon In Search

Nov 6, 2024 - 7:11 am
Previous Story: Google Places 'Shop All Deals' Banner In The Search Results