Twitter (X) Now Is Blocking Bing Search

Oct 19, 2023 - 6:51 am 14 by
Filed Under Bing Search

Twitter Bird Fighting Bing Robots

X, well, Twitter.com, is now blocking Bing Search, specifically Bingbot, from crawling and accessing content posted on Twitter.com, on the X platform. Twitter specifically added to its robots.txt file a directive to disallow Bingbot from crawling the content on its platform.

Here is a screenshot of its robots.txt file:

Twitter Robots Txt Bingbot

This was spotted first, I believe, by Mike Ginley who posted this on X, "Twitter blocking Bing is an interesting move..." Glenn Gabe dug into the timeline, noticing this was a fairly recent change by Bing:

In fact, a site command on Bing only shows 180,000 Twitter URLs showing up:

Bing Twitter Site Command

But with Google, a site command shows 422 million URLs.

Google Twitter Site Command

Back in July Twitter blocked Google leading to a huge drop in visibility for Twitter in Google Search. A few days later, Twitter reversed that change.

I guess Twitter / X does not want traffic from Bing Search? I mean, if they want more efficient indexing, just use IndexNow?

Forum discussion at X.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Ranking Volatility, Tons Of Google Bugs, Most Read Articles, Bing Deep Search & Quality... - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Video Recaps

Search News Buzz Video Recap: Google Ranking Volatility, Tons Of Google Bugs, Most Read Articles, Bing Deep Search & Quality & SEOs Not Loving Google

Mar 1, 2024 - 8:01 am
Google

Google Court Document Says Search Quality Continues To Improve

Mar 1, 2024 - 7:51 am
Google Search Engine Optimization

Google Structured Data Carousels Beta Documentation Added

Mar 1, 2024 - 7:41 am
Google

Now You Can Opt Out Of Google Search Place Entities In Page Insights

Mar 1, 2024 - 7:31 am
Google Maps

Google Updates Business Profiles Customer Interactions Every Few Days

Mar 1, 2024 - 7:21 am
Google AdSense

Google AdSense Offerwall Messages (Beta)

Mar 1, 2024 - 7:11 am
Previous Story: Google Places 'Shop All Deals' Banner In The Search Results