ChatGPT Relaunches Browse With Bing Respecting Robots.txt Protocols

Sep 28, 2023 - 7:11 am 1 by

Open Ai Robot Cookie Jar

OpenAI has relaunched the browse with Bing feature in ChatGPT which lets users use ChatGPT leveraging the index of Bing Search. This was after Open AI turned off the feature after it was caught accessing content behind paywalls.

OpenAI has said on X, "ChatGPT can now browse the internet to provide you with current and authoritative information, complete with direct links to sources. It is no longer limited to data before September 2021. Since the original launch of browsing in May, we received useful feedback. Updates include following robots.txt and identifying user agents so sites can control how ChatGPT interacts with them. Browsing is particularly useful for tasks that require up-to-date information, such as helping you with technical research, trying to choose a bike, or planning a vacation. Browsing is available to Plus and Enterprise users today, and we’ll expand to all users soon. To enable, choose Browse with Bing in the selector under GPT-4."

The AI company posted, saying, "As of July 3, 2023, we’ve disabled the Browse with Bing beta feature out of an abundance of caution while we fix this in order to do right by content owners. We are working to bring the beta back as quickly as possible, and appreciate your understanding!"

The issue was that some content that was behind a paywall was being consumed and presented to users. Open AI said they disabled it to do "right by content owners" until they fix it, which they did 12 weeks later.

Here are those tweets:

That took longer than I expected...

Forum discussion at X.

 

Popular Categories

The Pulse of the search community

Google Search Volatility

More Details

Search Video Recaps

 
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: July 10, 2026

Jul 10, 2026 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Search Breaks Usage Records, Social & Video Platforms Show In Search Console & More Google Ads, ChatGPT Ads & More

Jul 10, 2026 - 8:01 am
Google Ads

Google Ads Now Show AI Creation/Edited Labels

Jul 10, 2026 - 7:51 am
Google Ads

Google Automatically Assigns Product Categories With Evolving Taxonomy

Jul 10, 2026 - 7:41 am
Google Search Engine Optimization

Hack: Google AI Performance Reports For Platform Properties

Jul 10, 2026 - 7:31 am
Google Search Engine Optimization

Google: Canonicalization Issues May Take Up To Two Weeks To Resolve

Jul 10, 2026 - 7:21 am
 
Previous Story: Google Search Central Swag - Water Bottle, Hat, T-Shirt, Notepads, etc