Microsoft is testing image recognition and visual search features in Bing Chat. This is where you can upload an image and ask Bing Chat questions around that image.
Bing has this for Bing Image search, it is named visual search.
Right now, Bing's CEO Mikhail Parakhin said it is being tested on 5% of all searches.
He said this a few times on Twitter recently, he said, "We are flighting at 5% right now, if all goes well - will keep increasing." Adding that it is not rolling out this week because they want "to make sure it is safe, aligned and doesn't decrease quality of the regular chat." He added, "Running the first flight for Image recognition right now. As we get confidence in quality and safety, will roll out broadly for everyone. Plugins are a separate story, should start flighting hopefully in a matter of weeks."
Here are those tweets:
Started flighting
— Mikhail Parakhin (@MParakhin) June 10, 2023
Not this week - we have to make sure it is safe, aligned and doesn't decrease quality of the regular chat. We are flighting at 5% right now, if all goes well - will keep increasing.
— Mikhail Parakhin (@MParakhin) June 13, 2023
Running the first flight for Image recognition right now. As we get confidence in quality and safety, will roll out broadly for everyone. Plugins are a separate story, should start flighting hopefully in a matter of weeks.
— Mikhail Parakhin (@MParakhin) June 13, 2023
I do not see this myself but I suspect you'd be able to drag an image on top of the search box and ask a question:
Forum discussion at Twitter.
Update: Here are examples of this in the wild:
@mparakhin @jjordirib1 I got this feature in my Edge browser beta, but nowhere else. Unfortunately, it worked only once for me. All other tries have not worked. It first displayed three times the message with the blurred faces and after that asked me to retry (did not work) pic.twitter.com/YWUcU1U9Te
— Wladimir Kirianov (@wladefant) June 16, 2023
— Wladimir Kirianov (@wladefant) June 16, 2023
