Google AI Mode Gains Search With Image Multimodal Capabilities With Lens

Apr 8, 2025 - 7:51 am 0 by
Filed Under Google

Google Ai Mode

Google announced that AI Mode now lets you search by uploading a photo or image from your device. Before the new AI Mode only allowed you to search with text, but now, like you can with other Google Search features, you can use multimodal capabilities in Lens with AI Mode.

Google wrote, "With AI Mode’s new multimodal understanding, you can snap a photo or upload an image, ask a question about it and get a rich, comprehensive response with links to dive deeper. This experience brings together powerful visual search capabilities in Lens with a custom version of Gemini, so you can easily ask complex questions about what you see."

Here is what it looks like:

Google Ai Mode Lens Smaller

Here is some more of the technical details:

AI Mode builds on our years of work on visual search and takes it a step further. With Gemini’s multimodal capabilities, AI Mode can understand the entire scene in an image, including the context of how objects relate to one another and their unique materials, colors, shapes and arrangements. Drawing on our deep visual search expertise, Lens precisely identifies each object in the image. Using our query fan-out technique, AI Mode then issues multiple queries about the image as a whole and the objects within the image, accessing more breadth and depth of information than a traditional search on Google. The result is a response that’s incredibly nuanced and contextually relevant, so you take the next step.

As a reminder, Google has rolled out AI Mode beyond its premium subscribers a couple of weeks ago but I guess Google is doing a larger roll out. Google's Robby Stein wrote, "we’ve now started to make AI Mode available to millions more Labs users in the U.S."

Forum discussion at X.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google Search Engine Optimization

Google Search Console Reporting Change Since 100 Results Broke

Sep 15, 2025 - 7:51 am
Bing Search

Bing Places Update Coming Soon: Navigation, Experience & More

Sep 15, 2025 - 7:41 am
Google Search Engine Optimization

PSA: Most Third Party Google Search Tracking Tools Are Broken

Sep 15, 2025 - 7:31 am
Search Engine Optimization

Structured Data Does Not Help With Visibility In AI Search

Sep 15, 2025 - 7:21 am
Google News

FTC Investigating Google Over Ad Pricing & Terms On Websites

Sep 15, 2025 - 7:11 am
Google Search Engine Optimization

No, Google Search Console Did Not Add An AI Overviews Filter

Sep 15, 2025 - 7:02 am
 
Previous Story: Google Things To Know Also Linking Back To More Search Results