Apple Visual Intelligence Is Out With ChatGPT & Google Integration

Dec 12, 2024 - 7:31 am 4 by
Filed Under Apple App Store

Apple Visual Intelligence

Apple yesterday, including what I've been waiting to play with - Apple Visual Intelligence. It seems, at least for now, that Apple Visual Intelligence works with ChatGPT and Google Search but I was not able to trigger it for Apple Maps like the initial demo showed.

Apple wrote:

A new visual intelligence experience builds on Apple Intelligence and helps users learn about objects and places instantly, thanks to the new Camera Control on the iPhone 16 lineup. Visual intelligence can summarize and copy text, translate text between languages, detect phone numbers or email addresses with the option to add to contacts, and more. Camera Control also allows users to search Google so they can see where they can buy an item, or benefit from ChatGPT’s problem-solving skills to ask for an explanation about a complex diagram, such as from class notes. Users are in control of when third-party tools are used and what information is shared.

So sure, I was able to help me find how to buy a similar football with Google:

Apple Visual Intelligence Google

I was able to get it to do some of my homework with ChatGPT:

Apple Visual Intelligence Chatgpt Homework

Even describe the toys I have on my shelf with ChatGPT:

Apple Visual Intelligence Chatgpt Describe

But when I tried local searches of restaurants that I am looking at, it would not work, like we saw in the demo.

Here is the original demo that starts at the 55:05 mark:

ChatGPT is super integrated, just watch this demo from Sam Altman and the OpenAI team:

So this has a ton of potential, if integrated into more AI solutions.

Forum discussion at X.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: April 28, 2025

Apr 28, 2025 - 10:00 am
Google

Deposition: Google Used Search Signals & Data To Train Gemini AI Models

Apr 28, 2025 - 7:41 am
Bing Search

Bing Copilot Answer More Videos Section

Apr 28, 2025 - 7:31 am
Google

Google Tests New Shipping, Returns & Payment Section In Retail Knowledge Panel

Apr 28, 2025 - 7:21 am

Apple Updates Applebot Docs: Explaining Applebot-Extended vs Applebot

Apr 28, 2025 - 7:11 am
Google Search Engine Optimization

Google Search Console API Data Stuck On April 22

Apr 28, 2025 - 5:56 am
Previous Story: Official: Bing Search Drops Cache Link