Apple Expands Visual Intelligence With Bill Splitting, Nutrition Insights, and visionOS Support
Apple today unveiled significant upgrades to Visual Intelligence, including a new Siri mode in the Camera app that can analyze real-world objects and take actions directly from what the iPhone sees.
Apple's vice president of software engineering Sebastien Marineau-Mes detailed the enhancements during today's WWDC keynote, explaining that the new Siri mode in Camera uses image understanding powered by Apple's foundational models to interpret what the camera is pointed at and surface contextually relevant actions.
One of the headline use cases is bill splitting. Users can aim their iPhone camera at a restaurant check and immediately divide the total between friends, with Apple Cash integration allowing payments to be sent on the spot. Apple also demoed pointing the camera at a plate of food to receive nutritional insights.
Visual Intelligence is also coming to visionOS, bringing the same capability to Apple's spatial computing platform. Siri can recognize real-world objects in a user's environment and surface relevant information about them on demand.
Popular Stories
Apple today provided developers with the third beta of an upcoming visionOS 27 update for testing purposes, with the beta coming two weeks after Apple released the second beta.
visionOS 27 can be installed by opening the Settings app, going to Software Updates, and opting into Beta Updates.
visionOS 27 introduces Siri AI, the smarter and more capable version of Siri that's similar in...
Apple today provided developers with the fourth betas of upcoming watchOS 26.6, tvOS 26.6, and visionOS 26.6 betas for testing purposes. The software comes a week after Apple seeded the third betas.
The software updates are available through the Settings app on each device, and because these are developer betas, a free developer account is required.
There's no word on what's in the...
Apple has suspended development of the display for a cheaper, lighter version of the Vision Pro that it originally planned to launch in the next few years, according to The Elec.
The Korean outlet says Apple supplier Samsung Display is set to internally wind down the panel project – known in the industry as "G-VR" – with development set to be formally terminated by September.
G-VR is ...
