This year Apple focused on
App Intents connects our App to Apple Intelligence using Spotlight Semantic Index, App Toolbox, and System Orchestrator
Apple Cloud Compute is free, PrivateCloudComputeModel . We can also call Gemini and Claude.
We used to use a Language model session, but now we can update the model as we go instead of create it up front.
Each Dynamic Profile is meant to work as its own separate agent.
With this we can evaluate and visualize model behavior. And the new /model CLI lets us interact with Foundation Models from the terminal.
The foundation models will be open source, so we will be able to run this on our own servers.
New framework making it possible to interact with AI from our Swift code. Both on mac and iOS.
Siri now understands App Actions, so we might be able to be run by Siri. We might be limited to only use system schemas. 😕
And thanks to on screen annotations, we can make Siri aware of what’s on screen.