A fully featured iOS app, built in Swift - here is a demo of the app to give you a deeper look into the app! 👀
On-device app intents ( meaning I had basically 🤪built a super-Siri for just the
#GoogleIO event)
Agentic 🤖Tool Calling : had access to whatever I wanted it to have access to: calendar, bookmarks, system preferences, even push notifications, agentic on device local AI !
I built the app to give me time, and even location aware reminders 🗺️ so I could know where I need to be, even walking directions which used another agentic tool call with the on device maps SDK .
I didn’t want to always be on the phone so I pushed to my Apple Watch ⌚️, for reminders and quick actions (via bluetooth so still using local-only workflows btw) !
I leveraged the
@googlegemma E4B model’s transcription 👂 features to save notes on each session so I didn’t have to switch between apps.
In this demo you see real dynamic cards rendered by the tool calls directly in the generative chat interface ( yes generative chat, all were components generated by the model based on JSON tool calls responses that were built on the fly from the model intuitively trained to give JSON tool calls responses when needed,I got a huge kick out of, if you watch I exposed the JSON intentionally because after all I'm a
@googleaidevs builder, why not right? )
I even pushed this to the the edge with built in application memory workflow, giving my app the ability to maintain context of what I was interested in just by tracking my interactions with the data within the app or what the app generates from the fine tuning. So If looked at event within the app, or asked about a speaker on chat, the app would retain that for accelerated recall in other parts of this application )
ALL offline-ondevice built with
@GoogleAIStudio and
@antigravity AND entirely with Gemini 3.1 and Gemini Flash as my coding model too!
I had an absolute blast building this. 👇 and it has audio, which makes this demo really land imo.
Built to be entirely offline and on-device. I used
@googlegemma E4B and fine-tuned it on a custom dataset of all the information to get my personal conceirege to all things
#GoogleIO
Design and prototype made with
@GoogleAIStudio and built (INCLUDING THIS DEMO) entirely with
@antigravity, not only was the app built but full computer use, mouse control. Recorded end to end, voice over all done with some custom skills and MCP .