AI frameworks at Apple

Joined September 2009
30 Photos and videos
Richard Wei retweeted
The overview maps everything else, including the bit nobody mentions: macOS 27 ships an fm CLI, and fm serve gives you a local OpenAI-compatible endpoint backed by Apple's models. I'll update the post as I publish the rest: ivanmagda.dev/posts/wwdc26-f…
1
4
322
Richard Wei retweeted
My favorite part: Dynamic Profiles. One session swaps instructions, tools, and the model mid-conversation via a SwiftUI-style body. I built these mechanisms by hand for my coding-agent series, so I mapped Apple's versions onto ours, footguns included: ivanmagda.dev/posts/foundati…
1
1
2
245
Richard Wei retweeted
PrivateCloudComputeLanguageModel: a 32K-context server model with reasoning, switched on with one line. No account, no keys, no per-token bill for eligible apps. Each user spends from a daily quota instead, and that quota deserves real UI. Deep dive: ivanmagda.dev/posts/foundati…
1
1
5
282
Richard Wei retweeted
Last June, Foundation Models was a Swift API to one small on-device model. After WWDC26 the same session API runs Apple's server model, Claude, Gemini, or a local Qwen. I spent the week in the betas. Three posts on what changed:
1
3
20
1,459
Richard Wei retweeted
We had a blast at the Machine Learning & AI Group Lab today! ML technologies, frameworks, models, evaluations, and lots of fun with @trebolloc, @LouisDhauwe and others. 🎬 Video is up on YouTube - questions and discussions on Core AI, MLX, Foundation Models framework, Evaluations and more! WWDC26 was amazing for AI/ML. Super excited for all the incredible experiences you’ll build with these technologies! Thank you! youtube.com/live/n6TdbD7nh2k…
7
40
2,831
Richard Wei retweeted
You can now use Gemini via Apple's Foundation Model framework. This means: - same calls for on-device and cloud-hosted inference - you can use Grounding with Google Search / Google Maps - access to Gemini's large context window (up to 1M tokens)
2
10
79
7,333
Richard Wei retweeted
Foundation Modelsめっちゃ進化してる😲iOS 27では、オンデバイスモデルにVision機能が追加されたことにより、画像に関する質問にも答えられるように。 UIImage, NSImage, CGImage, Core Image 型, CoreVideo, Pixel Buffer, ファイル URLの形式に対応。 大きな画像ほどトークンを消費する #wwdc26
1
3
15
2,680
Richard Wei retweeted
If you missed our AI/ML Group Lab yesterday, we're doing another one on Friday June 12, 2026 9:00 AM – 10:00 AM PT. We'll discuss Core AI, Foundation Models framework, Evaluations framework and MLX. Join us! developer.apple.com/wwdc26/s…
We wrapped up an amazing panel discussion on the latest in AI and Machine Learning at WWDC26. Thank you for all your questions about agents in Xcode, Core AI, Evaluations framework, Foundation Models framework, MLX. Here is the recording ICYMI. youtube.com/live/bXb18GwYQS8…
8
22
2,554
Apple developers can now use @ㅤGenerable, LanguageModelSession and many familiar Swift APIs directly with Claude!
New for Apple developers: Foundation Models support for Claude lets developers use Apple's Foundation Models framework to call Claude for multi-step reasoning, code generation, and longer context.
2
9
1,211
Richard Wei retweeted
For WWDC26, Apple has introduced a shift in how you think about the foundation models framework. The broad "Foundation Models" term could now refer to any of these 3 things, which can be confusing. → Apple Foundation Models (AFM) - the actual on- device and server LLMs from Apple . → Foundation Models Framework - a model-agnostic layer for running LLMs on Apple devices (both local AND server, Apple AND Third-Party) . → Foundation Models Framework Utilities - An open source package that adds extra utilities for working with LLMs. Supported on apple platforms and linux. The Framework is now the main product. AFM is just one of the options you can plug in.
1
10
52
5,919
RT @conspirator: Anthropic and Google recently announced support for Apple's Foundation Models framework, making state-of-the-art Claude an…
7
Richard Wei retweeted
Wait, what? 😱 Apple Foundation Model on Private Cloud Compute is working on fm CLI! Here's a video!
12
21
336
38,493
Richard Wei retweeted
One of my favorite features in macOS 27 is fm CLI. Simply open the terminal and type: $ fm chat And start chatting with the on-device or Private Cloud Compute (PCC) model. You can also use fm in your bash scripts to automate tasks! Watch it in action: youtu.be/pvefPi4J2G4?t=239&s…
1
6
53
9,471
Richard Wei retweeted
We made it to the biggest stage in tech today🍎. Daydream was featured in the @Apple WWDC keynote this morning at Apple Park. Soon you can shop any image in your camera role, a feature our team built on Apple Foundational Models utilizing new Image Input and Skills capabilities. A moment we'll never forget. This is for every shopper who believed in us early. Thank you @Apple #WWDC26 #Apple #craig
7
16
1,379
Richard Wei retweeted
Tons of new stuff in the Foundation Models framework this year! • Updated on-device LLM with image input support • Access to Private Cloud Compute • Protocol to plug in any LLM • Open source utilities package And much more! #WWDC26 developer.apple.com/document…
3
10
50
3,947
Richard Wei retweeted
19 Sep 2025
A list of apps that are using Apple's local models to introduce new features. techcrunch.com/2025/09/19/ho…

4
10
49
29,016
16 Sep 2025
Trying out lots of new apps from App Store today! Love all these delightful features leveraging our on-device LLM 🤩 #iOS26
2
8
1,478