Joined December 2006
20 Photos and videos
Mar 3
sosumi.ai now has a CLI ``` npx @nshipster/sosumi fetch /documentation/swift/array ``` This lets you fetch and render  Developer content directly into LLM-readable Markdown, without connecting to a remote MCP server.
12
36
274
42,176
Mar 3
...which ironically would have been especially useful during the outage sosumi.ai had yesterday in the process of shipping the CLI 🫠 github.com/NSHipster/sosumi.…
1
1
10
5,555
Mar 3
Apologies to anyone impacted by yesterday's outage. I'm taking it as an opportunity to shore up the infrastructure — adding the kind of things you'd expect for a production deployment (synthetics, alerting, etc.). It's a curious thing about software, and really any shared endeavor: as something becomes depended upon by more people, the nature of what it demands from you changes. It's silly for a hobby project nobody uses to have a lot of process. But at some point neglect stops being cool-kid pragmatism and becomes stubborn recklessness. What made you fast early on becomes a liability. It's a lot like growing up. You do it reluctantly, and usually because you learned something the hard way.
12
4,113
Mattt retweeted
Today ggml.ai joins Hugging Face Together we will continue to build ggml, make llama.cpp more accessible and empower the open-source community. Our joint mission is to make local AI easy and efficient to use by everyone on their own hardware.

I've started a company: ggml.ai From a fun side project just a few months ago, ggml has now become a useful library and framework for machine learning with a great open-source community
142
232
1,655
312,410
Feb 18
We want to be good citizens of the ecosystem, so sosumi.ai respects robots.txt on every external host. Site owners can opt out by disallowing the sosumi-ai user-agent. Full crawler policy and contact info: sosumi.ai/bot
1
1
5
2,107
Feb 18
It's rewarding to see so many developers using sosumi.ai on the daily. Thanks for making it part of your regular workflow!
1
1
5
1,877
Feb 11
AnyLanguageModel 0.7.0 is here, with guided generation for all models — Core ML, MLX, llama.cpp, Ollama, OpenAI, Anthropic, Gemini — plus, a new Open Responses model, and a ToolExecutionDelegate for observing and controlling tool calls. Check it out! github.com/mattt/AnyLanguage…
2
3
33
3,078
Feb 11
Next up: Improving guided generation with XGrammar. This release uses a hand-rolled implementation of constrained generation, but we do much better. I wrote a Swift wrapper around the C library and published it here: github.com/mattt/swift-xgram… PR here: github.com/mattt/AnyLanguage…
1
3
1,500
Feb 11
Other than that, this is getting pretty close to a feature-complete 1.0 release, I reckon. Big thanks to everyone who's opened issues and contributed PRs. If you hit any bumps or have anything you'd like to share, please reach out!
1
1
5
1,281
Feb 4
Just released AnyLanguageModel 0.6.0, with support for guided generation for MLX and Llama, custom JSON mode for Gemini, model prewarming for MLX, improved DeepSeek API compatibility, and the ability to create custom adapters in your own project. github.com/mattt/AnyLanguage…
6
14
119
10,867
Mattt retweeted
12 Dec 2025
🎉 llama.cpp now has Ollama-style model management. • Auto-discover GGUFs from cache • Load on first request • Each model runs in its own process • Route by `model` (OpenAI-compatible API) • LRU unload at `--models-max` huggingface.co/blog/ggml-org…
16
58
409
35,542
5 Dec 2025
Introducing swift-huggingface: a complete Swift client for @huggingface Hub. • Fast, resumable downloads • Flexible, predictable auth • Sharable cache with Python / hf CLI • Xet support (coming soon!) huggingface.co/blog/swift-hu…
6
52
392
44,073
5 Dec 2025
I built this package in response to feedback we received about the HubAPI implementation in swift-transformers. Try swift-huggingface today, and stay tuned for its integration into swift-transformers in an upcoming release. github.com/huggingface/swift…
1
11
2,061
5 Dec 2025
In my collaboration with @huggingface, I'm on a mission to make it easier to build apps that leverage local, open-source AI models. So much of this has been community-driven, and I really appreciate the feedback I've received so far. What would you like to see next?
2
9
1,629
20 Nov 2025
Just published an article on @huggingface's blog about AnyLanguageModel that goes into more detail about the motivation behind the library and what we're building toward: huggingface.co/blog/anylangu… 🆕 Be sure to check out our new chat-ui-swift example project (linked at the end)
3
33
143
12,298
9 Nov 2025
AnyLanguageModel 0.4.0 is out with support for multi-modal inputs. Vision language models are incredibly useful — extract text from receipts, analyze diagrams, describe images for accessibility, answer questions about photos, and much more. You can now pass images directly to models running with MLX & Ollama, plus Anthropic, Gemini, and OpenAI providers. Core ML support coming soon.
29 Oct 2025
Introducing AnyLanguageModel: A Swift package that provides a drop-in replacement for Apple's Foundation Models framework with support for custom language model providers. github.com/mattt/AnyLanguage… Just change your import statement:
7
8
86
12,633
9 Nov 2025
Forgot to mention — AnyLanguageModel now officially supports Linux, making it a great fit for anyone running web applications in Swift.
1
9
1,720
9 Nov 2025
Thanks to Noor Bhatia (github.com/noorbhatia) for their requesting this feature and helping to implement support for MLX 🙌
2
5
658
9 Nov 2025
(And don't worry — I didn't forget about doc improvements for token authentication patterns. Look for that next week.)
570