Joined February 2009
- Tweets 116
- Following 337
- Followers 207
- Likes 174
6 Photos and videos
Cormac Brick retweeted
May 21
TLMs: Tiny LLMs and Agents on Edge Devices with @cormacb
youtube.com/watch?v=-TiET_K-…
Function Gemma ships at 270 million parameters and runs nearly 2,000 tokens per second prefill on a Pixel 7. Out of the box, it hits 46% accuracy on a fixed set of app intents. Fine tune on a synthetically generated dataset and that clears 90% on eight of ten functions.
Cormac walks through the two paths developers have for on device AI: a skill harness built on Gemma 4 with a restaurant roulette demo running fully on device. Then Eloquent, a production transcription app built by chaining two sub billion parameter models together.
cc @osanseviero
7
94
600
30,578
Cormac Brick retweeted
Apr 17
Check out this video on how to run Gemma 4 locally on an iPhone!
It runs completely offline and handles long context, meaning no data plan, no API calls, and no monthly fees required.
115
337
3,862
398,185
Cormac Brick retweeted
Apr 10
Our first successful Gemma 4 Runtime in London with @swyx @patloeber @nick_kango @cormacb and others! 💎Great to go out for a run and talk about Gemma, agents, evals and more
9
11
190
11,823
2 Mar 2023
Hello @memdotai 👋 just setting up my Twitter flow. Here's my validation code: TyWbWXsnd84F3Pb0Q68l
1
238
Cormac Brick retweeted
11 Jun 2021
My letter to the editor in response to economist.com/briefing/2021/….
61
334
2,937
Cormac Brick retweeted
28 Apr 2020
Do you like #AnimalCrossing
Do you like artificial intelligence 💻
Do you like workshops 🧠
acaiworkshop.com
17
120
482
16 Feb 2019
Awesome (in the literal sense)...
14 Feb 2019
Here's a ridiculous result from the @OpenAI GPT-2 paper (Table 13) that might get buried --- the model makes up an entire, coherent news article about TALKING UNICORNS, given only 2 sentences of context.
WHAT??!!
2
3 Jan 2019
This is really cool project, congrats to Lucian and all involved -- battery life increase from 6 weeks to 1.5 years!
lnkd.in/gg5Ypz9 lnkd.in/gwwmaRv
1
28 Aug 2018
We are hiring in Seattle to join the Vertex.ai crew that recently joined us through acquisition. Great opportunity to join a top class team working on one of the new frontiers of CS/ML. lnkd.in/gEaDYxZ
8
8
Cormac Brick retweeted
22 Jun 2018
My colleague Raghu has just released "Quantizing deep convolutional networks for efficient inference" - arxiv.org/abs/1806.08342v1
This white paper covers practical quantization approaches for most common CNNs in @TensorFlow, I think it will be super useful!
1
59
165
Cormac Brick retweeted
11 Mar 2018
It is starting to look like deep learning workflows of the future feature autotuned architectures running with autotuned compute schedules across arbitrary backends. I don't know if I should be excited or scared.
26
131
565
Cormac Brick retweeted
7 Mar 2018
Intel and Microsoft Enable AI Inference at the Edge with Intel Movidius Vision Processing Units on Windows ML sco.lt/5kPStt
6
10
1 Mar 2018
I'm on the steering committee of SysML, a new conference that targets work at the intersection of computer systems and machine learning. The inaugural event will be at Stanford, Feb. 15-16, 2018, and submissions are due January 5th. Consider submitting if you have relevant work! x.com/edchi/status/942160617…
SysML is a new conference on systems and machine learning. Non-archival this year. The inaugural conference will take place Feb 15-16, 2018 in Stanford, CA. Consider submitting your work! sysml.cc/#submission #sysml2018
7
170
484
9 Dec 2017
1
