Joined May 2008
263 Photos and videos
A company IPO hitting $1 trillion is crazy. What voodoo financial engineering is this. $SPCX
44
Siddharth retweeted
It's very cool that Apple shipped a 20B parameter on-device. You can't put 20B parameters in RAM at any reasonable precision. To make it work they are using pretty exotic architecture by today's standards. A small model predicts from the query (or prompt) which experts to load from Nand into RAM. The key distinction from a typical MoE is that you do this once per query and then generate all the tokens with the same experts (instead of switching the experts for every token).
77
297
3,197
225,563
Siddharth retweeted
Introducing Claude Fable 5: a Mythos-class model that we’ve made safe for general use. Its capabilities exceed those of any model we’ve ever made generally available.
5,003
14,523
104,710
55,836,685
Working now.
12
Siddharth retweeted

312
1,144
7,338
1,839,218
Are we commercializing and commoditizing human existence?
8
It's good to read and understand countering view points on important subjects. I understand how everyone is hyped about AI Coding agents, and I use them and they are pretty cool! But let's read about this differing opinion, just to challenge our confirmation bias. This is from @realGeorgeHotz Read it for fun, if nothing else. geohot.github.io/blog/jekyll…
17
Siddharth retweeted
Over 55% of internet traffic is from bots, overtaking human traffic for the first time in history, per Cloudflare
78
382
2,754
1,441,005
Chart crimes
9
Yes, the term "token anxiety" will soon enter the Psychology diagnostic and statistical manual, and there will be a few dozen papers on it. Therapists are going to have a bright future.
21
The classic example: ask an LLM how many R’s are in “strawberry.” LLMs used to get it wrong. That’s not the model failing at counting. It’s the model not operating on letters directly, only token IDs that happen to spell out a word a human would split letter by letter. 0xkato.xyz/how-llms-actually…
18
Siddharth retweeted
Code volume does not represent productivity.
Massive output uptick due to agentic AI. Complete flat adoption.
98
68
711
65,833
Siddharth retweeted
Massive output uptick due to agentic AI. Complete flat adoption.
466
974
7,321
2,417,441
Google Gemini is acting buggy today. It's cross referencing chats and producing hallucinations. It's giving Error 1099 consistently.
1
1
370