unsupervised learning and rl

Joined April 2008
780 Photos and videos
Pinned Tweet
Happy to release Accelerated Scan, a kernel library for first order parallel associative scans in vanilla @PyTorch, Triton 2.2.0 and CUDA C . pip install accelerated-scan🧵
5
37
267
50,370
Volodymyr Kyrylov retweeted
The core of ai psychosis, by the way, is the failure to properly align human-intelligence axes with ai-intelligence ones.
2
3
39
3,072
59 GW
There is not a single power plant left in Ukraine that has not been damaged by Russian attacks. Not one. But we still generate electricity. Thanks to our people. We have kept our system running thanks to physical protection of the facilities – and thanks to everyone who helps us with air defense. Just as important, Ukraine still has power because of our people – thousands of workers who serve millions. When I see our energy workers, our repair crews, rescue teams – I see something that is often missing in politics: true dedication – the ability to work at one hundred percent, to act immediately – in a real emergency. Not in a month, not in a year or two, but they save lives here, they save lives now. All these years. Many politicians could learn – and must learn – from ordinary rescuers, from ordinary repair crews, from ordinary electricians – how to act immediately.
4
671
spark is close to an order of magnitude latency improvement for token output, now tools are the bottleneck. great for networks of codex exec
Feb 12
GPT-5.3-Codex-Spark is now in research preview. You can just build things—faster.
2
12
1,170
During my first attempts to exit vim, I didn’t realize I was accidentally entering codex from the 70s
5
494
Training on intermediate solutions during search helps kernel and algorithm engineering — excited about this application of gpt-oss.
2
1
13
1,592
this time is the charm
11 Dec 2025
Replying to @OpenAI
GPT-5.2 Thinking evals
1
19
1,830
macapptree is an amazing tool for screen perception in gpt-oss!
Wild NeurIPS moment: @darkproger from @OpenAI told me he uses our open-source macapptree as his go-to tool for parsing macOS accessibility 🤯 Made my day!
1
1
26
4,831
Excited to be talking about gpt-oss today!
19 Nov 2025
I am excited to be organizing the 8th scaling workshop at @NeurIPSConf this year! Dec 5-6 | 5-8pm PT | Hard Rock Hotel San Diego Co-organized by @cerebras, @Mila_Quebec, and @mbzuai Register: luma.com/gy51vuqd
3
2
24
6,518
Volodymyr Kyrylov retweeted
30 Nov 2025
The Strategic Explorations team @OpenAI is looking to recruit researchers interested in working on the next frontier of language modeling! Feel free to reach out to me by email. @darkproger and I will also be at NeurIPS to connect and discuss in person.
13
18
324
38,254
it feels so nice to start sweeping once the implementation is not buggy any more
9
846
Volodymyr Kyrylov retweeted
22 Oct 2025
as of 5 minutes ago, our gpt-oss implementation is merged into torchtitan! thanks to all the work by @jianiw_wang @__tianyu at @pytorch making it clean & scalable for the community ❤️ i hope y'all play around with training gpt-oss, it's great for its sparsity & reasoning
1 Oct 2025
periodic ❤️ open-source! for example, we’ve been collaborating with the @PyTorch team to build the highest MFU gpt-oss training implementation (includes thinky sinky flexattn) here’s a few SFT runs of gpt-oss-20b & 120b, where i get ~24% MFU for 20b and ~8% for 120b
9
7
192
27,432
To authenticate codex on spark, do: scp -r .codex vol@spark-abcd.local: Assuming it’s already working on your box with a screen and you are vol
6
492
Volodymyr Kyrylov retweeted
LLMs are winning IOI golds & crushing code gen—but can they verify correctness? In Feb, our benchmark saw single digit scores with o3-mini. We re-ran our evals with the latest open models: GPT-OSS gets 21.6% at demonstrating bugs in code! Progress✅But verification's still hard
3
10
79
40,467
Volodymyr Kyrylov retweeted
6 Aug 2025
👀 we care a lot about correctness, ran many evals and stared at many tensors to compare them. numerics of vLLM on hopper should be solid and verified! if you run into any correctness issue on vLLM, we would love to know and debug them!
Heads-up for developers trying gpt-oss: performance and correctness can vary a bit across providers and runtimes right now due to implementation differences. We’re working with inference providers to make sure gpt-oss performs at its best everywhere, and we’d love your feedback!
5
28
318
66,700
Volodymyr Kyrylov retweeted
6 Aug 2025
Yes, I’m very sure vllm is correct — we spent quite a bit of time on that. 🥹
6 Aug 2025
👀 we care a lot about correctness, ran many evals and stared at many tensors to compare them. numerics of vLLM on hopper should be solid and verified! if you run into any correctness issue on vLLM, we would love to know and debug them!
9
143
19,156