introducing chipmunk—a training-free algorithm making ai video generation 3.7x & image gen 1.6x faster! ⚡️
our kernels for column-sparse attention are 9.3x faster than FlashAttention-3 and column-sparse GEMM is 2.5x faster vs. cuBLAS
a thread on the GPU kernel optimizations 🧵
Our latest joint work w/ SandyResearch @ UCSD: training-free acceleration of Diffusion Transformers w/ dynamic sparsity, led by @austinsilveria@SohamGovande!
⚡️ 3.7x faster video and 1.6x faster image generation while preserving quality!
🧵 Open-source code & CUDA kernels!
Thankful for TK kernels that now run on Apple hardware - with @CKT_Conner, bringing faster attention and GEMMs to your M2 MacBooks! happy thanksgiving 🍁
Thrilled to be unveiling Thunderkittens 0.1: now with more simplicity, more speed, and more kernels!
Had a blast working on this with @bfspector, @simran_s_arora, and folks at @HazyResearch 🚀
(1/7) In celebration of National Cat Day, we’re excited to release our first major batch of updates to ThunderKittens! ThunderKittens is now easier, better, faster, and cuter than ever before! In addition to massive speed boosts, we’re releasing a broad swath of kernels, new features, and tons of usability improvements.
(Blog post: hazyresearch.stanford.edu/bl…, Paper: arxiv.org/abs/2410.20399)
As always, joint with @AaryanSinghal4, @simran_s_arora, @HazyResearch, and team!
Introducing ambientGPT: an open-source and multimodal MacOS foundation model GUI
Run GPT-4o and open-source models with full ambient knowledge of your screen.
Foundation models have long been confined to the browser. With ambientGPT, your screen context is directly inferred as part of the query, ensuring you never need to explicitly upload context again!
Github: github.com/siddrrsh/ambientG…
The three presidential candidates are now competing to prove that they can pump your bags more than the other two.
We are the new wealthy elite.
Newsy Johnson
BREAKING: Legendary mathematician and hedge fund manager Jim Simons has passed away, age 86.
His Medallion fund was called "Greatest Money-Making Machine of All Time" and made an annual return of 62% per year from 1988 to 2018 (before fees).
Don't really blame @hosseeb for this to be honest.
Its pretty clear the rest of the crypto VCs are following some variation of my due diligence framework. Most don't have @dragonfly_xyz's resources.
I have now updated it for future reference.