PyTorch 2.12 introduces major updates across compilation, export, distributed training, and accelerator support. Highlights include up to 100x faster batched linalg.eigh on CUDA, the new torch.accelerator.Graph API, Microscaling quantization support in torch .export.save, and fused Adagrad. The release includes 2,926 commits from 457 contributors since PyTorch 2.11. Have questions? Join @AndreyTalman (@Meta), @albanDesmaison (@Meta), and @joespeez (@reflection_ai), moderated by @Chris_AI_HPC (@Meta), on May 20 at 10:00 AM PT for a live Q&A covering the release and answering questions from the community. 🔗 Read the release blog and register for the webinar: pytorch.org/blog/pytorch-2-1… #PyTorch #OpenSourceAI #MachineLearning #AIInfrastructure

🗓️ TUESDAY @ Booth #338 12PM: Wheel Next w/ @_seemethere 1PM: OpenEnv w/ Ali Sol & @mr_purelycloud 2PM: Core Maintainer Office Hours w/ @albanD @malfet @joespeez @ptrblck_de 3PM: Titan & Forge w/ @syedahmedz, Davide Italiano, Kai Wu 4PM: Ambassador Program w/ @matthew_d_white 5PM: vLLM Inference w/ @woosuk_k

🗓️ MONDAY @ Booth #338 2PM: Shaping the Future w/ @matthew_d_white 3PM: TensorRT PyTorch w/ Angela Yi & @narendasan 4PM: DeepSpeed Trillion-Param Training w/ @PKUWZP 5PM: PyTorch Export w/ Angela Yi 6PM: Ray Distributed Computing w/ @robertnishihara #AI #GTC2025

If you are at GTC and you care about AI Frameworks, don't miss your chance to talk with the PyTorch experts at the booth. We have a packed schedule experts on different topics available for you to meet at booth #338.

PyTorch 2.10 is now available, with updates focused on performance, determinism, and numerical debugging for modern training and post-training workflows. Highlights include Python 3.14 support for torch.compile(), reduced kernel launch overhead in TorchInductor, a new varlen_attn() op for variable-length sequences, and improved tools for tracking numerical divergence. 🖇️ 🔥 Read the PyTorch 2.10 release blog and release notes: hubs.la/Q03_NHfT0 #PyTorch #OpenSourceAI #AIInfrastructure

🚀 Join PyTorch Compile H2, 25 Roadmap Q&A! 📅 Sep 3, 25 | ⏰ 9AM PST 📌 RSVP & Submit Questions: docs.google.com/forms/d/15RB… 📍 Location: fb.zoom.us/j/99817055012?pwd… 📜 Roadmap: dev-discuss.pytorch.org/t/me… Hear from the leads, ask questions, & help shape the future of PyTorch Compile.

Sharing a little of what I have been up to recently (I help organize collaborative roadmap process for the PyTorch team at Meta) -- I've done a lot of roadmaps in my career and I like the way PyTorch does it best.

Introducing ExecuTorch Alpha ⚡ ExecuTorch Alpha is focused on deploying large language models and large ML models to the edge, stabilizing the API surface, and improving installation processes. Learn more in our latest blog: hubs.la/Q02vzrrW0

Announcing the alpha release of torchtune! torchtune is a PyTorch-native library for fine-tuning LLMs. It combines hackable memory-efficient fine-tuning recipes with integrations into your favorite tools. Get started fine-tuning today! Details: hubs.la/Q02t214F0

Training a model (not something I do all that much these days) and feeling like myself in grad school "my computer is working hard on physics calculations therefore I am working hard, right?"

I just learned (rather belatedly) of Rusty's passing. He was a well known figure in HPC and just a great person to interact with. He'll be missed.

Excited to see PyTorch taking on a structure that will help it continue to grow and scale.

Introducing torch.profiler! New PyTorch Profiler collects both GPU and framework related info, correlates them, performs automatic detection of bottlenecks in the model, generates recommendations on how to resolve these bottlenecks, and visualize. Read 👉pytorch.org/blog/introducing…

PyTorch 1.8 supports ROCm wheels, providing an easy onboarding for using AMD GPUs. You can simply go to the standard PyTorch installation selector and choose ROCm as an installation option and execute the provided command. Learn more below: pytorch.org/blog/pytorch-for…

PyTorch 1.8 is live. pytorch.org/blog/pytorch-1.8…

This is one of the best pieces on this issue that I've seen so far. Highlights the direction of the research Dr. Gebru was attempting to get published that is at the heart of issue. My 2c is that she and coauthors were raising potentially legit issues with important models.

Enjoying the presentations at PyTorch Developer Day. fb.me/e/5HAdsZeb3

Love this post! It is fun seeing technologies I helped out with at different times come together. Great experiment/tutorial.

My friend has just passed away She died alone in the ICU of a hospital #COVID19 is not a myth; it exists and infects and kills people

Two things i should always try to remember: 1. I have never regretted a single instance of kindness 2. I have regretted, sometimes for years, every cruel impulse I have indulged