Soumith Chintala

Soumith Chintala

Soumith Chintala

@soumithchintala

10 Nov 2022

We are introducing a DTensor into @PyTorch . Worth a few more eye-balls on the RFC (drafted in August). The longer google-doc is at the bottom of the issue. github.com/pytorch/pytorch/i… Credited the inspirations appropriately: TF/XLA/JAX's GSPMD/DTensor and OneFlow's GlobalTensor

[RFC] PyTorch DistributedTensor · Issue #88838 · pytorch/pytorch

🚀 The feature, motivation and pitch RFC: PyTorch DistributedTensor We have been developing a DistributedTensor (a.k.a DTensor) concept under the pytorch/tau repo in the past few months, and now we...

github.com

102