#pytorchcon
Think DeepSpeed is only good for ZeRO and its usability, not training throughput? At #PyTorchCon North America 2026, Masahiro Tanaka will cover tensor, sequence, and expert parallelism in DeepSpeed and walk through benchmarks. His session, “DeepSpeed Is Not Just ZeRO: Tensor, Sequence, and Expert Parallelism with ZeRO-Level Usability,” will cover AutoTP, AutoSP, and AutoEP, how these capabilities can be combined with ZeRO, and where each parallelism strategy fits. Register for PyTorch Conference North America 2026:
PyTorch15,756 Aufrufe • vor 2 Tagen
PyTorch Conference is where the open source Al community gathers to talk about what we are all building together. Priya Nagpurkar, VP of AI Native Systems at IBM Research will give a keynote at #PyTorchCon North America on IBM & Red Hat's contributions to the PyTorch ecosystem, including exciting developments on infrastructure for out-of-tree accelerators, enablement of IBM's Spyre Accelerator, and work with Ilm-d for distributed inference. Come to the talk, meet the community, and hear what's next in open source Al. Join us in San Jose, October 20-21:
PyTorch16,019 Aufrufe • vor 3 Tagen
At #PyTorchCon North America 2026, Liz Li and Shekhar of AMD will discuss their work enabling scalable MXFP8 pretraining on MI355X GPUs. Liz and Shekhar will cover optimization of key MXFP8 operators in TorchAO and how those kernels were integrated with TorchTitan to build an end-to-end upstream PyTorch training stack for large language models. Their session, “Scaling MXFP8 Pretraining on 1K+ AMD Instinct MI355X: TorchAO Kernels and TorchTitan Training,” will also cover Triton and FlyDSL implementations and lessons from numerical validation, convergence, and performance tuning. Join us in San Jose on October 20-21. Register today:
PyTorch16,137 Aufrufe • vor 14 Tagen
At PyTorch Conference North America 2026, hear directly from and connect with the people working on PyTorch, vLLM, DeepSpeed, ray, Helion, and Safetensors, alongside experts working across the AI stack. At #PyTorchCon NA 2025, Richard Liaw (ray, Anyscale) spoke about the Ray team’s focus on building something “useful and critical to the AI infrastructure space” and about “how important Ray can be for the stack.” PyTorch conferences are the open source AI community’s town square, where what’s next gets decided. Register by September 4 (tomorrow) to save on your conference pass: #PyTorchCon
PyTorch16,342 Aufrufe • vor 1 Monat
Keine weiteren Inhalte verfügbar