Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

How do you deliver full API parity across heterogeneous accelerators with zero additional overhead? At PyTorch Conference North America 2026, Zesheng Zong (Huawei), PyTorch Foundation Ambassador and Accelerator Integration Working Group Co-Chair, will share key technical updates on backend integration. The community is adapting over 600,000 upstream test cases...

PyTorch's profile picture

PyTorch

517,761 subscribers

14,135 Aufrufe • vor 29 Tagen •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

8 Kommentare

Profilbild von IronRed | SandHive
IronRed | SandHivevor 27 Tagen

@Huawei . Counting down to San Jose! The demos should unsloth those acc retweets

Profilbild von Mira Synth Tech
Mira Synth Techvor 28 Tagen

@Huawei This is exactly the kind of groundwork that moves the whole ecosystem forward. Love seeing 600k tests go generic and CI tied across backends

Profilbild von Ella Tech & Tool
Ella Tech & Toolvor 28 Tagen

@Huawei 600k tests going generic and real-time CI across backends is huge. This will make hardware support so much easier

Profilbild von Flix Muller
Flix Mullervor 28 Tagen

@Huawei Achieving API parity across different accelerators without extra overhead is a major step toward a more accessible PyTorch ecosystem. Cross-backend testing can make hardware integration much smoother for developers.

Profilbild von Oklahoma Data Partners
Oklahoma Data Partnersvor 28 Tagen

@Huawei API parity across mixed hardware is as much a data problem as a compute one — teams feel it when the same pipeline behaves differently on different accelerators. Zero-overhead parity removes a whole class of silent inconsistencies in production ML.

Profilbild von Alice The Ai Expert
Alice The Ai Expertvor 28 Tagen

@Huawei Huge step for the ecosystem 600k generic tests and real-time CI relay across accelerators is how you actually deliver seamless API parity with no extra overhead!

Profilbild von NOOR TECH
NOOR TECHvor 28 Tagen

@Huawei PyTorch Conference North America 2026: Zesheng Zong on delivering full API parity across heterogeneous accelerators zero overhead

Profilbild von Wei佳
Wei佳vor 28 Tagen

@Huawei Would those 600K backend-generic tests catch the weird per-chip kernel bugs, or is that the CI relay's job?

Ähnliche Videos

PyTorch Conference is where the open source Al community gathers to talk about what we are all building together. Priya Nagpurkar, VP of AI Native Systems at IBM Research will give a keynote at #PyTorchCon North America on IBM & Red Hat's contributions to the PyTorch ecosystem, including exciting developments on infrastructure for out-of-tree accelerators, enablement of IBM's Spyre Accelerator, and work with Ilm-d for distributed inference. Come to the talk, meet the community, and hear what's next in open source Al. Join us in San Jose, October 20-21:
0:38

PyTorch Conference is where the open source Al community gathers to talk about what we are all building together. Priya Nagpurkar, VP of AI Native Systems at IBM Research will give a keynote at #PyTorchCon North America on IBM & Red Hat's contributions to the PyTorch ecosystem, including exciting developments on infrastructure for out-of-tree accelerators, enablement of IBM's Spyre Accelerator, and work with Ilm-d for distributed inference. Come to the talk, meet the community, and hear what's next in open source Al. Join us in San Jose, October 20-21:

PyTorch

16,261 Aufrufe • vor 1 Monat

PyTorch Ambassador and #PyTorchCon North America 2026 program committee member Masahiro Hiramori (Masahiro Hiramori), 三菱電機｜Mitsubishi Electric, will be following work across on-device AI, efficient inference, voice agents, and machine learning compilers at this year’s conference. He's also looking forward to exchanging ideas with other developers and seeing what the broader PyTorch community is building. Register for PyTorch Conference North America 2026:
0:37

PyTorch Ambassador and #PyTorchCon North America 2026 program committee member Masahiro Hiramori (Masahiro Hiramori), 三菱電機｜Mitsubishi Electric, will be following work across on-device AI, efficient inference, voice agents, and machine learning compilers at this year’s conference. He's also looking forward to exchanging ideas with other developers and seeing what the broader PyTorch community is building. Register for PyTorch Conference North America 2026:

PyTorch

20,086 Aufrufe • vor 1 Monat

"It's really great to feel the energy and see all the collaboration that's happening, lots of conversations. We have people here who are just starting to learn about PyTorch, and we have people who are maintainers. It's super nice to see that energy and see how together we're going to be able to solve some of these very difficult problems for humanity." Ankit Patel, NVIDIA, at PyTorch Conference Europe 2026 Register today to join the open source AI community at PyTorch Conference North America in San Jose, October 20–21: #PyTorchCon
0:37

"It's really great to feel the energy and see all the collaboration that's happening, lots of conversations. We have people here who are just starting to learn about PyTorch, and we have people who are maintainers. It's super nice to see that energy and see how together we're going to be able to solve some of these very difficult problems for humanity." Ankit Patel, NVIDIA, at PyTorch Conference Europe 2026 Register today to join the open source AI community at PyTorch Conference North America in San Jose, October 20–21: #PyTorchCon

PyTorch

17,000 Aufrufe • vor 2 Monaten

What You Cannot Profile, You Cannot Optimize: Learning to Read PyTorch Traces In his talk at PyTorch Conference North America 2026, Suvaditya Mukherjee from Hugging Face will share practical guidance on how to start using the PyTorch Profiler on your models to extract maximum performance efficiency. Whether you are aiming to identify performance bottlenecks or optimize model execution, this talk will help you get the most out of your hardware. Join the open source AI community in San Jose, October 20-21: #PyTorchCon Suvaditya Mukherjee
0:27

What You Cannot Profile, You Cannot Optimize: Learning to Read PyTorch Traces In his talk at PyTorch Conference North America 2026, Suvaditya Mukherjee from Hugging Face will share practical guidance on how to start using the PyTorch Profiler on your models to extract maximum performance efficiency. Whether you are aiming to identify performance bottlenecks or optimize model execution, this talk will help you get the most out of your hardware. Join the open source AI community in San Jose, October 20-21: #PyTorchCon Suvaditya Mukherjee

PyTorch

16,264 Aufrufe • vor 1 Monat

New chips are shipping faster than ever before, but the ecosystem is being held back by having to rewrite and then re-debug the same code over & over again. Chris Lattner CEO and Co-founder at Modular and EVP of Advanced AI Software & Platforms at Qualcomm, will deliver a keynote at PyTorch Conference North America about an open software platform for heterogeneous compute powered by Mojo and MAX. PyTorch has always been the place where the best models come together, and now there's a way to get those models onto all kinds of hardware. If you're interested in Al and compute, join us at the PyTorch Conference in San Jose, CA. Register now: #PyTorchCon
0:50

New chips are shipping faster than ever before, but the ecosystem is being held back by having to rewrite and then re-debug the same code over & over again. Chris Lattner CEO and Co-founder at Modular and EVP of Advanced AI Software & Platforms at Qualcomm, will deliver a keynote at PyTorch Conference North America about an open software platform for heterogeneous compute powered by Mojo and MAX. PyTorch has always been the place where the best models come together, and now there's a way to get those models onto all kinds of hardware. If you're interested in Al and compute, join us at the PyTorch Conference in San Jose, CA. Register now: #PyTorchCon

PyTorch

20,838 Aufrufe • vor 2 Monaten

Involved in the AI ecosystem? There's something for everyone at PyTorch Conference North America. Steve Pousty of Red Hat explains why you should attend from the new intro track added this year to poster sessions, booths, and colocated events. Steve is giving a talk on the use of PyTorch and PyTorch-based libraries from the ecosystem to do remote sensing for satellite imagery. Join us in San Jose, October 20-21: #PyTorchCon
0:54

Involved in the AI ecosystem? There's something for everyone at PyTorch Conference North America. Steve Pousty of Red Hat explains why you should attend from the new intro track added this year to poster sessions, booths, and colocated events. Steve is giving a talk on the use of PyTorch and PyTorch-based libraries from the ecosystem to do remote sensing for satellite imagery. Join us in San Jose, October 20-21: #PyTorchCon

PyTorch

12,529 Aufrufe • vor 1 Monat

Learn how PyTorch can extend language modeling beyond classification to practical time-to-event prediction. Witold Czubala of UBS will share a PyTorch-based transformer model that predicts six-month attrition from longitudinal advisor–client email communications for wealth management during PyTorch Conference North America in San Jose, CA. Join us October 20-21: #PyTorchCon
1:35

Learn how PyTorch can extend language modeling beyond classification to practical time-to-event prediction. Witold Czubala of UBS will share a PyTorch-based transformer model that predicts six-month attrition from longitudinal advisor–client email communications for wealth management during PyTorch Conference North America in San Jose, CA. Join us October 20-21: #PyTorchCon

PyTorch

17,149 Aufrufe • vor 2 Monaten

Liang Zhang (Huawei) delivers “Ascend & PyTorch: Pioneer New AI Open Ecosystem” at PyTorch Conference China 2026. Drawing on eight years of open source practice, Liang Zhang looks at how Ascend’s collaboration with the PyTorch community is evolving from hardware adaptation to joint research on technical standards. The keynote also covers next-generation AI hardware-software codesign, interoperability between Chinese and global AI technology stacks, and building an open and sustainable AI industrial ecosystem. Here's Liang Zhang, introduced by Mark Collier 柯理怀: #PyTorchCon
1:15

Liang Zhang (Huawei) delivers “Ascend & PyTorch: Pioneer New AI Open Ecosystem” at PyTorch Conference China 2026. Drawing on eight years of open source practice, Liang Zhang looks at how Ascend’s collaboration with the PyTorch community is evolving from hardware adaptation to joint research on technical standards. The keynote also covers next-generation AI hardware-software codesign, interoperability between Chinese and global AI technology stacks, and building an open and sustainable AI industrial ecosystem. Here's Liang Zhang, introduced by Mark Collier 柯理怀: #PyTorchCon

PyTorch

16,367 Aufrufe • vor 2 Monaten

The open source AI community thrives on collaboration, choice, and open contribution. As Joseph Groenenboom from Red Hat highlights, empowering developers to freely contribute and build options is essential for growing the entire AI ecosystem. PyTorch Conference North America 2026 is where that community comes together in person. Join us to collaborate with open source pioneers, expand your deployment capabilities, and directly contribute to shaping the future of machine learning. Register for PyTorch Conference North America today: #PyTorchCon
0:28

The open source AI community thrives on collaboration, choice, and open contribution. As Joseph Groenenboom from Red Hat highlights, empowering developers to freely contribute and build options is essential for growing the entire AI ecosystem. PyTorch Conference North America 2026 is where that community comes together in person. Join us to collaborate with open source pioneers, expand your deployment capabilities, and directly contribute to shaping the future of machine learning. Register for PyTorch Conference North America today: #PyTorchCon

PyTorch

17,740 Aufrufe • vor 2 Monaten

SGLang-Diffusion is a high-performance serving framework for diffusion models, designed for both large-scale offline generation and latency-sensitive real-time inference. At PyTorch Conference North America 2026, Yihao Wang and Kevin Mi of RadixArk will present the design of SGLang-Diffusion and the PyTorch-based inference optimizations behind it, including efficient request scheduling, memory management, batching strategies, and execution-path optimizations for diffusion pipelines. Join us in San Jose, October 20-21: #PyTorchCon
0:35

SGLang-Diffusion is a high-performance serving framework for diffusion models, designed for both large-scale offline generation and latency-sensitive real-time inference. At PyTorch Conference North America 2026, Yihao Wang and Kevin Mi of RadixArk will present the design of SGLang-Diffusion and the PyTorch-based inference optimizations behind it, including efficient request scheduling, memory management, batching strategies, and execution-path optimizations for diffusion pipelines. Join us in San Jose, October 20-21: #PyTorchCon

PyTorch

17,499 Aufrufe • vor 1 Monat

Build a neural network from scratch, train it, and optimize it for real-world AI infrastructure during our PyTorch Associate Training the day before PyTorch Conference North America on October 19th. Your instructor, Faradawn Yang of NVIDIA AI explains how this training will give you hands on experience with the latest AI accelerators & prepare you for the PyTorch Certified Associate (PTCA) certification exam. #PyTorchCon
0:48

Build a neural network from scratch, train it, and optimize it for real-world AI infrastructure during our PyTorch Associate Training the day before PyTorch Conference North America on October 19th. Your instructor, Faradawn Yang of NVIDIA AI explains how this training will give you hands on experience with the latest AI accelerators & prepare you for the PyTorch Certified Associate (PTCA) certification exam. #PyTorchCon

PyTorch

17,476 Aufrufe • vor 1 Monat

At #PyTorchCon North America 2026, Liz Li and Shekhar of AMD will discuss their work enabling scalable MXFP8 pretraining on MI355X GPUs. Liz and Shekhar will cover optimization of key MXFP8 operators in TorchAO and how those kernels were integrated with TorchTitan to build an end-to-end upstream PyTorch training stack for large language models. Their session, “Scaling MXFP8 Pretraining on 1K+ AMD Instinct MI355X: TorchAO Kernels and TorchTitan Training,” will also cover Triton and FlyDSL implementations and lessons from numerical validation, convergence, and performance tuning. Join us in San Jose on October 20-21. Register today:
1:16

At #PyTorchCon North America 2026, Liz Li and Shekhar of AMD will discuss their work enabling scalable MXFP8 pretraining on MI355X GPUs. Liz and Shekhar will cover optimization of key MXFP8 operators in TorchAO and how those kernels were integrated with TorchTitan to build an end-to-end upstream PyTorch training stack for large language models. Their session, “Scaling MXFP8 Pretraining on 1K+ AMD Instinct MI355X: TorchAO Kernels and TorchTitan Training,” will also cover Triton and FlyDSL implementations and lessons from numerical validation, convergence, and performance tuning. Join us in San Jose on October 20-21. Register today:

PyTorch

16,137 Aufrufe • vor 1 Monat

ERRC: Entropy-Reinvested Residual Correction for Tensor-Parallel LLM Communication PyTorch Foundation Ambassador Abdulsalam Bande will present a poster on ERRC (Entropy-Reinvested Residual Correction for Tensor-Parallel LLM Communication) at PyTorch Conference North America 2026. ERRC focuses on optimizing GPU data exchange during LLM inference. By compressing inter-GPU communication and using the saved bandwidth to mitigate quantization errors, ERRC makes multi-GPU inference significantly more efficient. Register and join us to San Jose, October 20-21: #PyTorchCon Abdulsalam Bande
0:30

ERRC: Entropy-Reinvested Residual Correction for Tensor-Parallel LLM Communication PyTorch Foundation Ambassador Abdulsalam Bande will present a poster on ERRC (Entropy-Reinvested Residual Correction for Tensor-Parallel LLM Communication) at PyTorch Conference North America 2026. ERRC focuses on optimizing GPU data exchange during LLM inference. By compressing inter-GPU communication and using the saved bandwidth to mitigate quantization errors, ERRC makes multi-GPU inference significantly more efficient. Register and join us to San Jose, October 20-21: #PyTorchCon Abdulsalam Bande

PyTorch

17,043 Aufrufe • vor 1 Monat

At PyTorch Conference 2026, Lu Fang, Research Scientist, and Ilina Mitra, Engineering Manager Meta, will present a deep dive on building high-performance recommendation inference systems. They will detail end-to-end production workflows, covering graph capture, model splitting, and serving across large-scale platforms like Facebook and Instagram. Attendees will gain technical insights into advanced optimizations for high TPS and low latency, as well as strategies for multi-accelerator support to handle diverse machine learning workloads at scale. Register for PyTorchCon North America today: #PyTorchCon houseroad Ilina Mitra
1:13

At PyTorch Conference 2026, Lu Fang, Research Scientist, and Ilina Mitra, Engineering Manager Meta, will present a deep dive on building high-performance recommendation inference systems. They will detail end-to-end production workflows, covering graph capture, model splitting, and serving across large-scale platforms like Facebook and Instagram. Attendees will gain technical insights into advanced optimizations for high TPS and low latency, as well as strategies for multi-accelerator support to handle diverse machine learning workloads at scale. Register for PyTorchCon North America today: #PyTorchCon houseroad Ilina Mitra

PyTorch

16,853 Aufrufe • vor 2 Monaten

Want to hear more about new vLLM and SGLang engines built on a new PyTorch-native TPU backend, TorchTPU? Find Qi Zhou of Google, Colin Taylor and Angela Yi of Meta at PyTorch Conference North America in San Jose where they will discuss how they focused on making the existing SGLang & vLLM infrastructure work natively on TPU, preserving the schedulers, batching systems, OpenAI-compatible APIs, and torch.compile workflows already familiar to GPU users. Because the serving engines remain upstream, new models and features can run on TPU without requiring separate TPU-specific implementations. Learn more about how it works across the stacks & what they learned running this in production, including compile time, device placement under tracing, KV cache layout, and cross-chip collectives. Register for #PyTorchCon NA now:
0:48

Want to hear more about new vLLM and SGLang engines built on a new PyTorch-native TPU backend, TorchTPU? Find Qi Zhou of Google, Colin Taylor and Angela Yi of Meta at PyTorch Conference North America in San Jose where they will discuss how they focused on making the existing SGLang & vLLM infrastructure work natively on TPU, preserving the schedulers, batching systems, OpenAI-compatible APIs, and torch.compile workflows already familiar to GPU users. Because the serving engines remain upstream, new models and features can run on TPU without requiring separate TPU-specific implementations. Learn more about how it works across the stacks & what they learned running this in production, including compile time, device placement under tracing, KV cache layout, and cross-chip collectives. Register for #PyTorchCon NA now:

PyTorch

16,806 Aufrufe • vor 1 Monat

Interested in optimizing Mixture of Experts LLM inference on ARM CPUs? In his talk at PyTorch Conference North America, Maajid Khan from Fujitsu Research India will explore efficient MoE LLM inference using vLLM and OpenVINO, sharing practical strategies for running these models effectively on ARM architectures. Register and join us in San Jose, October 20-21: #PyTorchCon
0:26

Interested in optimizing Mixture of Experts LLM inference on ARM CPUs? In his talk at PyTorch Conference North America, Maajid Khan from Fujitsu Research India will explore efficient MoE LLM inference using vLLM and OpenVINO, sharing practical strategies for running these models effectively on ARM architectures. Register and join us in San Jose, October 20-21: #PyTorchCon

PyTorch

16,448 Aufrufe • vor 1 Monat

Think DeepSpeed is only good for ZeRO and its usability, not training throughput? At #PyTorchCon North America 2026, Masahiro Tanaka will cover tensor, sequence, and expert parallelism in DeepSpeed and walk through benchmarks. His session, “DeepSpeed Is Not Just ZeRO: Tensor, Sequence, and Expert Parallelism with ZeRO-Level Usability,” will cover AutoTP, AutoSP, and AutoEP, how these capabilities can be combined with ZeRO, and where each parallelism strategy fits. Register for PyTorch Conference North America 2026:
0:31

Think DeepSpeed is only good for ZeRO and its usability, not training throughput? At #PyTorchCon North America 2026, Masahiro Tanaka will cover tensor, sequence, and expert parallelism in DeepSpeed and walk through benchmarks. His session, “DeepSpeed Is Not Just ZeRO: Tensor, Sequence, and Expert Parallelism with ZeRO-Level Usability,” will cover AutoTP, AutoSP, and AutoEP, how these capabilities can be combined with ZeRO, and where each parallelism strategy fits. Register for PyTorch Conference North America 2026:

PyTorch

15,911 Aufrufe • vor 1 Monat

Get more out of your AI infrastructure. Carlos Costa, Distinguished Engineer at IBM Research and co-founder of the llm-d project will share some exciting news about llm-d: how the project changed the way the open source AI community scales inference at PyTorch Conference North America. A little over a year after the project was founded, llm-d is reaching a new level of maturity, delivering state-of-the-art performance for generative serving, while also enabling the capabilities needed for day two operations, including multi-tenant quality of service, zero downtime operations, and all of that without sacrificing performance in production. Join us in San Jose, October 20-21:
0:52

Get more out of your AI infrastructure. Carlos Costa, Distinguished Engineer at IBM Research and co-founder of the llm-d project will share some exciting news about llm-d: how the project changed the way the open source AI community scales inference at PyTorch Conference North America. A little over a year after the project was founded, llm-d is reaching a new level of maturity, delivering state-of-the-art performance for generative serving, while also enabling the capabilities needed for day two operations, including multi-tenant quality of service, zero downtime operations, and all of that without sacrificing performance in production. Join us in San Jose, October 20-21:

PyTorch

11,679 Aufrufe • vor 1 Monat

High-Velocity GPU Kernel Authoring with CUTLASS Python Join Guray Ozen from NVIDIA at PyTorch Conference North America 2026, where he will present recent improvements to CUTLASS for Python. CUTLASS for Python is the technology stack used to write speed-of-light kernels for the latest GPU generations, powering today's most critical AI workloads. In his presentation, Guray will introduce several new productivity features for developers and agents, including CuTe extensions, CUTLASS primitives, a task scheduler, compiler diagnostics, and static checks to help catch errors before launch. Join us on October 20-21 in San Jose: #PyTorchCon
0:48

High-Velocity GPU Kernel Authoring with CUTLASS Python Join Guray Ozen from NVIDIA at PyTorch Conference North America 2026, where he will present recent improvements to CUTLASS for Python. CUTLASS for Python is the technology stack used to write speed-of-light kernels for the latest GPU generations, powering today's most critical AI workloads. In his presentation, Guray will introduce several new productivity features for developers and agents, including CuTe extensions, CUTLASS primitives, a task scheduler, compiler diagnostics, and static checks to help catch errors before launch. Join us on October 20-21 in San Jose: #PyTorchCon

PyTorch

11,242 Aufrufe • vor 1 Monat

The #IntelGaudi 3 #AI accelerator offers a highly competitive alternative to NVIDIA’s H100 with higher performance, increased scalability, and PyTorch integration. Explore more key product benefits.
0:29

The #IntelGaudi 3 #AI accelerator offers a highly competitive alternative to NVIDIA’s H100 with higher performance, increased scalability, and PyTorch integration. Explore more key product benefits.

Intel AI

71,845 Aufrufe • vor 2 Jahren