Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Build a neural network from scratch, train it, and optimize it for real-world AI infrastructure during our PyTorch Associate Training the day before PyTorch Conference North America on October 19th. Your instructor, Faradawn Yang of NVIDIA AI explains how this training will give you hands on experience with the... show more

PyTorch

514,796 subscribers

17,402 views • 3 days ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

5 Comments

NVIDIA AI2 days ago

Nice! Well done on the video Faradawn. No doubt you'll have a packed room again this year 🙌

Hiruko2 days ago

@NVIDIAAI 抱歉，第一眼看成立党老师了

Dmitry Legchikov2 days ago

@NVIDIAAI Very charismatic man!

elian2 days ago

@NVIDIAAI cute that you can get certified in pytorch the day before the next breaking release drops

miaomiao2 days ago

@NVIDIAAI like his big mouth

Related Videos

At PyTorch Conference North America 2026, hear directly from and connect with the people working on PyTorch, vLLM, DeepSpeed, ray, Helion, and Safetensors, alongside experts working across the AI stack. At #PyTorchCon NA 2025, Richard Liaw (ray, Anyscale) spoke about the Ray team’s focus on building something “useful and critical to the AI infrastructure space” and about “how important Ray can be for the stack.” PyTorch conferences are the open source AI community’s town square, where what’s next gets decided. Register by September 4 (tomorrow) to save on your conference pass: #PyTorchCon

At PyTorch Conference North America 2026, hear directly from and connect with the people working on PyTorch, vLLM, DeepSpeed, ray, Helion, and Safetensors, alongside experts working across the AI stack. At #PyTorchCon NA 2025, Richard Liaw (ray, Anyscale) spoke about the Ray team’s focus on building something “useful and critical to the AI infrastructure space” and about “how important Ray can be for the stack.” PyTorch conferences are the open source AI community’s town square, where what’s next gets decided. Register by September 4 (tomorrow) to save on your conference pass: #PyTorchCon

PyTorch

16,342 views • 28 days ago

The open source AI community thrives on collaboration, choice, and open contribution. As Joseph Groenenboom from Red Hat highlights, empowering developers to freely contribute and build options is essential for growing the entire AI ecosystem. PyTorch Conference North America 2026 is where that community comes together in person. Join us to collaborate with open source pioneers, expand your deployment capabilities, and directly contribute to shaping the future of machine learning. Register for PyTorch Conference North America today: #PyTorchCon

The open source AI community thrives on collaboration, choice, and open contribution. As Joseph Groenenboom from Red Hat highlights, empowering developers to freely contribute and build options is essential for growing the entire AI ecosystem. PyTorch Conference North America 2026 is where that community comes together in person. Join us to collaborate with open source pioneers, expand your deployment capabilities, and directly contribute to shaping the future of machine learning. Register for PyTorch Conference North America today: #PyTorchCon

PyTorch

17,621 views • 19 days ago

"It's really great to feel the energy and see all the collaboration that's happening, lots of conversations. We have people here who are just starting to learn about PyTorch, and we have people who are maintainers. It's super nice to see that energy and see how together we're going to be able to solve some of these very difficult problems for humanity." Ankit Patel, NVIDIA, at PyTorch Conference Europe 2026 Register today to join the open source AI community at PyTorch Conference North America in San Jose, October 20–21: #PyTorchCon

"It's really great to feel the energy and see all the collaboration that's happening, lots of conversations. We have people here who are just starting to learn about PyTorch, and we have people who are maintainers. It's super nice to see that energy and see how together we're going to be able to solve some of these very difficult problems for humanity." Ankit Patel, NVIDIA, at PyTorch Conference Europe 2026 Register today to join the open source AI community at PyTorch Conference North America in San Jose, October 20–21: #PyTorchCon

PyTorch

17,000 views • 18 days ago

At PyTorch Conference North America 2026, hear directly from and connect with the people working on PyTorch, vLLM, DeepSpeed, ray, Helion, and Safetensors, alongside experts working across the AI stack. Keynote speaker Simon Mo (vLLM, Inferact) says vLLM’s goal is to become “the easiest to use and most efficient inference engine.” At #PyTorchCon NA 2025, he spoke about the difficulty and cost of using large language models and continuing to push inference efficiency forward. PyTorch conferences are the open source AI community’s town square, where what’s next gets decided. Register by September 4 to save on your conference pass:

At PyTorch Conference North America 2026, hear directly from and connect with the people working on PyTorch, vLLM, DeepSpeed, ray, Helion, and Safetensors, alongside experts working across the AI stack. Keynote speaker Simon Mo (vLLM, Inferact) says vLLM’s goal is to become “the easiest to use and most efficient inference engine.” At #PyTorchCon NA 2025, he spoke about the difficulty and cost of using large language models and continuing to push inference efficiency forward. PyTorch conferences are the open source AI community’s town square, where what’s next gets decided. Register by September 4 to save on your conference pass:

PyTorch

22,334 views • 1 month ago

Liang Zhang (Huawei) delivers “Ascend & PyTorch: Pioneer New AI Open Ecosystem” at PyTorch Conference China 2026. Drawing on eight years of open source practice, Liang Zhang looks at how Ascend’s collaboration with the PyTorch community is evolving from hardware adaptation to joint research on technical standards. The keynote also covers next-generation AI hardware-software codesign, interoperability between Chinese and global AI technology stacks, and building an open and sustainable AI industrial ecosystem. Here's Liang Zhang, introduced by Mark Collier 柯理怀: #PyTorchCon

Liang Zhang (Huawei) delivers “Ascend & PyTorch: Pioneer New AI Open Ecosystem” at PyTorch Conference China 2026. Drawing on eight years of open source practice, Liang Zhang looks at how Ascend’s collaboration with the PyTorch community is evolving from hardware adaptation to joint research on technical standards. The keynote also covers next-generation AI hardware-software codesign, interoperability between Chinese and global AI technology stacks, and building an open and sustainable AI industrial ecosystem. Here's Liang Zhang, introduced by Mark Collier 柯理怀: #PyTorchCon

PyTorch

16,367 views • 23 days ago

IBM’s Christian Jacobi (IBM Fellow and CTO, IBM Systems Development) on why the PyTorch community matters for AI today, the role of open source, and what he’s hearing from clients deploying AI in core IT and business processes. 🎥

IBM’s Christian Jacobi (IBM Fellow and CTO, IBM Systems Development) on why the PyTorch community matters for AI today, the role of open source, and what he’s hearing from clients deploying AI in core IT and business processes. 🎥

PyTorch

14,339 views • 8 months ago

Interested in optimizing Mixture of Experts LLM inference on ARM CPUs? In his talk at PyTorch Conference North America, Maajid Khan from Fujitsu Research India will explore efficient MoE LLM inference using vLLM and OpenVINO, sharing practical strategies for running these models effectively on ARM architectures. Register and join us in San Jose, October 20-21: #PyTorchCon

Interested in optimizing Mixture of Experts LLM inference on ARM CPUs? In his talk at PyTorch Conference North America, Maajid Khan from Fujitsu Research India will explore efficient MoE LLM inference using vLLM and OpenVINO, sharing practical strategies for running these models effectively on ARM architectures. Register and join us in San Jose, October 20-21: #PyTorchCon

PyTorch

16,448 views • 6 days ago

New chips are shipping faster than ever before, but the ecosystem is being held back by having to rewrite and then re-debug the same code over & over again. Chris Lattner CEO and Co-founder at Modular and EVP of Advanced AI Software & Platforms at Qualcomm, will deliver a keynote at PyTorch Conference North America about an open software platform for heterogeneous compute powered by Mojo and MAX. PyTorch has always been the place where the best models come together, and now there's a way to get those models onto all kinds of hardware. If you're interested in Al and compute, join us at the PyTorch Conference in San Jose, CA. Register now: #PyTorchCon

New chips are shipping faster than ever before, but the ecosystem is being held back by having to rewrite and then re-debug the same code over & over again. Chris Lattner CEO and Co-founder at Modular and EVP of Advanced AI Software & Platforms at Qualcomm, will deliver a keynote at PyTorch Conference North America about an open software platform for heterogeneous compute powered by Mojo and MAX. PyTorch has always been the place where the best models come together, and now there's a way to get those models onto all kinds of hardware. If you're interested in Al and compute, join us at the PyTorch Conference in San Jose, CA. Register now: #PyTorchCon

PyTorch

20,090 views • 16 days ago

TOMORROW 🎉 Join us for the virtual premiere of the PyTorch Documentary! We'll be live on YouTube at 10am PT on June 25 along with some of our key PyTorch collaborators from AMD, AWS, Google, Meta and Microsoft 💜 🔗

TOMORROW 🎉 Join us for the virtual premiere of the PyTorch Documentary! We'll be live on YouTube at 10am PT on June 25 along with some of our key PyTorch collaborators from AMD, AWS, Google, Meta and Microsoft 💜 🔗

PyTorch

48,761 views • 2 years ago

At #PyTorchCon North America 2026, Liz Li and Shekhar of AMD will discuss their work enabling scalable MXFP8 pretraining on MI355X GPUs. Liz and Shekhar will cover optimization of key MXFP8 operators in TorchAO and how those kernels were integrated with TorchTitan to build an end-to-end upstream PyTorch training stack for large language models. Their session, “Scaling MXFP8 Pretraining on 1K+ AMD Instinct MI355X: TorchAO Kernels and TorchTitan Training,” will also cover Triton and FlyDSL implementations and lessons from numerical validation, convergence, and performance tuning. Join us in San Jose on October 20-21. Register today:

At #PyTorchCon North America 2026, Liz Li and Shekhar of AMD will discuss their work enabling scalable MXFP8 pretraining on MI355X GPUs. Liz and Shekhar will cover optimization of key MXFP8 operators in TorchAO and how those kernels were integrated with TorchTitan to build an end-to-end upstream PyTorch training stack for large language models. Their session, “Scaling MXFP8 Pretraining on 1K+ AMD Instinct MI355X: TorchAO Kernels and TorchTitan Training,” will also cover Triton and FlyDSL implementations and lessons from numerical validation, convergence, and performance tuning. Join us in San Jose on October 20-21. Register today:

PyTorch

16,137 views • 7 days ago

PyTorch 2.13 brings FlexAttention to Apple Silicon, cuts peak memory by up to 4× for large-vocabulary models with nn.LinearCrossEntropyLoss, and updates distributed training, compilation, profiling, and on-device inference. Our live Q&A examined CUDA version support, CuTeDSL in TorchInductor, Python 3.15, ExecuTorch, torch.compile, and plans for PyTorch 2.14. Andrey Talman (Meta), albanD (Meta), and Piotr Bialecki (NVIDIA) joined moderator Chris Gottbrath (Gottbrath Technologies). This clip explains how FlexAttention compiles kernels specialized for the requested masking pattern, allowing them to skip unnecessary computation. It also covers speedups of up to approximately 12× over SDPA in tested sparse configurations and a deterministic backward path on CUDA that removes one source of nondeterminism in gradient computation. 🔗 Watch the full PyTorch 2.13 Release Live Q&A:

PyTorch 2.13 brings FlexAttention to Apple Silicon, cuts peak memory by up to 4× for large-vocabulary models with nn.LinearCrossEntropyLoss, and updates distributed training, compilation, profiling, and on-device inference. Our live Q&A examined CUDA version support, CuTeDSL in TorchInductor, Python 3.15, ExecuTorch, torch.compile, and plans for PyTorch 2.14. Andrey Talman (Meta), albanD (Meta), and Piotr Bialecki (NVIDIA) joined moderator Chris Gottbrath (Gottbrath Technologies). This clip explains how FlexAttention compiles kernels specialized for the requested masking pattern, allowing them to skip unnecessary computation. It also covers speedups of up to approximately 12× over SDPA in tested sparse configurations and a deterministic backward path on CUDA that removes one source of nondeterminism in gradient computation. 🔗 Watch the full PyTorch 2.13 Release Live Q&A:

PyTorch

18,591 views • 2 months ago

I vibecoded this neural network visualization for my students and open sourced it. It shows a simple MLP trained on MNIST handwritten digits at several training steps. The visualization is using Three.js and it comes with training code in PyTorch . Link + repo 👇

I vibecoded this neural network visualization for my students and open sourced it. It shows a simple MLP trained on MNIST handwritten digits at several training steps. The visualization is using Three.js and it comes with training code in PyTorch . Link + repo 👇

David Finsterwalder | eu/acc

488,228 views • 10 months ago

Microsoft just released a full AI degree for free It's called AI For Beginners, and it's a complete 12-week, 24-lesson curriculum. Free, on GitHub, no signup It starts from zero and builds up. The history of AI, neural networks and deep learning, computer vision, natural language processing, transformers and large language models, even genetic algorithms and AI ethics. Every lesson comes with reading, runnable Jupyter notebooks in both PyTorch and TensorFlow, quizzes, and hands-on labs. So you're not just reading theory, you're writing real code. There's also a beginner track if you're totally new: "Hello AI World," a simple neural network from scratch, an image classifier, and a sentiment analyzer. Here's the link: Bookmark this

Microsoft just released a full AI degree for free It's called AI For Beginners, and it's a complete 12-week, 24-lesson curriculum. Free, on GitHub, no signup It starts from zero and builds up. The history of AI, neural networks and deep learning, computer vision, natural language processing, transformers and large language models, even genetic algorithms and AI ethics. Every lesson comes with reading, runnable Jupyter notebooks in both PyTorch and TensorFlow, quizzes, and hands-on labs. So you're not just reading theory, you're writing real code. There's also a beginner track if you're totally new: "Hello AI World," a simple neural network from scratch, an image classifier, and a sentiment analyzer. Here's the link: Bookmark this

Yarchi

54,059 views • 3 months ago

This is what happens when GTC lands in Taipei. 🇹🇼 Keynote reveals, hands-on demos, real connections, and Jensen fans everywhere. It's not just a conference. It's where the AI era gets built together — and the energy of the community proves it. Join us at our next GTC — grow your AI skills, network, and experience the vibe for yourself.

This is what happens when GTC lands in Taipei. 🇹🇼 Keynote reveals, hands-on demos, real connections, and Jensen fans everywhere. It's not just a conference. It's where the AI era gets built together — and the energy of the community proves it. Join us at our next GTC — grow your AI skills, network, and experience the vibe for yourself.

NVIDIA

48,446 views • 3 months ago

FlexAttention is a novel compiler-driven programming model that allows implementing the majority of attention variants in a few lines of idiomatic PyTorch code Boyuan Feng & Avik Chaudhuri show how many existing attention variants can be implemented via FlexAttention & that we achieve competitive performance compared to handwritten kernels. 📺 Watch the full video on YouTube:

FlexAttention is a novel compiler-driven programming model that allows implementing the majority of attention variants in a few lines of idiomatic PyTorch code Boyuan Feng & Avik Chaudhuri show how many existing attention variants can be implemented via FlexAttention & that we achieve competitive performance compared to handwritten kernels. 📺 Watch the full video on YouTube:

PyTorch

17,929 views • 1 year ago

You’re already training Big Tech’s AI models. So why aren’t you getting compensated for it? With Action Model you can download our browser extension and train AI passively in the background or by completing ActionFi tasks, while earning rewards and ownership in the model itself. This is what the future of AI should look like. Ownership back in the hands of the people who help build it, not billionaire control.

You’re already training Big Tech’s AI models. So why aren’t you getting compensated for it? With Action Model you can download our browser extension and train AI passively in the background or by completing ActionFi tasks, while earning rewards and ownership in the model itself. This is what the future of AI should look like. Ownership back in the hands of the people who help build it, not billionaire control.

Action Model

26,468 views • 5 months ago

Introducing... OSAI 🐺🚨 From the makers of OSCP, the OSAI brings OffSec’s offensive methodology to AI with advanced red teaming for AI environments. This certification turns AI security knowledge into legitimate capability that holds up in the real world. 🔺 Expand into one of the fastest-growing security domains 🔺 Prove hands-on capability with a practical certification 🔺 Build repeatable methodology you can use across engagements Be the first to see what #OSAI covers, who it’s for, how the certification works, and be entered in a giveaway for free access:

Introducing... OSAI 🐺🚨 From the makers of OSCP, the OSAI brings OffSec’s offensive methodology to AI with advanced red teaming for AI environments. This certification turns AI security knowledge into legitimate capability that holds up in the real world. 🔺 Expand into one of the fastest-growing security domains 🔺 Prove hands-on capability with a practical certification 🔺 Build repeatable methodology you can use across engagements Be the first to see what #OSAI covers, who it’s for, how the certification works, and be entered in a giveaway for free access:

OffSec

62,419 views • 8 months ago