Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

A free MIT course about deep learning, 2026 edition: Here, MIT CSAIL researcher Alexander Amini discusses the differences between supervised, unsupervised, & reinforcement learning approaches (Lecture 5).

MIT CSAIL

347,896 subscribers

17,599 görüntüleme • 1 ay önce •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Free MIT course breaks down foundation models & genAI: Here, CSAIL researcher & lead lecturer Rickard Brüel Gabrielsson discusses AGI & a key innovation behind AI systems: learning from observation (Lecture 1).

Free MIT course breaks down foundation models & genAI: Here, CSAIL researcher & lead lecturer Rickard Brüel Gabrielsson discusses AGI & a key innovation behind AI systems: learning from observation (Lecture 1).

MIT CSAIL

11,973 görüntüleme • 1 yıl önce

A free MIT course about building scalable & high-performance software systems: (v/MIT OpenCourseWare) Here, MIT prof. & CSAIL principal investigator Charles Leiserson discusses why performance matters in computing (Lecture 1).

A free MIT course about building scalable & high-performance software systems: (v/MIT OpenCourseWare) Here, MIT prof. & CSAIL principal investigator Charles Leiserson discusses why performance matters in computing (Lecture 1).

MIT CSAIL

61,054 görüntüleme • 5 ay önce

Free MIT course breaks down deep learning: Here, MIT ass't prof. Sara Beery discusses how it's driven breakthroughs in areas like image generation, coding, & playing games (Lecture 1).

Free MIT course breaks down deep learning: Here, MIT ass't prof. Sara Beery discusses how it's driven breakthroughs in areas like image generation, coding, & playing games (Lecture 1).

MIT CSAIL

20,456 görüntüleme • 2 ay önce

A free MIT course breaking down mathematics for computer science & engineering: (v/MIT OpenCourseWare) Here, MIT prof. Tom Leighton, who is also the CEO & co-founder of Akamai, discusses what a proof is (Lesson 1).

A free MIT course breaking down mathematics for computer science & engineering: (v/MIT OpenCourseWare) Here, MIT prof. Tom Leighton, who is also the CEO & co-founder of Akamai, discusses what a proof is (Lesson 1).

MIT CSAIL

57,884 görüntüleme • 7 ay önce

Watch "Endless experimentation: Building AI models in the wild." This is a 50-minute, MIT lecture about problems when deploying models and LLMs in the real world and how to prepare to solve them. This is a great lecture for those building production machine learning.

Watch "Endless experimentation: Building AI models in the wild." This is a 50-minute, MIT lecture about problems when deploying models and LLMs in the real world and how to prepare to solve them. This is a great lecture for those building production machine learning.

Santiago

117,204 görüntüleme • 2 yıl önce

This 1 hour MIT lecture about "Machine Learning" will tell you more about how to build your own ML model than 2 months of internship at OpenAI. Bookmark this & give it 1 hour today, no matter what. This will change the way you use AI. Then read the post below.

This 1 hour MIT lecture about "Machine Learning" will tell you more about how to build your own ML model than 2 months of internship at OpenAI. Bookmark this & give it 1 hour today, no matter what. This will change the way you use AI. Then read the post below.

Movez

83,797 görüntüleme • 4 ay önce

Super excited to launch a new AI course! 🚀 Fine-Tuning & Reinforcement Learning for LLMs: Intro to Post-Training A collaboration between AMD 🤝 Andrew Ng’s DeepLearning.AI to give every developer the tools & compute to work with the same post-training techniques, used across today’s leading AI labs. 🎓 Learn for free → 🧵

Super excited to launch a new AI course! 🚀 Fine-Tuning & Reinforcement Learning for LLMs: Intro to Post-Training A collaboration between AMD 🤝 Andrew Ng’s DeepLearning.AI to give every developer the tools & compute to work with the same post-training techniques, used across today’s leading AI labs. 🎓 Learn for free → 🧵

Sharon Zhou

20,386 görüntüleme • 9 ay önce

this 1 hour MIT lecture on portfolio management is the single best video from the Mathematics in Finance series. a former Morgan Stanley trader teaches you more about diversification and position sizing than most learn in years. 26 lectures in the course. all free. save this.

this 1 hour MIT lecture on portfolio management is the single best video from the Mathematics in Finance series. a former Morgan Stanley trader teaches you more about diversification and position sizing than most learn in years. 26 lectures in the course. all free. save this.

Goshawk Trades

122,667 görüntüleme • 3 ay önce

Lung cancer is the leading cause of cancer-related deaths worldwide. A deep learning model developed by MIT & MGH researchers called "Sybil" can accurately predict a patient’s risk of lung cancer up to 6 years in advance by analyzing a low-dose CT scan:

Lung cancer is the leading cause of cancer-related deaths worldwide. A deep learning model developed by MIT & MGH researchers called "Sybil" can accurately predict a patient’s risk of lung cancer up to 6 years in advance by analyzing a low-dose CT scan:

MIT CSAIL

41,414 görüntüleme • 1 yıl önce

MIT put its full quantum physics course online for free and the opening lecture starts with a box you can't look inside. Almost nobody finishes it. This is 8.04, Quantum Physics I, taught by Allan Adams on the MIT campus. Same room, same problem sets, same professor the tuition pays for. He skips the history and the philosophy. He builds a simple apparatus, sends things through it, and shows the result no classical picture can survive. Skip the first 10 minutes, that part is course admin. What follows is thought experiment stacked on thought experiment until superposition stops being a word and becomes the only explanation left. Every engineer arguing about quantum computing in 2026 is arguing about what happens in this hour. A systems engineer I know watched it twice with a notebook and called it the clearest teaching he'd seen since university. MIT charges $60,000 a year. This lecture costs nothing. The gate was never locked. Almost nobody walks through.

MIT put its full quantum physics course online for free and the opening lecture starts with a box you can't look inside. Almost nobody finishes it. This is 8.04, Quantum Physics I, taught by Allan Adams on the MIT campus. Same room, same problem sets, same professor the tuition pays for. He skips the history and the philosophy. He builds a simple apparatus, sends things through it, and shows the result no classical picture can survive. Skip the first 10 minutes, that part is course admin. What follows is thought experiment stacked on thought experiment until superposition stops being a word and becomes the only explanation left. Every engineer arguing about quantum computing in 2026 is arguing about what happens in this hour. A systems engineer I know watched it twice with a notebook and called it the clearest teaching he'd seen since university. MIT charges $60,000 a year. This lecture costs nothing. The gate was never locked. Almost nobody walks through.

xanax

14,337 görüntüleme • 16 gün önce

How GPT-5 thinks, with OpenAI VP of Research Jerry Tworek 00:00 - Intro 01:01 - What Reasoning Actually Means in AI 02:32 - Chain of Thought: Models Thinking in Words 05:25 - How Models Decide How Long to Think 07:24 - Evolution from o1 to o3 to GPT-5 11:00 - The Road to OpenAI: Growing up in Poland, Dropping out of School, Trading 20:32 - Working on Robotics and Rubik's Cube Solving 23:02 - A Day in the Life: Talking to Researchers 24:06 - How Research Priorities Are Determined 26:53 - OpenAI's Culture of Transparency 29:32 - Balancing Research with Shipping Fast 31:52 - Using OpenAI's Own Tools Daily 32:43 - Pre-Training Plus RL: The Modern AI Stack 35:10 - Reinforcement Learning 101: Training Dogs 40:17 - The Evolution of Deep Reinforcement Learning 42:09 - When GPT-4 Seemed Underwhelming at First 45:39 - How RLHF Made GPT-4 Actually Useful 48:02 - Unsupervised vs Supervised Learning 49:59 - GRPO and How DeepSeek Accelerated US Research 53:05 - What It Takes to Scale Reinforcement Learning 55:36 - Agentic AI and Long-Horizon Thinking 59:19 - Alignment as an RL Problem 1:01:11 - Winning ICPC World Finals Without Specific Training 1:05:53 - Applying RL Beyond Math and Coding 1:09:15 - The Path from Here to AGI 1:12:23 - Pure RL vs Language Models

How GPT-5 thinks, with OpenAI VP of Research Jerry Tworek 00:00 - Intro 01:01 - What Reasoning Actually Means in AI 02:32 - Chain of Thought: Models Thinking in Words 05:25 - How Models Decide How Long to Think 07:24 - Evolution from o1 to o3 to GPT-5 11:00 - The Road to OpenAI: Growing up in Poland, Dropping out of School, Trading 20:32 - Working on Robotics and Rubik's Cube Solving 23:02 - A Day in the Life: Talking to Researchers 24:06 - How Research Priorities Are Determined 26:53 - OpenAI's Culture of Transparency 29:32 - Balancing Research with Shipping Fast 31:52 - Using OpenAI's Own Tools Daily 32:43 - Pre-Training Plus RL: The Modern AI Stack 35:10 - Reinforcement Learning 101: Training Dogs 40:17 - The Evolution of Deep Reinforcement Learning 42:09 - When GPT-4 Seemed Underwhelming at First 45:39 - How RLHF Made GPT-4 Actually Useful 48:02 - Unsupervised vs Supervised Learning 49:59 - GRPO and How DeepSeek Accelerated US Research 53:05 - What It Takes to Scale Reinforcement Learning 55:36 - Agentic AI and Long-Horizon Thinking 59:19 - Alignment as an RL Problem 1:01:11 - Winning ICPC World Finals Without Specific Training 1:05:53 - Applying RL Beyond Math and Coding 1:09:15 - The Path from Here to AGI 1:12:23 - Pure RL vs Language Models

Matt Turck

451,229 görüntüleme • 9 ay önce

Learn more about Boltz-2, the new open source AI model from MIT and Recursion capable of predicting protein binding affinity with unprecedented speed, scale and accuracy. ▪️ Boltz-2 is the first model to combine structure and binding affinity prediction, approaching the accuracy of physics-based free energy perturbation (FEP) calculations while being over 1,000 times faster and less computationally expensive. 💥 The model addresses a critical bottleneck in small molecule drug discovery. ▪️ A powerful tool built on novel machine learning: “By predicting both molecular structure and binding affinity simultaneously with unprecedented speed and scale, Boltz-2 gives R&D teams a powerful tool to triage more effectively and focus resources on the most promising compounds,” says Najat Khan, PhD, Chief R&D Officer and Chief Commercial Officer at Recursion. ▪️ The added power of open source: “Because Boltz-2 is open-source, including its training code, scientists can easily adapt it for specific types of molecules, making it even more powerful as a tool to accelerate discovery," says Regina Barzilay, PhD, MIT School of Engineering Distinguished Professor for AI and Health, AI faculty lead at MIT Jameel Clinic for AI & Health and MIT CSAIL principal investigator. 👉 Learn more, read the preprint, and access Boltz-2 here: 📅 Join us for live presentations, demos and discussions: 📎 MIT Presentation (Cambridge) – Monday, June 9. 📎 NVIDIA #GTC25 (Paris) – Wednesday, June 11. 📎 Molecular Machine Learning Conference - MoML (Montreal) – Tuesday, June 17.

Learn more about Boltz-2, the new open source AI model from MIT and Recursion capable of predicting protein binding affinity with unprecedented speed, scale and accuracy. ▪️ Boltz-2 is the first model to combine structure and binding affinity prediction, approaching the accuracy of physics-based free energy perturbation (FEP) calculations while being over 1,000 times faster and less computationally expensive. 💥 The model addresses a critical bottleneck in small molecule drug discovery. ▪️ A powerful tool built on novel machine learning: “By predicting both molecular structure and binding affinity simultaneously with unprecedented speed and scale, Boltz-2 gives R&D teams a powerful tool to triage more effectively and focus resources on the most promising compounds,” says Najat Khan, PhD, Chief R&D Officer and Chief Commercial Officer at Recursion. ▪️ The added power of open source: “Because Boltz-2 is open-source, including its training code, scientists can easily adapt it for specific types of molecules, making it even more powerful as a tool to accelerate discovery," says Regina Barzilay, PhD, MIT School of Engineering Distinguished Professor for AI and Health, AI faculty lead at MIT Jameel Clinic for AI & Health and MIT CSAIL principal investigator. 👉 Learn more, read the preprint, and access Boltz-2 here: 📅 Join us for live presentations, demos and discussions: 📎 MIT Presentation (Cambridge) – Monday, June 9. 📎 NVIDIA #GTC25 (Paris) – Wednesday, June 11. 📎 Molecular Machine Learning Conference - MoML (Montreal) – Tuesday, June 17.

Recursion

15,593 görüntüleme • 1 yıl önce

New Course: Reinforcement Fine-Tuning LLMs with GRPO! Learn to use reinforcement learning to improve your LLM performance in this short course, built in collaboration with Predibase by Rubrik, and taught by Travis Addair, its Co-Founder and CTO, and Arnav Garg, its Senior Engineer and Machine Learning Lead. Reasoning models have been one of the most important developments in LLMs. Reinforcement Fine-Tuning (RFT) uses rewards to encourage LLMs to find solutions to multi-step reasoning tasks such as solving math problems and debugging code - without needing pre-existing training examples like in traditional supervised fine-tuning. Group Relative Policy Optimization (GRPO) is a reinforcement fine-tuning algorithm gaining rapid adoption. Developed by the DeepSeek team and used to train the R1 reasoning model, GRPO uses reward functions that you can write in Python to assign rewards to model responses. It’s beneficial for tasks with verifiable outcomes and can work well even with fewer than 100 training examples. It can also significantly improve the reasoning ability of smaller LLMs, making applications faster and more cost effective. In this course, you’ll take a technical deep dive into RFT with GRPO. You’ll learn to build reward functions that you can use in the GRPO training process to guide an LLM toward better performance on multi-step reasoning tasks. In detail, you’ll: - Learn when reinforcement fine-tuning is a better fit than supervised fine-tuning, especially for tasks involving multi-step reasoning or limited labeled data. - Understand how GRPO uses programmable reward functions as a more scalable alternative to the human feedback required for other reinforcement learning algorithms, such as RLHF and DPO. - Frame the Wordle game as a reinforcement fine-tuning problem and see how an LLM can learn to plan, analyze feedback, and improve its strategy over time. - Design reward functions that power the reinforcement fine-tuning process. - Learn techniques for evaluating more subjective tasks, such as rating the quality of a text summary, using an LLM as a judge. - Understand why reward hacking happens and how to avoid it by adding penalty functions to discourage undesirable behaviors. - Learn the four key components of the loss calculation in the GRPO algorithm: token probability distribution ratios, advantages, clipping, and KL-divergence. - Launch reinforcement fine-tuning jobs using Predibase’s hosted training services. By the end of this course, you’ll be able to build and fine-tune LLMs using reinforcement learning to improve reasoning without relying on large labeled datasets or subjective human feedback. Please sign up here:

New Course: Reinforcement Fine-Tuning LLMs with GRPO! Learn to use reinforcement learning to improve your LLM performance in this short course, built in collaboration with Predibase by Rubrik, and taught by Travis Addair, its Co-Founder and CTO, and Arnav Garg, its Senior Engineer and Machine Learning Lead. Reasoning models have been one of the most important developments in LLMs. Reinforcement Fine-Tuning (RFT) uses rewards to encourage LLMs to find solutions to multi-step reasoning tasks such as solving math problems and debugging code - without needing pre-existing training examples like in traditional supervised fine-tuning. Group Relative Policy Optimization (GRPO) is a reinforcement fine-tuning algorithm gaining rapid adoption. Developed by the DeepSeek team and used to train the R1 reasoning model, GRPO uses reward functions that you can write in Python to assign rewards to model responses. It’s beneficial for tasks with verifiable outcomes and can work well even with fewer than 100 training examples. It can also significantly improve the reasoning ability of smaller LLMs, making applications faster and more cost effective. In this course, you’ll take a technical deep dive into RFT with GRPO. You’ll learn to build reward functions that you can use in the GRPO training process to guide an LLM toward better performance on multi-step reasoning tasks. In detail, you’ll: - Learn when reinforcement fine-tuning is a better fit than supervised fine-tuning, especially for tasks involving multi-step reasoning or limited labeled data. - Understand how GRPO uses programmable reward functions as a more scalable alternative to the human feedback required for other reinforcement learning algorithms, such as RLHF and DPO. - Frame the Wordle game as a reinforcement fine-tuning problem and see how an LLM can learn to plan, analyze feedback, and improve its strategy over time. - Design reward functions that power the reinforcement fine-tuning process. - Learn techniques for evaluating more subjective tasks, such as rating the quality of a text summary, using an LLM as a judge. - Understand why reward hacking happens and how to avoid it by adding penalty functions to discourage undesirable behaviors. - Learn the four key components of the loss calculation in the GRPO algorithm: token probability distribution ratios, advantages, clipping, and KL-divergence. - Launch reinforcement fine-tuning jobs using Predibase’s hosted training services. By the end of this course, you’ll be able to build and fine-tune LLMs using reinforcement learning to improve reasoning without relying on large labeled datasets or subjective human feedback. Please sign up here:

Andrew Ng

86,457 görüntüleme • 1 yıl önce

Here's my conversation with Edward Gibson (Ted Gibson, Language Lab MIT), a linguist and psychologist at MIT, heading the MIT Language Lab. We talk all about the human language: syntax, grammar, structure, theories of language, evolution of language, how it reflects culture, and of course LLMs, both their amazing power and their limitations. It's here on X in full, and is up on YouTube, Spotify, and everywhere else. Links in comment. Timestamps: 0:00 - Introduction 1:13 - Human language 5:19 - Generalizations in language 11:06 - Dependency grammar 21:05 - Morphology 29:40 - Evolution of languages 33:00 - Noam Chomsky 1:17:06 - Thinking and language 1:30:36 - LLMs 1:43:35 - Center embedding 2:10:02 - Learning a new language 2:13:54 - Nature vs nurture 2:20:30 - Culture and language 2:34:58 - Universal language 2:39:21 - Language translation 2:42:36 - Animal communication

Here's my conversation with Edward Gibson (Ted Gibson, Language Lab MIT), a linguist and psychologist at MIT, heading the MIT Language Lab. We talk all about the human language: syntax, grammar, structure, theories of language, evolution of language, how it reflects culture, and of course LLMs, both their amazing power and their limitations. It's here on X in full, and is up on YouTube, Spotify, and everywhere else. Links in comment. Timestamps: 0:00 - Introduction 1:13 - Human language 5:19 - Generalizations in language 11:06 - Dependency grammar 21:05 - Morphology 29:40 - Evolution of languages 33:00 - Noam Chomsky 1:17:06 - Thinking and language 1:30:36 - LLMs 1:43:35 - Center embedding 2:10:02 - Learning a new language 2:13:54 - Nature vs nurture 2:20:30 - Culture and language 2:34:58 - Universal language 2:39:21 - Language translation 2:42:36 - Animal communication

Lex Fridman

340,293 görüntüleme • 2 yıl önce

An exciting new course: Fine-tuning and Reinforcement Learning for LLMs: Intro to Post-training, taught by Sharon Zhou, VP of AI at AMD. Available now at Post-training is the key technique used by frontier labs to turn a base LLM--a model trained on massive unlabeled text to predict the next word/token--into a helpful, reliable assistant that can follow instructions. I've also seen many applications where post-training is what turns a demo application that works only 80% of the time into a reliable system that consistently performs. This course will teach you the most important post-training techniques! In this 5 module course, Sharon walks you through the complete post-training pipeline: supervised fine-tuning, reward modeling, RLHF, and techniques like PPO and GRPO. You'll also learn to use LoRA for efficient training, and to design evals that catch problems before and after deployment. Skills you'll gain: - Apply supervised fine-tuning and reinforcement learning (RLHF, PPO, GRPO) to align models to desired behaviors - Use LoRA for efficient fine-tuning without retraining entire models - Prepare datasets and generate synthetic data for post-training - Understand how to operate LLM production pipelines, with go/no-go decision points and feedback loops These advanced methods aren’t limited to frontier AI labs anymore, and you can now use them in your own applications. Learn here:

An exciting new course: Fine-tuning and Reinforcement Learning for LLMs: Intro to Post-training, taught by Sharon Zhou, VP of AI at AMD. Available now at Post-training is the key technique used by frontier labs to turn a base LLM--a model trained on massive unlabeled text to predict the next word/token--into a helpful, reliable assistant that can follow instructions. I've also seen many applications where post-training is what turns a demo application that works only 80% of the time into a reliable system that consistently performs. This course will teach you the most important post-training techniques! In this 5 module course, Sharon walks you through the complete post-training pipeline: supervised fine-tuning, reward modeling, RLHF, and techniques like PPO and GRPO. You'll also learn to use LoRA for efficient training, and to design evals that catch problems before and after deployment. Skills you'll gain: - Apply supervised fine-tuning and reinforcement learning (RLHF, PPO, GRPO) to align models to desired behaviors - Use LoRA for efficient fine-tuning without retraining entire models - Prepare datasets and generate synthetic data for post-training - Understand how to operate LLM production pipelines, with go/no-go decision points and feedback loops These advanced methods aren’t limited to frontier AI labs anymore, and you can now use them in your own applications. Learn here:

Andrew Ng

132,304 görüntüleme • 9 ay önce

The Man Who Might SOLVE AI Alignment 🦸‍♂️ Dr. Steven Byrnes (Steven Byrnes) is one of the few people who both understands why alignment is hard, and is taking a serious technical shot at solving it. He has a whopping 90% P(Doom), but argues that LLMs will plateau before becoming truly dangerous, and the real threat will come from next-generation “brain-like AGI” based on actor-critic reinforcement learning. After his UC Berkeley physics PhD & Harvard postdoc, he became an AGI safety researcher at Astera Institute. He's now deep in the neuroscience of reverse-engineering how human brains actually work, knowledge that could plausibly help us solve the technical AI alignment problem. In this unusually deep episode — because with all due respect to my other guests, I didn't have to waste any time arguing with him about obvious surface issues — we talk about his "two subsystems" model of the brain, why current AI safety approaches miss the mark, his disagreements with social evolution approaches, and why understanding human neuroscience matters for building aligned AGI.

The Man Who Might SOLVE AI Alignment 🦸‍♂️ Dr. Steven Byrnes (Steven Byrnes) is one of the few people who both understands why alignment is hard, and is taking a serious technical shot at solving it. He has a whopping 90% P(Doom), but argues that LLMs will plateau before becoming truly dangerous, and the real threat will come from next-generation “brain-like AGI” based on actor-critic reinforcement learning. After his UC Berkeley physics PhD & Harvard postdoc, he became an AGI safety researcher at Astera Institute. He's now deep in the neuroscience of reverse-engineering how human brains actually work, knowledge that could plausibly help us solve the technical AI alignment problem. In this unusually deep episode — because with all due respect to my other guests, I didn't have to waste any time arguing with him about obvious surface issues — we talk about his "two subsystems" model of the brain, why current AI safety approaches miss the mark, his disagreements with social evolution approaches, and why understanding human neuroscience matters for building aligned AGI.

Liron Shapira

10,542 görüntüleme • 1 yıl önce

In case you missed it, we recently launched "Post-training of LLMs," a short course where you'll: ✅ Understand when and why to use post-training methods like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning. ✅ Learn the concepts underlying the three post-training methods of SFT, DPO, and Online RL, their common use-cases, and how to curate high-quality data to effectively train a model using each method. ✅ Download a pre-trained model and implement post-training pipelines to turn a base model into an instruct model, change the identity of a chat assistant, and improve a model’s math capabilities. Learn more and enroll for free:

In case you missed it, we recently launched "Post-training of LLMs," a short course where you'll: ✅ Understand when and why to use post-training methods like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning. ✅ Learn the concepts underlying the three post-training methods of SFT, DPO, and Online RL, their common use-cases, and how to curate high-quality data to effectively train a model using each method. ✅ Download a pre-trained model and implement post-training pipelines to turn a base model into an instruct model, change the identity of a chat assistant, and improve a model’s math capabilities. Learn more and enroll for free:

DeepLearning.AI

16,779 görüntüleme • 1 yıl önce

Today, we're joined by Nikita Rudin, co-founder and CEO of Flexion to discuss the gap between current robotic capabilities and what’s required to deploy fully autonomous robots in the real world. Nikita explains how reinforcement learning and simulation have driven rapid progress in robot locomotion—and why locomotion is still far from “solved.” We dig into the sim2real gap, and how adding visual inputs introduces noise and significantly complicates sim-to-real transfer. We also explore the debate between end-to-end models and modular approaches, and why separating locomotion, planning, and semantics remains a pragmatic approach today. Nikita also introduces the concept of "real-to-sim", which uses real-world data to refine simulation parameters for higher fidelity training, discusses how reinforcement learning, imitation learning, and teleoperation data are combined to train robust policies for both quadruped and humanoid robots, and introduces Flexion's hierarchical approach that utilizes pre-trained Vision-Language Models (VLMs) for high-level task orchestration with Vision-Language-Action (VLA) models and low-level whole-body trackers. Finally, Nikita shares the behind-the-scenes in humanoid robot demos, his take on reinforcement learning in simulation versus the real world, the nuances of reward tuning, and offers practical advice for researchers and practitioners looking to get started in robotics today. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 04:07 - Is robot locomotion solved? 06:04 - Sim-to-real gap 08:58 - Adding semantics to policies 09:42 - Modular vs end-to-end architectures 10:29 - Planner model 12:21 - Adapting RL techniques from quadrupeds to humanoids 15:39 - Behind robot demos 18:09 - Humanoid robots in home environments 22:03 - Training approach 23:56 - VLA models 27:59 - Closing the sim-to-real gap 32:55 - Task orchestration using VLMs 36:38 - Tool use 38:10 - Model hierarchy 43:37 - Simulator versus simulation environment 44:57 - Combining imitation learning and reinforcement learning 46:42 - RL in real world versus RL in simulation 52:58 - Reward tuning and value functions in robotics 56:38 - Predictions 1:00:10 - Humanoids, quadropeds, and wheeled platforms 1:02:45 - Advice, recommended robot kits, and community pla

Today, we're joined by Nikita Rudin, co-founder and CEO of Flexion to discuss the gap between current robotic capabilities and what’s required to deploy fully autonomous robots in the real world. Nikita explains how reinforcement learning and simulation have driven rapid progress in robot locomotion—and why locomotion is still far from “solved.” We dig into the sim2real gap, and how adding visual inputs introduces noise and significantly complicates sim-to-real transfer. We also explore the debate between end-to-end models and modular approaches, and why separating locomotion, planning, and semantics remains a pragmatic approach today. Nikita also introduces the concept of "real-to-sim", which uses real-world data to refine simulation parameters for higher fidelity training, discusses how reinforcement learning, imitation learning, and teleoperation data are combined to train robust policies for both quadruped and humanoid robots, and introduces Flexion's hierarchical approach that utilizes pre-trained Vision-Language Models (VLMs) for high-level task orchestration with Vision-Language-Action (VLA) models and low-level whole-body trackers. Finally, Nikita shares the behind-the-scenes in humanoid robot demos, his take on reinforcement learning in simulation versus the real world, the nuances of reward tuning, and offers practical advice for researchers and practitioners looking to get started in robotics today. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 04:07 - Is robot locomotion solved? 06:04 - Sim-to-real gap 08:58 - Adding semantics to policies 09:42 - Modular vs end-to-end architectures 10:29 - Planner model 12:21 - Adapting RL techniques from quadrupeds to humanoids 15:39 - Behind robot demos 18:09 - Humanoid robots in home environments 22:03 - Training approach 23:56 - VLA models 27:59 - Closing the sim-to-real gap 32:55 - Task orchestration using VLMs 36:38 - Tool use 38:10 - Model hierarchy 43:37 - Simulator versus simulation environment 44:57 - Combining imitation learning and reinforcement learning 46:42 - RL in real world versus RL in simulation 52:58 - Reward tuning and value functions in robotics 56:38 - Predictions 1:00:10 - Humanoids, quadropeds, and wheeled platforms 1:02:45 - Advice, recommended robot kits, and community pla

The TWIML AI Podcast

22,592 görüntüleme • 7 ay önce

MIT filmed the single hour that makes all of calculus one subject instead of two. Free, uncut, chalk only. Almost nobody watches it. This is 18.01, Single Variable Calculus, lecture 19, taught by David Jerison. The First Fundamental Theorem of Calculus. Slopes and areas were separate problems for centuries. Different tools, different people, different questions. This lecture shows they were the same thing pointed in opposite directions. Every gradient computed in every training run rides on that connection. Most engineers use it daily and have never seen the proof that makes it legal. Watch the board work in the middle. He builds the link line by line, real students in the room, no software, no animation. A machine learning engineer I know rewatched it before an interview and said the chain from loss to update finally read as 1 object instead of 3 tricks. Full course free on YouTube under Creative Commons. You've been using the theorem. You've never seen it earned.

MIT filmed the single hour that makes all of calculus one subject instead of two. Free, uncut, chalk only. Almost nobody watches it. This is 18.01, Single Variable Calculus, lecture 19, taught by David Jerison. The First Fundamental Theorem of Calculus. Slopes and areas were separate problems for centuries. Different tools, different people, different questions. This lecture shows they were the same thing pointed in opposite directions. Every gradient computed in every training run rides on that connection. Most engineers use it daily and have never seen the proof that makes it legal. Watch the board work in the middle. He builds the link line by line, real students in the room, no software, no animation. A machine learning engineer I know rewatched it before an interview and said the chain from loss to update finally read as 1 object instead of 3 tricks. Full course free on YouTube under Creative Commons. You've been using the theorem. You've never seen it earned.

obssnnn

123,603 görüntüleme • 15 gün önce

MIT HANDED ITS DEEP LEARNING COURSE TO A FRONTIER-LAB ENGINEER FOR 68 MINUTES BECAUSE 90% OF PEOPLE SHIPPING AI CODE CAN'T EXPLAIN HOW THE MODEL ACTUALLY WORKS This is Maxime Labonne. He runs post-training at Liquid AI and wrote the LLM Engineer's Handbook. MIT gave him the room to break down the engine sitting inside every coding agent you've ever prompted. Twenty minutes in it stops being abstract. You finally see why the model confidently invents things that don't exist, why context is everything, and why "Just tell it to try again" sometimes fixes it and sometimes makes it worse. In 2026 "I use AI to code" stopped being a skill. Knowing why the model behaves the way it does -> tokens, context, post-training, where it quietly breaks -> is what separates someone who ships from someone babysitting a black box. Understanding an LLM isn't a research-team luxury anymore -> it's the difference between driving the agent and being driven by it. Anyone can prompt. The person who knows what's under the hood is the one still standing when the prompt stops working. Save this one & actually finish it ↓

MIT HANDED ITS DEEP LEARNING COURSE TO A FRONTIER-LAB ENGINEER FOR 68 MINUTES BECAUSE 90% OF PEOPLE SHIPPING AI CODE CAN'T EXPLAIN HOW THE MODEL ACTUALLY WORKS This is Maxime Labonne. He runs post-training at Liquid AI and wrote the LLM Engineer's Handbook. MIT gave him the room to break down the engine sitting inside every coding agent you've ever prompted. Twenty minutes in it stops being abstract. You finally see why the model confidently invents things that don't exist, why context is everything, and why "Just tell it to try again" sometimes fixes it and sometimes makes it worse. In 2026 "I use AI to code" stopped being a skill. Knowing why the model behaves the way it does -> tokens, context, post-training, where it quietly breaks -> is what separates someone who ships from someone babysitting a black box. Understanding an LLM isn't a research-team luxury anymore -> it's the difference between driving the agent and being driven by it. Anyone can prompt. The person who knows what's under the hood is the one still standing when the prompt stops working. Save this one & actually finish it ↓

slash1s

236,758 görüntüleme • 2 ay önce