Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

A new Science Robotics study highlights a reinforcement learning–based framework that integrates perceptual uncertainty into policy learning to equip humanoid robots with reactive soccer skills and dynamic behaviors.

Science Magazine

4,770,466 subscribers

56,716 views • 12 days ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

A new Science Robotics study highlights exoskeletons that allow physical therapists and patients recovering from stroke to “feel” each other’s movements as they walk on separate treadmills, enabling nuanced gait correction.

A new Science Robotics study highlights exoskeletons that allow physical therapists and patients recovering from stroke to “feel” each other’s movements as they walk on separate treadmills, enabling nuanced gait correction.

Science Magazine

40,401 views • 2 months ago

A new approach uses diffused orientation fields to help robots transfer skills across curved objects of diverse shapes and sizes, enabling them to peel and slice varied fruits and vegetables. Learn more in Science Robotics:

A new approach uses diffused orientation fields to help robots transfer skills across curved objects of diverse shapes and sizes, enabling them to peel and slice varied fruits and vegetables. Learn more in Science Robotics:

Science Magazine

18,401 views • 4 months ago

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

NVIDIA Robotics

18,568 views • 6 months ago

Current Vision-Language-Action (VLA) paradigms in autonomous driving primarily rely on Imitation Learning (IL), which introduces inherent challenges such as distribution shift and causal confusion. Online Reinforcement Learning offers a promising pathway to address these issues through trial-and-error learning. However, applying online reinforcement learning to VLA models in autonomous driving is hindered by inefficient exploration in continuous action spaces. MindDrive, a VLA framework comprising a large language model (LLM) with two distinct sets of LoRA parameters. The one LLM serves as a Decision Expert for scenario reasoning and driving decision-making, while the other acts as an Action Expert that dynamically maps linguistic decisions into feasible trajectories. Paper Title: MindDrive: A Vision-Language-Action Model for Autonomous Driving via Project: Link:

Current Vision-Language-Action (VLA) paradigms in autonomous driving primarily rely on Imitation Learning (IL), which introduces inherent challenges such as distribution shift and causal confusion. Online Reinforcement Learning offers a promising pathway to address these issues through trial-and-error learning. However, applying online reinforcement learning to VLA models in autonomous driving is hindered by inefficient exploration in continuous action spaces. MindDrive, a VLA framework comprising a large language model (LLM) with two distinct sets of LoRA parameters. The one LLM serves as a Decision Expert for scenario reasoning and driving decision-making, while the other acts as an Action Expert that dynamically maps linguistic decisions into feasible trajectories. Paper Title: MindDrive: A Vision-Language-Action Model for Autonomous Driving via Project: Link:

AI Bites | YouTube Channel

43,496 views • 6 months ago

🚨Current scalable RL algos train a policy w/o value func, which is limiting with learning in open-ended, non-stationary, dynamic environments. But, how to scale value-based RL with more data/compute is unclear... Not anymore: presenting scaling laws for value-based RL 🧵⬇️

🚨Current scalable RL algos train a policy w/o value func, which is limiting with learning in open-ended, non-stationary, dynamic environments. But, how to scale value-based RL with more data/compute is unclear... Not anymore: presenting scaling laws for value-based RL 🧵⬇️

Aviral Kumar

37,376 views • 1 year ago

Unveiling Babbel's new look! With a focus on tailoring learning experiences to meet your needs, our new brand experience shows that learning a new language is a journey. One that leads to transformation in yourself and the world around you as you learn to speak with others.

Babbel

41,342 views • 2 years ago

Robora Sim: A PyBullet-Powered Environment for Learning Robotic Physical Intelligence We are currently building our Robora simulation environment setup for our sim based learning, leveraging PyBullet, an industry-standard physics engine widely used in AI-driven robotics research and development. The environment is optimized with GPU-accelerated learning algorithms, enabling high-speed imitation learning and reinforcement learning within a safe and controlled virtual setup before shipping out to real world. This simulation platform allows our models to learn, adapt, and generalize across different robot morphologies, terrain types and task objectives - all before deployment to the real world. At it's core, the system combines a VLA-powered high-level planner with low-level motion control algorithms, working cohesively to produce emergent, physically intelligent behaviors. This synergy between simulation, learning, and real-world transfer marks a major step forward in our pursuit of adaptive and intelligent robotic systems. Through advanced domain randomization and synthetic data generation, the Robora Simulation Environment ensures that policies trained in simulation transfer effectively to real-world robots, minimizing the sim-to-real gap. Moreover, users will be able to test and integrate their own hardware kits within selected simulation environments in the Robora Dapp, ensuring seamless compatibility and safer real-world implementation.

Robora Sim: A PyBullet-Powered Environment for Learning Robotic Physical Intelligence We are currently building our Robora simulation environment setup for our sim based learning, leveraging PyBullet, an industry-standard physics engine widely used in AI-driven robotics research and development. The environment is optimized with GPU-accelerated learning algorithms, enabling high-speed imitation learning and reinforcement learning within a safe and controlled virtual setup before shipping out to real world. This simulation platform allows our models to learn, adapt, and generalize across different robot morphologies, terrain types and task objectives - all before deployment to the real world. At it's core, the system combines a VLA-powered high-level planner with low-level motion control algorithms, working cohesively to produce emergent, physically intelligent behaviors. This synergy between simulation, learning, and real-world transfer marks a major step forward in our pursuit of adaptive and intelligent robotic systems. Through advanced domain randomization and synthetic data generation, the Robora Simulation Environment ensures that policies trained in simulation transfer effectively to real-world robots, minimizing the sim-to-real gap. Moreover, users will be able to test and integrate their own hardware kits within selected simulation environments in the Robora Dapp, ensuring seamless compatibility and safer real-world implementation.

Robora

23,489 views • 11 months ago

BaBot: The Ball-Balancing Robot - Real-time PID control on a 2-axis platform, powered by a microcontroller using the same chip as an Arduino. - Precision servos and IR sensors track the ball with speed and accuracy. - Perfect for learning control systems, teaching robotics, or showing off your engineering skills. - Fully open-source & ready to build at Video Credit: Johan Link #engineering #technology #robots #robotics

BaBot: The Ball-Balancing Robot - Real-time PID control on a 2-axis platform, powered by a microcontroller using the same chip as an Arduino. - Precision servos and IR sensors track the ball with speed and accuracy. - Perfect for learning control systems, teaching robotics, or showing off your engineering skills. - Fully open-source & ready to build at Video Credit: Johan Link #engineering #technology #robots #robotics

Wevolver

48,877 views • 1 year ago

As a newly appointed 𝗔𝘀𝘀𝗶𝘀𝘁𝗮𝗻𝘁 𝗣𝗿𝗼𝗳𝗲𝘀𝘀𝗼𝗿 at Imperial College London, I'm thrilled to announce the 𝗦𝗮𝗳𝗲 𝗪𝗵𝗼𝗹𝗲-𝗯𝗼𝗱𝘆 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝘁 𝗥𝗼𝗯𝗼𝘁𝗶𝗰𝘀 𝗟𝗮𝗯 (𝗦𝗪𝗜𝗥𝗟) at 𝗜𝗺𝗽𝗲𝗿𝗶𝗮𝗹 𝗖𝗼𝗹𝗹𝗲𝗴𝗲 𝗟𝗼𝗻𝗱𝗼𝗻. 𝗦𝗮𝗳𝗲 𝗪𝗵𝗼𝗹𝗲-𝗯𝗼𝗱𝘆 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝘁 𝗥𝗼𝗯𝗼𝘁𝗶𝗰𝘀 𝗟𝗮𝗯 (𝗦𝗪𝗜𝗥𝗟) ( is a new research lab focused on the intersection of safety and intelligence in next-generation robotics. We're hiring exceptional PhD students who are passionate about pushing the boundaries of robot learning. 𝗪𝗵𝗮𝘁 𝗺𝗮𝗸𝗲𝘀 𝗦𝗪𝗜𝗥𝗟 𝘂𝗻𝗶𝗾𝘂𝗲? We operate at the exciting convergence of: • Online & offline reinforcement learning • Imitation learning & human demonstrations • Sample-efficient learning methods • Whole-body and soft robotics systems We're 𝗹𝗼𝗼𝗸𝗶𝗻𝗴 𝗳𝗼𝗿 𝗽𝗿𝗼𝘀𝗽𝗲𝗰𝘁𝗶𝘃𝗲 𝗣𝗵𝗗 𝘀𝘁𝘂𝗱𝗲𝗻𝘁𝘀 interested in: • Developing safe exploration algorithms for robotic systems • Creating sample-efficient learning methods that minimize real-world trials • Building foundation models for robotics with safety guarantees • Advancing soft robotics and compliant human-robot interaction • Bridging theory and practice in embodied AI Why now? As robots become more capable and work closer with humans, we need systems that are both intelligent enough to handle complex tasks 𝗔𝗡𝗗 safe enough for real-world deployment. Traditional approaches treat safety and intelligence as competing priorities, we believe they're synergistic. If you're a motivated researcher who wants to develop the theoretical foundations and practical algorithms for tomorrow's safe, intelligent robots, I'd love to hear from you. Want to join? Apply via

As a newly appointed 𝗔𝘀𝘀𝗶𝘀𝘁𝗮𝗻𝘁 𝗣𝗿𝗼𝗳𝗲𝘀𝘀𝗼𝗿 at Imperial College London, I'm thrilled to announce the 𝗦𝗮𝗳𝗲 𝗪𝗵𝗼𝗹𝗲-𝗯𝗼𝗱𝘆 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝘁 𝗥𝗼𝗯𝗼𝘁𝗶𝗰𝘀 𝗟𝗮𝗯 (𝗦𝗪𝗜𝗥𝗟) at 𝗜𝗺𝗽𝗲𝗿𝗶𝗮𝗹 𝗖𝗼𝗹𝗹𝗲𝗴𝗲 𝗟𝗼𝗻𝗱𝗼𝗻. 𝗦𝗮𝗳𝗲 𝗪𝗵𝗼𝗹𝗲-𝗯𝗼𝗱𝘆 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝘁 𝗥𝗼𝗯𝗼𝘁𝗶𝗰𝘀 𝗟𝗮𝗯 (𝗦𝗪𝗜𝗥𝗟) ( is a new research lab focused on the intersection of safety and intelligence in next-generation robotics. We're hiring exceptional PhD students who are passionate about pushing the boundaries of robot learning. 𝗪𝗵𝗮𝘁 𝗺𝗮𝗸𝗲𝘀 𝗦𝗪𝗜𝗥𝗟 𝘂𝗻𝗶𝗾𝘂𝗲? We operate at the exciting convergence of: • Online & offline reinforcement learning • Imitation learning & human demonstrations • Sample-efficient learning methods • Whole-body and soft robotics systems We're 𝗹𝗼𝗼𝗸𝗶𝗻𝗴 𝗳𝗼𝗿 𝗽𝗿𝗼𝘀𝗽𝗲𝗰𝘁𝗶𝘃𝗲 𝗣𝗵𝗗 𝘀𝘁𝘂𝗱𝗲𝗻𝘁𝘀 interested in: • Developing safe exploration algorithms for robotic systems • Creating sample-efficient learning methods that minimize real-world trials • Building foundation models for robotics with safety guarantees • Advancing soft robotics and compliant human-robot interaction • Bridging theory and practice in embodied AI Why now? As robots become more capable and work closer with humans, we need systems that are both intelligent enough to handle complex tasks 𝗔𝗡𝗗 safe enough for real-world deployment. Traditional approaches treat safety and intelligence as competing priorities, we believe they're synergistic. If you're a motivated researcher who wants to develop the theoretical foundations and practical algorithms for tomorrow's safe, intelligent robots, I'd love to hear from you. Want to join? Apply via

Stephen James

16,673 views • 11 months ago

teleoperator kicking himself over not programming Asimov's Laws of Robotics... Worth considering if we should base today's reality on the science fiction musings from the past. Testing with humanoid robots is a very interesting new challenge. Historically robots have been confined to keep out zones with rigid walls and laser barriers, lock-out/tag-out, etc. This is the easy way to ensure people don't get hurt by very capable machines. But the more we integrate humanoid robotics into collaborative roles with humans the more we need to remove those barriers by nature of the work.

teleoperator kicking himself over not programming Asimov's Laws of Robotics... Worth considering if we should base today's reality on the science fiction musings from the past. Testing with humanoid robots is a very interesting new challenge. Historically robots have been confined to keep out zones with rigid walls and laser barriers, lock-out/tag-out, etc. This is the easy way to ensure people don't get hurt by very capable machines. But the more we integrate humanoid robotics into collaborative roles with humans the more we need to remove those barriers by nature of the work.

Wes

677,535 views • 8 months ago

Memo is a robot that uses AI to perform household tasks effectively. Today Sunday announced its Series B, and we’re proud to be investors. Training robots for the home is hard — the environment is messy, dynamic, and full of edge cases. So Sunday is training robots directly on real households. Founders Tony Zhao and Cheng Chi built a glove-based system that lets hundreds of contributors record everyday tasks in their own homes, creating high-fidelity demonstrations that feed directly into robot learning. Home robotics will be defined by the companies that learn fastest from real homes. Sunday is building that loop. More here: Aaref Hilaly Amanda Huang

Memo is a robot that uses AI to perform household tasks effectively. Today Sunday announced its Series B, and we’re proud to be investors. Training robots for the home is hard — the environment is messy, dynamic, and full of edge cases. So Sunday is training robots directly on real households. Founders Tony Zhao and Cheng Chi built a glove-based system that lets hundreds of contributors record everyday tasks in their own homes, creating high-fidelity demonstrations that feed directly into robot learning. Home robotics will be defined by the companies that learn fastest from real homes. Sunday is building that loop. More here: Aaref Hilaly Amanda Huang

Bain Capital Ventures

22,012 views • 5 months ago

7. Learning new skills or mastering a new subject Mega prompt: You are an expert educator specializing in [SUBJECT AREA]. Create a personalized learning plan for mastering [SKILL] in [TIMEFRAME]. My current level: [BEGINNER/INTERMEDIATE/ADVANCED] My goal: [WHAT I WANT TO ACHIEVE] Time available: [HOURS PER WEEK] Learning style: [HANDS-ON/READING/VIDEO/MIXED] Provide: 1. Learning roadmap with clear milestones 2. Week-by-week curriculum 3. Resources (free and paid) with links 4. Practice projects that build real skills 5. Common pitfalls and how to avoid them 6. Ways to validate learning (tests, projects, certifications) 7. 5 specific exercises I can do today Make it practical. I want to DO things, not just consume content. Context: [WHY YOU'RE LEARNING THIS, YOUR BACKGROUND]

7. Learning new skills or mastering a new subject Mega prompt: You are an expert educator specializing in [SUBJECT AREA]. Create a personalized learning plan for mastering [SKILL] in [TIMEFRAME]. My current level: [BEGINNER/INTERMEDIATE/ADVANCED] My goal: [WHAT I WANT TO ACHIEVE] Time available: [HOURS PER WEEK] Learning style: [HANDS-ON/READING/VIDEO/MIXED] Provide: 1. Learning roadmap with clear milestones 2. Week-by-week curriculum 3. Resources (free and paid) with links 4. Practice projects that build real skills 5. Common pitfalls and how to avoid them 6. Ways to validate learning (tests, projects, certifications) 7. 5 specific exercises I can do today Make it practical. I want to DO things, not just consume content. Context: [WHY YOU'RE LEARNING THIS, YOUR BACKGROUND]

Louis Gleeson

143,922 views • 8 months ago

💫 Are your ready to teach in the digital age? 📘 Modern PBL: Project-Based Learning in the Digital Age' by Dan Jones is a guide that equips educators with the tools and strategies needed to thrive in a digital learning environment. #ModernPBL

💫 Are your ready to teach in the digital age? 📘 Modern PBL: Project-Based Learning in the Digital Age' by Dan Jones is a guide that equips educators with the tools and strategies needed to thrive in a digital learning environment. #ModernPBL

TeacherGoals

67,254 views • 2 years ago

Haven't been to a conference in a while, really excited to be at #NeurIPS2024! I'll be helping present 4 of our group's recent papers: 1. Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL 2. Distributional Successor Features Enable Zero-Shot Policy Optimization 3. Learning to Cooperate with Humans using Generative Agents 4. Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning Find more details on each paper and where to find us in this thread (1/6)

Haven't been to a conference in a while, really excited to be at #NeurIPS2024! I'll be helping present 4 of our group's recent papers: 1. Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL 2. Distributional Successor Features Enable Zero-Shot Policy Optimization 3. Learning to Cooperate with Humans using Generative Agents 4. Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning Find more details on each paper and where to find us in this thread (1/6)

Abhishek Gupta

10,803 views • 1 year ago

These are not CGI. Reinforcement learning is so back. When operating on strings, it gives us o3. When operating on physical motors, it gives us a perfect humanoid backflip and a robot creature that out-maneuvers almost every animal on earth. RL is one of the only learning algorithms that can master both the world of bits and the world of atoms. Give me a reward function, and I shall move the world. 2025, Year of RL.

These are not CGI. Reinforcement learning is so back. When operating on strings, it gives us o3. When operating on physical motors, it gives us a perfect humanoid backflip and a robot creature that out-maneuvers almost every animal on earth. RL is one of the only learning algorithms that can master both the world of bits and the world of atoms. Give me a reward function, and I shall move the world. 2025, Year of RL.

Jim Fan

356,840 views • 1 year ago

This is getting unreal. "A huge humanoid robotics wave is about to arrive 👀" Chinese robotics company AheadForm just unveiled one of the world's most lifelike humanoid robots at WAIC 2026 in Shanghai. This AI-powered humanoid can hold natural conversations, maintain eye contact, blink, display realistic facial expressions and synchronize its speech with lifelike head and facial movements.

This is getting unreal. "A huge humanoid robotics wave is about to arrive 👀" Chinese robotics company AheadForm just unveiled one of the world's most lifelike humanoid robots at WAIC 2026 in Shanghai. This AI-powered humanoid can hold natural conversations, maintain eye contact, blink, display realistic facial expressions and synchronize its speech with lifelike head and facial movements.

SciTech Era

464,916 views • 1 month ago