Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

With RL, the robot can learn very precise tasks, like fastening a zip tie, and can actually do it more consistently and more quickly than even human teleoperation.

Physical Intelligence

45,643 subscribers

17,073 views • 4 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Our model can now learn from its own experience with RL! Our new π*0.6 model can more than double throughput over a base model trained without RL, and can perform real-world tasks: making espresso drinks, folding diverse laundry, and assembling boxes. More in the thread below.

Our model can now learn from its own experience with RL! Our new π*0.6 model can more than double throughput over a base model trained without RL, and can perform real-world tasks: making espresso drinks, folding diverse laundry, and assembling boxes. More in the thread below.

Physical Intelligence

706,891 views • 8 months ago

Elon: Optimus Will Learn Tasks by Watching Videos and will "Move the Needle" on U.S. GDP “Optimus is a general-purpose robot that can learn by observing human behavior. You can demonstrate a task, verbally describe it, or even show it a video, and it will be able to do that task. It’s gonna be a very capable robot. Long-term, Optimus will have a very significant impact on the US GDP, it will actually move the needle on US GDP significantly.” Source: Tesla

Elon: Optimus Will Learn Tasks by Watching Videos and will "Move the Needle" on U.S. GDP “Optimus is a general-purpose robot that can learn by observing human behavior. You can demonstrate a task, verbally describe it, or even show it a video, and it will be able to do that task. It’s gonna be a very capable robot. Long-term, Optimus will have a very significant impact on the US GDP, it will actually move the needle on US GDP significantly.” Source: Tesla

Mario Nawfal

196,520 views • 6 months ago

Are you celebrating #PiDay with pie ... or do you prefer cake? Researchers have designed a robot that can create and cook a cake with more than π ingredients. Learn more:

Are you celebrating #PiDay with pie ... or do you prefer cake? Researchers have designed a robot that can create and cook a cake with more than π ingredients. Learn more:

Science Magazine

35,028 views • 4 months ago

We developed an RL method for fine-tuning our models for precise tasks in just a few hours or even minutes. Instead of training the whole model, we add an “RL token” output to π-0.6, our latest model, which is used by a tiny actor and critic to learn quickly with RL.

We developed an RL method for fine-tuning our models for precise tasks in just a few hours or even minutes. Instead of training the whole model, we add an “RL token” output to π-0.6, our latest model, which is used by a tiny actor and critic to learn quickly with RL.

Physical Intelligence

437,740 views • 4 months ago

Happy #NationalRoboticsWeek! Last year, we gave you a sneak peek at AthenaZero, our robotic manipulator built to tackle dynamic tasks like a human arm. Learn more about how this fast, precise robot can switch in an instant from a gentle touch to high force depending on what the task requires:

Happy #NationalRoboticsWeek! Last year, we gave you a sneak peek at AthenaZero, our robotic manipulator built to tackle dynamic tasks like a human arm. Learn more about how this fast, precise robot can switch in an instant from a gentle touch to high force depending on what the task requires:

RAI Institute

23,415 views • 3 months ago

RL in the real world presents some big challenges, but also some really big opportunities. In our new work, HIL-SERL, Charles Xu, Jeffrey Wu, Jianlan Luo show that real-world RL can learn a huge range of precise and robust tasks, and perform them much faster than imitation.

RL in the real world presents some big challenges, but also some really big opportunities. In our new work, HIL-SERL, Charles Xu, Jeffrey Wu, Jianlan Luo show that real-world RL can learn a huge range of precise and robust tasks, and perform them much faster than imitation.

Sergey Levine

36,489 views • 1 year ago

If you want a robot to do something well, you need to know how to talk to it. If you don't, you can learn, with Semantic Action RL! In our paper, Jagdeep Bhatia, Andrew Wagenmaker, Will Chen show how RL over VLA prompts enables new tasks and learns blazing fast in the real world!

If you want a robot to do something well, you need to know how to talk to it. If you don't, you can learn, with Semantic Action RL! In our paper, Jagdeep Bhatia, Andrew Wagenmaker, Will Chen show how RL over VLA prompts enables new tasks and learns blazing fast in the real world!

Sergey Levine

30,319 views • 29 days ago

Researchers have designed a robot that can create and cook a cake with up to seven ingredients, more than any other printed food to date. Learn more: News from Science

Researchers have designed a robot that can create and cook a cake with up to seven ingredients, more than any other printed food to date. Learn more: News from Science

Science Magazine

6,649,185 views • 2 years ago

ELON: OPTIMUS WILL ELIMINATE POVERTY AND TRANSFORM MEDICAL CARE “You know, people often talk about eliminating poverty or giving everyone amazing medical care. There’s actually only one way to do that, and that’s with the Optimus robot. With humanoid robots, you can actually give everyone amazing medical care. Optimus will be more precise, ultimately better than the best human surgeon, with a level of precision beyond human ability. People always talked about eliminating poverty, but Optimus will actually do it. Optimus will give people incredible medical care.” Source: uncover.robotics

ELON: OPTIMUS WILL ELIMINATE POVERTY AND TRANSFORM MEDICAL CARE “You know, people often talk about eliminating poverty or giving everyone amazing medical care. There’s actually only one way to do that, and that’s with the Optimus robot. With humanoid robots, you can actually give everyone amazing medical care. Optimus will be more precise, ultimately better than the best human surgeon, with a level of precision beyond human ability. People always talked about eliminating poverty, but Optimus will actually do it. Optimus will give people incredible medical care.” Source: uncover.robotics

Mario Nawfal

348,773 views • 8 months ago

Joao: “I think Alcaraz has more arsenal than Sinner. Sinner is more like a robot that just kills the ball and does everything perfect.Carlos,he can do everything.He can do with topspin,fire the ball,has good movement,goes to the net. It’s more difficult to understand the game...”

Joao: “I think Alcaraz has more arsenal than Sinner. Sinner is more like a robot that just kills the ball and does everything perfect.Carlos,he can do everything.He can do with topspin,fire the ball,has good movement,goes to the net. It’s more difficult to understand the game...”

alcaraz archive

1,122,495 views • 4 months ago

🎁 Introducing Oscar Unlocks, our new digital rewards program for Oscar members. With Oscar Unlocks, members can gain rewards, fun badges, and more just by completing simple tasks that help them personalize and make the most of their plan. How it works: – Members complete easy, digital tasks, like creating their account or setting up autopay. – Members can earn exclusive badges and access to the best of Oscar the more they engage in the program: the more they do, the more they can unlock. Learn more:

🎁 Introducing Oscar Unlocks, our new digital rewards program for Oscar members. With Oscar Unlocks, members can gain rewards, fun badges, and more just by completing simple tasks that help them personalize and make the most of their plan. How it works: – Members complete easy, digital tasks, like creating their account or setting up autopay. – Members can earn exclusive badges and access to the best of Oscar the more they engage in the program: the more they do, the more they can unlock. Learn more:

Oscar

101,490 views • 9 months ago

Tesla Optimus can arrange batteries in their factories, ours can do skincare (on Yuzhe Qin)! We opensource Bunny-VisionPro, a teleoperation system for bimanual hand manipulation. The users can control the robot hands in real time using VisionPro, flexible like a bunny. 🐇 We also have kitchen tasks, playing Rubik's Cube, and dynamic motion tasks. Imitation learning policies are trained on sweeping with a broom, serving a drink, and wiping glasses. Check our website for more details: The project is led by Runyu Ding Runyu Ding, Yuzhe Qin Yuzhe Qin , and Jiyue Zhu

Tesla Optimus can arrange batteries in their factories, ours can do skincare (on Yuzhe Qin)! We opensource Bunny-VisionPro, a teleoperation system for bimanual hand manipulation. The users can control the robot hands in real time using VisionPro, flexible like a bunny. 🐇 We also have kitchen tasks, playing Rubik's Cube, and dynamic motion tasks. Imitation learning policies are trained on sweeping with a broom, serving a drink, and wiping glasses. Check our website for more details: The project is led by Runyu Ding Runyu Ding, Yuzhe Qin Yuzhe Qin , and Jiyue Zhu

Xiaolong Wang

90,938 views • 2 years ago

In 2023, researchers designed a robot that can create and cook a cake with up to seven ingredients, more than any other printed food to date. Learn more: #ScienceMagArchives News from Science

In 2023, researchers designed a robot that can create and cook a cake with up to seven ingredients, more than any other printed food to date. Learn more: #ScienceMagArchives News from Science

Science Magazine

88,296 views • 1 year ago

What happens when robot world models learn from human experience at scale? 🤔 DreamDojo from NVIDIA Research is a generalist robot world model pretrained on 44K hours of egocentric human videos and then post-trained on robot data to generalize across new objects and environments. After distillation, it runs at 10 FPS for live teleoperation, policy evaluation, and model-based planning. Read the ICML paper to learn more 📄

What happens when robot world models learn from human experience at scale? 🤔 DreamDojo from NVIDIA Research is a generalist robot world model pretrained on 44K hours of egocentric human videos and then post-trained on robot data to generalize across new objects and environments. After distillation, it runs at 10 FPS for live teleoperation, policy evaluation, and model-based planning. Read the ICML paper to learn more 📄

NVIDIA Robotics

22,413 views • 26 days ago

Teaching robots to perform dexterous manipulation tasks currently requires teleoperation, which limits demonstration quality, speed, and scalability. Instead, why not use human videos? The problem is that a human hand isn’t a robot hand, so data must be retargeted using simulation to resolve issues like collisions and interpenetration when controlling the hand. In VideoManip, Hongyi Chen and co-authors built a system to solve this problem, taking in RGB videos of humans performing manipulation tasks and using them to create accurate simulations with which to learn robot policies. Watch episode #73 of RoboPapers, hosted by Michael Cho - Rbt/Acc and Chris Paxton, now to learn more!

Teaching robots to perform dexterous manipulation tasks currently requires teleoperation, which limits demonstration quality, speed, and scalability. Instead, why not use human videos? The problem is that a human hand isn’t a robot hand, so data must be retargeted using simulation to resolve issues like collisions and interpenetration when controlling the hand. In VideoManip, Hongyi Chen and co-authors built a system to solve this problem, taking in RGB videos of humans performing manipulation tasks and using them to create accurate simulations with which to learn robot policies. Watch episode #73 of RoboPapers, hosted by Michael Cho - Rbt/Acc and Chris Paxton, now to learn more!

RoboPapers

27,344 views • 3 months ago

🇨🇦 ROBOT HANDS JUST LEVELED UP IN CANADA Sanctuary AI showed off a robotic hand that uses hydraulic power to grip, twist, and move like a real one. The hand can handle delicate objects, like dice, without crushing them, proving robots are getting scary precise. Hydraulic actuation gives the robot smoother, stronger control, making it better for heavy industrial work and tricky small tasks. This could change how robots work in factories, warehouses, or even in jobs too dangerous for humans. The future of robot hands? Less clunky claws, more human-like grip power with machine muscle. Source: Wevolver

🇨🇦 ROBOT HANDS JUST LEVELED UP IN CANADA Sanctuary AI showed off a robotic hand that uses hydraulic power to grip, twist, and move like a real one. The hand can handle delicate objects, like dice, without crushing them, proving robots are getting scary precise. Hydraulic actuation gives the robot smoother, stronger control, making it better for heavy industrial work and tricky small tasks. This could change how robots work in factories, warehouses, or even in jobs too dangerous for humans. The future of robot hands? Less clunky claws, more human-like grip power with machine muscle. Source: Wevolver

Mario Nawfal

50,661 views • 11 months ago

NAVIAI-I3, a more robust humanoid robot, was launched by the Zhejiang Humanoid Robotics Innovation Center. Standing 1.8 meters tall, it can run like a human and walk on various terrains. This humanoid robot appears to be primarily designed for specialized industrial tasks, such as security patrols in underground parking lots. They previously launched the lightweight bipedal NVAI-2 and a wheeled humanoid robot. The bipedal robot is used in manufacturing operations, while the wheeled humanoid robot is used for unstructured, flexible tasks such as warehouse sorting, supermarket shelving, and office cleaning. We filmed this demonstration at the World Robot Conference; you can see it in the comments section.

NAVIAI-I3, a more robust humanoid robot, was launched by the Zhejiang Humanoid Robotics Innovation Center. Standing 1.8 meters tall, it can run like a human and walk on various terrains. This humanoid robot appears to be primarily designed for specialized industrial tasks, such as security patrols in underground parking lots. They previously launched the lightweight bipedal NVAI-2 and a wheeled humanoid robot. The bipedal robot is used in manufacturing operations, while the wheeled humanoid robot is used for unstructured, flexible tasks such as warehouse sorting, supermarket shelving, and office cleaning. We filmed this demonstration at the World Robot Conference; you can see it in the comments section.

CyberRobo

15,521 views • 8 months ago

Robots don’t learn survival the way humans do 🤖 Toru shares how teleoperation and multi-sensory policy learning can fast-track robots toward foundational human skills.She then dives into a core RL question: how do we design learning environments and reward functions that lead to useful, optimizable behaviors? Watch the full session here:

Robots don’t learn survival the way humans do 🤖 Toru shares how teleoperation and multi-sensory policy learning can fast-track robots toward foundational human skills.She then dives into a core RL question: how do we design learning environments and reward functions that lead to useful, optimizable behaviors? Watch the full session here:

Cohere Labs

20,841 views • 5 months ago