正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

1/ We just released π0.7 — a steerable generalist robot model with emergent capabilities. I want to share a bit of the backstory, because π0.7 taught me something surprising about where robot learning is heading. A thread on bittersweet lessons 🧵

Lucy Shi

3,851 subscribers

87,736 次观看 • 3 个月前 •via X (Twitter)

教育健康养生科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

I trained a humanoid robot to play famous anime openings on the piano with reinforcement learning (Attack on Titan, Evangelion, SAO, and more) how I did it + surprising discoveries in thread🧵

I trained a humanoid robot to play famous anime openings on the piano with reinforcement learning (Attack on Titan, Evangelion, SAO, and more) how I did it + surprising discoveries in thread🧵

anandmaj

24,589 次观看 • 1 年前

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️

Ted Xiao

152,458 次观看 • 1 年前

YouTube is a LARGE dataset of demonstration videos to train Generalist robot agents, but lacks action data. How can we learn DEXTEROUS skills from them? In #CoRL2024, we explore the problem of learning a Generalist Piano Playing agent from YouTube videos.

YouTube is a LARGE dataset of demonstration videos to train Generalist robot agents, but lacks action data. How can we learn DEXTEROUS skills from them? In #CoRL2024, we explore the problem of learning a Generalist Piano Playing agent from YouTube videos.

Julen Urain

42,451 次观看 • 1 年前

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.

Qiayuan Liao

80,436 次观看 • 2 年前

The wait is finally over!!! 😁 We just dropped an in-depth tutorial on how to build your own robot! Teach it new skills by showing it a few moves with just a laptop. Then watch your homemade robot act autonomously 🤯 1/🧵👇

The wait is finally over!!! 😁 We just dropped an in-depth tutorial on how to build your own robot! Teach it new skills by showing it a few moves with just a laptop. Then watch your homemade robot act autonomously 🤯 1/🧵👇

Remi Cadene

400,348 次观看 • 1 年前

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks

Yinghao Xu

46,962 次观看 • 6 个月前

Scientists have taught a humanoid robot to play tennis using just 5 hours of motion capture data. After training, the robot is capable of sustaining long rallies with a human and returning balls at speeds exceeding 15 m/s with an accuracy of about 90%.

Scientists have taught a humanoid robot to play tennis using just 5 hours of motion capture data. After training, the robot is capable of sustaining long rallies with a human and returning balls at speeds exceeding 15 m/s with an accuracy of about 90%.

Massimo

49,108 次观看 • 4 个月前

One of my favorite works in the "robot learning from human videos" space that I have seen lately. This is because it offers a really coherent and unique way to represent robot skills without a lot of the downsides we see from estimation-based approaches.

One of my favorite works in the "robot learning from human videos" space that I have seen lately. This is because it offers a really coherent and unique way to represent robot skills without a lot of the downsides we see from estimation-based approaches.

Chris Paxton

78,419 次观看 • 9 个月前

Watching Generalist AI demonstrate real-time intuition is incredible! 🤖✨ Check out this "Physical Commonsense" in action: the robot flips a washer, picks it up and then double-nudges it perfectly into a tight foam slot. This isn't a scripted motion; it’s an emergent behavior from a model trained on 270,000+ hours of real-world interaction. We are seeing the era where robots are starting to intuit and react to physics.

Watching Generalist AI demonstrate real-time intuition is incredible! 🤖✨ Check out this "Physical Commonsense" in action: the robot flips a washer, picks it up and then double-nudges it perfectly into a tight foam slot. This isn't a scripted motion; it’s an emergent behavior from a model trained on 270,000+ hours of real-world interaction. We are seeing the era where robots are starting to intuit and react to physics.

Humanoids daily

14,762 次观看 • 6 个月前

China just open sourced an embodied AI model series. and the demo is wild. They ripped the network cable out of a robot dog mid run. it kept tracking like nothing happened. No cloud. no wifi. a 0.9B model running entirely on the dog. This is MiniCPM-Robot 🧵

China just open sourced an embodied AI model series. and the demo is wild. They ripped the network cable out of a robot dog mid run. it kept tracking like nothing happened. No cloud. no wifi. a 0.9B model running entirely on the dog. This is MiniCPM-Robot 🧵

Clara Bennett

13,013 次观看 • 14 天前

Every home is different. That means that to build a useful home robot, we must be able to perform zero-shot generalization on a wide range of tasks. Humanoid company 1X has a solution: world models. 1X Director of Evaluations Daniel Ho joins us on RoboPapers to talk about: - why world models are the future for scaling robot learning - how to use world models for robot control - what world models unlock for evaluating robot model performance - how we can hill-climb from here to general purpose robots Watch Episode #61 of RoboPapers, with Michael Cho - Rbt/Acc and Chris Paxton, now!

Every home is different. That means that to build a useful home robot, we must be able to perform zero-shot generalization on a wide range of tasks. Humanoid company 1X has a solution: world models. 1X Director of Evaluations Daniel Ho joins us on RoboPapers to talk about: - why world models are the future for scaling robot learning - how to use world models for robot control - what world models unlock for evaluating robot model performance - how we can hill-climb from here to general purpose robots Watch Episode #61 of RoboPapers, with Michael Cho - Rbt/Acc and Chris Paxton, now!

RoboPapers

27,567 次观看 • 6 个月前

We release Cosmos Policy 💫: a state-of-the-art robot policy built on a video diffusion model backbone. - policy + world model + value function — in 1 model - no architectural changes to the base video model - SOTA in LIBERO (98.5%), RoboCasa (67.1%), & ALOHA tasks (93.6%) 🧵👇

We release Cosmos Policy 💫: a state-of-the-art robot policy built on a video diffusion model backbone. - policy + world model + value function — in 1 model - no architectural changes to the base video model - SOTA in LIBERO (98.5%), RoboCasa (67.1%), & ALOHA tasks (93.6%) 🧵👇

Moo Jin Kim

149,398 次观看 • 6 个月前

Why do generalist robotic models fail when a cup is moved just two inches to the left? It’s not a lack of motor skill, it’s an alignment problem. Today, we introduce VLS: Vision-Language Steering of Pretrained Robot Policies, a training-free framework that guides robot behavior in real time. Check out the project: 👇🧵 (Watch till the end: VLS runs uncut, steering pretrained policies across long-horizon tasks.)

Why do generalist robotic models fail when a cup is moved just two inches to the left? It’s not a lack of motor skill, it’s an alignment problem. Today, we introduce VLS: Vision-Language Steering of Pretrained Robot Policies, a training-free framework that guides robot behavior in real time. Check out the project: 👇🧵 (Watch till the end: VLS runs uncut, steering pretrained policies across long-horizon tasks.)

Jiafei Duan

72,465 次观看 • 6 个月前

Robot AI brains, aka Vision-Language-Action models, cannot adapt to new tasks as easily as LLMs like Gemini, ChatGPT, or Grok. LLMs can adapt quickly with their in-context learning (ICL) capabilities. But can we inject ICL abilities into a pre-trained VLA like pi0? Yes! Introducing RICL (Retraining for In-Context Learning), our Conference on Robot Learning (CoRL) 2025 paper. Our RICL-pi0 model can adapt to unseen objects, novel motions, and new scenes with just ICL and RAG (retrieval-augmented generation). RICL-pi0 also boosts performance on the long-tail of tasks. A quick 1 minute video summary:

Robot AI brains, aka Vision-Language-Action models, cannot adapt to new tasks as easily as LLMs like Gemini, ChatGPT, or Grok. LLMs can adapt quickly with their in-context learning (ICL) capabilities. But can we inject ICL abilities into a pre-trained VLA like pi0? Yes! Introducing RICL (Retraining for In-Context Learning), our Conference on Robot Learning (CoRL) 2025 paper. Our RICL-pi0 model can adapt to unseen objects, novel motions, and new scenes with just ICL and RAG (retrieval-augmented generation). RICL-pi0 also boosts performance on the long-tail of tasks. A quick 1 minute video summary:

Kaustubh Sridhar

52,158 次观看 • 11 个月前

🚀 Galbot just released AstraBrain-WBC 0.5, the world’s first humanoid robot cerebellum foundation model. Trained on 20,000 hours of human motion data, it validates a Scaling Law for robot motion control and demonstrates zero-shot execution of unseen motions on real humanoids. The era of robot control foundation models is getting closer.

🚀 Galbot just released AstraBrain-WBC 0.5, the world’s first humanoid robot cerebellum foundation model. Trained on 20,000 hours of human motion data, it validates a Scaling Law for robot motion control and demonstrates zero-shot execution of unseen motions on real humanoids. The era of robot control foundation models is getting closer.

Eren Chen

10,270 次观看 • 1 个月前

1/ 🧠Humans are the best robot data source! 2/ 👓Human egocentric video is rich in quantity, but poor in quality. 3/ Beyond scaling data, smarter representation and architecture matter just as much. 4/ Want an open-source framework to train your own learn-from-human-data robot policy? 🚀We introduce HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Robot-Data-Free ✦ Just 30 min of data per task ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Easy-to-Implement Let's squeeze every bit of signal out of human data! 🌐 Website: 📄 Paper: 💻 Code: 📹 Video: 🧵 1/n

1/ 🧠Humans are the best robot data source! 2/ 👓Human egocentric video is rich in quantity, but poor in quality. 3/ Beyond scaling data, smarter representation and architecture matter just as much. 4/ Want an open-source framework to train your own learn-from-human-data robot policy? 🚀We introduce HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Robot-Data-Free ✦ Just 30 min of data per task ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Easy-to-Implement Let's squeeze every bit of signal out of human data! 🌐 Website: 📄 Paper: 💻 Code: 📹 Video: 🧵 1/n

Zhi (Leo) Wang

110,230 次观看 • 2 个月前

Boston Dynamics has released a new video about humanoid robot hands. "Grippers are one of the most intricate parts of a humanoid robot, packed with actuation and sensing; they need to be durable enough to handle tough jobs, but precise enough to handle fragile items. Our engineers share how the Atlas gripper has evolved as our manipulation capabilities expand and the principles that will guide future iterations."

Boston Dynamics has released a new video about humanoid robot hands. "Grippers are one of the most intricate parts of a humanoid robot, packed with actuation and sensing; they need to be durable enough to handle tough jobs, but precise enough to handle fragile items. Our engineers share how the Atlas gripper has evolved as our manipulation capabilities expand and the principles that will guide future iterations."

Sawyer Merritt

230,895 次观看 • 10 个月前

Just a little taste of the Robohacks hackathon happening now at Y Combinator in San Francisco. This is only two of the teams. The first is a team building a robot for an AirBnb on Mars. The second built a system that 3D prints new tools for the robot to do new work on Mars. Both demonstrate why I love builders so much. Dreaming of a new world and learning together how to build for a new robot none of them have used before.

Just a little taste of the Robohacks hackathon happening now at Y Combinator in San Francisco. This is only two of the teams. The first is a team building a robot for an AirBnb on Mars. The second built a system that 3D prints new tools for the robot to do new work on Mars. Both demonstrate why I love builders so much. Dreaming of a new world and learning together how to build for a new robot none of them have used before.

Robert Scoble

14,399 次观看 • 3 个月前

What happens when robot world models learn from human experience at scale? 🤔 DreamDojo from NVIDIA Research is a generalist robot world model pretrained on 44K hours of egocentric human videos and then post-trained on robot data to generalize across new objects and environments. After distillation, it runs at 10 FPS for live teleoperation, policy evaluation, and model-based planning. Read the ICML paper to learn more 📄

What happens when robot world models learn from human experience at scale? 🤔 DreamDojo from NVIDIA Research is a generalist robot world model pretrained on 44K hours of egocentric human videos and then post-trained on robot data to generalize across new objects and environments. After distillation, it runs at 10 FPS for live teleoperation, policy evaluation, and model-based planning. Read the ICML paper to learn more 📄

NVIDIA Robotics

22,413 次观看 • 1 个月前