Загрузка видео...

Не удалось загрузить видео

На главную

Whole-body Large Behavior Model diffusion policy from Boston Dynamics and TRI. Most advanced mobile-manipulation demo with error recovery I've seen to date.

simonkalouche's profile picture

Simon Kalouche

10,486 subscribers

41,706 просмотров • 1 год назад •via X (Twitter)

Наука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

How do you scale whole-body data? 😜Start with Ego！ Vision-only，whole body mesh！ ≈3 cm whole-body error 100K hours/month. From real-world human behavior to policy-ready Whole-Body Manipulation Data—at scale. See the Whole Body. Learn the Whole Skill. #PhysicalAI #Robotics
1:14

How do you scale whole-body data? 😜Start with Ego！ Vision-only，whole body mesh！ ≈3 cm whole-body error 100K hours/month. From real-world human behavior to policy-ready Whole-Body Manipulation Data—at scale. See the Whole Body. Learn the Whole Skill. #PhysicalAI #Robotics

Genrobot.AI

14,841 просмотров • 15 дней назад

Boston Dynamics Atlas Robot Powered by AI "Large Behavior Models" Boston Dynamics and Toyota just showed Atlas doing something wild, packing boxes using a Large Behavior Model. One AI brain controls walking, crouching, lifting, everything. Just learned from human demos.
2:24

Boston Dynamics Atlas Robot Powered by AI "Large Behavior Models" Boston Dynamics and Toyota just showed Atlas doing something wild, packing boxes using a Large Behavior Model. One AI brain controls walking, crouching, lifting, everything. Just learned from human demos.

Robots Digest 🤖

25,305 просмотров • 9 месяцев назад

The new humanoid whole-body teleop & policy learning demo from Boston Dynamics & Toyota Research Institute (TRI) is so impressive. The telelop system includes BD's MPC system as controllers, VR headset, base stations, and trackers on chest & feet. The policy learning architecture is similar to TRI's LBM. Source:
1:54

The new humanoid whole-body teleop & policy learning demo from Boston Dynamics & Toyota Research Institute (TRI) is so impressive. The telelop system includes BD's MPC system as controllers, VR headset, base stations, and trackers on chest & feet. The policy learning architecture is similar to TRI's LBM. Source:

Guanya Shi

36,726 просмотров • 1 год назад

Boston Dynamics’ Spot Masters Whole-Body Manipulation — Using AI to Drag, Roll, and Stack 15 kg Tires with Precision by RAI Institute #Robotics #Engineering #ArtificialIntelligence #Innovation #Technology
0:27

Boston Dynamics’ Spot Masters Whole-Body Manipulation — Using AI to Drag, Roll, and Stack 15 kg Tires with Precision by RAI Institute #Robotics #Engineering #ArtificialIntelligence #Innovation #Technology

Ronald van Loon

39,538 просмотров • 8 месяцев назад

Boston Dynamics has released a new video of their next-generation humanoid robot, Atlas. "We are excited to share some of our progress on developing Large Behavior Models for Atlas. This work is part of a collaboration between AI research teams at Toyota Research Institute (TRI) and Boston Dynamics. We have been building end-to-end language-conditioned policies that enable Atlas to accomplish long-horizon manipulation tasks."
2:02

Boston Dynamics has released a new video of their next-generation humanoid robot, Atlas. "We are excited to share some of our progress on developing Large Behavior Models for Atlas. This work is part of a collaboration between AI research teams at Toyota Research Institute (TRI) and Boston Dynamics. We have been building end-to-end language-conditioned policies that enable Atlas to accomplish long-horizon manipulation tasks."

Sawyer Merritt

200,744 просмотров • 1 год назад

Boston Dynamics recently showcased Atlas performing a powerful backflip with remarkable precision. The robot landed cleanly on its toes and immediately launched into a second backflip. This advanced capability is powered by a whole-body learning system developed by the RAI Institute and deployed by Boston Dynamics.
0:24

Boston Dynamics recently showcased Atlas performing a powerful backflip with remarkable precision. The robot landed cleanly on its toes and immediately launched into a second backflip. This advanced capability is powered by a whole-body learning system developed by the RAI Institute and deployed by Boston Dynamics.

Space and Technology

79,162 просмотров • 3 месяцев назад

🤖 Introducing ω-0 (OMEGA-0) — a whole-body World Action Model for humanoids. Can one model make a humanoid walk, manipulate, and coordinate its whole body simultaneously across many real-world tasks? ω-0 does exactly that. ⚡ One unified model for multi-task whole-body loco-manipulation 🧠 Predicts future visual latents while generating executable whole-body actions 🏠 Trained with ω-HOME: 40+ hours, 24 household tasks, 4,827 episodes 🔥 81.8% real-world success rate across 11 evaluation tasks No separate locomotion/manipulation policies. One model. Whole body. Multiple tasks. Humanoid intelligence should not be a collection of isolated skills. It should be a unified whole-body policy. 🔗 📜 One-take, uncut real-world demo👇
3:06

🤖 Introducing ω-0 (OMEGA-0) — a whole-body World Action Model for humanoids. Can one model make a humanoid walk, manipulate, and coordinate its whole body simultaneously across many real-world tasks? ω-0 does exactly that. ⚡ One unified model for multi-task whole-body loco-manipulation 🧠 Predicts future visual latents while generating executable whole-body actions 🏠 Trained with ω-HOME: 40+ hours, 24 household tasks, 4,827 episodes 🔥 81.8% real-world success rate across 11 evaluation tasks No separate locomotion/manipulation policies. One model. Whole body. Multiple tasks. Humanoid intelligence should not be a collection of isolated skills. It should be a unified whole-body policy. 🔗 📜 One-take, uncut real-world demo👇

Jianfei Yang

18,740 просмотров • 1 месяц назад

I just came across the most realistic text-to-audio model I've ever seen. You can even clone your voice. The audiobook industry is about to change forever. Demo: from
0:32

I just came across the most realistic text-to-audio model I've ever seen. You can even clone your voice. The audiobook industry is about to change forever. Demo: from

Lior Alexander

750,031 просмотров • 3 лет назад

Introducing Helix 02 It's our most powerful model to date - it's using the whole body to do dishes end-to-end and it's fully autonomous
3:36

Introducing Helix 02 It's our most powerful model to date - it's using the whole body to do dishes end-to-end and it's fully autonomous

Figure

1,096,396 просмотров • 7 месяцев назад

Excited to introduce OmniClone, a robust teleoperation system for humanoid mobile manipulation. While systems like TWIST2 and SONIC paved the way, we put efforts into solving the critical stability and scaling gaps. 1/ 📊 Moving past "vibe-based" testing. We’ve built a comprehensive diagnostic benchmark to systematically evaluate whole-body teleoperation. No more trial-and-error—get the actionable insights needed for true policy optimization. 2/ 👤 Universal Human-to-Robot Mapping. Teleop often breaks when switching operators. OmniClone mitigates biases from hardware fluctuations and, crucially, diverse human body shapes, ensuring high-stability control regardless of the person in the suit. 3/ 🚀 System Optimizations for Whole-body Manipulation Policy. By optimizing for affordability and reproducibility, OmniClone provides the high-fidelity pipeline necessary to collect data and train humanoid whole-body policies at scale. fully The model checkpoints and deploy code are now fully released—welcome to play with it! 📦 📄 Paper: 🌐 Project: 💻 Code:
3:12

Excited to introduce OmniClone, a robust teleoperation system for humanoid mobile manipulation. While systems like TWIST2 and SONIC paved the way, we put efforts into solving the critical stability and scaling gaps. 1/ 📊 Moving past "vibe-based" testing. We’ve built a comprehensive diagnostic benchmark to systematically evaluate whole-body teleoperation. No more trial-and-error—get the actionable insights needed for true policy optimization. 2/ 👤 Universal Human-to-Robot Mapping. Teleop often breaks when switching operators. OmniClone mitigates biases from hardware fluctuations and, crucially, diverse human body shapes, ensuring high-stability control regardless of the person in the suit. 3/ 🚀 System Optimizations for Whole-body Manipulation Policy. By optimizing for affordability and reproducibility, OmniClone provides the high-fidelity pipeline necessary to collect data and train humanoid whole-body policies at scale. fully The model checkpoints and deploy code are now fully released—welcome to play with it! 📦 📄 Paper: 🌐 Project: 💻 Code:

Siyuan Huang

14,117 просмотров • 6 месяцев назад

Real-Time Omni-Modal Interaction Driven Whole-Body Mobile Manipulation🥳 Unitree UnifoLM-OminiA-0.3 — a single model handling diverse home-care and wellness tasks, with omni-modal interactive understanding, fully autonomous, stable and disturbance-resistant execution.
2:14

Real-Time Omni-Modal Interaction Driven Whole-Body Mobile Manipulation🥳 Unitree UnifoLM-OminiA-0.3 — a single model handling diverse home-care and wellness tasks, with omni-modal interactive understanding, fully autonomous, stable and disturbance-resistant execution.

Unitree

15,489,088 просмотров • 2 месяцев назад

Boston Dynamics taught Atlas a Rabona kick. Learned from human mocap, retargeted to Atlas, trained in sim via RL, deployed zero-shot to the real robot. Soccer skills demand whole-body coordination, and similar recipe transfers to warehouse work.
0:58

Boston Dynamics taught Atlas a Rabona kick. Learned from human mocap, retargeted to Atlas, trained in sim via RL, deployed zero-shot to the real robot. Soccer skills demand whole-body coordination, and similar recipe transfers to warehouse work.

The Humanoid Hub

11,268 просмотров • 3 месяцев назад

🧐Applying world models to improve real-world policy on challenging manipulation tasks used to be considered out of reach. 😌After sustained effort, we’re now seeing encouraging progress. 🚀Thrilled to introduce RISE: Self-Improving Robot Policy with Compositional World Model RISE is, to our knowledge, the first work to use a world model as an effective learning environment for challenging real-world manipulation, enabling policy improvement on tasks that demand high dynamics, dexterity, and precision. Incredible teamwork with KL Hongyang Li Yue Xiangyu Hao Zhao Chonghao Sima
4:04

🧐Applying world models to improve real-world policy on challenging manipulation tasks used to be considered out of reach. 😌After sustained effort, we’re now seeing encouraging progress. 🚀Thrilled to introduce RISE: Self-Improving Robot Policy with Compositional World Model RISE is, to our knowledge, the first work to use a world model as an effective learning environment for challenging real-world manipulation, enabling policy improvement on tasks that demand high dynamics, dexterity, and precision. Incredible teamwork with KL Hongyang Li Yue Xiangyu Hao Zhao Chonghao Sima

Jiazhi Yang

77,124 просмотров • 7 месяцев назад

Large Language Diffusion with Masking (LLaDA) are here - and their generation looks so fucking dope! 🤯 True to Yann LeCun's vision, Ditch the auto-regressive bits and approximate the language distribution via Maximum Likelihood Estimation! So cool to watch the model denoise text from tokens in real time! - The team released their model checkpoints and there's a demo for you to play with it too! Try it out!🤗
1:15

Large Language Diffusion with Masking (LLaDA) are here - and their generation looks so fucking dope! 🤯 True to Yann LeCun's vision, Ditch the auto-regressive bits and approximate the language distribution via Maximum Likelihood Estimation! So cool to watch the model denoise text from tokens in real time! - The team released their model checkpoints and there's a demo for you to play with it too! Try it out!🤗

Vaibhav (VB) Srivastav

21,410 просмотров • 1 год назад

Boston Dynamics has shared a new video of its humanoid robot, Atlas. "Our engineers made one final push to test the limits of full-body control and mobility, with help from the RAI Institute."
1:17

Boston Dynamics has shared a new video of its humanoid robot, Atlas. "Our engineers made one final push to test the limits of full-body control and mobility, with help from the RAI Institute."

Sawyer Merritt

1,284,247 просмотров • 7 месяцев назад

The first-gen electric Atlas performs a perfect round-off backflip, thanks to a whole-body learning framework from the RAI Institute. This framework enables both high-level athleticism and a natural gait. Both Boston Dynamics and the RAI Institute are owned by Hyundai Motor Group.
1:02

The first-gen electric Atlas performs a perfect round-off backflip, thanks to a whole-body learning framework from the RAI Institute. This framework enables both high-level athleticism and a natural gait. Both Boston Dynamics and the RAI Institute are owned by Hyundai Motor Group.

The Humanoid Hub

36,668 просмотров • 7 месяцев назад