Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Can we learn whole-body mobile manipulation directly from human demonstrations? Introducing Whole-Body Mobile Manipulation Interface (HoMMI) Egocentric + UMI, 0 teleop -> bimanual & whole-body manipulation, long-horizon navigation, active perception

XiaomengXu11's profile picture

Xiaomeng Xu

1,259 subscribers

83,085 görüntüleme • 5 ay önce •via X (Twitter)

EğitimSağlık & İyilikBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Autonomous end to end whole body mobile manipulation, via Noble Machines. All one policy.
0:56

Autonomous end to end whole body mobile manipulation, via Noble Machines. All one policy.

Chris Paxton

12,023 görüntüleme • 5 ay önce

Can we collect robot data without any robots? Introducing Universal Manipulation Interface (UMI) An open-source $400 system from Stanford University designed to democratize robot data collection 0 teleop -> autonomously wash dishes (precise), toss (dynamic), and fold clothes (bimanual)
1:16

Can we collect robot data without any robots? Introducing Universal Manipulation Interface (UMI) An open-source $400 system from Stanford University designed to democratize robot data collection 0 teleop -> autonomously wash dishes (precise), toss (dynamic), and fold clothes (bimanual)

Cheng Chi

439,417 görüntüleme • 2 yıl önce

Its been doing this for like two hours. RL whole body mobile manipulation, objects bought on Monday, never seen before
1:18

Its been doing this for like two hours. RL whole body mobile manipulation, objects bought on Monday, never seen before

Chris Paxton

43,535 görüntüleme • 1 yıl önce

Whole-body Large Behavior Model diffusion policy from Boston Dynamics and TRI. Most advanced mobile-manipulation demo with error recovery I've seen to date.
0:22

Whole-body Large Behavior Model diffusion policy from Boston Dynamics and TRI. Most advanced mobile-manipulation demo with error recovery I've seen to date.

Simon Kalouche

41,706 görüntüleme • 1 yıl önce

X-Humanoid unveiled TG-VLA, which it calls the world's first whole-body VLA framework for full-size humanoid robots. The goal: move humanoids past "mobile dual-arm systems" to human-like, whole-body coordinated operation. Built on three technologies: - HEX: an open-source full-size humanoid VLA that learns across embodiments and coordinates the whole body. Claimed SOTA on real-world whole-body manipulation - HAF-VLA: hierarchical action flow that decomposes whole-body motion into subtasks. Best or joint-best on 6 benchmarks - DSRL-DCT: online RL for high-DoF humanoids in a compressed latent space. 100% success on mobile manipulation HEX is open-source.
2:48

X-Humanoid unveiled TG-VLA, which it calls the world's first whole-body VLA framework for full-size humanoid robots. The goal: move humanoids past "mobile dual-arm systems" to human-like, whole-body coordinated operation. Built on three technologies: - HEX: an open-source full-size humanoid VLA that learns across embodiments and coordinates the whole body. Claimed SOTA on real-world whole-body manipulation - HAF-VLA: hierarchical action flow that decomposes whole-body motion into subtasks. Best or joint-best on 6 benchmarks - DSRL-DCT: online RL for high-DoF humanoids in a compressed latent space. 100% success on mobile manipulation HEX is open-source.

The Humanoid Hub

19,563 görüntüleme • 2 ay önce

🤖 Introducing ω-0 (OMEGA-0) — a whole-body World Action Model for humanoids. Can one model make a humanoid walk, manipulate, and coordinate its whole body simultaneously across many real-world tasks? ω-0 does exactly that. ⚡ One unified model for multi-task whole-body loco-manipulation 🧠 Predicts future visual latents while generating executable whole-body actions 🏠 Trained with ω-HOME: 40+ hours, 24 household tasks, 4,827 episodes 🔥 81.8% real-world success rate across 11 evaluation tasks No separate locomotion/manipulation policies. One model. Whole body. Multiple tasks. Humanoid intelligence should not be a collection of isolated skills. It should be a unified whole-body policy. 🔗 📜 One-take, uncut real-world demo👇
3:06

🤖 Introducing ω-0 (OMEGA-0) — a whole-body World Action Model for humanoids. Can one model make a humanoid walk, manipulate, and coordinate its whole body simultaneously across many real-world tasks? ω-0 does exactly that. ⚡ One unified model for multi-task whole-body loco-manipulation 🧠 Predicts future visual latents while generating executable whole-body actions 🏠 Trained with ω-HOME: 40+ hours, 24 household tasks, 4,827 episodes 🔥 81.8% real-world success rate across 11 evaluation tasks No separate locomotion/manipulation policies. One model. Whole body. Multiple tasks. Humanoid intelligence should not be a collection of isolated skills. It should be a unified whole-body policy. 🔗 📜 One-take, uncut real-world demo👇

Jianfei Yang

18,390 görüntüleme • 22 gün önce

So cool...a humanoid just drove a go-kart for real. A Unitree G1 lowers itself into the tight cockpit, hands on the wheel, feet on the pedals, then runs the track， even drifts. It shows constrained whole-body loco-manipulation, mobile pick-and-place, and hand-eye-foot coordination in one sequence. This comes from China’s Symbiosis Robotics and their Direct Perception Control (DPC) model. It skips the usual high-level goals + tracker stack, mapping vision, language, body state and feedback straight to joint and hand targets. The focus is whole-body coordination for loco-manipulation. Interestingly, data diversity...Training used 15,010 hours of joint-aligned data-- 6,781h human egocentric, 4,024h armed robots, 3,660h wheeled humanoids, 545h bipedal. Teleop, head-mounted and egocentric sources were all converted into time-aligned joint trajectories across embodiments. A clean test that packs perception, balance and continuous whole-body control into one task chain ,and leaves room for other real-world scenarios.
1:17

So cool...a humanoid just drove a go-kart for real. A Unitree G1 lowers itself into the tight cockpit, hands on the wheel, feet on the pedals, then runs the track， even drifts. It shows constrained whole-body loco-manipulation, mobile pick-and-place, and hand-eye-foot coordination in one sequence. This comes from China’s Symbiosis Robotics and their Direct Perception Control (DPC) model. It skips the usual high-level goals + tracker stack, mapping vision, language, body state and feedback straight to joint and hand targets. The focus is whole-body coordination for loco-manipulation. Interestingly, data diversity...Training used 15,010 hours of joint-aligned data-- 6,781h human egocentric, 4,024h armed robots, 3,660h wheeled humanoids, 545h bipedal. Teleop, head-mounted and egocentric sources were all converted into time-aligned joint trajectories across embodiments. A clean test that packs perception, balance and continuous whole-body control into one task chain ,and leaves room for other real-world scenarios.

CyberRobo

75,626 görüntüleme • 14 gün önce

Introducing the QUANXTA Zero Series, X Square Robot’s next-generation UMI data collection solution for embodied AI. The series includes three products: QUANXTA Zero-G0: VR headset + backpack + dual grippers QUANXTA Zero-G1: headband rig + dual grippers QUANXTA Zero-E0: headband rig Built for scalable embodied AI data production: Multimodal capture. Whole-body mobile manipulation. Real-robot replay. 1 ms synchronization. 100% frame-level alignment. From human demonstrations to trainable robot data. Learn more:
2:29

Introducing the QUANXTA Zero Series, X Square Robot’s next-generation UMI data collection solution for embodied AI. The series includes three products: QUANXTA Zero-G0: VR headset + backpack + dual grippers QUANXTA Zero-G1: headband rig + dual grippers QUANXTA Zero-E0: headband rig Built for scalable embodied AI data production: Multimodal capture. Whole-body mobile manipulation. Real-robot replay. 1 ms synchronization. 100% frame-level alignment. From human demonstrations to trainable robot data. Learn more:

X Square Robot

354,518 görüntüleme • 1 ay önce

Real-Time Omni-Modal Interaction Driven Whole-Body Mobile Manipulation🥳 Unitree UnifoLM-OminiA-0.3 — a single model handling diverse home-care and wellness tasks, with omni-modal interactive understanding, fully autonomous, stable and disturbance-resistant execution.
2:14

Real-Time Omni-Modal Interaction Driven Whole-Body Mobile Manipulation🥳 Unitree UnifoLM-OminiA-0.3 — a single model handling diverse home-care and wellness tasks, with omni-modal interactive understanding, fully autonomous, stable and disturbance-resistant execution.

Unitree

15,486,468 görüntüleme • 1 ay önce

Data is the core bottleneck for robotics, here is the solution: Introducing MicroAGI00: We open sourced 1M+ frames of egocentric human long horizon mobile manipulation data. Scaling to 300M by Dec '25 and 100B frames Q4 2026 dm if you want your robot to wipe your office 🧵
0:29

Data is the core bottleneck for robotics, here is the solution: Introducing MicroAGI00: We open sourced 1M+ frames of egocentric human long horizon mobile manipulation data. Scaling to 300M by Dec '25 and 100B frames Q4 2026 dm if you want your robot to wipe your office 🧵

Bercan

39,646 görüntüleme • 10 ay önce

The table-to-dishwasher task is the classic nightmare scenario for roboticists: Long-horizon, highly dexterous, precise, whole-body manipulation combined with delicate, transparent, reflective, and deformable objects. Yet Memo handles it so naturally and elegantly.
1:18

The table-to-dishwasher task is the classic nightmare scenario for roboticists: Long-horizon, highly dexterous, precise, whole-body manipulation combined with delicate, transparent, reflective, and deformable objects. Yet Memo handles it so naturally and elegantly.

Tony Zhao

802,304 görüntüleme • 9 ay önce

We open-sourced all components of the HTD whole-body controller (WBC): -Play our WBC on your browser: -Main HTD codebase entry: (data collection and HTD policy soon!) Highlighted features: -Lightweight decoupled WBC that can be trained on a single GPU -A stable control base for humanoid loco-manipulation (in a mobile-manipulation style) -Support a wide range of body poses including extreme ones -Isaac Sim/Lab training, zero-shot deployment
1:17

We open-sourced all components of the HTD whole-body controller (WBC): -Play our WBC on your browser: -Main HTD codebase entry: (data collection and HTD policy soon!) Highlighted features: -Lightweight decoupled WBC that can be trained on a single GPU -A stable control base for humanoid loco-manipulation (in a mobile-manipulation style) -Support a wide range of body poses including extreme ones -Isaac Sim/Lab training, zero-shot deployment

Yaru Niu

21,742 görüntüleme • 7 gün önce

🤖 How can we scale up humanoid robot learning? Introducing 🌟VLK🌟: generating large-scale synthetic data with paired egocentric observations, text, and full-body G1 kinematics for learning humanoid loco-manipulation. No teleoperation needed! Website:
0:23

🤖 How can we scale up humanoid robot learning? Introducing 🌟VLK🌟: generating large-scale synthetic data with paired egocentric observations, text, and full-body G1 kinematics for learning humanoid loco-manipulation. No teleoperation needed! Website:

Jiaman Li

972,535 görüntüleme • 2 ay önce

Okay, this is genuinely impressive. 🤯 Oli just worked through a roomful of household chores — no teleop, no cuts, one continuous take. The brain is LimX COSA 0.5, a three-layer stack coordinating reasoning (Sys 2), skill execution (Sys 1), and motion control (Sys 0), along with memory, task scheduling, and whole-body coordination. What matters isn’t one polished demo trick. It’s that the robot stayed coherent across an entire long-horizon mobile manipulation sequence — on real hardware, in one take.
2:51

Okay, this is genuinely impressive. 🤯 Oli just worked through a roomful of household chores — no teleop, no cuts, one continuous take. The brain is LimX COSA 0.5, a three-layer stack coordinating reasoning (Sys 2), skill execution (Sys 1), and motion control (Sys 0), along with memory, task scheduling, and whole-body coordination. What matters isn’t one polished demo trick. It’s that the robot stayed coherent across an entire long-horizon mobile manipulation sequence — on real hardware, in one take.

RoboHub🤖

33,607 görüntüleme • 1 ay önce

Boston Dynamics’ Spot Masters Whole-Body Manipulation — Using AI to Drag, Roll, and Stack 15 kg Tires with Precision by RAI Institute #Robotics #Engineering #ArtificialIntelligence #Innovation #Technology
0:27

Boston Dynamics’ Spot Masters Whole-Body Manipulation — Using AI to Drag, Roll, and Stack 15 kg Tires with Precision by RAI Institute #Robotics #Engineering #ArtificialIntelligence #Innovation #Technology

Ronald van Loon

39,538 görüntüleme • 8 ay önce

See Spot perform dynamic whole-body manipulation. Using a combination of reinforcement learning (RL) and sampling-based control, the robot is able to autonomously drag, roll, and stack tires weighing 15 kg (33 lb), well above its maximum arm lift capacity. Learn more about coordinating locomotion and manipulation processes:
0:27

See Spot perform dynamic whole-body manipulation. Using a combination of reinforcement learning (RL) and sampling-based control, the robot is able to autonomously drag, roll, and stack tires weighing 15 kg (33 lb), well above its maximum arm lift capacity. Learn more about coordinating locomotion and manipulation processes:

RAI Institute

87,583 görüntüleme • 10 ay önce

LimX just released the TRON 2 Autonomous Mobile Manipulation Kit, and demonstrated the possibilities of modular design. One use case demo I really like shows dexterous hand picking up takeout, the wheeled-legged robot smoothly climbing a flight of stairs, and then handing it off to another TRON2 It combines the speed of wheels with the high mobility of legs,3D perception, autonomous navigation, whole-body motion control+manipulation… --- Not every building has an elevator. A wheeled-legged TRON 2 could become a truly reliable life assistant, especially for elderly people living alone.
0:44

LimX just released the TRON 2 Autonomous Mobile Manipulation Kit, and demonstrated the possibilities of modular design. One use case demo I really like shows dexterous hand picking up takeout, the wheeled-legged robot smoothly climbing a flight of stairs, and then handing it off to another TRON2 It combines the speed of wheels with the high mobility of legs,3D perception, autonomous navigation, whole-body motion control+manipulation… --- Not every building has an elevator. A wheeled-legged TRON 2 could become a truly reliable life assistant, especially for elderly people living alone.

CyberRobo

39,666 görüntüleme • 1 ay önce

How to learn dexterous manipulation for any robot hand from a single human demonstration? Check out DexMachina, our new RL algorithm that learns long-horizon, bimanual dexterous policies for a variety of dexterous hands, articulated objects, and complex motions.
0:43

How to learn dexterous manipulation for any robot hand from a single human demonstration? Check out DexMachina, our new RL algorithm that learns long-horizon, bimanual dexterous policies for a variety of dexterous hands, articulated objects, and complex motions.

Mandi Zhao

121,553 görüntüleme • 1 yıl önce

🤖 Ever wondered what robots need to truly help humans around the house? 🏡 Introducing 𝗕𝗘𝗛𝗔𝗩𝗜𝗢𝗥 𝗥𝗼𝗯𝗼𝘁 𝗦𝘂𝗶𝘁𝗲 (𝗕𝗥𝗦)—a comprehensive framework for mastering mobile whole-body manipulation across diverse household tasks! 🧹🫧 From taking out the trash to laying out clothes and cleaning toilets—𝗕𝗥𝗦 equips robots to handle practical, everyday activities. 🌐 Explore more: Let's dive in! 🤿🧵
1:09

🤖 Ever wondered what robots need to truly help humans around the house? 🏡 Introducing 𝗕𝗘𝗛𝗔𝗩𝗜𝗢𝗥 𝗥𝗼𝗯𝗼𝘁 𝗦𝘂𝗶𝘁𝗲 (𝗕𝗥𝗦)—a comprehensive framework for mastering mobile whole-body manipulation across diverse household tasks! 🧹🫧 From taking out the trash to laying out clothes and cleaning toilets—𝗕𝗥𝗦 equips robots to handle practical, everyday activities. 🌐 Explore more: Let's dive in! 🤿🧵

Yunfan Jiang

186,173 görüntüleme • 1 yıl önce

NEWS: Humanoid robotics company Figure has released Helix 02, what they claim in their most capable humanoid model yet. "A single neural system that controls the full body directly from pixels, enabling dexterous, long horizon autonomy across an entire room: • Autonomous, long‑horizon loco-manipulation: Helix 02 unloads and reloads a dishwasher across a full-sized kitchen - a four-minute, end-to-end autonomous task that integrates walking, manipulation, and balance with no resets and no human intervention. We believe this is the longest horizon, most complex task completed autonomously by a humanoid robot to date. • All sensors in. All actuators out: Helix 02 connects every onboard sensor - vision, touch, and proprioception - directly to every actuator through a single unified visuomotor neural network. • Human-like whole body control from human data: All results are enabled by System 0, a learned whole‑body controller trained on over 1,000 hours of human motion data and sim‑to‑real reinforcement learning. System 0 replaces 109,504 lines of hand‑engineered C++ with a single neural prior for stable, natural motion. • New classes of dexterity: With Figure 03’s embedded tactile sensing and palm cameras, Helix 02 performs manipulation that was previously out of reach: extracting individual pills, dispensing precise syringe volumes, and singulating small, irregular objects from clutter despite self‑occlusion. Helix 02 is trained on over 1,000 hours of human motion data and integrates vision, touch, and proprioception."
3:25

NEWS: Humanoid robotics company Figure has released Helix 02, what they claim in their most capable humanoid model yet. "A single neural system that controls the full body directly from pixels, enabling dexterous, long horizon autonomy across an entire room: • Autonomous, long‑horizon loco-manipulation: Helix 02 unloads and reloads a dishwasher across a full-sized kitchen - a four-minute, end-to-end autonomous task that integrates walking, manipulation, and balance with no resets and no human intervention. We believe this is the longest horizon, most complex task completed autonomously by a humanoid robot to date. • All sensors in. All actuators out: Helix 02 connects every onboard sensor - vision, touch, and proprioception - directly to every actuator through a single unified visuomotor neural network. • Human-like whole body control from human data: All results are enabled by System 0, a learned whole‑body controller trained on over 1,000 hours of human motion data and sim‑to‑real reinforcement learning. System 0 replaces 109,504 lines of hand‑engineered C++ with a single neural prior for stable, natural motion. • New classes of dexterity: With Figure 03’s embedded tactile sensing and palm cameras, Helix 02 performs manipulation that was previously out of reach: extracting individual pills, dispensing precise syringe volumes, and singulating small, irregular objects from clutter despite self‑occlusion. Helix 02 is trained on over 1,000 hours of human motion data and integrates vision, touch, and proprioception."

Sawyer Merritt

624,770 görüntüleme • 7 ay önce