Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

SONIC has been released for a while — here are some tips for whole-body teleoperation 🤖 1. WiFi quality directly determines teleoperation performance It's highly network-dependent. Use a dedicated router, avoid shared networks. PICO and the robot/host must be on the same network. High latency = dropped packets =...

zhengyiluo's profile picture

Zhengyi “Zen” Luo

6,358 subscribers

40,808 Aufrufe • vor 7 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

8 Kommentare

Profilbild von Kyriakos
Kyriakosvor 7 Monaten

humans in the loop still underrated for robotics progress

Profilbild von Deepanshu Rohilla✈️CoRL’26
Deepanshu Rohilla✈️CoRL’26vor 7 Monaten

Does it use MoCap cameras? If yes, how does the performance vary with the quality of MoCap cameras?

Profilbild von Zhengyi “Zen” Luo
Zhengyi “Zen” Luovor 7 Monaten

No MoCap cameras, just VR whole-body tracking from PICO

Profilbild von Deepanshu Rohilla✈️CoRL’26
Deepanshu Rohilla✈️CoRL’26vor 7 Monaten

Got it. Thanks. Getting this performance without MoCap is impressive. Are you planning to build a remote teleop version of it?

Profilbild von David White (MSFT)
David White (MSFT)vor 7 Monaten

Sorry to ask a newbie question but what robot is that and what others can it work on? Or does it simply not matter?

Profilbild von Pedroset
Pedrosetvor 7 Monaten

This is so cool, SONIC is the best control policy! Have you tryed with groot yet? Any functional finetuning for the unitree g1??

Profilbild von Sam
Samvor 7 Monaten

Yes it works fabulously ,, Are you gonna release the training instruction/code soon , so to train on different robots?

Profilbild von Robot rental宇树机器人
Robot rental宇树机器人vor 7 Monaten

If you need a robot, you can contact me.

Ähnliche Videos

Excited to introduce OmniClone, a robust teleoperation system for humanoid mobile manipulation. While systems like TWIST2 and SONIC paved the way, we put efforts into solving the critical stability and scaling gaps. 1/ 📊 Moving past "vibe-based" testing. We’ve built a comprehensive diagnostic benchmark to systematically evaluate whole-body teleoperation. No more trial-and-error—get the actionable insights needed for true policy optimization. 2/ 👤 Universal Human-to-Robot Mapping. Teleop often breaks when switching operators. OmniClone mitigates biases from hardware fluctuations and, crucially, diverse human body shapes, ensuring high-stability control regardless of the person in the suit. 3/ 🚀 System Optimizations for Whole-body Manipulation Policy. By optimizing for affordability and reproducibility, OmniClone provides the high-fidelity pipeline necessary to collect data and train humanoid whole-body policies at scale. fully The model checkpoints and deploy code are now fully released—welcome to play with it! 📦 📄 Paper: 🌐 Project: 💻 Code:
3:12

Excited to introduce OmniClone, a robust teleoperation system for humanoid mobile manipulation. While systems like TWIST2 and SONIC paved the way, we put efforts into solving the critical stability and scaling gaps. 1/ 📊 Moving past "vibe-based" testing. We’ve built a comprehensive diagnostic benchmark to systematically evaluate whole-body teleoperation. No more trial-and-error—get the actionable insights needed for true policy optimization. 2/ 👤 Universal Human-to-Robot Mapping. Teleop often breaks when switching operators. OmniClone mitigates biases from hardware fluctuations and, crucially, diverse human body shapes, ensuring high-stability control regardless of the person in the suit. 3/ 🚀 System Optimizations for Whole-body Manipulation Policy. By optimizing for affordability and reproducibility, OmniClone provides the high-fidelity pipeline necessary to collect data and train humanoid whole-body policies at scale. fully The model checkpoints and deploy code are now fully released—welcome to play with it! 📦 📄 Paper: 🌐 Project: 💻 Code:

Siyuan Huang

14,191 Aufrufe • vor 7 Monaten

Live from World Robot Conference 2026 in Beijing: ROBOTERA is showcasing teleoperation of the XHAND 1 Pro dexterous hand with MANUS™ gloves. Video 1: a ROBOTERA operator demonstrates high-precision teleoperation. Video 2: a visitor tries the setup without first running a user-specific calibration, yet the teleoperation remains stable, smooth, and responsive. With 21 active degrees of freedom, fully direct-drive actuation, and integrated tactile sensing, XHAND 1 Pro is built for advanced robotic manipulation and embodied intelligence research. MANUS provides high-fidelity, low-latency hand motion data as real-time input for robot control. #WRC2026 #robotics #humanoids #teleoperation #PhysicalAI
0:19

Live from World Robot Conference 2026 in Beijing: ROBOTERA is showcasing teleoperation of the XHAND 1 Pro dexterous hand with MANUS™ gloves. Video 1: a ROBOTERA operator demonstrates high-precision teleoperation. Video 2: a visitor tries the setup without first running a user-specific calibration, yet the teleoperation remains stable, smooth, and responsive. With 21 active degrees of freedom, fully direct-drive actuation, and integrated tactile sensing, XHAND 1 Pro is built for advanced robotic manipulation and embodied intelligence research. MANUS provides high-fidelity, low-latency hand motion data as real-time input for robot control. #WRC2026 #robotics #humanoids #teleoperation #PhysicalAI

MANUS™

11,998 Aufrufe • vor 2 Monaten

The Right Kind of Clothing for #Yoga Before starting your Yogic practices, preparing the body the right way matters. Here are a few tips on clothing and accessories that support your energy and enhance focus during daily sadhana.
0:36

The Right Kind of Clothing for #Yoga Before starting your Yogic practices, preparing the body the right way matters. Here are a few tips on clothing and accessories that support your energy and enhance focus during daily sadhana.

Isha Foundation

12,369 Aufrufe • vor 1 Jahr

X Square Robot has introduced TwinDEX: a co-designed pair of three-finger, 9-DoF dexterous hands, one wearable for data collection, one matched robot end effector for deployment. The wearable and the robot hand share the same kinematics, geometry, materials, look, and sensors, so human demos map straight to the robot without retargeting. Human data collection improves throughput 5.3x compared to teleoperation, and a policy can be trained with a few hundred episodes without any robot data.
3:51

X Square Robot has introduced TwinDEX: a co-designed pair of three-finger, 9-DoF dexterous hands, one wearable for data collection, one matched robot end effector for deployment. The wearable and the robot hand share the same kinematics, geometry, materials, look, and sensors, so human demos map straight to the robot without retargeting. Human data collection improves throughput 5.3x compared to teleoperation, and a policy can be trained with a few hundred episodes without any robot data.

The Humanoid Hub

277,022 Aufrufe • vor 1 Monat

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.
0:58

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

The Humanoid Hub

46,715 Aufrufe • vor 1 Jahr

Optimal Caffeine Usage Tips: 1. Delay your first coffee by 90–120 minutes after waking to avoid crashes. 2. Use caffeine strategically: • Before workouts for performance. • After learning to boost memory. 3. Avoid overuse to prevent tolerance. A little discipline goes a long way.
0:27

Optimal Caffeine Usage Tips: 1. Delay your first coffee by 90–120 minutes after waking to avoid crashes. 2. Use caffeine strategically: • Before workouts for performance. • After learning to boost memory. 3. Avoid overuse to prevent tolerance. A little discipline goes a long way.

Tommi Pedruzzi

66,117 Aufrufe • vor 1 Jahr

🚀 Unitree open-sources UnifoLM-WBT-Dataset — a high-quality real-world humanoid robot whole-body teleoperation (WBT) dataset for open environments. 🥳Publicly available since March 5, 2026, the dataset will continue to receive high-frequency rolling updates. It aims to establish the most comprehensive real-world humanoid robot dataset in terms of scenario coverage, task complexity, and manipulation diversity. 👉 Explore the dataset here:
1:27

🚀 Unitree open-sources UnifoLM-WBT-Dataset — a high-quality real-world humanoid robot whole-body teleoperation (WBT) dataset for open environments. 🥳Publicly available since March 5, 2026, the dataset will continue to receive high-frequency rolling updates. It aims to establish the most comprehensive real-world humanoid robot dataset in terms of scenario coverage, task complexity, and manipulation diversity. 👉 Explore the dataset here:

Unitree

5,633,606 Aufrufe • vor 7 Monaten

Robotics is still data starved. Collecting high-quality robot demonstrations remains brutally slow and expensive. Introducing COBALT: A cloud-native teleoperation platform designed for large-scale robot learning. We are democratizing data collection by leveraging the hardware everyone already owns: the smartphone All you need is to download an app (today)! Read on for more!
0:39

Robotics is still data starved. Collecting high-quality robot demonstrations remains brutally slow and expensive. Introducing COBALT: A cloud-native teleoperation platform designed for large-scale robot learning. We are democratizing data collection by leveraging the hardware everyone already owns: the smartphone All you need is to download an app (today)! Read on for more!

Animesh Garg

104,884 Aufrufe • vor 4 Monaten

‘CLONE’ – whole-body teleoperation of a humanoid. Intuitive control signals are captured by tracking the teleoperator’s head and hand poses using Apple Vision Pro. A Mixture-of-Experts policy takes the sparse input and synthesizes the corresponding whole-body humanoid pose.
1:08

‘CLONE’ – whole-body teleoperation of a humanoid. Intuitive control signals are captured by tracking the teleoperator’s head and hand poses using Apple Vision Pro. A Mixture-of-Experts policy takes the sparse input and synthesizes the corresponding whole-body humanoid pose.

The Humanoid Hub

38,155 Aufrufe • vor 1 Jahr

I have been cleaning my daughter's mess for more than two years now. Last weekend our robot came to home to do the job for me. 🤖 Our new work on visual whole-body control learns a policy to coordinate the robot legs and arms for mobile manipulation. See how the legs bend on grasping objects on the ground based on visual inputs autonomously. (It is NOT teleoperation!) We again adopt a Sim2Real approach and our policy generalizes to beaches, forests, and streets in San Diego. 👇🧵
3:15

I have been cleaning my daughter's mess for more than two years now. Last weekend our robot came to home to do the job for me. 🤖 Our new work on visual whole-body control learns a policy to coordinate the robot legs and arms for mobile manipulation. See how the legs bend on grasping objects on the ground based on visual inputs autonomously. (It is NOT teleoperation!) We again adopt a Sim2Real approach and our policy generalizes to beaches, forests, and streets in San Diego. 👇🧵

Xiaolong Wang

159,462 Aufrufe • vor 2 Jahren

Reward AI just came out of stealth and unveiled OM-1, a robot policy learned entirely from humans. No teleoperation, no on-robot data. One Model, Any Body. 1. Capture. A wearable 7-DoF hand (Omnibody Hand) lets people demonstrate manipulation naturally while working, cooking, or sorting. Sensors record tactile, proximity, force and hand pose at full human speed. 2. Learn. OM-1 trains on this human data alone. No teleop, no on-robot experience. Then it runs across bodies from industrial arms to humanoids, and scaling is just adding more human data. 3. Control. A high-frequency control layer, trained with RL in sim, executes those actions on any robot, holding steady through unknown loads like a stuck fridge door. The result: OM-1 picks up a brand-new task from under 30 minutes of data.
0:27

Reward AI just came out of stealth and unveiled OM-1, a robot policy learned entirely from humans. No teleoperation, no on-robot data. One Model, Any Body. 1. Capture. A wearable 7-DoF hand (Omnibody Hand) lets people demonstrate manipulation naturally while working, cooking, or sorting. Sensors record tactile, proximity, force and hand pose at full human speed. 2. Learn. OM-1 trains on this human data alone. No teleop, no on-robot experience. Then it runs across bodies from industrial arms to humanoids, and scaling is just adding more human data. 3. Control. A high-frequency control layer, trained with RL in sim, executes those actions on any robot, holding steady through unknown loads like a stuck fridge door. The result: OM-1 picks up a brand-new task from under 30 minutes of data.

The Humanoid Hub

35,764 Aufrufe • vor 1 Monat

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:
0:35

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

32,823 Aufrufe • vor 1 Monat

The next generation of on-chain activity will be driven by autonomous AI agents on high-performance networks. Shido Network provides the infrastructure for AI agents to interact with smart contracts, move assets, and execute logic across a fast and scalable ecosystem.
0:20

The next generation of on-chain activity will be driven by autonomous AI agents on high-performance networks. Shido Network provides the infrastructure for AI agents to interact with smart contracts, move assets, and execute logic across a fast and scalable ecosystem.

Shido

151,624 Aufrufe • vor 7 Monaten

I've never seen it this hot before in the UK in June. Thinking about this from a health perspective, especially for more vulnerable groups: 1. Considering AC is not widely adopted here, it's a must to have lots of fans in the home to stay cool 2. Hydration and electrolytes are a must. And don't be short of salt intake, as it's lost when you sweat 3. You can still move your body, too many people by default become inactive at home. I got up early so I could still go outside and exercise. But even within the home, it's not good to be too sedentary 4. Avoid going out between noon and 5 pm if it can be helped during the heatwave 5. I'm also loading my body with healthy cold foods and antioxidants. England has some of the best delicious blueberries — and I'm eating loads of them! Here's my video on why blueberries are so extraordinary for health:
2:15

I've never seen it this hot before in the UK in June. Thinking about this from a health perspective, especially for more vulnerable groups: 1. Considering AC is not widely adopted here, it's a must to have lots of fans in the home to stay cool 2. Hydration and electrolytes are a must. And don't be short of salt intake, as it's lost when you sweat 3. You can still move your body, too many people by default become inactive at home. I got up early so I could still go outside and exercise. But even within the home, it's not good to be too sedentary 4. Avoid going out between noon and 5 pm if it can be helped during the heatwave 5. I'm also loading my body with healthy cold foods and antioxidants. England has some of the best delicious blueberries — and I'm eating loads of them! Here's my video on why blueberries are so extraordinary for health:

Suneel Dhand MD

15,111 Aufrufe • vor 4 Monaten

🚨ELON MUSK: "With Neuralink devices, you should be able to have full body control and sensors from an Optimus robot. You could basically inhabit an Optimus robot. It's not just the hand, but the whole thing. So you could mentally remote into an Optimus robot."
0:32

🚨ELON MUSK: "With Neuralink devices, you should be able to have full body control and sensors from an Optimus robot. You could basically inhabit an Optimus robot. It's not just the hand, but the whole thing. So you could mentally remote into an Optimus robot."

GrokTimus

28,483 Aufrufe • vor 1 Jahr

Feeling what a robot feels is becoming real! 🫰 Fluid Reality just ran its first full end-to-end touch teleoperation system, and the demo shows why high-resolution haptics might be the missing piece in robot control. A 22 mm fingertip display with 32 independently actuated “bubbles” was mapped directly to tactile sensors on a robot hand. 🫧 Three fingers streamed real-time touch data robot → human, giving the operator actual contact feedback instead of waving their hands blind, like most teleop systems today. It’s still early, but this is a real step toward dexterous ops and high-quality data for training Physical AI systems. Companies involved: Samsung Electronics, Alt-Bionics, Inc. (the robot hand), MANUS™ (hand tracking), and Sensible Robotics (fingertip sensors) Touch isn’t a nice-to-have in robotics. It’s the difference between manipulation that works in the real world P.S. Guess how many touch receptors we humans, have in our hand! :) ~~ ♻ Join the weekly robotics newsletter, and never miss any news →
1:23

Feeling what a robot feels is becoming real! 🫰 Fluid Reality just ran its first full end-to-end touch teleoperation system, and the demo shows why high-resolution haptics might be the missing piece in robot control. A 22 mm fingertip display with 32 independently actuated “bubbles” was mapped directly to tactile sensors on a robot hand. 🫧 Three fingers streamed real-time touch data robot → human, giving the operator actual contact feedback instead of waving their hands blind, like most teleop systems today. It’s still early, but this is a real step toward dexterous ops and high-quality data for training Physical AI systems. Companies involved: Samsung Electronics, Alt-Bionics, Inc. (the robot hand), MANUS™ (hand tracking), and Sensible Robotics (fingertip sensors) Touch isn’t a nice-to-have in robotics. It’s the difference between manipulation that works in the real world P.S. Guess how many touch receptors we humans, have in our hand! :) ~~ ♻ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

46,927 Aufrufe • vor 10 Monaten

Introducing Open-TeleVision: with Fully Autonomous policy video👇. We can conduct a long-horizon task with inserting 12 cans nonstop without any interruptions. We offer: 🤖 Highly precise and smooth bimanual manipulation. 📺 Active egocentric vision (with a moving neck) feedback. It is achieved by imitation learning from teleoperation: We propose a VR-based REAL-TIME teleoperation that streams the stereo video observation from the robot camera to the VR device. The robot neck moves as the human head moves, the robot hands move as the human hands move, offering the operator an intuitive experience as the human herself becomes the robot. The devils are all in the details, and how to implement things right: ✅How to perform IK/retargeting for smooth and precise control. ✅How to do all these and also stream stereo video without no latency, all in real time. We released our code here: Active head hardware design: 1/n
0:33

Introducing Open-TeleVision: with Fully Autonomous policy video👇. We can conduct a long-horizon task with inserting 12 cans nonstop without any interruptions. We offer: 🤖 Highly precise and smooth bimanual manipulation. 📺 Active egocentric vision (with a moving neck) feedback. It is achieved by imitation learning from teleoperation: We propose a VR-based REAL-TIME teleoperation that streams the stereo video observation from the robot camera to the VR device. The robot neck moves as the human head moves, the robot hands move as the human hands move, offering the operator an intuitive experience as the human herself becomes the robot. The devils are all in the details, and how to implement things right: ✅How to perform IK/retargeting for smooth and precise control. ✅How to do all these and also stream stereo video without no latency, all in real time. We released our code here: Active head hardware design: 1/n

Xiaolong Wang

25,744 Aufrufe • vor 2 Jahren

Elon Musk says people with Neuralink brain chips will eventually "be able to have full-body control and sensors from a Tesla Optimus robot, so you could basically inhabit an Optimus robot. Not just the hand, the whole thing. You could mentally remote into an Optimus robot. The future is gonna be weird, but pretty cool."
2:53

Elon Musk says people with Neuralink brain chips will eventually "be able to have full-body control and sensors from a Tesla Optimus robot, so you could basically inhabit an Optimus robot. Not just the hand, the whole thing. You could mentally remote into an Optimus robot. The future is gonna be weird, but pretty cool."

Sawyer Merritt

1,197,849 Aufrufe • vor 1 Jahr