Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Learning Time-Optimal and Speed-Adjustable Tactile In-Hand Manipulation by DLR on humanoids 2024

ChongZzZhang's profile picture

C. Zhang

7,024 subscribers

21,319 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

3 Kommentare

Profilbild von Michael Cho - Rbt/Acc
Michael Cho - Rbt/Accvor 1 Jahr

Really impressive stuff!

Profilbild von RICE AI ( ◉ - ◉ )
RICE AI ( ◉ - ◉ )vor 1 Jahr

Amazing control

Profilbild von darthur
darthurvor 1 Jahr

Oh, come on! Orient the letter properly.

Ähnliche Videos

Tactile feedback is one of the most important modalities in manipulation, but has been underutilized in dexterous hands. T-Dex is a framework for learning dexterous policies from tactile play data, beating vision and torque-based methods by 1.7x. 🧵👇
0:55

Tactile feedback is one of the most important modalities in manipulation, but has been underutilized in dexterous hands. T-Dex is a framework for learning dexterous policies from tactile play data, beating vision and torque-based methods by 1.7x. 🧵👇

Lerrel Pinto

84,611 Aufrufe • vor 3 Jahren

A good hand can push intelligence development. Introducing Eyesight Hand, equipped with full-hand high-res tactile sensors and proprioceptive actuators. It is compliant, agile, and powerful. Good tactile sensing makes learning more efficient and robust. Shout out to Branden!
1:04

A good hand can push intelligence development. Introducing Eyesight Hand, equipped with full-hand high-res tactile sensors and proprioceptive actuators. It is compliant, agile, and powerful. Good tactile sensing makes learning more efficient and robust. Shout out to Branden!

Hao-Shu Fang

23,520 Aufrufe • vor 1 Jahr

One engineering challenge in dexterous Robot hands is balancing strength and speed. Here a SharpaWave performing rapid hand cycles at over 4x/sec. The Dynamic Tactile Array uses visuo-tactile sensing: fingertip integrates camera & 1,000+ tactile pixels.
0:46

One engineering challenge in dexterous Robot hands is balancing strength and speed. Here a SharpaWave performing rapid hand cycles at over 4x/sec. The Dynamic Tactile Array uses visuo-tactile sensing: fingertip integrates camera & 1,000+ tactile pixels.

Rohan Paul

27,256 Aufrufe • vor 2 Monaten

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.
1:09

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.

東京ロボティクス株式会社

10,909 Aufrufe • vor 1 Jahr

I was really impressed by the UMI gripper (Cheng Chi et al.), but a key limitation is that **force-related data wasn’t captured**: humans feel haptic feedback through the mechanical springs, but the robot couldn’t leverage that info, limiting the data’s value for fine-grained manipulation tasks. Led by my amazing students Yolanda Zhu and Binghao Huang, we designed a **portable visuo-tactile gripper** by integrating our dense, flexible tactile arrays with the UMI gripper to enable large-scale in-the-wild data collection. 🔗 We demonstrate **cross-modal representation learning** and **downstream policy learning** on tasks requiring in-hand state estimation (e.g., test tube reorientation) and fine-grained force sensing (e.g., pipette fluid transfer). Key takeaways: - Our flexible tactile arrays store the rich haptic information humans perceive as dense tactile signals. - Portability and robustness are key for in-the-wild data collection; our portable gripper is compact, lightweight, and durable. - Touch provides precise, robust measurements of in-hand object pose, invariant to lighting and viewpoint. - Cross-modal pretraining on large-scale in-the-wild data significantly improves policy robustness and sample efficiency (as shown many times before — and verified again here!). Also check out our previous investigations of dense, flexible tactile grids for understanding human-robot-environment interactions: - Dense tactile glove (Nature ’19): - 3D-ViTac (CoRL ’24):
5:35

I was really impressed by the UMI gripper (Cheng Chi et al.), but a key limitation is that **force-related data wasn’t captured**: humans feel haptic feedback through the mechanical springs, but the robot couldn’t leverage that info, limiting the data’s value for fine-grained manipulation tasks. Led by my amazing students Yolanda Zhu and Binghao Huang, we designed a **portable visuo-tactile gripper** by integrating our dense, flexible tactile arrays with the UMI gripper to enable large-scale in-the-wild data collection. 🔗 We demonstrate **cross-modal representation learning** and **downstream policy learning** on tasks requiring in-hand state estimation (e.g., test tube reorientation) and fine-grained force sensing (e.g., pipette fluid transfer). Key takeaways: - Our flexible tactile arrays store the rich haptic information humans perceive as dense tactile signals. - Portability and robustness are key for in-the-wild data collection; our portable gripper is compact, lightweight, and durable. - Touch provides precise, robust measurements of in-hand object pose, invariant to lighting and viewpoint. - Cross-modal pretraining on large-scale in-the-wild data significantly improves policy robustness and sample efficiency (as shown many times before — and verified again here!). Also check out our previous investigations of dense, flexible tactile grids for understanding human-robot-environment interactions: - Dense tactile glove (Nature ’19): - 3D-ViTac (CoRL ’24):

Yunzhu Li

13,188 Aufrufe • vor 1 Jahr

This dexterous robotic hand can see, feel, and solve a Rubik’s cube BrainCo's Revo 3 dexterous robotic hand, a Chinese-developed system with integrated vision, full-palm tactile sensors, and high-precision actuators for complex manipulation tasks
0:37

This dexterous robotic hand can see, feel, and solve a Rubik’s cube BrainCo's Revo 3 dexterous robotic hand, a Chinese-developed system with integrated vision, full-palm tactile sensors, and high-precision actuators for complex manipulation tasks

Science girl

19,923 Aufrufe • vor 4 Monaten

TIME FOR $AAPL TO GO ALL-IN ON HUMANOIDS
3:58

TIME FOR $AAPL TO GO ALL-IN ON HUMANOIDS

Shay Boloor

41,837 Aufrufe • vor 1 Jahr

Very impressed by the new Tesla Optimus end2end skill learning video! Our TRILL work ( spills some secret sauce: 1. VR teleoperation, 2. deep imitation learning, 3. real-time whole-body control. It's all open-source! Dive in if you're into humanoids! 👾
0:46

Very impressed by the new Tesla Optimus end2end skill learning video! Our TRILL work ( spills some secret sauce: 1. VR teleoperation, 2. deep imitation learning, 3. real-time whole-body control. It's all open-source! Dive in if you're into humanoids! 👾

Yuke Zhu

50,680 Aufrufe • vor 2 Jahren

🖐️ Who’s got the most dexterous hand in robotics? We’re putting Sharpa, Unitree Hand, and Delto Gripper side by side — from grasp finesse to tactile tricks. Watch and tell us — which one's your pick?
0:43

🖐️ Who’s got the most dexterous hand in robotics? We’re putting Sharpa, Unitree Hand, and Delto Gripper side by side — from grasp finesse to tactile tricks. Watch and tell us — which one's your pick?

Reborn

13,735 Aufrufe • vor 1 Jahr

Three demos showing SharpaWave’s fine manipulation under high-fidelity teleoperation. Task No.1: putting on a trash bag. With teleoperation and tactile feedback, it finds the rim, opens it, and wraps it neatly — even on a slippery, deformable object. #Sharpa #SharpaWave #Teleoperation #Tactile #DexterousHand
1:11

Three demos showing SharpaWave’s fine manipulation under high-fidelity teleoperation. Task No.1: putting on a trash bag. With teleoperation and tactile feedback, it finds the rim, opens it, and wraps it neatly — even on a slippery, deformable object. #Sharpa #SharpaWave #Teleoperation #Tactile #DexterousHand

Sharpa

80,348 Aufrufe • vor 9 Monaten

12 deep learning architectures to study in 2025, by hand✍️
0:58

12 deep learning architectures to study in 2025, by hand✍️

Tom Yeh

107,095 Aufrufe • vor 1 Jahr

Boston Dynamics engineers talk about Atlas’ 3-finger hand. 7-DOF, features a palm camera and tactile-sensing fingertips. They chose not to add more fingers for the initial phases of hand design for higher reliability and speed of development.
3:59

Boston Dynamics engineers talk about Atlas’ 3-finger hand. 7-DOF, features a palm camera and tactile-sensing fingertips. They chose not to add more fingers for the initial phases of hand design for higher reliability and speed of development.

The Humanoid Hub

49,806 Aufrufe • vor 11 Monaten

‘LEARNING TO MEASURE TIME IN LOVE AND LOSS’ by Chris Huntington
9:33

‘LEARNING TO MEASURE TIME IN LOVE AND LOSS’ by Chris Huntington

Christopher Tester

11,707 Aufrufe • vor 1 Jahr

1/🧠Humans are the best robot data source — but video alone misses one thing: force. 2/🙁Tactile gloves capture force — but they're costly and block the real touch manipulation depends on. 3/💪Maybe the future of touch lives on your wrist: surface EMG reads the muscles that cause force — tactile sensing without ever touching a tactile sensor. 4/🔥Want a fully open-source framework — hardware + software — to train your own force-aware learn-from-human-data robot policy? 🚀We introduce ForceBand: Learning Forceful Manipulation with sEMG -- bring force into human videos with sEMG, for force-aware manipulation ⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Force Beyond Vision ✦ Free-Hand Force Sensing ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Low-Cost & Easy-to-Implement Let's squeeze every bit of signal out of human data, and let robots feel the force! 🌐 Website: 📄 Paper: 💻 Code: 🎥 Video: 🧵 1/n
1:48

1/🧠Humans are the best robot data source — but video alone misses one thing: force. 2/🙁Tactile gloves capture force — but they're costly and block the real touch manipulation depends on. 3/💪Maybe the future of touch lives on your wrist: surface EMG reads the muscles that cause force — tactile sensing without ever touching a tactile sensor. 4/🔥Want a fully open-source framework — hardware + software — to train your own force-aware learn-from-human-data robot policy? 🚀We introduce ForceBand: Learning Forceful Manipulation with sEMG -- bring force into human videos with sEMG, for force-aware manipulation ⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Force Beyond Vision ✦ Free-Hand Force Sensing ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Low-Cost & Easy-to-Implement Let's squeeze every bit of signal out of human data, and let robots feel the force! 🌐 Website: 📄 Paper: 💻 Code: 🎥 Video: 🧵 1/n

Zhi (Leo) Wang

52,051 Aufrufe • vor 2 Monaten

Touch alone isn’t enough. 🖐️ For robotics, tactile intelligence truly levels up when touch gains spatial meaning. At #ICRA2026, we dove into the core concept behind SaTA: Spatially-anchored Tactile Awareness for robust, dexterous manipulation. Read it here: The challenge is fundamental: a robot shouldn’t just register a touch, it needs to understand exactly where that contact occurs relative to its fingers, joints, and overall hand structure. This is the missing link that turns raw data into precise, real-time adjustments during manipulation. Why does this matter? Because the most complex part of any manipulation task happens when vision is at its least reliable, that final millimeter before insertion, sliding, gripping, or fine-tuning. At Sharpa, this is exactly why we’re building tactile hands and tactile AI in tandem. 🚀 #Sharpa #Robotics #EmbodiedAI #TactileIntelligence #ICRA2026 #DexterousManipulation 📷
0:54

Touch alone isn’t enough. 🖐️ For robotics, tactile intelligence truly levels up when touch gains spatial meaning. At #ICRA2026, we dove into the core concept behind SaTA: Spatially-anchored Tactile Awareness for robust, dexterous manipulation. Read it here: The challenge is fundamental: a robot shouldn’t just register a touch, it needs to understand exactly where that contact occurs relative to its fingers, joints, and overall hand structure. This is the missing link that turns raw data into precise, real-time adjustments during manipulation. Why does this matter? Because the most complex part of any manipulation task happens when vision is at its least reliable, that final millimeter before insertion, sliding, gripping, or fine-tuning. At Sharpa, this is exactly why we’re building tactile hands and tactile AI in tandem. 🚀 #Sharpa #Robotics #EmbodiedAI #TactileIntelligence #ICRA2026 #DexterousManipulation 📷

Sharpa

15,168 Aufrufe • vor 3 Monaten