Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

More beautiful robot hands. This one from Sharpa The hand uses what they call a Dynamic Tactile Array, meaning vision and touch work together and their SaTA (Spatially-anchored Tactile Awareness) algorithm. Each fingertip includes a mini camera and 1,000+ tactile pixels, hitting 0.005N pressure sensitivity. With 22 DOF and... show more

Rohan Paul

149,256 subscribers

41,775 views • 8 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

One engineering challenge in dexterous Robot hands is balancing strength and speed. Here a SharpaWave performing rapid hand cycles at over 4x/sec. The Dynamic Tactile Array uses visuo-tactile sensing: fingertip integrates camera & 1,000+ tactile pixels.

One engineering challenge in dexterous Robot hands is balancing strength and speed. Here a SharpaWave performing rapid hand cycles at over 4x/sec. The Dynamic Tactile Array uses visuo-tactile sensing: fingertip integrates camera & 1,000+ tactile pixels.

Rohan Paul

27,256 views • 2 months ago

Singapore's Sharpa unveiled SharpaWave, a lifelike robotic hand —Features 22 DOF to balance for dexterity and strength —Each fingertip has 1,000+ tactile sensing pixels and 5 mN pressure sensitivity —AI models adapt the hand's grip and modulate force

Singapore's Sharpa unveiled SharpaWave, a lifelike robotic hand —Features 22 DOF to balance for dexterity and strength —Each fingertip has 1,000+ tactile sensing pixels and 5 mN pressure sensitivity —AI models adapt the hand's grip and modulate force

Brett Adcock

12,418 views • 1 year ago

Most humanlike robotic hand ever built❓ Developed by Sharpa in Singapore, it’s a 1:1 life-size, 22-DoF robotic hand designed for both precision and strength! Capable of manipulating fragile objects like an egg or applying 30 N of fingertip force without damage. ✅ Over 1,000 tactile pixels per fingertip with 0.005 N sensitivity ✅ Dynamic Tactile Array operating at 180 FPS for real-time feedback ✅ Certified for 1 million grip cycles without failure ✅ Ethernet interface, ROS and MuJoCo compatible This isn’t a lab prototype. Sharpa began mass production and customer shipments in October 2025. Full details: —- Weekly robotics and AI insights. Subscribe free:

Most humanlike robotic hand ever built❓ Developed by Sharpa in Singapore, it’s a 1:1 life-size, 22-DoF robotic hand designed for both precision and strength! Capable of manipulating fragile objects like an egg or applying 30 N of fingertip force without damage. ✅ Over 1,000 tactile pixels per fingertip with 0.005 N sensitivity ✅ Dynamic Tactile Array operating at 180 FPS for real-time feedback ✅ Certified for 1 million grip cycles without failure ✅ Ethernet interface, ROS and MuJoCo compatible This isn’t a lab prototype. Sharpa began mass production and customer shipments in October 2025. Full details: —- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu - eu/acc

23,360 views • 10 months ago

Touch alone isn’t enough. 🖐️ For robotics, tactile intelligence truly levels up when touch gains spatial meaning. At #ICRA2026, we dove into the core concept behind SaTA: Spatially-anchored Tactile Awareness for robust, dexterous manipulation. Read it here: The challenge is fundamental: a robot shouldn’t just register a touch, it needs to understand exactly where that contact occurs relative to its fingers, joints, and overall hand structure. This is the missing link that turns raw data into precise, real-time adjustments during manipulation. Why does this matter? Because the most complex part of any manipulation task happens when vision is at its least reliable, that final millimeter before insertion, sliding, gripping, or fine-tuning. At Sharpa, this is exactly why we’re building tactile hands and tactile AI in tandem. 🚀 #Sharpa #Robotics #EmbodiedAI #TactileIntelligence #ICRA2026 #DexterousManipulation 📷

Touch alone isn’t enough. 🖐️ For robotics, tactile intelligence truly levels up when touch gains spatial meaning. At #ICRA2026, we dove into the core concept behind SaTA: Spatially-anchored Tactile Awareness for robust, dexterous manipulation. Read it here: The challenge is fundamental: a robot shouldn’t just register a touch, it needs to understand exactly where that contact occurs relative to its fingers, joints, and overall hand structure. This is the missing link that turns raw data into precise, real-time adjustments during manipulation. Why does this matter? Because the most complex part of any manipulation task happens when vision is at its least reliable, that final millimeter before insertion, sliding, gripping, or fine-tuning. At Sharpa, this is exactly why we’re building tactile hands and tactile AI in tandem. 🚀 #Sharpa #Robotics #EmbodiedAI #TactileIntelligence #ICRA2026 #DexterousManipulation 📷

Sharpa

15,168 views • 3 months ago

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.

AI at Meta

453,343 views • 1 year ago

Sharpa Robotics officially launched its dexterous hand, the SharpaWave, on October 16, moving it into mass production. The hand, which impressed many at ICRA 2025, is built around what the company calls a "Dynamic Tactile Array" (DTA) for high-fidelity sensing. Key specs from the official brochure are noteworthy: • Human-like design: 22 degrees of freedom in a 1:1 human-sized form factor. • Advanced sensing: The DTA features >1000 tactile pixels per fingertip, 20 N of fingertip strength with a movement speed of >4 Hz across all gestures. With out-of-the-box support for ROS and MuJoCo simulation, Sharpa is making a clear play for the robotics R&D community.

Sharpa Robotics officially launched its dexterous hand, the SharpaWave, on October 16, moving it into mass production. The hand, which impressed many at ICRA 2025, is built around what the company calls a "Dynamic Tactile Array" (DTA) for high-fidelity sensing. Key specs from the official brochure are noteworthy: • Human-like design: 22 degrees of freedom in a 1:1 human-sized form factor. • Advanced sensing: The DTA features >1000 tactile pixels per fingertip, 20 N of fingertip strength with a movement speed of >4 Hz across all gestures. With out-of-the-box support for ROS and MuJoCo simulation, Sharpa is making a clear play for the robotics R&D community.

Humanoids daily

66,083 views • 10 months ago

BCI company BrainCo just released a new dexterous hand: Revo3. But this time, it’s not for humans, it’s built for humanoid robots. ＞21 DOF ＞Full-palm + fingertip tactile sensing ＞Direct drive + backdrivable design ＞33 grasp types ＞20N fingertip pinch force ＞Open-source ecosystem, one-click deployment It looks bigger and heavier than the previous versions, but clearly designed for real robot work:picking up objects, using tools, and performing tasks... btw, what do you think are the real differences between the hands of humanoid robots and the bionic hands used by humans?

BCI company BrainCo just released a new dexterous hand: Revo3. But this time, it’s not for humans, it’s built for humanoid robots. ＞21 DOF ＞Full-palm + fingertip tactile sensing ＞Direct drive + backdrivable design ＞33 grasp types ＞20N fingertip pinch force ＞Open-source ecosystem, one-click deployment It looks bigger and heavier than the previous versions, but clearly designed for real robot work:picking up objects, using tools, and performing tasks... btw, what do you think are the real differences between the hands of humanoid robots and the bionic hands used by humans?

CyberRobo

71,948 views • 5 months ago

1/🧠Humans are the best robot data source — but video alone misses one thing: force. 2/🙁Tactile gloves capture force — but they're costly and block the real touch manipulation depends on. 3/💪Maybe the future of touch lives on your wrist: surface EMG reads the muscles that cause force — tactile sensing without ever touching a tactile sensor. 4/🔥Want a fully open-source framework — hardware + software — to train your own force-aware learn-from-human-data robot policy? 🚀We introduce ForceBand: Learning Forceful Manipulation with sEMG -- bring force into human videos with sEMG, for force-aware manipulation ⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Force Beyond Vision ✦ Free-Hand Force Sensing ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Low-Cost & Easy-to-Implement Let's squeeze every bit of signal out of human data, and let robots feel the force! 🌐 Website: 📄 Paper: 💻 Code: 🎥 Video: 🧵 1/n

1/🧠Humans are the best robot data source — but video alone misses one thing: force. 2/🙁Tactile gloves capture force — but they're costly and block the real touch manipulation depends on. 3/💪Maybe the future of touch lives on your wrist: surface EMG reads the muscles that cause force — tactile sensing without ever touching a tactile sensor. 4/🔥Want a fully open-source framework — hardware + software — to train your own force-aware learn-from-human-data robot policy? 🚀We introduce ForceBand: Learning Forceful Manipulation with sEMG -- bring force into human videos with sEMG, for force-aware manipulation ⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Force Beyond Vision ✦ Free-Hand Force Sensing ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Low-Cost & Easy-to-Implement Let's squeeze every bit of signal out of human data, and let robots feel the force! 🌐 Website: 📄 Paper: 💻 Code: 🎥 Video: 🧵 1/n

Zhi (Leo) Wang

52,051 views • 2 months ago

ROBOTIS just upgraded its wheeled humanoid with the HX5-D20 dexterous hand 👋 •»20 DOF fully active,5 fingers × 4 DOF each. Human-like motion, from piano keys to scissors. • »Direct drive, wire-free ,Powered by ultra-small Dynamixel actuators. Zero backlash. High durability. Clean control. • »Fingertip tactile sensing ,Real-time pressure feedback for force-controlled grasping, blind operation, and fragile object handling. Already deployed at Google, Apple, and MIT labs.

ROBOTIS just upgraded its wheeled humanoid with the HX5-D20 dexterous hand 👋 •»20 DOF fully active,5 fingers × 4 DOF each. Human-like motion, from piano keys to scissors. • »Direct drive, wire-free ,Powered by ultra-small Dynamixel actuators. Zero backlash. High durability. Clean control. • »Fingertip tactile sensing ,Real-time pressure feedback for force-controlled grasping, blind operation, and fragile object handling. Already deployed at Google, Apple, and MIT labs.

CyberRobo

42,010 views • 6 months ago

Robots need to feel the world to operate in it. Most manipulation policies today are tactile-blind. They either cannot interpret high-frequency tactile signals or treat them as a static channel. And the field lacks enough touch-rich datasets to train tactile-reactive policies at scale. T-Rex was built to answer both. Dantong Niu and team, advised by Jim Fan, Fei-Fei Li, Jitendra MALIK, Pieter Abbeel trevordarrell have tested whether a robot policy can react to high-frequency tactile signals the way human hands do, without giving up the generalization power of modern VLAs. The result: 65% average success rate across 12 real-world tasks. +30 absolute points over the strongest baseline. In one year, tactile VLAs have gone from promising to outperforming non-tactile baselines like pi0.5 on dexterous tasks. #Robotics #SharpaWave #Sharpa #EmbodiedAI #DexterousManipulation #TactileSensing #RobotLearning Project link:

Robots need to feel the world to operate in it. Most manipulation policies today are tactile-blind. They either cannot interpret high-frequency tactile signals or treat them as a static channel. And the field lacks enough touch-rich datasets to train tactile-reactive policies at scale. T-Rex was built to answer both. Dantong Niu and team, advised by Jim Fan, Fei-Fei Li, Jitendra MALIK, Pieter Abbeel trevordarrell have tested whether a robot policy can react to high-frequency tactile signals the way human hands do, without giving up the generalization power of modern VLAs. The result: 65% average success rate across 12 real-world tasks. +30 absolute points over the strongest baseline. In one year, tactile VLAs have gone from promising to outperforming non-tactile baselines like pi0.5 on dexterous tasks. #Robotics #SharpaWave #Sharpa #EmbodiedAI #DexterousManipulation #TactileSensing #RobotLearning Project link:

Sharpa

12,931 views • 2 months ago

Who can say no to a humanoid robot that can actually feel a hug? 🤖 JQ Industries just built a fabric-based electronic skin for Unitree G1 — covering the torso, hands, and feet. This is not about appearance. It’s about giving robots real tactile sensing and pressure feedback. According to the company, the system includes tactile gloves, upper-body skin, and foot sensors. That means the robot can feel contact through its hands, detect pressure across its body, and use foot feedback to adjust balance. This is the missing layer in most humanoids. Vision alone can’t handle physical interaction. Robots need touch to grip safely, react to humans, and stay stable in real-world environments. JQ says its fiber sensors can detect forces as low as 0.01N, handle up to 3500kPa, and bend below 0.1mm radius. The system can also integrate with Isaac Sim, making tactile data usable for training and deployment. Unitree G1 is already built for manipulation and control — this adds the sensing layer it lacked. JQ says it’s now working with multiple humanoid companies, with some systems already shipping at scale. This is what happens when robots stop just seeing the world — and start physically feeling it.

Who can say no to a humanoid robot that can actually feel a hug? 🤖 JQ Industries just built a fabric-based electronic skin for Unitree G1 — covering the torso, hands, and feet. This is not about appearance. It’s about giving robots real tactile sensing and pressure feedback. According to the company, the system includes tactile gloves, upper-body skin, and foot sensors. That means the robot can feel contact through its hands, detect pressure across its body, and use foot feedback to adjust balance. This is the missing layer in most humanoids. Vision alone can’t handle physical interaction. Robots need touch to grip safely, react to humans, and stay stable in real-world environments. JQ says its fiber sensors can detect forces as low as 0.01N, handle up to 3500kPa, and bend below 0.1mm radius. The system can also integrate with Isaac Sim, making tactile data usable for training and deployment. Unitree G1 is already built for manipulation and control — this adds the sensing layer it lacked. JQ says it’s now working with multiple humanoid companies, with some systems already shipping at scale. This is what happens when robots stop just seeing the world — and start physically feeling it.

RoboHub🤖

10,952 views • 5 months ago

Now all you need to make tactile sensors is a 3D printer, magnets, and magnetometers! [📍It’s open source!] A new tactile sensor, called e-Flesh, with a simple working principle… measure deformations in 3D printable microstructures. Since e-Flesh is 3D printable, you can make it in all shapes and sizes for applications ranging from foot fall sensing to multifingered hands. This is critical in getting touch not just on fingertips, but all around robots. eFlesh can democratize touch sensing with open-sourced❗️ Make your own: Paper:

Now all you need to make tactile sensors is a 3D printer, magnets, and magnetometers! [📍It’s open source!] A new tactile sensor, called e-Flesh, with a simple working principle… measure deformations in 3D printable microstructures. Since e-Flesh is 3D printable, you can make it in all shapes and sizes for applications ranging from foot fall sensing to multifingered hands. This is critical in getting touch not just on fingertips, but all around robots. eFlesh can democratize touch sensing with open-sourced❗️ Make your own: Paper:

Ilir Aliu

154,953 views • 7 months ago

No one could turn down a humanoid robot with human-like tactile sensitivity. JQ Industries equipped the Unitree G1 humanoid robot with a fabric-based electronic skin (piezoresistive flexible tactile sensors). A light touch can convert pressure, deformation, and slip into electrical signals, which are then processed by AI for real-time closed-loop control.(Integrates NVIDIA Isaac Sim) With this skin,humanoid robots start to behave more naturally: Touch sensing is no longer limited to dexterous hands,the entire body can feel, allowing the robot to stop or adjust posture instantly during collisions. It can also detect hugs, taps on the shoulder, or gentle touches, and respond in a softer, more human-like way. This matters especially in elder care and medical rehabilitation. A humanoid robot could gently help someone stand up, or control force precisely during assisted massage without harming the skin. Rigid mechanical systems deliver superhuman physical strength, while flexible sensing systems enable nuanced emotions. Electronic skin bridges high intelligence and high emotional intelligence.

No one could turn down a humanoid robot with human-like tactile sensitivity. JQ Industries equipped the Unitree G1 humanoid robot with a fabric-based electronic skin (piezoresistive flexible tactile sensors). A light touch can convert pressure, deformation, and slip into electrical signals, which are then processed by AI for real-time closed-loop control.(Integrates NVIDIA Isaac Sim) With this skin,humanoid robots start to behave more naturally: Touch sensing is no longer limited to dexterous hands,the entire body can feel, allowing the robot to stop or adjust posture instantly during collisions. It can also detect hugs, taps on the shoulder, or gentle touches, and respond in a softer, more human-like way. This matters especially in elder care and medical rehabilitation. A humanoid robot could gently help someone stand up, or control force precisely during assisted massage without harming the skin. Rigid mechanical systems deliver superhuman physical strength, while flexible sensing systems enable nuanced emotions. Electronic skin bridges high intelligence and high emotional intelligence.

CyberRobo

22,118 views • 5 months ago

Here’s the windmill assembly demo we showed at CES 2026 — the one no one saw coming. North executes a fully autonomous, long-horizon dexterous sequence with sustained hand–eye–tactile coordination and assembly-level precision enabled by tactile feedback. It’s also robust to disturbance: you can reposition the objects, and North will still identify them and recover the task. This is powered by CraftNet (VTLA) — using tactile feedback to continuously fine-tune the last-millimeter interaction, enabling reliable execution across 30+ steps. Read more about CraftNet: #Sharpa #SharpaWave #SharpaNorth #CraftNet #System0 #CES2026

Here’s the windmill assembly demo we showed at CES 2026 — the one no one saw coming. North executes a fully autonomous, long-horizon dexterous sequence with sustained hand–eye–tactile coordination and assembly-level precision enabled by tactile feedback. It’s also robust to disturbance: you can reposition the objects, and North will still identify them and recover the task. This is powered by CraftNet (VTLA) — using tactile feedback to continuously fine-tune the last-millimeter interaction, enabling reliable execution across 30+ steps. Read more about CraftNet: #Sharpa #SharpaWave #SharpaNorth #CraftNet #System0 #CES2026

Sharpa

88,136 views • 8 months ago

A dexterous hand capable of operating an iPhone Impressive, with nimble fingertip control. INSPIRE ROBOTS from Beijing has released a new dexterous hand featuring tactile and force sensing, and equipped with a motion library, making it ready to use right out of the box. Especially noteworthy is the modular finger design, allowing users to easily replace a damaged finger. With 13 degrees of freedom and a single-hand load capacity of 30kg, it can be used in general applications such as factory component handling, precision assembly, and warehouse logistics sorting. Notably, this company has already sold over 10,000 of these dexterous hands.

A dexterous hand capable of operating an iPhone Impressive, with nimble fingertip control. INSPIRE ROBOTS from Beijing has released a new dexterous hand featuring tactile and force sensing, and equipped with a motion library, making it ready to use right out of the box. Especially noteworthy is the modular finger design, allowing users to easily replace a damaged finger. With 13 degrees of freedom and a single-hand load capacity of 30kg, it can be used in general applications such as factory component handling, precision assembly, and warehouse logistics sorting. Notably, this company has already sold over 10,000 of these dexterous hands.

CyberRobo

14,196 views • 8 months ago

My eyes can't keep up with its hand gestures. Xynova's new dexterous hand--Prima1, uses direct drive. 22 degrees of freedom, tactile sensing, high-precision force control... it seems designed more for industrial manufacturing scenarios. They will be showcasing a physical hand at the WRC in Beijing. it must be said, when people discuss which is better, Xynova has already covered tendon-driven, hybrid-driven, and direct-drive hands.

My eyes can't keep up with its hand gestures. Xynova's new dexterous hand--Prima1, uses direct drive. 22 degrees of freedom, tactile sensing, high-precision force control... it seems designed more for industrial manufacturing scenarios. They will be showcasing a physical hand at the WRC in Beijing. it must be said, when people discuss which is better, Xynova has already covered tendon-driven, hybrid-driven, and direct-drive hands.

CyberRobo

381,379 views • 22 days ago

A modular data glove built for robot learning. ENSURING’s Magic Glove uses quick-release sensor modules, combining 15 motion-tracking units, 1,000+ tactile sensing points, and real-time 6-axis force data. The modular design is the interesting part here: sensors can be swapped or reconfigured depending on the task, making it a more flexible interface for teleoperation, dexterous manipulation, and embodied AI data collection.

A modular data glove built for robot learning. ENSURING’s Magic Glove uses quick-release sensor modules, combining 15 motion-tracking units, 1,000+ tactile sensing points, and real-time 6-axis force data. The modular design is the interesting part here: sensors can be swapped or reconfigured depending on the task, making it a more flexible interface for teleoperation, dexterous manipulation, and embodied AI data collection.

Eren Chen

33,006 views • 22 days ago

Mimic Robotics released a full-stack dexterity platform: the mimic hand M1 + umimic (U1) wearable. They keep human hand morphology consistent across the entire data-model-dexterous hand-manipulation pipeline--from video pre-training to wearable demos and robot deployment. This avoids cross-embodiment gaps and captures the essence of upper-limb intelligence. M1: Tendon-driven (15 active DoF), highly backdrivable ( 25kg grasp, industrial-grade, Swiss-made. U1 lets humans teach the robot naturally with their own hands--1:1 kinematics and sensing match, no latency or retargeting, enabling higher-quality and more scalable data. Looking forward to its performance at the customer site.

Mimic Robotics released a full-stack dexterity platform: the mimic hand M1 + umimic (U1) wearable. They keep human hand morphology consistent across the entire data-model-dexterous hand-manipulation pipeline--from video pre-training to wearable demos and robot deployment. This avoids cross-embodiment gaps and captures the essence of upper-limb intelligence. M1: Tendon-driven (15 active DoF), highly backdrivable ( 25kg grasp, industrial-grade, Swiss-made. U1 lets humans teach the robot naturally with their own hands--1:1 kinematics and sensing match, no latency or retargeting, enabling higher-quality and more scalable data. Looking forward to its performance at the customer site.

CyberRobo

26,160 views • 1 month ago

The sense of touch is the most criminally under-explored modality in robotics. Imagine doing sleight of hand wearing thick oven mitts. That's exactly how a robot feels today if it were alive. A magnetic piece snapping into place, a paper cup peeling out of a stack, a USB negotiating its way into the port - all invisible to the camera. Learning how to feel must be a full-stack co-designed effort. We are open-sourcing a principled methodology called "T-Rex": 1. Tactile as first-class citizen of the model. Our mixture-of-transformer runs two clocks asynchronously: a slow visuomotor expert plans the motion, and a fast tactile expert refines it in real time with high-frequency corrections at 4 "touch ticks" per vision tick. Forces change faster than frames arrive, so the architecture had to as well. 2. Open data. The largest tactile dataset ever released to our knowledge: a 50-hour (~5,500 episodes) high-quality, carefully synchronized robot play corpus, collected on SOTA tactile hand hardware with 22 degrees of freedom. Available today on HuggingFace! 3. Training recipe: T-Rex extends our prior work, EgoScale. Human egocentric videos for pretraining, a diverse dose of tactile robot play for mid-training. Our experiments show this bridges contact-free pretraining to contact-rich manipulation remarkably well. Pixels are cheap and everywhere, but they run out of steam at the moment of contact. Tactile will carry the last mile. The next scaling curve will be measured in hours of touch. T-Rex is a great collaboration between NVIDIA and Berkeley: 🧵

The sense of touch is the most criminally under-explored modality in robotics. Imagine doing sleight of hand wearing thick oven mitts. That's exactly how a robot feels today if it were alive. A magnetic piece snapping into place, a paper cup peeling out of a stack, a USB negotiating its way into the port - all invisible to the camera. Learning how to feel must be a full-stack co-designed effort. We are open-sourcing a principled methodology called "T-Rex": 1. Tactile as first-class citizen of the model. Our mixture-of-transformer runs two clocks asynchronously: a slow visuomotor expert plans the motion, and a fast tactile expert refines it in real time with high-frequency corrections at 4 "touch ticks" per vision tick. Forces change faster than frames arrive, so the architecture had to as well. 2. Open data. The largest tactile dataset ever released to our knowledge: a 50-hour (~5,500 episodes) high-quality, carefully synchronized robot play corpus, collected on SOTA tactile hand hardware with 22 degrees of freedom. Available today on HuggingFace! 3. Training recipe: T-Rex extends our prior work, EgoScale. Human egocentric videos for pretraining, a diverse dose of tactile robot play for mid-training. Our experiments show this bridges contact-free pretraining to contact-rich manipulation remarkably well. Pixels are cheap and everywhere, but they run out of steam at the moment of contact. Tactile will carry the last mile. The next scaling curve will be measured in hours of touch. T-Rex is a great collaboration between NVIDIA and Berkeley: 🧵

Jim Fan

169,322 views • 18 days ago