Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Robot hands still break most simulators. Meta Reality Labs just open-sourced Project SuperDex — a contact-first physics engine built for the hard part: multi-finger grasps, in-hand reorientation, soft contact, tactile sensing. VR teleop for cheap demo data. Gym-style RL on top. projectsuperdex. com

Carlos E. Perez

63,813 subscribers

27,741 views • 2 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

4 Comments

cosmos1 month ago

😳

Peyman Servati1 month ago

Grasping is full hand function. For dexterity get @TexavieInc 5k1n tactile gloves for both human and robot tactile and pose sensing! Industry leading 1244 taxers all over hand. 🚀 Guess we are way ahead of Reality Labs!

Jackson Zheng1 month ago

The problem with this physics engine at the moment is it can't even simulate two fingertips holding an egg in place. The simulation will always make the egg slip slowly over time no matter how hard the robot grips it.

Whimsical Ai2 months ago

They may need

Related Videos

Meta just open-sourced its dexterity stack! 🪬 Most physics simulators were built for things that move through space. Walking robots, drones, cars. Contact is the part they approximate worst, and obviously dexterous manipulation is nothing but contact. Project SuperDex, from Meta Reality Labs Research, is built the other way around, a contact-first physics engine with the whole platform stacked on top of it. The cool part is that it's on GitHub. The engine runs one solver across rigid bodies, soft bodies, rods and tendons, shells and cloth, in the same model. → Non-convex collision with accurate contact force distributions, so a multi-finger grasp gets simulated rather than approximated → Tactile sensors and soft contact as first-class primitives → Numerical stability without the tight time-step limits explicit solvers force on you → Constraint-aware inverse kinematics running on the same optimization core as the forward dynamics Then the data layer. Put on a Quest 3, teleoperate the simulated hand with haptic feedback, and generate demonstration datasets without touching real hardware. They show a shape-sorting policy trained entirely in simulation and deployed zero-shot on a real robotic hand. Robot hands are getting good. Data for them isn't that fast. Meta is betting the cheapest way to collect contact-rich demonstrations is a headset people already own, pointed at a simulator instead of a game. 🔗 Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Meta just open-sourced its dexterity stack! 🪬 Most physics simulators were built for things that move through space. Walking robots, drones, cars. Contact is the part they approximate worst, and obviously dexterous manipulation is nothing but contact. Project SuperDex, from Meta Reality Labs Research, is built the other way around, a contact-first physics engine with the whole platform stacked on top of it. The cool part is that it's on GitHub. The engine runs one solver across rigid bodies, soft bodies, rods and tendons, shells and cloth, in the same model. → Non-convex collision with accurate contact force distributions, so a multi-finger grasp gets simulated rather than approximated → Tactile sensors and soft contact as first-class primitives → Numerical stability without the tight time-step limits explicit solvers force on you → Constraint-aware inverse kinematics running on the same optimization core as the forward dynamics Then the data layer. Put on a Quest 3, teleoperate the simulated hand with haptic feedback, and generate demonstration datasets without touching real hardware. They show a shape-sorting policy trained entirely in simulation and deployed zero-shot on a real robotic hand. Robot hands are getting good. Data for them isn't that fast. Meta is betting the cheapest way to collect contact-rich demonstrations is a headset people already own, pointed at a simulator instead of a game. 🔗 Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

60,922 views • 2 months ago

Pretty excited about the new SuperDex robotics simulator by Meta. 1. It's contact-first simulator in C++ designed for smooth, non-convex rigid–soft physics (vs mujoco designed for convex shapes) 2. Rather than standalone simulator, it includes a full suite of tools (RL/gym environments ("Superdex Lab"), GUI authoring tool ("Superdex Studio"), VR teleop). 3. It runs well on Mac! Trying it out below:

Pretty excited about the new SuperDex robotics simulator by Meta. 1. It's contact-first simulator in C++ designed for smooth, non-convex rigid–soft physics (vs mujoco designed for convex shapes) 2. Rather than standalone simulator, it includes a full suite of tools (RL/gym environments ("Superdex Lab"), GUI authoring tool ("Superdex Studio"), VR teleop). 3. It runs well on Mac! Trying it out below:

pfung

15,352 views • 2 months ago

Presenting research from Berkeley AI Research Humanoid Intelligence Center. DexTacWAM: A Visuo-Tactile World-Action Model for Dexterous Manipulation.🖐️🤖 Dexterous manipulation requires touch, yet multi-finger tactile data remain scarce and expensive to collect at scale. Through continual vision-to-touch learning, DexTacWAM adapts a pretrained video world model into a visuo-tactile world model for predictive multi-finger contact modeling and action generation. Across six contact-rich dexterous manipulation tasks, DexTacWAM achieves the highest score on every task, averaging 70.6 vs. 38.0 for the strongest baseline. 🔬 Why not simply inject tactile features into the action policy? With the same multi-finger tactile encoder, policy architecture, and training procedure, replacing the tactile world-model latent with direct tactile features drops the 4-task mean from 74.7 to 26.6. Takeaway: the benefit does not come simply from providing tactile observations to the policy, but from making multi-finger contact evolution part of the predicted world state. All code, model weights, and datasets are now open-sourced! 🌐 Project: 📄 Paper: 💻 Code: 🤗 Weights&Data: Author List: Haoran Yuan, Zekai Wang, Boning Shao Haoran Lu, trevordarrell, Ismini Lourentzou, Wei ZHAN

Presenting research from Berkeley AI Research Humanoid Intelligence Center. DexTacWAM: A Visuo-Tactile World-Action Model for Dexterous Manipulation.🖐️🤖 Dexterous manipulation requires touch, yet multi-finger tactile data remain scarce and expensive to collect at scale. Through continual vision-to-touch learning, DexTacWAM adapts a pretrained video world model into a visuo-tactile world model for predictive multi-finger contact modeling and action generation. Across six contact-rich dexterous manipulation tasks, DexTacWAM achieves the highest score on every task, averaging 70.6 vs. 38.0 for the strongest baseline. 🔬 Why not simply inject tactile features into the action policy? With the same multi-finger tactile encoder, policy architecture, and training procedure, replacing the tactile world-model latent with direct tactile features drops the 4-task mean from 74.7 to 26.6. Takeaway: the benefit does not come simply from providing tactile observations to the policy, but from making multi-finger contact evolution part of the predicted world state. All code, model weights, and datasets are now open-sourced! 🌐 Project: 📄 Paper: 💻 Code: 🤗 Weights&Data: Author List: Haoran Yuan, Zekai Wang, Boning Shao Haoran Lu, trevordarrell, Ismini Lourentzou, Wei ZHAN

Berkeley AI Research

112,249 views • 28 days ago

In house tactile sensor prototype. Detects taps, motion, and multiple contact with force magnitudes. Built to be cheap, robust, and replaceable. Not in our demos yet, still WIP. We pair simple tactile sensing with torque transparent joints to recover rich contact without expensive sensors.

In house tactile sensor prototype. Detects taps, motion, and multiple contact with force magnitudes. Built to be cheap, robust, and replaceable. Not in our demos yet, still WIP. We pair simple tactile sensing with torque transparent joints to recover rich contact without expensive sensors.

Kyber Labs

39,735 views • 6 months ago

TARS has made some big announcements at ICRA 2026. DexHand - A dexterous hand with 1:1 replication of human metacarpal and finger structure, multi-axis thumb opposition - Quasi-direct-drive + backdrivable joints, 21 degrees of freedom - All 26 ASL letter signs reproduced at high precision -0.05mm fingertip tactile sensing - Data. Model. Hand. Fused into one embodied AI-native dexterous hand. OmniVTA with TacForeSight A visuo-tactile world model for general-use, paired with TacForeSight, a force-guided technology that not only allows robots to understand contact but also enables them to predict contact before it happens. - Semantic touch ("slippery," "rough," "soft," "hard") enabling texture-based material cognition. - Operates inside a real-time closed loop - Contact state prediction and reaction at the microsecond scale, faster than human AWE 3.0 - Claimed to be the world's leading general-purpose embodied foundation model for real-world work - A1 robot packing demo as the showcase: long-horizon, bimanual, with autonomous error recovery and end-to-end imitation learning - Set a Guinness World Record in March 2026 for "Most sub-millimeter wire harness assembled by a robot in one hour" - SenseHub data acquisition suite captures human experience data to train AWE 3.0

TARS has made some big announcements at ICRA 2026. DexHand - A dexterous hand with 1:1 replication of human metacarpal and finger structure, multi-axis thumb opposition - Quasi-direct-drive + backdrivable joints, 21 degrees of freedom - All 26 ASL letter signs reproduced at high precision -0.05mm fingertip tactile sensing - Data. Model. Hand. Fused into one embodied AI-native dexterous hand. OmniVTA with TacForeSight A visuo-tactile world model for general-use, paired with TacForeSight, a force-guided technology that not only allows robots to understand contact but also enables them to predict contact before it happens. - Semantic touch ("slippery," "rough," "soft," "hard") enabling texture-based material cognition. - Operates inside a real-time closed loop - Contact state prediction and reaction at the microsecond scale, faster than human AWE 3.0 - Claimed to be the world's leading general-purpose embodied foundation model for real-world work - A1 robot packing demo as the showcase: long-horizon, bimanual, with autonomous error recovery and end-to-end imitation learning - Set a Guinness World Record in March 2026 for "Most sub-millimeter wire harness assembled by a robot in one hour" - SenseHub data acquisition suite captures human experience data to train AWE 3.0

The Humanoid Hub

11,322 views • 4 months ago

UMI, but for humanoid hands. UMI-style capture already works great for simple grippers. For a high-DOF hand, where the action space is huge and contact force carries the important signal, matching the data collector to the hand matters even more. Chestnut just announced that pair: Aero Hand, an 18-DOF human-sized dexterous hand (tendon/linkage hybrid, tested for 3M+ cycles), and Aero UMI, a wearable exoskeleton whose kinematics exactly matches the robotic hand, with direct per-joint angle sensing accurate to 0.1°. Zero embodiment gap for human data collection. Doubles as a teleop rig.

UMI, but for humanoid hands. UMI-style capture already works great for simple grippers. For a high-DOF hand, where the action space is huge and contact force carries the important signal, matching the data collector to the hand matters even more. Chestnut just announced that pair: Aero Hand, an 18-DOF human-sized dexterous hand (tendon/linkage hybrid, tested for 3M+ cycles), and Aero UMI, a wearable exoskeleton whose kinematics exactly matches the robotic hand, with direct per-joint angle sensing accurate to 0.1°. Zero embodiment gap for human data collection. Doubles as a teleop rig.

The Humanoid Hub

27,381 views • 29 days ago

Feeling what a robot feels is becoming real! 🫰 Fluid Reality just ran its first full end-to-end touch teleoperation system, and the demo shows why high-resolution haptics might be the missing piece in robot control. A 22 mm fingertip display with 32 independently actuated “bubbles” was mapped directly to tactile sensors on a robot hand. 🫧 Three fingers streamed real-time touch data robot → human, giving the operator actual contact feedback instead of waving their hands blind, like most teleop systems today. It’s still early, but this is a real step toward dexterous ops and high-quality data for training Physical AI systems. Companies involved: Samsung Electronics, Alt-Bionics, Inc. (the robot hand), MANUS™ (hand tracking), and Sensible Robotics (fingertip sensors) Touch isn’t a nice-to-have in robotics. It’s the difference between manipulation that works in the real world P.S. Guess how many touch receptors we humans, have in our hand! :) ~~ ♻ Join the weekly robotics newsletter, and never miss any news →

Feeling what a robot feels is becoming real! 🫰 Fluid Reality just ran its first full end-to-end touch teleoperation system, and the demo shows why high-resolution haptics might be the missing piece in robot control. A 22 mm fingertip display with 32 independently actuated “bubbles” was mapped directly to tactile sensors on a robot hand. 🫧 Three fingers streamed real-time touch data robot → human, giving the operator actual contact feedback instead of waving their hands blind, like most teleop systems today. It’s still early, but this is a real step toward dexterous ops and high-quality data for training Physical AI systems. Companies involved: Samsung Electronics, Alt-Bionics, Inc. (the robot hand), MANUS™ (hand tracking), and Sensible Robotics (fingertip sensors) Touch isn’t a nice-to-have in robotics. It’s the difference between manipulation that works in the real world P.S. Guess how many touch receptors we humans, have in our hand! :) ~~ ♻ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

46,927 views • 10 months ago

Contact does not always deform surfaces, especially when interacting with liquids and soft objects. However, most existing tactile sensors rely on surface deformation to infer contact. Excited to share LightTact, a visual-tactile fingertip sensor that makes contact directly visible. It provides: - Deformation-Independent Sensing: contact is detected optically, not inferred from surface deformation. - High-Contrast Raw Images: non-contact pixels stay near-black. - Pixel-Level Contact Segmentation: robust across materials, forces, appearances, and external lighting conditions. This project was co-led with Boda ( Grateful to all co-authors for their contributions, and many thanks to Yuxiang Yang for the insightful discussions. We will present LightTact at RSS 2026 in Sydney next week! Paper: Open-source:

Contact does not always deform surfaces, especially when interacting with liquids and soft objects. However, most existing tactile sensors rely on surface deformation to infer contact. Excited to share LightTact, a visual-tactile fingertip sensor that makes contact directly visible. It provides: - Deformation-Independent Sensing: contact is detected optically, not inferred from surface deformation. - High-Contrast Raw Images: non-contact pixels stay near-black. - Pixel-Level Contact Segmentation: robust across materials, forces, appearances, and external lighting conditions. This project was co-led with Boda ( Grateful to all co-authors for their contributions, and many thanks to Yuxiang Yang for the insightful discussions. We will present LightTact at RSS 2026 in Sydney next week! Paper: Open-source:

Changyi Lin

65,672 views • 3 months ago

Can we use wearable devices to collect robot data without actual robots? Yes! With a pair of gloves🧤! Introducing DexCap, a portable hand motion capture system that collects 3D data (point cloud + finger motion) for training robots with dexterous hands Everything open-sourced

Can we use wearable devices to collect robot data without actual robots? Yes! With a pair of gloves🧤! Introducing DexCap, a portable hand motion capture system that collects 3D data (point cloud + finger motion) for training robots with dexterous hands Everything open-sourced

Chen Wang

239,752 views • 2 years ago

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.

AI at Meta

453,860 views • 2 years ago

Robotics just hit a dexterity milestone 🤯! Sharpa Robotics demonstrated autonomous dual-hand apple peeling using its new MoDE-VLA system. Using human-like dexterous hands with tactile sensing, the robot can feel contact and adjust its grip while rotating and peeling the apple. While the system achieved 30% success, the 73% peel completion rate shows robots are starting to master the fine, contact-rich manipulation needed for real world tasks.

Robotics just hit a dexterity milestone 🤯! Sharpa Robotics demonstrated autonomous dual-hand apple peeling using its new MoDE-VLA system. Using human-like dexterous hands with tactile sensing, the robot can feel contact and adjust its grip while rotating and peeling the apple. While the system achieved 30% success, the 73% peel completion rate shows robots are starting to master the fine, contact-rich manipulation needed for real world tasks.

SciTech Era

39,696 views • 7 months ago

One engineering challenge in dexterous Robot hands is balancing strength and speed. Here a SharpaWave performing rapid hand cycles at over 4x/sec. The Dynamic Tactile Array uses visuo-tactile sensing: fingertip integrates camera & 1,000+ tactile pixels.

One engineering challenge in dexterous Robot hands is balancing strength and speed. Here a SharpaWave performing rapid hand cycles at over 4x/sec. The Dynamic Tactile Array uses visuo-tactile sensing: fingertip integrates camera & 1,000+ tactile pixels.

Rohan Paul

27,256 views • 3 months ago

Humans grasp objects with a purpose! Web2Grasp enables such functional grasping for dexterous robot hands via hand-object reconstruction from web images - without *any* robot teleop data collection 1/n

Humans grasp objects with a purpose! Web2Grasp enables such functional grasping for dexterous robot hands via hand-object reconstruction from web images - without any robot teleop data collection 1/n

Homanga Bharadhwaj @ CVPR

28,408 views • 1 year ago

From $5,300! All open source! Engineai first professional robot SA01 big humanoid officially debuted! contact: sales@engineai.com.cn # Engine Technology # Engine robot # Robot #engineai # Bipedal robot # Bipedal robot # Artificial intelligence #AI #robort

From $5,300! All open source! Engineai first professional robot SA01 big humanoid officially debuted! contact: [email protected] # Engine Technology # Engine robot # Robot #engineai # Bipedal robot # Bipedal robot # Artificial intelligence #AI #robort

EngineAI

11,717 views • 2 years ago

A policy that teaches robot hands to touch things the way humans do... not just grab and move, but feel and adjust in real time. Robot manipulation research often stops at picking up objects and placing them. CGP goes further: it handles tasks like opening jars, flipping objects in-hand, wiping dishes, and grasping fragile eggs, the kind of dexterous, contact-rich skills that require constant micro-adjustments based on what the fingers are actually feeling. The robot doesn't just see what it's doing; it predicts what contact should feel like at each step, then checks whether reality matches the prediction. If a finger is slipping, the policy knows before the object drops. Works on real robot hands (both 4-finger and 5-finger designs) with tactile sensors embedded in the fingertips Robust to visual distractions! The robot keeps flipping a box correctly even when the camera view is disrupted, because it's grounding decisions in touch, not just vision. Baseline policies without contact grounding fail in predictable ways: slipping mid-task, incomplete motions, loss of grasp, CGP avoids these This is a meaningful step toward robots that can handle the physical world with the kind of reliable, adaptive grip that humans take for granted. Relevant for manufacturing, logistics, assistive robotics, and anywhere fragile or irregular objects need to be handled carefully. Published at RSS 2026, developed with Meta Reality Labs Research. Thanks for sharing, Zhengtong Xu / Zhengtong Xu ——- Weekly robotics and AI insights. Subscribe free:

A policy that teaches robot hands to touch things the way humans do... not just grab and move, but feel and adjust in real time. Robot manipulation research often stops at picking up objects and placing them. CGP goes further: it handles tasks like opening jars, flipping objects in-hand, wiping dishes, and grasping fragile eggs, the kind of dexterous, contact-rich skills that require constant micro-adjustments based on what the fingers are actually feeling. The robot doesn't just see what it's doing; it predicts what contact should feel like at each step, then checks whether reality matches the prediction. If a finger is slipping, the policy knows before the object drops. Works on real robot hands (both 4-finger and 5-finger designs) with tactile sensors embedded in the fingertips Robust to visual distractions! The robot keeps flipping a box correctly even when the camera view is disrupted, because it's grounding decisions in touch, not just vision. Baseline policies without contact grounding fail in predictable ways: slipping mid-task, incomplete motions, loss of grasp, CGP avoids these This is a meaningful step toward robots that can handle the physical world with the kind of reliable, adaptive grip that humans take for granted. Relevant for manufacturing, logistics, assistive robotics, and anywhere fragile or irregular objects need to be handled carefully. Published at RSS 2026, developed with Meta Reality Labs Research. Thanks for sharing, Zhengtong Xu / Zhengtong Xu ——- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

12,860 views • 4 months ago

Tactile Diffusion generates synthetic tactile images from sim data, capturing the complex illumination of the gel deformation. This research from UW & Meta AI is the first method using diffusion to close the sim2real gap for vision-based tactile sensing. Read the paper ⬇️

Tactile Diffusion generates synthetic tactile images from sim data, capturing the complex illumination of the gel deformation. This research from UW & Meta AI is the first method using diffusion to close the sim2real gap for vision-based tactile sensing. Read the paper ⬇️

AI at Meta

100,168 views • 3 years ago

Most of today's AI can see the world, but it doesn’t **feel** it. Capturing the sense of touch is crucial for dexterous robotic manipulation, user modeling, and understanding physical interactions. Introducing OpenTouch: bringing full-hand tactile sensing into real-world AI🖐️ OpenTouch is collected in-the-wild using tactile sensing gloves, hand pose tracking gloves, and egocentric glasses. It includes: • 5 hours of real-world data, • 3 hours densely annotated contact-rich interactions, • 2,900 curated interaction clips, • across 800 objects, 14 environments, and 29 grasp types. all open at:

Most of today's AI can see the world, but it doesn’t feel it. Capturing the sense of touch is crucial for dexterous robotic manipulation, user modeling, and understanding physical interactions. Introducing OpenTouch: bringing full-hand tactile sensing into real-world AI🖐️ OpenTouch is collected in-the-wild using tactile sensing gloves, hand pose tracking gloves, and egocentric glasses. It includes: • 5 hours of real-world data, • 3 hours densely annotated contact-rich interactions, • 2,900 curated interaction clips, • across 800 objects, 14 environments, and 29 grasp types. all open at:

Paul Liang

49,323 views • 6 months ago

Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei, the first open humanoid reference design built on Jetson Thor + the Isaac GR00T platform. - The body: Unitree H2 chassis + Sharpa Wave tactile 5-finger hands. - The brain: Jetson Thor compute + the NVIDIA Isaac GR00T open software stack (teleop, foundation models, sim, ROS). - Aimed at academic labs that want to do frontier humanoid research without proprietary lock-in. - Early adopters: ETH Zurich, Stanford Robotics Center, UCSD ARCLab. Endorsed by Skild's Deepak Pathak and Ai2's Dieter Fox. Ships from Unitree late 2026.

Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei, the first open humanoid reference design built on Jetson Thor + the Isaac GR00T platform. - The body: Unitree H2 chassis + Sharpa Wave tactile 5-finger hands. - The brain: Jetson Thor compute + the NVIDIA Isaac GR00T open software stack (teleop, foundation models, sim, ROS). - Aimed at academic labs that want to do frontier humanoid research without proprietary lock-in. - Early adopters: ETH Zurich, Stanford Robotics Center, UCSD ARCLab. Endorsed by Skild's Deepak Pathak and Ai2's Dieter Fox. Ships from Unitree late 2026.

The Humanoid Hub

40,132 views • 4 months ago