Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Tactile Diffusion generates synthetic tactile images from sim data, capturing the complex illumination of the gel deformation. This research from UW & Meta AI is the first method using diffusion to close the sim2real gap for vision-based tactile sensing. Read the paper ⬇️

AI at Meta

810,618 subscribers

100,156 views • 3 years ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

6 Comments

FreddieK8883 years ago

#iExec's decentralized infrastructure can provide Meta with a secure platform for deploying their #NFTs and #metaverse applications. This can help to ensure that the applications are resistant to attacks and can provide a better user experience. $RLC

a(b)3 years ago

@freecs_org

🌹KINGof KINGS🌹LORD of LORDS🌹IAM🌹🦁🌹WHO IAM🌹3 years ago

@ylecun IAMazing🌹 🌹🕊️🦁🔥🔥🔥

Lucid Scientific, Inc.1 year ago

Expand the possibilities of your metabolic research. Resipher tracks real-time cellular oxygen consumption in standard 96-well plates, delivering continuous real-time data directly from your incubator. Request a free virtual demo or quote today >>

Quick AI News3 years ago

Wow! This is incredible! This research is a major step forward in closing the sim2real gap for vision-based tactile sensing. Exciting times ahead for AI!

AI at Meta1 year ago

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

Related Videos

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.

AI at Meta

453,148 views • 1 year ago

Tactile feedback is one of the most important modalities in manipulation, but has been underutilized in dexterous hands. T-Dex is a framework for learning dexterous policies from tactile play data, beating vision and torque-based methods by 1.7x. 🧵👇

Tactile feedback is one of the most important modalities in manipulation, but has been underutilized in dexterous hands. T-Dex is a framework for learning dexterous policies from tactile play data, beating vision and torque-based methods by 1.7x. 🧵👇

Lerrel Pinto

84,258 views • 3 years ago

More beautiful robot hands. This one from Sharpa The hand uses what they call a Dynamic Tactile Array, meaning vision and touch work together and their SaTA (Spatially-anchored Tactile Awareness) algorithm. Each fingertip includes a mini camera and 1,000+ tactile pixels, hitting 0.005N pressure sensitivity. With 22 DOF and 6D force sensing, it can do everything from eggs to tools.

More beautiful robot hands. This one from Sharpa The hand uses what they call a Dynamic Tactile Array, meaning vision and touch work together and their SaTA (Spatially-anchored Tactile Awareness) algorithm. Each fingertip includes a mini camera and 1,000+ tactile pixels, hitting 0.005N pressure sensitivity. With 22 DOF and 6D force sensing, it can do everything from eggs to tools.

Rohan Paul

41,775 views • 6 months ago

At #CVPR2024: Tactile-augmented Radiance Fields! We probe a scene with a touch sensor and localize each sample within a NeRF. We use diffusion to estimate the tactile signals for the points we didn't touch. w/ Yiming Dou, Antonio Loquercio, Fengyu Yang, Yi Liu

At #CVPR2024: Tactile-augmented Radiance Fields! We probe a scene with a touch sensor and localize each sample within a NeRF. We use diffusion to estimate the tactile signals for the points we didn't touch. w/ Yiming Dou, Antonio Loquercio, Fengyu Yang, Yi Liu

Andrew Owens

38,616 views • 2 years ago

Most of today's AI can see the world, but it doesn’t **feel** it. Capturing the sense of touch is crucial for dexterous robotic manipulation, user modeling, and understanding physical interactions. Introducing OpenTouch: bringing full-hand tactile sensing into real-world AI🖐️ OpenTouch is collected in-the-wild using tactile sensing gloves, hand pose tracking gloves, and egocentric glasses. It includes: • 5 hours of real-world data, • 3 hours densely annotated contact-rich interactions, • 2,900 curated interaction clips, • across 800 objects, 14 environments, and 29 grasp types. all open at:

Most of today's AI can see the world, but it doesn’t feel it. Capturing the sense of touch is crucial for dexterous robotic manipulation, user modeling, and understanding physical interactions. Introducing OpenTouch: bringing full-hand tactile sensing into real-world AI🖐️ OpenTouch is collected in-the-wild using tactile sensing gloves, hand pose tracking gloves, and egocentric glasses. It includes: • 5 hours of real-world data, • 3 hours densely annotated contact-rich interactions, • 2,900 curated interaction clips, • across 800 objects, 14 environments, and 29 grasp types. all open at:

Paul Liang

47,158 views • 2 months ago

My team at FAIR AI at Meta is hiring postdocs. We are working in the space of dexterous manipulation and tactile sensing. If you are interested reach out / apply:

My team at FAIR AI at Meta is hiring postdocs. We are working in the space of dexterous manipulation and tactile sensing. If you are interested reach out / apply:

Mustafa Mukadam

40,587 views • 2 years ago

I'm thrilled to announce the launch of ⚡️Flash Diffusion from Jasper! Earlier this year, with our acquisition of Clipdrop, we launched the Jasper AI Research Lab in Paris. Today, we are excited to release our first piece of groundbreaking research: the open-source distillation method, "Flash Diffusion". Flash Diffusion accelerates inference by 500%, reduces computing costs, and produces higher-quality image outputs. Dive into the details and discover how Flash Diffusion is set to revolutionize the field of AI and image synthesis. Read all about it here: Try a demo on Hugging Face:

I'm thrilled to announce the launch of ⚡️Flash Diffusion from Jasper! Earlier this year, with our acquisition of Clipdrop, we launched the Jasper AI Research Lab in Paris. Today, we are excited to release our first piece of groundbreaking research: the open-source distillation method, "Flash Diffusion". Flash Diffusion accelerates inference by 500%, reduces computing costs, and produces higher-quality image outputs. Dive into the details and discover how Flash Diffusion is set to revolutionize the field of AI and image synthesis. Read all about it here: Try a demo on Hugging Face:

Timothy Young

10,091 views • 2 years ago

Watch as Sharpa North assembles a computer autonomously! From precise positioning to screwing and wire clipping, North executes complex, contact-rich tasks powered by tactile feedback. Dexterous hands + tactile AI are what make real-world task execution possible. This is the shift from simple automation to real-world robotics. #SharpaRobotics

Watch as Sharpa North assembles a computer autonomously! From precise positioning to screwing and wire clipping, North executes complex, contact-rich tasks powered by tactile feedback. Dexterous hands + tactile AI are what make real-world task execution possible. This is the shift from simple automation to real-world robotics. #SharpaRobotics

Sharpa

28,101 views • 3 months ago

The Figure 03 hand has a camera in the palm. It's unclear whether the fingers have tactile sensing.

The Figure 03 hand has a camera in the palm. It's unclear whether the fingers have tactile sensing.

The Humanoid Hub

220,812 views • 8 months ago

When you snap overlays to walls, don’t forget you benefit from tactile feedback if the computer vision is good enough 🥹

When you snap overlays to walls, don’t forget you benefit from tactile feedback if the computer vision is good enough 🥹

Brad Lynch

72,260 views • 1 year ago

ViTacFormer is a unified visuo-tactile framework for dexterous robot manipulation. It fuses high-res visual+tactile data using cross-attention and predicts future tactile signals via an autoregressive head, enabling multi-fingered hands to perform precise, long-horizon tasks.

ViTacFormer is a unified visuo-tactile framework for dexterous robot manipulation. It fuses high-res visual+tactile data using cross-attention and predicts future tactile signals via an autoregressive head, enabling multi-fingered hands to perform precise, long-horizon tasks.

The Humanoid Hub

10,816 views • 11 months ago

Introducing tactile skin sim-to-real for dexterous in-hand translation! We propose a simulation model for ReSkin, a magnetic tactile sensing skin. It can simulate ternary shear and binary normal forces. More:

Introducing tactile skin sim-to-real for dexterous in-hand translation! We propose a simulation model for ReSkin, a magnetic tactile sensing skin. It can simulate ternary shear and binary normal forces. More:

Haozhi Qi

33,513 views • 2 years ago

Touch alone isn’t enough. 🖐️ For robotics, tactile intelligence truly levels up when touch gains spatial meaning. At #ICRA2026, we dove into the core concept behind SaTA: Spatially-anchored Tactile Awareness for robust, dexterous manipulation. Read it here: The challenge is fundamental: a robot shouldn’t just register a touch, it needs to understand exactly where that contact occurs relative to its fingers, joints, and overall hand structure. This is the missing link that turns raw data into precise, real-time adjustments during manipulation. Why does this matter? Because the most complex part of any manipulation task happens when vision is at its least reliable, that final millimeter before insertion, sliding, gripping, or fine-tuning. At Sharpa, this is exactly why we’re building tactile hands and tactile AI in tandem. 🚀 #Sharpa #Robotics #EmbodiedAI #TactileIntelligence #ICRA2026 #DexterousManipulation 📷

Touch alone isn’t enough. 🖐️ For robotics, tactile intelligence truly levels up when touch gains spatial meaning. At #ICRA2026, we dove into the core concept behind SaTA: Spatially-anchored Tactile Awareness for robust, dexterous manipulation. Read it here: The challenge is fundamental: a robot shouldn’t just register a touch, it needs to understand exactly where that contact occurs relative to its fingers, joints, and overall hand structure. This is the missing link that turns raw data into precise, real-time adjustments during manipulation. Why does this matter? Because the most complex part of any manipulation task happens when vision is at its least reliable, that final millimeter before insertion, sliding, gripping, or fine-tuning. At Sharpa, this is exactly why we’re building tactile hands and tactile AI in tandem. 🚀 #Sharpa #Robotics #EmbodiedAI #TactileIntelligence #ICRA2026 #DexterousManipulation 📷

Sharpa

14,772 views • 28 days ago

🤖 INTERESTING: Advances in tactile sensing are giving humanoid robots the ability to feel and interact with the world more like humans.

🤖 INTERESTING: Advances in tactile sensing are giving humanoid robots the ability to feel and interact with the world more like humans.

Cointelegraph

36,052 views • 1 month ago

Can we bring human-like Touch to robots🤖? Introducing our CoRL work on 3D-ViTac. Humans rely on both vision 👁️ and touch 🫳 for complex tasks. With combined visual-tactile sensing, robots can now tackle challenging tasks, like precise in-hand reorientation, fragile objects grasping. Website: #Robotics #CoRL2024 #Touch #tactile #AI #ML

Can we bring human-like Touch to robots🤖? Introducing our CoRL work on 3D-ViTac. Humans rely on both vision 👁️ and touch 🫳 for complex tasks. With combined visual-tactile sensing, robots can now tackle challenging tasks, like precise in-hand reorientation, fragile objects grasping. Website: #Robotics #CoRL2024 #Touch #tactile #AI #ML

Binghao Huang

49,500 views • 1 year ago

I love how *tactile* the furry fandom is... #furryfandom

I love how tactile the furry fandom is... #furryfandom

Finn 🔜 AC

11,602 views • 1 year ago

A lot of hype around giving robots touch. That's the OG tactile sensing. FORCE. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

A lot of hype around giving robots touch. That's the OG tactile sensing. FORCE. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

216,800 views • 1 month ago

Levers, knobs, & detents. A tactile experience. The sounds of manual machinery. Monarch ASMR.

Levers, knobs, & detents. A tactile experience. The sounds of manual machinery. Monarch ASMR.

Dan_Antonelli

17,295 views • 11 months ago

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:

Stability AI

1,024,438 views • 2 years ago

Here’s the windmill assembly demo we showed at CES 2026 — the one no one saw coming. North executes a fully autonomous, long-horizon dexterous sequence with sustained hand–eye–tactile coordination and assembly-level precision enabled by tactile feedback. It’s also robust to disturbance: you can reposition the objects, and North will still identify them and recover the task. This is powered by CraftNet (VTLA) — using tactile feedback to continuously fine-tune the last-millimeter interaction, enabling reliable execution across 30+ steps. Read more about CraftNet: #Sharpa #SharpaWave #SharpaNorth #CraftNet #System0 #CES2026

Here’s the windmill assembly demo we showed at CES 2026 — the one no one saw coming. North executes a fully autonomous, long-horizon dexterous sequence with sustained hand–eye–tactile coordination and assembly-level precision enabled by tactile feedback. It’s also robust to disturbance: you can reposition the objects, and North will still identify them and recover the task. This is powered by CraftNet (VTLA) — using tactile feedback to continuously fine-tune the last-millimeter interaction, enabling reliable execution across 30+ steps. Read more about CraftNet: #Sharpa #SharpaWave #SharpaNorth #CraftNet #System0 #CES2026

Sharpa

87,877 views • 5 months ago