Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Open-source magnetic tactile sensor for $5! 🧲 Researchers introduced a magnetic tactile sensor that's low-cost, and easy to fabricate, democratizing tactile sensing for robotics. Operating in unstructured environments like homes and offices requires robots to sense forces during physical interaction. Yet the lack of a versatile, accessible tactile sensor...

lukas_m_ziegler's profile picture

Lukas Ziegler

65,556 subscribers

290,388 görüntüleme • 6 ay önce •via X (Twitter)

EğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

22 Yorum

DanielAIwork profil fotoğrafı
DanielAIwork6 ay önce

finally a sensor cheaper than my debug coffee. $5 magnets beating million dollar ones? my wallet is already crying with joy

M a n j u | ಮಂಜು profil fotoğrafı
M a n j u | ಮಂಜು6 ay önce

We are getting closer and closer to real touch . This would exponentially increase the environment awareness for automation systems and related applications where we can actually use feedback mechanism through direct contacts rather than pre-calculated pressure and forces..

Pato profil fotoğrafı
Pato6 ay önce

$5 sensor is wild. the real unlock is when cheap hardware meets cheap inference and suddenly a robot that folds laundry is a software problem not a hardware one

Sebastian Andreas Nikolaus profil fotoğrafı
Sebastian Andreas Nikolaus6 ay önce

Awesome!

Nathan Labbe profil fotoğrafı
Nathan Labbe6 ay önce

@IanPritchard 👀💡

Jason Ziegler profil fotoğrafı
Jason Ziegler6 ay önce

Very cool

Darren Dawson profil fotoğrafı
Darren Dawson6 ay önce

How did the double finger touch work, at the start of the video? I’m feeling sluggishly stupid about Hall effect sensors this morning.

DOCAƒro profil fotoğrafı
DOCAƒro6 ay önce

The cost ($5) and the ease of manufacture change everything for service robotics. 🤖 Question : with this magnetic approach, how do you manage interference in environments saturated with metals or motors ? Is the precision of the magnetometer stable ?

0x🥬🐦🥬🐦🥬🐦𐤊 profil fotoğrafı
0x🥬🐦🥬🐦🥬🐦𐤊6 ay önce

very cool, this magnetic solution will work for static sensing compared to piezoelectric sensors. Just not sure if soft/hard iron effect will cause a sudden unexpected behavior or not?

Kai Cabero profil fotoğrafı
Kai Cabero6 ay önce

crazy $5 open source sensor instead of overpriced hardware huge adoption for companies looking to cut infra costs

Sam U profil fotoğrafı
Sam U6 ay önce

creative !

Seungju chae profil fotoğrafı
Seungju chae6 ay önce

@yspdds 이런거 만들기 가능?

Mente Prompt • Inteligencia Artificial profil fotoğrafı
Mente Prompt • Inteligencia Artificial6 ay önce

Cost efficient

Chuck Petras profil fotoğrafı
Chuck Petras6 ay önce

@BrianRoemmele

Pierre-Louis Soulié profil fotoğrafı
Pierre-Louis Soulié6 ay önce

Will try!

Hejia Electronic Technology profil fotoğrafı
Hejia Electronic Technology6 ay önce

If robots are available, human work content will become less and less—where will those humans go from here?

Rachel profil fotoğrafı
Rachel6 ay önce

Love seeing tactile sensing get cheaper. A $5 part is the kind of threshold change that turns 'cool paper' into 'someone will actually build with this.'

M4rc0z profil fotoğrafı
M4rc0z6 ay önce

@yacineMTB

hamyori profil fotoğrafı
hamyori6 ay önce

good work!

Nurvai - The Data Layer for Physical AI profil fotoğrafı
Nurvai - The Data Layer for Physical AI6 ay önce

There’s definitely a broader push toward bringing contact sensing into robotics, and this fits that trend well. Curious how this compares to other low cost tactile approaches. What tradeoffs show up between cost, resolution, and robustness?

Patrick Walsh profil fotoğrafı
Patrick Walsh5 ay önce

Is it using capacitors underneath?

Guar Dittho profil fotoğrafı
Guar Dittho6 ay önce

Not sustainable

Benzer Videolar

What if you could give a robot a sense of touch for around $5? That's what makes eFlesh so interesting. It is a low-cost, 3D-printed tactile sensor that uses magnets and a magnetometer to sense contact, force and slipping. Put it on a robotic gripper and it could tell when an object is starting to slip, then adjust its grip instead of relying only on cameras. Cheap tactile sensing could make it much easier to add touch to robotic hands, grippers and other parts. Would you put a $5 tactile sensor on your robot? What would you make it do? Developed by Venkatesh, Lerrel Pinto and team
0:57

What if you could give a robot a sense of touch for around $5? That's what makes eFlesh so interesting. It is a low-cost, 3D-printed tactile sensor that uses magnets and a magnetometer to sense contact, force and slipping. Put it on a robotic gripper and it could tell when an object is starting to slip, then adjust its grip instead of relying only on cameras. Cheap tactile sensing could make it much easier to add touch to robotic hands, grippers and other parts. Would you put a $5 tactile sensor on your robot? What would you make it do? Developed by Venkatesh, Lerrel Pinto and team

Praveen Kumar Verma

21,321 görüntüleme • 1 ay önce

Physical intelligence needs touch, not just vision. eFlesh is a fully 3D-printable magnetic tactile sensor that enables reliable slip detection and contact awareness on real robots, using low-cost hardware and scalable fabrication
1:00

Physical intelligence needs touch, not just vision. eFlesh is a fully 3D-printable magnetic tactile sensor that enables reliable slip detection and contact awareness on real robots, using low-cost hardware and scalable fabrication

Robots Digest 🤖

243,808 görüntüleme • 9 ay önce

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.
2:35

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.

AI at Meta

453,988 görüntüleme • 2 yıl önce

Open-source dexterous hands with fingertip sensors! 🪬 ORCA Dexterity just released three dexterous hand models. Their mission: is to democratize robotic hand dexterity. They're sharing progress on exceptional, low-cost hardware and a software layer from low-level control to robotic hand learning. This is the open-source approach to dexterous manipulation. It has 83 taxels per finger with 0.1 N force detection which pretty is impressive for an open-source design. Tactile sensing is critical for dexterous manipulation, knowing contact forces enables gentle grasping, slip detection, and force-controlled assembly. Also 700g weight for the lite version makes it practical for mounting on robot arms without exceeding payload limits. Lower weight means faster movements and lower torque requirements. Open hardware accelerates robotics by letting researchers and builders modify designs for their specific needs without starting from scratch! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:20

Open-source dexterous hands with fingertip sensors! 🪬 ORCA Dexterity just released three dexterous hand models. Their mission: is to democratize robotic hand dexterity. They're sharing progress on exceptional, low-cost hardware and a software layer from low-level control to robotic hand learning. This is the open-source approach to dexterous manipulation. It has 83 taxels per finger with 0.1 N force detection which pretty is impressive for an open-source design. Tactile sensing is critical for dexterous manipulation, knowing contact forces enables gentle grasping, slip detection, and force-controlled assembly. Also 700g weight for the lite version makes it practical for mounting on robot arms without exceeding payload limits. Lower weight means faster movements and lower torque requirements. Open hardware accelerates robotics by letting researchers and builders modify designs for their specific needs without starting from scratch! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

38,323 görüntüleme • 7 ay önce

A lot of hype around giving robots touch. That's the OG tactile sensing. FORCE. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:35

A lot of hype around giving robots touch. That's the OG tactile sensing. FORCE. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

216,986 görüntüleme • 5 ay önce

Touch was the missing sense in robotics But FlexiTac is here to change that. An open-source, low-cost, scalable tactile sensor that’s: • ~3 min to fabricate • ~$2.5 per unit • Real-time + ML-ready This is what making hardware actually accessible looks like.
3:36

Touch was the missing sense in robotics But FlexiTac is here to change that. An open-source, low-cost, scalable tactile sensor that’s: • ~3 min to fabricate • ~$2.5 per unit • Real-time + ML-ready This is what making hardware actually accessible looks like.

Robots Digest 🤖

13,042 görüntüleme • 7 ay önce

In house tactile sensor prototype. Detects taps, motion, and multiple contact with force magnitudes. Built to be cheap, robust, and replaceable. Not in our demos yet, still WIP. We pair simple tactile sensing with torque transparent joints to recover rich contact without expensive sensors.
0:36

In house tactile sensor prototype. Detects taps, motion, and multiple contact with force magnitudes. Built to be cheap, robust, and replaceable. Not in our demos yet, still WIP. We pair simple tactile sensing with torque transparent joints to recover rich contact without expensive sensors.

Kyber Labs

39,735 görüntüleme • 7 ay önce

Tactile sensing is gaining traction, but slowly. Why? Because integration remains difficult. But what if adding touch sensors to your robot was as easy as hitting “print”? Introducing eFlesh: a 3D-printable, customizable tactile sensor. Shape it. Size it. Print it. 🧶👇
1:03

Tactile sensing is gaining traction, but slowly. Why? Because integration remains difficult. But what if adding touch sensors to your robot was as easy as hitting “print”? Introducing eFlesh: a 3D-printable, customizable tactile sensor. Shape it. Size it. Print it. 🧶👇

Raunaq Bhirangi

86,019 görüntüleme • 1 yıl önce

Can we bring human-like Touch to robots🤖? Introducing our CoRL work on 3D-ViTac. Humans rely on both vision 👁️ and touch 🫳 for complex tasks. With combined visual-tactile sensing, robots can now tackle challenging tasks, like precise in-hand reorientation, fragile objects grasping. Website: #Robotics #CoRL2024 #Touch #tactile #AI #ML
0:22

Can we bring human-like Touch to robots🤖? Introducing our CoRL work on 3D-ViTac. Humans rely on both vision 👁️ and touch 🫳 for complex tasks. With combined visual-tactile sensing, robots can now tackle challenging tasks, like precise in-hand reorientation, fragile objects grasping. Website: #Robotics #CoRL2024 #Touch #tactile #AI #ML

Binghao Huang

49,714 görüntüleme • 2 yıl önce

This robot explores the world like a mouse! 🐁 That's an OG project, guess the year ;) A mouse-inspired bot called WhiskEye travels the world with 24 artificial whiskers and spiking neurons that mimic a nervous system. Recognizing familiar places is essential for engineering applications like robot navigation, where interactions with the real world are key. Combining information from multiple senses helps to make better accuracy and robustness, but challenges like mismatched data and sensor errors complicate this process. Inspired by how animals navigate seamlessly, researchers developed predictive coding, a self-supervised learning method based on the brain's visual cortex model. It combines visual and tactile cues from a robot, outperforming existing methods in recognizing places, even when some sensors fail. What a great project from BristolRoboticsLab and Sheffield Robotics! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:34

This robot explores the world like a mouse! 🐁 That's an OG project, guess the year ;) A mouse-inspired bot called WhiskEye travels the world with 24 artificial whiskers and spiking neurons that mimic a nervous system. Recognizing familiar places is essential for engineering applications like robot navigation, where interactions with the real world are key. Combining information from multiple senses helps to make better accuracy and robustness, but challenges like mismatched data and sensor errors complicate this process. Inspired by how animals navigate seamlessly, researchers developed predictive coding, a self-supervised learning method based on the brain's visual cortex model. It combines visual and tactile cues from a robot, outperforming existing methods in recognizing places, even when some sensors fail. What a great project from BristolRoboticsLab and Sheffield Robotics! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

36,775 görüntüleme • 10 ay önce

1/🧠Humans are the best robot data source — but video alone misses one thing: force. 2/🙁Tactile gloves capture force — but they're costly and block the real touch manipulation depends on. 3/💪Maybe the future of touch lives on your wrist: surface EMG reads the muscles that cause force — tactile sensing without ever touching a tactile sensor. 4/🔥Want a fully open-source framework — hardware + software — to train your own force-aware learn-from-human-data robot policy? 🚀We introduce ForceBand: Learning Forceful Manipulation with sEMG -- bring force into human videos with sEMG, for force-aware manipulation ⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Force Beyond Vision ✦ Free-Hand Force Sensing ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Low-Cost & Easy-to-Implement Let's squeeze every bit of signal out of human data, and let robots feel the force! 🌐 Website: 📄 Paper: 💻 Code: 🎥 Video: 🧵 1/n
1:48

1/🧠Humans are the best robot data source — but video alone misses one thing: force. 2/🙁Tactile gloves capture force — but they're costly and block the real touch manipulation depends on. 3/💪Maybe the future of touch lives on your wrist: surface EMG reads the muscles that cause force — tactile sensing without ever touching a tactile sensor. 4/🔥Want a fully open-source framework — hardware + software — to train your own force-aware learn-from-human-data robot policy? 🚀We introduce ForceBand: Learning Forceful Manipulation with sEMG -- bring force into human videos with sEMG, for force-aware manipulation ⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Force Beyond Vision ✦ Free-Hand Force Sensing ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Low-Cost & Easy-to-Implement Let's squeeze every bit of signal out of human data, and let robots feel the force! 🌐 Website: 📄 Paper: 💻 Code: 🎥 Video: 🧵 1/n

Zhi (Leo) Wang@CoRL 2026

53,931 görüntüleme • 4 ay önce

20 Open-Source Humanoid Robots You Can Build Yourself | From $50 to $900 What if you could build your own humanoid robot without spending thousands of dollars? In this video, I explore 20 open-source and DIY humanoid robotics projects, ranked from 1 to 20. The list covers a wide range of budgets, from around $50 to $900 for an upper-body build. Some projects provide official 3D models, CAD files or assembled STEP models. Others do not have a complete, ready-to-use 3D model matching the robot shown in the video. For some entries, I arranged available components or created my own visual representations. The 3D models for projects 2, 8, 10 and 6 require verification. Some visuals may be reconstructions or assemblies rather than official models of the original robots. Please check the project documentation before treating any visual as an exact representation of the hardware. The 20 projects featured 1. RoboPrime | Around $60–100 A low-cost robotics project with an open-source design. 2. Open-source DIY humanoid builds A general category covering custom humanoid builds assembled from different hardware components. The humanoid shown is a generic 3D model created by me, not an official robot model. 3. Qmini | Price unconfirmed A compact robot project from Unitree Robotics. 4. Zowi | Around €100 A small educational robot associated with BQ. 5. Otto Humanoid / Otto DIY | From around $50 A DIY robotics platform. The final cost depends on the selected components and configuration. 6. Kayra | Price unconfirmed The visual combines official leg designs with additional components positioned by me. 7. PLEN2 | Around $499 for the kit A compact humanoid robot with published CAD files and walking-related software. 8. Nova Desktop Humanoid | Around $150 A desktop humanoid project by Daniel Hany. I positioned the available head and arm components myself in the 3D scene. 9. Bambot | Around $300 A low-cost robotics project with open-source design resources. 10. Rapiro | Around $390 A small humanoid robot designed by Shota Ishiwatari. The 3D reconstruction shown in the video requires verification against the original model. 11. Valera | Around $400 An open-source humanoid robotics project. 12. Reachy Mini Lite | Around $399 A compact robotics platform developed by Pollen Robotics in collaboration with Hugging Face. 13. Open Duck Mini | Under $400 An open-source bipedal robot project for robotics enthusiasts and developers. 14. MicroDuck | Around $399 A Pollen Robotics project with reinforcement-learning resources. 15. ROBOTIS MINI | Around $540 A compact humanoid platform associated with ROBOTIS components. 16. Halley | Around $500–800 An open-source robot project with 3D design resources. 17. Microban | Around $550–600 A robotics project associated with the Rhoban team at the University of Bordeaux. 18. Endeavor II | Around $600 A humanoid project with an assembled STEP model. 19. XLeRobot | Around $660 An open-source robotics project with accessible hardware designs. 20. InMoov | Around $900 for the upper body Created by Gaël Langevin, InMoov is a well-known 3D-printed humanoid robotics project. What I noticed while preparing this video The projects vary in price and in the amount of design information available. Some provide official 3D models and detailed mechanical files, while others need additional work to create a visual representation. The models shown for projects 2, 6, 8 and 10 need to be distinguished from verified official 3D assets. Check the original repositories and documentation for confirmation.
4:43

20 Open-Source Humanoid Robots You Can Build Yourself | From $50 to $900 What if you could build your own humanoid robot without spending thousands of dollars? In this video, I explore 20 open-source and DIY humanoid robotics projects, ranked from 1 to 20. The list covers a wide range of budgets, from around $50 to $900 for an upper-body build. Some projects provide official 3D models, CAD files or assembled STEP models. Others do not have a complete, ready-to-use 3D model matching the robot shown in the video. For some entries, I arranged available components or created my own visual representations. The 3D models for projects 2, 8, 10 and 6 require verification. Some visuals may be reconstructions or assemblies rather than official models of the original robots. Please check the project documentation before treating any visual as an exact representation of the hardware. The 20 projects featured 1. RoboPrime | Around $60–100 A low-cost robotics project with an open-source design. 2. Open-source DIY humanoid builds A general category covering custom humanoid builds assembled from different hardware components. The humanoid shown is a generic 3D model created by me, not an official robot model. 3. Qmini | Price unconfirmed A compact robot project from Unitree Robotics. 4. Zowi | Around €100 A small educational robot associated with BQ. 5. Otto Humanoid / Otto DIY | From around $50 A DIY robotics platform. The final cost depends on the selected components and configuration. 6. Kayra | Price unconfirmed The visual combines official leg designs with additional components positioned by me. 7. PLEN2 | Around $499 for the kit A compact humanoid robot with published CAD files and walking-related software. 8. Nova Desktop Humanoid | Around $150 A desktop humanoid project by Daniel Hany. I positioned the available head and arm components myself in the 3D scene. 9. Bambot | Around $300 A low-cost robotics project with open-source design resources. 10. Rapiro | Around $390 A small humanoid robot designed by Shota Ishiwatari. The 3D reconstruction shown in the video requires verification against the original model. 11. Valera | Around $400 An open-source humanoid robotics project. 12. Reachy Mini Lite | Around $399 A compact robotics platform developed by Pollen Robotics in collaboration with Hugging Face. 13. Open Duck Mini | Under $400 An open-source bipedal robot project for robotics enthusiasts and developers. 14. MicroDuck | Around $399 A Pollen Robotics project with reinforcement-learning resources. 15. ROBOTIS MINI | Around $540 A compact humanoid platform associated with ROBOTIS components. 16. Halley | Around $500–800 An open-source robot project with 3D design resources. 17. Microban | Around $550–600 A robotics project associated with the Rhoban team at the University of Bordeaux. 18. Endeavor II | Around $600 A humanoid project with an assembled STEP model. 19. XLeRobot | Around $660 An open-source robotics project with accessible hardware designs. 20. InMoov | Around $900 for the upper body Created by Gaël Langevin, InMoov is a well-known 3D-printed humanoid robotics project. What I noticed while preparing this video The projects vary in price and in the amount of design information available. Some provide official 3D models and detailed mechanical files, while others need additional work to create a visual representation. The models shown for projects 2, 6, 8 and 10 need to be distinguished from verified official 3D assets. Check the original repositories and documentation for confirmation.

Techniahqrobot | humanoid robots

33,960 görüntüleme • 12 gün önce

Introducing tactile skin sim-to-real for dexterous in-hand translation! We propose a simulation model for ReSkin, a magnetic tactile sensing skin. It can simulate ternary shear and binary normal forces. More:
0:38

Introducing tactile skin sim-to-real for dexterous in-hand translation! We propose a simulation model for ReSkin, a magnetic tactile sensing skin. It can simulate ternary shear and binary normal forces. More:

Haozhi Qi

33,562 görüntüleme • 2 yıl önce

The quadruped you can assemble yourself. Stella is an educational quadruped robot developed by Ahead. Designed for hands-on learning and self-assembly, the robot uses durable 3D-printed components. Ideal for all education levels, it is easy to repair, infinitely extendable, and equipped with advanced hardware and software. Despite its compact design, Stella is versatile, capable of operating in various environments and even carrying payloads like an optional robotic arm. A powerful tool for exploring robotics.
0:32

The quadruped you can assemble yourself. Stella is an educational quadruped robot developed by Ahead. Designed for hands-on learning and self-assembly, the robot uses durable 3D-printed components. Ideal for all education levels, it is easy to repair, infinitely extendable, and equipped with advanced hardware and software. Despite its compact design, Stella is versatile, capable of operating in various environments and even carrying payloads like an optional robotic arm. A powerful tool for exploring robotics.

Circuit

23,262 görüntüleme • 1 yıl önce

ManiFeel is a benchmark for contact-rich manipulation tasks. Force- and tactile-based tasks with occlusions and partially-observable state are going to be crucial for true general purpose robotics. Website:
0:20

ManiFeel is a benchmark for contact-rich manipulation tasks. Force- and tactile-based tasks with occlusions and partially-observable state are going to be crucial for true general purpose robotics. Website:

Chris Paxton

12,063 görüntüleme • 8 ay önce

❓I keep coming back to this: what tactile representation does manipulation need? We introduce PanoTac: A dense three-axis Tactile Sensor. In the demo, the robot reorients and inserts a tube, then wiggles the stopper free while the tube sits loosely in the rack. The right side show the tactile signals that helps robot detect when the stopper releases and when to switch from wiggling to lifting. (1/7)
0:29

❓I keep coming back to this: what tactile representation does manipulation need? We introduce PanoTac: A dense three-axis Tactile Sensor. In the demo, the robot reorients and inserts a tube, then wiggles the stopper free while the tube sits loosely in the rack. The right side show the tactile signals that helps robot detect when the stopper releases and when to switch from wiggling to lifting. (1/7)

Binghao Huang ✈️ CoRL

10,641 görüntüleme • 5 gün önce

Seeing touch without pressing down! 🫆 Most tactile sensors rely on deformation. Press down, deform the sensor, measure the deformation. But light contact, touching water, cream, soft films, doesn't deform anything. The sensor sees nothing. LightTact flips the approach. It uses optical detection instead. An ambient-blocking configuration suppresses external light and internal illumination everywhere except at actual contact points. Only scattered light from true contact gets through. The results? High-contrast raw images. Non-contact pixels stay near-black. Contact pixels show the natural appearance of whatever's touching. This works across material properties, contact forces, surface colors, and lighting conditions. Water, facial cream, thin films, liquids, all become visible the moment they touch. The sensor outputs spatially aligned visual-tactile images. Vision-language models can read them directly. Here's the paper: Changyi Lin and team - hats off ;) ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:47

Seeing touch without pressing down! 🫆 Most tactile sensors rely on deformation. Press down, deform the sensor, measure the deformation. But light contact, touching water, cream, soft films, doesn't deform anything. The sensor sees nothing. LightTact flips the approach. It uses optical detection instead. An ambient-blocking configuration suppresses external light and internal illumination everywhere except at actual contact points. Only scattered light from true contact gets through. The results? High-contrast raw images. Non-contact pixels stay near-black. Contact pixels show the natural appearance of whatever's touching. This works across material properties, contact forces, surface colors, and lighting conditions. Water, facial cream, thin films, liquids, all become visible the moment they touch. The sensor outputs spatially aligned visual-tactile images. Vision-language models can read them directly. Here's the paper: Changyi Lin and team - hats off ;) ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

207,951 görüntüleme • 3 ay önce

Sharpa Robotics just dropped a new hand video and the level keeps going up. This is the Sharpa Wave running WM Craftnet on a human scale fivefinger hand with 22 active DoF. The policy combines wrist depth, tactile sensing, proprioception and previous actions. The hand can rotate different objects in-hand, recover after external pushes and continue manipulating objects it was never trained on. The numbers are strong. 175/200 successful real-world rotation trials across 20 objects. A world-model prior trained on 9 objects was transferred to 49 new objects. Fall rate went from 6% to 0.3%. The Wave hardware itself has 22 actuators, up to 20 N fingertip force, 240×240 tactile sensing at up to 180 fps and 0.02 N pressure sensitivity. What caught my attention is the recovery behavior. The fingers keep changing contact points after the object slips or gets pushed instead of replaying the same finger motion. That is the kind of dexterity I want to see more of in robotic hands. According to Sharpa’s current specifications: • DTA tactile sensors on the fingers with a resolution of up to 240 × 240 • Pressure detection • Slip detection • Force change detection • Contact point localization • 6-axis force and torque measurement: Fx, Fy, Fz, Mx, My, Mz • Tactile sensing at up to 180 fps • 20 ms reported latency • Force detection range from 0 to 30 N • Maximum sensor load of 50 N • Sharpa also describes a miniature camera integrated into each fingertip for visuo-tactile sensing.
0:33

Sharpa Robotics just dropped a new hand video and the level keeps going up. This is the Sharpa Wave running WM Craftnet on a human scale fivefinger hand with 22 active DoF. The policy combines wrist depth, tactile sensing, proprioception and previous actions. The hand can rotate different objects in-hand, recover after external pushes and continue manipulating objects it was never trained on. The numbers are strong. 175/200 successful real-world rotation trials across 20 objects. A world-model prior trained on 9 objects was transferred to 49 new objects. Fall rate went from 6% to 0.3%. The Wave hardware itself has 22 actuators, up to 20 N fingertip force, 240×240 tactile sensing at up to 180 fps and 0.02 N pressure sensitivity. What caught my attention is the recovery behavior. The fingers keep changing contact points after the object slips or gets pushed instead of replaying the same finger motion. That is the kind of dexterity I want to see more of in robotic hands. According to Sharpa’s current specifications: • DTA tactile sensors on the fingers with a resolution of up to 240 × 240 • Pressure detection • Slip detection • Force change detection • Contact point localization • 6-axis force and torque measurement: Fx, Fy, Fz, Mx, My, Mz • Tactile sensing at up to 180 fps • 20 ms reported latency • Force detection range from 0 to 30 N • Maximum sensor load of 50 N • Sharpa also describes a miniature camera integrated into each fingertip for visuo-tactile sensing.

Techniahqrobot | humanoid robots

13,730 görüntüleme • 1 ay önce

Contact does not always deform surfaces, especially when interacting with liquids and soft objects. However, most existing tactile sensors rely on surface deformation to infer contact. Excited to share LightTact, a visual-tactile fingertip sensor that makes contact directly visible. It provides: - Deformation-Independent Sensing: contact is detected optically, not inferred from surface deformation. - High-Contrast Raw Images: non-contact pixels stay near-black. - Pixel-Level Contact Segmentation: robust across materials, forces, appearances, and external lighting conditions. This project was co-led with Boda ( Grateful to all co-authors for their contributions, and many thanks to Yuxiang Yang for the insightful discussions. We will present LightTact at RSS 2026 in Sydney next week! Paper: Open-source:
0:52

Contact does not always deform surfaces, especially when interacting with liquids and soft objects. However, most existing tactile sensors rely on surface deformation to infer contact. Excited to share LightTact, a visual-tactile fingertip sensor that makes contact directly visible. It provides: - Deformation-Independent Sensing: contact is detected optically, not inferred from surface deformation. - High-Contrast Raw Images: non-contact pixels stay near-black. - Pixel-Level Contact Segmentation: robust across materials, forces, appearances, and external lighting conditions. This project was co-led with Boda ( Grateful to all co-authors for their contributions, and many thanks to Yuxiang Yang for the insightful discussions. We will present LightTact at RSS 2026 in Sydney next week! Paper: Open-source:

Changyi Lin

65,715 görüntüleme • 4 ay önce