Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Open-source magnetic tactile sensor for $5! 🧲 Researchers introduced a magnetic tactile sensor that's low-cost, and easy to fabricate, democratizing tactile sensing for robotics. Operating in unstructured environments like homes and offices requires robots to sense forces during physical interaction. Yet the lack of a versatile, accessible tactile sensor...

lukas_m_ziegler's profile picture

Lukas Ziegler

56,537 subscribers

288,562 Aufrufe • vor 2 Monaten •via X (Twitter)

BildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Physical intelligence needs touch, not just vision. eFlesh is a fully 3D-printable magnetic tactile sensor that enables reliable slip detection and contact awareness on real robots, using low-cost hardware and scalable fabrication
1:00

Physical intelligence needs touch, not just vision. eFlesh is a fully 3D-printable magnetic tactile sensor that enables reliable slip detection and contact awareness on real robots, using low-cost hardware and scalable fabrication

Robots Digest 🤖

243,430 Aufrufe • vor 5 Monaten

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.
2:35

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.

AI at Meta

453,197 Aufrufe • vor 1 Jahr

A lot of hype around giving robots touch. That's the OG tactile sensing. FORCE. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:35

A lot of hype around giving robots touch. That's the OG tactile sensing. FORCE. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

216,800 Aufrufe • vor 1 Monat

Open-source dexterous hands with fingertip sensors! 🪬 ORCA Dexterity just released three dexterous hand models. Their mission: is to democratize robotic hand dexterity. They're sharing progress on exceptional, low-cost hardware and a software layer from low-level control to robotic hand learning. This is the open-source approach to dexterous manipulation. It has 83 taxels per finger with 0.1 N force detection which pretty is impressive for an open-source design. Tactile sensing is critical for dexterous manipulation, knowing contact forces enables gentle grasping, slip detection, and force-controlled assembly. Also 700g weight for the lite version makes it practical for mounting on robot arms without exceeding payload limits. Lower weight means faster movements and lower torque requirements. Open hardware accelerates robotics by letting researchers and builders modify designs for their specific needs without starting from scratch! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:20

Open-source dexterous hands with fingertip sensors! 🪬 ORCA Dexterity just released three dexterous hand models. Their mission: is to democratize robotic hand dexterity. They're sharing progress on exceptional, low-cost hardware and a software layer from low-level control to robotic hand learning. This is the open-source approach to dexterous manipulation. It has 83 taxels per finger with 0.1 N force detection which pretty is impressive for an open-source design. Tactile sensing is critical for dexterous manipulation, knowing contact forces enables gentle grasping, slip detection, and force-controlled assembly. Also 700g weight for the lite version makes it practical for mounting on robot arms without exceeding payload limits. Lower weight means faster movements and lower torque requirements. Open hardware accelerates robotics by letting researchers and builders modify designs for their specific needs without starting from scratch! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

38,036 Aufrufe • vor 4 Monaten

Touch was the missing sense in robotics But FlexiTac is here to change that. An open-source, low-cost, scalable tactile sensor that’s: • ~3 min to fabricate • ~$2.5 per unit • Real-time + ML-ready This is what making hardware actually accessible looks like.
3:36

Touch was the missing sense in robotics But FlexiTac is here to change that. An open-source, low-cost, scalable tactile sensor that’s: • ~3 min to fabricate • ~$2.5 per unit • Real-time + ML-ready This is what making hardware actually accessible looks like.

Robots Digest 🤖

12,982 Aufrufe • vor 3 Monaten

In house tactile sensor prototype. Detects taps, motion, and multiple contact with force magnitudes. Built to be cheap, robust, and replaceable. Not in our demos yet, still WIP. We pair simple tactile sensing with torque transparent joints to recover rich contact without expensive sensors.
0:36

In house tactile sensor prototype. Detects taps, motion, and multiple contact with force magnitudes. Built to be cheap, robust, and replaceable. Not in our demos yet, still WIP. We pair simple tactile sensing with torque transparent joints to recover rich contact without expensive sensors.

Kyber Labs

38,930 Aufrufe • vor 3 Monaten

Can we bring human-like Touch to robots🤖? Introducing our CoRL work on 3D-ViTac. Humans rely on both vision 👁️ and touch 🫳 for complex tasks. With combined visual-tactile sensing, robots can now tackle challenging tasks, like precise in-hand reorientation, fragile objects grasping. Website: #Robotics #CoRL2024 #Touch #tactile #AI #ML
0:22

Can we bring human-like Touch to robots🤖? Introducing our CoRL work on 3D-ViTac. Humans rely on both vision 👁️ and touch 🫳 for complex tasks. With combined visual-tactile sensing, robots can now tackle challenging tasks, like precise in-hand reorientation, fragile objects grasping. Website: #Robotics #CoRL2024 #Touch #tactile #AI #ML

Binghao Huang

49,500 Aufrufe • vor 1 Jahr

Tactile sensing is gaining traction, but slowly. Why? Because integration remains difficult. But what if adding touch sensors to your robot was as easy as hitting “print”? Introducing eFlesh: a 3D-printable, customizable tactile sensor. Shape it. Size it. Print it. 🧶👇
1:03

Tactile sensing is gaining traction, but slowly. Why? Because integration remains difficult. But what if adding touch sensors to your robot was as easy as hitting “print”? Introducing eFlesh: a 3D-printable, customizable tactile sensor. Shape it. Size it. Print it. 🧶👇

Raunaq Bhirangi

85,814 Aufrufe • vor 1 Jahr

This robot explores the world like a mouse! 🐁 That's an OG project, guess the year ;) A mouse-inspired bot called WhiskEye travels the world with 24 artificial whiskers and spiking neurons that mimic a nervous system. Recognizing familiar places is essential for engineering applications like robot navigation, where interactions with the real world are key. Combining information from multiple senses helps to make better accuracy and robustness, but challenges like mismatched data and sensor errors complicate this process. Inspired by how animals navigate seamlessly, researchers developed predictive coding, a self-supervised learning method based on the brain's visual cortex model. It combines visual and tactile cues from a robot, outperforming existing methods in recognizing places, even when some sensors fail. What a great project from BristolRoboticsLab and Sheffield Robotics! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:34

This robot explores the world like a mouse! 🐁 That's an OG project, guess the year ;) A mouse-inspired bot called WhiskEye travels the world with 24 artificial whiskers and spiking neurons that mimic a nervous system. Recognizing familiar places is essential for engineering applications like robot navigation, where interactions with the real world are key. Combining information from multiple senses helps to make better accuracy and robustness, but challenges like mismatched data and sensor errors complicate this process. Inspired by how animals navigate seamlessly, researchers developed predictive coding, a self-supervised learning method based on the brain's visual cortex model. It combines visual and tactile cues from a robot, outperforming existing methods in recognizing places, even when some sensors fail. What a great project from BristolRoboticsLab and Sheffield Robotics! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

36,775 Aufrufe • vor 6 Monaten

1/🧠Humans are the best robot data source — but video alone misses one thing: force. 2/🙁Tactile gloves capture force — but they're costly and block the real touch manipulation depends on. 3/💪Maybe the future of touch lives on your wrist: surface EMG reads the muscles that cause force — tactile sensing without ever touching a tactile sensor. 4/🔥Want a fully open-source framework — hardware + software — to train your own force-aware learn-from-human-data robot policy? 🚀We introduce ForceBand: Learning Forceful Manipulation with sEMG -- bring force into human videos with sEMG, for force-aware manipulation ⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Force Beyond Vision ✦ Free-Hand Force Sensing ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Low-Cost & Easy-to-Implement Let's squeeze every bit of signal out of human data, and let robots feel the force! 🌐 Website: 📄 Paper: 💻 Code: 🎥 Video: 🧵 1/n
1:48

1/🧠Humans are the best robot data source — but video alone misses one thing: force. 2/🙁Tactile gloves capture force — but they're costly and block the real touch manipulation depends on. 3/💪Maybe the future of touch lives on your wrist: surface EMG reads the muscles that cause force — tactile sensing without ever touching a tactile sensor. 4/🔥Want a fully open-source framework — hardware + software — to train your own force-aware learn-from-human-data robot policy? 🚀We introduce ForceBand: Learning Forceful Manipulation with sEMG -- bring force into human videos with sEMG, for force-aware manipulation ⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Force Beyond Vision ✦ Free-Hand Force Sensing ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Low-Cost & Easy-to-Implement Let's squeeze every bit of signal out of human data, and let robots feel the force! 🌐 Website: 📄 Paper: 💻 Code: 🎥 Video: 🧵 1/n

Zhi (Leo) Wang

49,050 Aufrufe • vor 16 Tagen

Introducing tactile skin sim-to-real for dexterous in-hand translation! We propose a simulation model for ReSkin, a magnetic tactile sensing skin. It can simulate ternary shear and binary normal forces. More:
0:38

Introducing tactile skin sim-to-real for dexterous in-hand translation! We propose a simulation model for ReSkin, a magnetic tactile sensing skin. It can simulate ternary shear and binary normal forces. More:

Haozhi Qi

33,513 Aufrufe • vor 2 Jahren

The quadruped you can assemble yourself. Stella is an educational quadruped robot developed by Ahead. Designed for hands-on learning and self-assembly, the robot uses durable 3D-printed components. Ideal for all education levels, it is easy to repair, infinitely extendable, and equipped with advanced hardware and software. Despite its compact design, Stella is versatile, capable of operating in various environments and even carrying payloads like an optional robotic arm. A powerful tool for exploring robotics.
0:32

The quadruped you can assemble yourself. Stella is an educational quadruped robot developed by Ahead. Designed for hands-on learning and self-assembly, the robot uses durable 3D-printed components. Ideal for all education levels, it is easy to repair, infinitely extendable, and equipped with advanced hardware and software. Despite its compact design, Stella is versatile, capable of operating in various environments and even carrying payloads like an optional robotic arm. A powerful tool for exploring robotics.

Circuit

23,215 Aufrufe • vor 1 Jahr

ManiFeel is a benchmark for contact-rich manipulation tasks. Force- and tactile-based tasks with occlusions and partially-observable state are going to be crucial for true general purpose robotics. Website:
0:20

ManiFeel is a benchmark for contact-rich manipulation tasks. Force- and tactile-based tasks with occlusions and partially-observable state are going to be crucial for true general purpose robotics. Website:

Chris Paxton

12,063 Aufrufe • vor 4 Monaten

ViTacFormer is a unified visuo-tactile framework for dexterous robot manipulation. It fuses high-res visual+tactile data using cross-attention and predicts future tactile signals via an autoregressive head, enabling multi-fingered hands to perform precise, long-horizon tasks.
2:18

ViTacFormer is a unified visuo-tactile framework for dexterous robot manipulation. It fuses high-res visual+tactile data using cross-attention and predicts future tactile signals via an autoregressive head, enabling multi-fingered hands to perform precise, long-horizon tasks.

The Humanoid Hub

10,816 Aufrufe • vor 1 Jahr

A bipedal humanoid robot covered entirely with tactile skin embedded with 18,000 sensors (115 degrees of freedom). 18,000 sensor skin…
1:17

A bipedal humanoid robot covered entirely with tactile skin embedded with 18,000 sensors (115 degrees of freedom). 18,000 sensor skin…

Brian Roemmele

71,044 Aufrufe • vor 2 Monaten

From Laptops to Robots. Lenovo has released Daystar - a six-legged hexapod robot designed for industrial, research, and educational use. The robot comes with advanced sensors for obstacle detection and environmental mapping. Its modular design also supports custom sensor attachments and programming, enabling it to adapt to tasks like inspections, surveillance, and robotics research.
0:58

From Laptops to Robots. Lenovo has released Daystar - a six-legged hexapod robot designed for industrial, research, and educational use. The robot comes with advanced sensors for obstacle detection and environmental mapping. Its modular design also supports custom sensor attachments and programming, enabling it to adapt to tasks like inspections, surveillance, and robotics research.

Circuit

39,376 Aufrufe • vor 1 Jahr

More beautiful robot hands. This one from Sharpa The hand uses what they call a Dynamic Tactile Array, meaning vision and touch work together and their SaTA (Spatially-anchored Tactile Awareness) algorithm. Each fingertip includes a mini camera and 1,000+ tactile pixels, hitting 0.005N pressure sensitivity. With 22 DOF and 6D force sensing, it can do everything from eggs to tools.
0:59

More beautiful robot hands. This one from Sharpa The hand uses what they call a Dynamic Tactile Array, meaning vision and touch work together and their SaTA (Spatially-anchored Tactile Awareness) algorithm. Each fingertip includes a mini camera and 1,000+ tactile pixels, hitting 0.005N pressure sensitivity. With 22 DOF and 6D force sensing, it can do everything from eggs to tools.

Rohan Paul

41,775 Aufrufe • vor 6 Monaten

At #CVPR2024: Tactile-augmented Radiance Fields! We probe a scene with a touch sensor and localize each sample within a NeRF. We use diffusion to estimate the tactile signals for the points we didn't touch. w/ Yiming Dou, Antonio Loquercio, Fengyu Yang, Yi Liu
0:34

At #CVPR2024: Tactile-augmented Radiance Fields! We probe a scene with a touch sensor and localize each sample within a NeRF. We use diffusion to estimate the tactile signals for the points we didn't touch. w/ Yiming Dou, Antonio Loquercio, Fengyu Yang, Yi Liu

Andrew Owens

38,616 Aufrufe • vor 2 Jahren

Tactile feedback is one of the most important modalities in manipulation, but has been underutilized in dexterous hands. T-Dex is a framework for learning dexterous policies from tactile play data, beating vision and torque-based methods by 1.7x. 🧵👇
0:55

Tactile feedback is one of the most important modalities in manipulation, but has been underutilized in dexterous hands. T-Dex is a framework for learning dexterous policies from tactile play data, beating vision and torque-based methods by 1.7x. 🧵👇

Lerrel Pinto

84,605 Aufrufe • vor 3 Jahren

Hands are the bridge for the emergence of intelligence. DM-Hand1, developed by Shenzhen DaimonRobotics, is a humanoid hand equipped with visual and tactile sensors, enabling robots to perceive any object and its changes and respond appropriately. This means humanoid robots equipped with this hand show strong potential in precision tasks, cluttered item sorting, and especially in service roles like elderly care.
1:08

Hands are the bridge for the emergence of intelligence. DM-Hand1, developed by Shenzhen DaimonRobotics, is a humanoid hand equipped with visual and tactile sensors, enabling robots to perceive any object and its changes and respond appropriately. This means humanoid robots equipped with this hand show strong potential in precision tasks, cluttered item sorting, and especially in service roles like elderly care.

CyberRobo

97,691 Aufrufe • vor 1 Jahr