Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Tactile Diffusion generates synthetic tactile images from sim data, capturing the complex illumination of the gel deformation. This research from UW & Meta AI is the first method using diffusion to close the sim2real gap for vision-based tactile sensing. Read the paper ⬇️

100,159 Aufrufe • vor 3 Jahren •via X (Twitter)

6 Kommentare

Profilbild von FreddieK888
FreddieK888vor 3 Jahren

#iExec's decentralized infrastructure can provide Meta with a secure platform for deploying their #NFTs and #metaverse applications. This can help to ensure that the applications are resistant to attacks and can provide a better user experience. $RLC

Profilbild von a(b)
a(b)vor 3 Jahren

@freecs_org

Profilbild von 🌹KINGof KINGS🌹LORD of LORDS🌹IAM🌹🦁🌹WHO IAM🌹
🌹KINGof KINGS🌹LORD of LORDS🌹IAM🌹🦁🌹WHO IAM🌹vor 3 Jahren

@ylecun IAMazing🌹 🌹🕊️🦁🔥🔥🔥

Profilbild von Lucid Scientific, Inc.
Lucid Scientific, Inc.vor 1 Jahr

Expand the possibilities of your metabolic research. Resipher tracks real-time cellular oxygen consumption in standard 96-well plates, delivering continuous real-time data directly from your incubator. Request a free virtual demo or quote today >>

Profilbild von Quick AI News
Quick AI Newsvor 3 Jahren

Wow! This is incredible! This research is a major step forward in closing the sim2real gap for vision-based tactile sensing. Exciting times ahead for AI!

Profilbild von AI at Meta
AI at Metavor 1 Jahr

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

Ähnliche Videos

I was really impressed by the UMI gripper (Cheng Chi et al.), but a key limitation is that **force-related data wasn’t captured**: humans feel haptic feedback through the mechanical springs, but the robot couldn’t leverage that info, limiting the data’s value for fine-grained manipulation tasks. Led by my amazing students Yolanda Zhu and Binghao Huang, we designed a **portable visuo-tactile gripper** by integrating our dense, flexible tactile arrays with the UMI gripper to enable large-scale in-the-wild data collection. 🔗 We demonstrate **cross-modal representation learning** and **downstream policy learning** on tasks requiring in-hand state estimation (e.g., test tube reorientation) and fine-grained force sensing (e.g., pipette fluid transfer). Key takeaways: - Our flexible tactile arrays store the rich haptic information humans perceive as dense tactile signals. - Portability and robustness are key for in-the-wild data collection; our portable gripper is compact, lightweight, and durable. - Touch provides precise, robust measurements of in-hand object pose, invariant to lighting and viewpoint. - Cross-modal pretraining on large-scale in-the-wild data significantly improves policy robustness and sample efficiency (as shown many times before — and verified again here!). Also check out our previous investigations of dense, flexible tactile grids for understanding human-robot-environment interactions: - Dense tactile glove (Nature ’19): - 3D-ViTac (CoRL ’24):

Yunzhu Li

13,188 Aufrufe • vor 1 Jahr