A good hand can push intelligence development. Introducing Eyesight Hand, equipped with full-hand high-res tactile sensors and proprioceptive actuators. It is compliant, agile, and powerful. Good tactile sensing makes learning more efficient and robust. Shout out to Branden!

For more details please visit

Very impressive work! Did you try providing the vision only model with torque data? It's obviously not as rich as tactile feedback, but I'm wondering how far it gets you. For tasks like cutting it seems like it might perform a lot better

That's a pretty good point. We didn't provide torque, but we would love to compare that in the next project. We are also curious about how far proprioception can take us.

One more question from reading it again today: do you expect GelSim(ple) to need to be calibrated between different hands? The images produced seem pretty clear, but don’t know how much variation the silicone casting process introduces

I don’t think it’s necessary though not validated by experiments. When we look at different sensors their images are almost the same, except that the printed dots are not aligned because they are hand made in lab.

Makes sense, definitely want to give these touch sensors a try at some point since it feels both accessible and very rich. Are they able to detect light touches? Like would it be able to grab an empty soda can without pushing it around much?

Yeah, definitely! I think some ppl showed berry picking with these kind of sensors

That’s great to hear; I’m very excited to try it out

Amazing concept and implementation for the tactical force sensing.

This is some fantastic work! Very exciting

Cool design!

Thanks Yuzhe!

how did I miss this?? It's so cool, Hao-Shu!

Thanks Huazhe!

I'm blown away by the Eyesight Hand's capabilities! What kind of applications do you see for this tech?