How do we make dexterous hands handle both power and precision tasks with ease? 🫳👌🫰
@jianglong_ye1.3K followers
110,823 views
18 Comments
Comments from the original post on X (Twitter)

@jianglong_ye
The advantage of our method becomes even clearer when compared with the previous kinematics retargeting + original design baseline, both in teleoperation and in the policy trained with the teleoperation data🔥.
54 likes

@jianglong_ye
We also validate our method in a zero-shot sim-to-real setting (no teleoperation). Check the following uncut continuous grasping videos and the comparison with our previous Dex1B🚀.
13 likes

@jianglong_ye
Our method jointly optimizes control and fingertip geometry. Simple contact with parallel finger motions makes the resulting actions much more robust. The fingertip geometry is treated as a contact plane and optimized with a neural physics surrogate model ⚡
19 likes

@jianglong_ye
This project is co-led by I and @laiiwei . Great collaboration with @LuccaChiang , Changwei Jing, @xyz2maureen , and @xiaolonw. Check our project page:
12 likes

@cybernetic_lab
This “Power to Precision” work shows how far we can go when we co-optimize the hand itself and the policy behind it. The gap between power tasks and fine manipulation is closing fast. Good work @jianglong_ye
7 likes

@laiiwei
We will release our mesh & control design tomorrow! 🤗
5 likes

@xyz2maureen
It is a great journey working on this project, especially we could see dex hand do real dexterous job : )
3 likes

@nicks_robots
Interesting stuff. Personally, I think a squishy fingertip with a fingernail would be optimal for picking, similar to our own hands. I don't think anyone has really done that yet!
2 likes

@chaitanya1cha
interesting work!
2 likes

@chynaqqq
The co-design approach, which jointly optimizes fingertip geometry and control policy, is a brilliant way to overcome hardware limitations without requiring a complete redesign. What was the core inspiration for the simplified "thumb-index parallel motion" control strategy for precision tasks?
1 like

@jianglong_ye
Love this. The thumb–index parallel motion strategy is simple and well aligned with common human precision grasps, and it is also what people often use in teleoperation practice.

@Solo__Tech
This is the future of robot hands, one system that can lift a pan and pinch a nut.
1 like

@leo_lin6
love the work, for the teleoperation do you guys use a webcam or vr? Thanks
1 like

@jianglong_ye
We use VR (Vision Pro)

@zhengyiluo
Great work!!! Question: is the extra foam on the finger absolutely necessary?
1 like

@jianglong_ye
Thanks! It depends on whether the original design of the hand is suitable for pinch or not. You can look at our comparison video. It is extremely hard for the original design to pinch the tiny nut. Even for larger objects like a marker pen, although it can be grasped with the original hand design, our experiments still show that a flatter contact area provides a more stable grasp.
1 like

@KingLahid
Very nice 🤠

@gaminglahi10467
Good for project