Skip navigation
How do we make dexterous hands handle both power and precision tasks with ease? 🫳👌🫰
0:00 / 0:37

How do we make dexterous hands handle both power and precision tasks with ease? 🫳👌🫰

Jianglong Ye

@jianglong_ye1.3K followers

Visit on X
386 likesDownloadOriginal post

110,823 views

How do we make dexterous hands handle both power and precision tasks with ease? 🫳👌🫰 We introduce Power to Precision (💪➡️🎯), our new paper that optimizes both control and fingertip geometry to unlock robust manipulation from power grasp to fine-grained manipulations. With simplified finger motions and augmented fingertips, the hand can perform diverse motions from pinching a nut🔩 to handling a pan🍳. Check the demos below🎥.

18 Comments

Comments from the original post on X (Twitter)

  • Jianglong Ye's profile picture

    @jianglong_ye

    The advantage of our method becomes even clearer when compared with the previous kinematics retargeting + original design baseline, both in teleoperation and in the policy trained with the teleoperation data🔥.

    54 likes

  • Jianglong Ye's profile picture

    @jianglong_ye

    We also validate our method in a zero-shot sim-to-real setting (no teleoperation). Check the following uncut continuous grasping videos and the comparison with our previous Dex1B🚀.

    13 likes

  • Jianglong Ye's profile picture

    @jianglong_ye

    Our method jointly optimizes control and fingertip geometry. Simple contact with parallel finger motions makes the resulting actions much more robust. The fingertip geometry is treated as a contact plane and optimized with a neural physics surrogate model ⚡

    19 likes

  • Jianglong Ye's profile picture

    @jianglong_ye

    This project is co-led by I and @laiiwei . Great collaboration with @LuccaChiang , Changwei Jing, @xyz2maureen , and @xiaolonw. Check our project page:

    12 likes

  • Cybernetic Labs's profile picture

    @cybernetic_lab

    This “Power to Precision” work shows how far we can go when we co-optimize the hand itself and the policy behind it. The gap between power tasks and fine manipulation is closing fast. Good work @jianglong_ye

    7 likes

  • Lai Wei's profile picture

    @laiiwei

    We will release our mesh & control design tomorrow! 🤗

    5 likes

  • Xueyan Zou's profile picture

    @xyz2maureen

    It is a great journey working on this project, especially we could see dex hand do real dexterous job : )

    3 likes

  • Nick K's profile picture

    @nicks_robots

    Interesting stuff. Personally, I think a squishy fingertip with a fingernail would be optimal for picking, similar to our own hands. I don't think anyone has really done that yet!

    2 likes

  • Chaitanya Chawla's profile picture

    @chaitanya1cha

    interesting work!

    2 likes

  • Chyna's profile picture

    @chynaqqq

    The co-design approach, which jointly optimizes fingertip geometry and control policy, is a brilliant way to overcome hardware limitations without requiring a complete redesign. What was the core inspiration for the simplified "thumb-index parallel motion" control strategy for precision tasks?

    1 like

  • Jianglong Ye's profile picture

    @jianglong_ye

    Love this. The thumb–index parallel motion strategy is simple and well aligned with common human precision grasps, and it is also what people often use in teleoperation practice.

  • SoloTech's profile picture

    @Solo__Tech

    This is the future of robot hands, one system that can lift a pan and pinch a nut.

    1 like

  • Leo Lin's profile picture

    @leo_lin6

    love the work, for the teleoperation do you guys use a webcam or vr? Thanks

    1 like

  • Jianglong Ye's profile picture

    @jianglong_ye

    We use VR (Vision Pro)

  • Zhengyi “Zen” Luo's profile picture

    @zhengyiluo

    Great work!!! Question: is the extra foam on the finger absolutely necessary?

    1 like

  • Jianglong Ye's profile picture

    @jianglong_ye

    Thanks! It depends on whether the original design of the hand is suitable for pinch or not. You can look at our comparison video. It is extremely hard for the original design to pinch the tiny nut. Even for larger objects like a marker pen, although it can be grasped with the original hand design, our experiments still show that a flatter contact area provides a more stable grasp.

    1 like

  • lahidhasan2008's profile picture

    @KingLahid

    Very nice 🤠

  • Lahid Hasan007's profile picture

    @gaminglahi10467

    Good for project