跳过导航
Robots assembling robot brain -- imagine this kind of robustness on every precision manufacturing…
0:00 / 1:39

Robots assembling robot brain -- imagine this kind of robustness on every precision manufacturing…

Deepak Pathak

@deepakpathak3.1万 位关注者

在 X 上查看
239 个赞下载原帖

46,392 次观看 #NVIDIAGTC

Robots assembling robot brain -- imagine this kind of robustness on every precision manufacturing line! Live demo of GPU rack assembly at #NVIDIAGTC: - end-to-end neural network (Skild Brain) finetuned with little data - memory to perform long horizon task (placing jigs, 16 screwes, removing jigs) - robust to disturbances and fast to set up - no fancy sensors, just off-the-shelf arms and cameras

13 条评论

评论来自 X (Twitter) 上的原帖

  • Jerry Chéng 的头像

    @thejerrycheng

    Super cool! But does it also generalize to other tool use? I feel this demo could also be achieved by non-learning methods using the classical robotics stack. Gripper and rigid attachment may not be good in the long run

    2 个赞

  • Deepak Pathak 的头像

    @deepakpathak

    Classical methods are no where close this kind of randomness and require <0.1mm precision sensing. As for transfer, same base model (Skild Brain) is operating across examples in this thread.

    5 个赞

  • Sherif Zaidan 的头像

    @SherifZaidan

    @chris_j_paxton Oh man, universal robot arms and RobotiQ grippers .. feels like 2012 all over again

    2 个赞

  • Deepak Pathak 的头像

    @deepakpathak

    @chris_j_paxton Haha.. unfortunately options are really scarce when you want to deploy something that can last 1000s of hrs without intervention. Do let me know if you have some good alternatives!

    2 个赞

  • JulianSaks 的头像

    @JulianSaks

    super impressive!

    1 个赞

  • Futuro Martinez 的头像

    @AIEnthusiastIM

    Robots assembling the very infrastructure powering AI! This precision and robustness with off-the-shelf components is game-changing for manufacturing scalability.

    1 个赞

  • Decent Cloud 的头像

    @DecentCloud_org

    Robots building GPU racks. The constraint shifted from assembly to allocation.

  • Pushkar 的头像

    @Pushkar11420566

    How much real-world finetuning data was needed to reach this level of robustness?

  • Weijie Wang 的头像

    @ZiMu983597

    live long-horizon task on off-the-shelf hardware is a genuine strength, but still an n≈1 capability demo—without success rates and disturbance metrics, "robust" is unearned.

  • 𓅋 𐎫𐎤𐎶 ‎ﷺ 的头像

    @yesitsarmin

    What model is this running, was it trained for this specific task?

  • Deepak Pathak 的头像

    @deepakpathak

    Skild Brain fine-tuned with little domain data. Same base model as all tasks in this thread:

    1 个赞

  • Flexa 的头像

    @flexarobotics

    "Finetuned with little domain data" is the key signal. The base model is doing the heavy lifting — the domain data just steers it. This is the same pattern as LLM fine-tuning. The bottleneck shifts from "how much data" to "what distribution of data" covers the long tail.

  • EDWARD (❖,❖) 的头像

    @edward_evm

    This robust robot brain demo looks cool for manufacturing 🦾