Загрузка видео...

Не удалось загрузить видео

На главную

Why create robot intelligence for just one hand, when we could have it learn from many? GEN-1, our latest embodied foundation model, now supports a broad range of end effectors from 5-finger hands, to specialized tools, and everything in between.

307,298 просмотров • 3 месяцев назад •via X (Twitter)

Комментарии: 32

Фото профиля Generalist
Generalist3 месяцев назад

Each hand is a different sensorimotor interface by which GEN-1 experiences the physical world. Scaling pretraining across thousands of these interfaces teaches GEN-1 a universal physical commonsense that transfers to new hands and new ways to grasp, push, pull, twist, and more.

Фото профиля Generalist
Generalist3 месяцев назад

Every hand is a different language for physical interaction. Just as training on multiple languages produces more capable LLMs, a model trained across embodiments can gather shared knowledge across instances and more readily separate what is specific to a hand from what is universal about the world.

Фото профиля Generalist
Generalist3 месяцев назад

Unlike humans, robots aren’t locked into the hands they’re born with. Machines can easily swap mechanical hands, and tool changers are common in automation. Switching between different end effectors to reach a goal can be viewed as a form of physical reasoning: using the right tool for the right job, much as multilingual chain-of-thought can improve LLM reasoning for downstream RL.

Фото профиля Generalist
Generalist3 месяцев назад

What happens when you change the hand mid-task? We tested this by modifying the hands mid-rollout and letting the same model keep running. It perceives the new tool, and finds a new trajectory and contact strategy to complete the task. This works because training on mixed data forces the model to condition its behavior on the hand in front of it. This brings it closer to a general understanding of how shapes and contact surfaces interact with the physical world – and which actuation strategy should follow.

Фото профиля Generalist
Generalist3 месяцев назад

Nature didn’t converge on just a single solution for manipulating the physical world. It exploded into millions. You can see this everywhere in the diversity of life around us: from the beak of a bird, to the trunk of an elephant, from the suction pads of an octopus, to the pollen baskets of a honeybee. The human hand is only a single point in a design space so large we’ve barely begun to map. For machines, five-fingered hands will just be one tool among many; limiting robots to only that would be a failure of imagination.

Фото профиля Generalist
Generalist3 месяцев назад

If we can build general intelligence that understands the underlying physics of interaction, then the shape of the hand becomes secondary to the intelligence that drives it. A suction pad, a gripper, a brush, a plasma welding nozzle – are all just different interfaces through which the same intelligence can reshape the physical world. The future of robot hands won’t look like ours. It will look more like a toolbox with a thousand hands: augmented, recombined, and scaled. Robots were always meant to extend what humans can do – to empower people to shape the physical world in places and at scales we never could before. Read more about our work at:

Фото профиля Xianyi Cheng
Xianyi Cheng3 месяцев назад

Great work! We have a low-cost, 3D-printed quick-swapping system build on a 1 DoF gripper that generalizes across everyday tools We can even attach it to a $7 hand :)

Фото профиля Lane Burgett
Lane Burgett3 месяцев назад

What about my excavator embodiment?

Фото профиля maru
maru3 месяцев назад

Gen-1 is Trillion time's better then figure toys

Фото профиля Mikhail
Mikhail3 месяцев назад

Amazing! We have our own quick change mechanism on our custom build bi-manual robot

Фото профиля John Dagdelen
John Dagdelen3 месяцев назад

Really cool stuff! One question, though. How does the model adjust the action space it outputs in real time when end effector changes? Does the system have to communicate to the model that an axis changed? For example, when gripper gets taped up.

Фото профиля Clawbrowser - Anti-Detect Browser for AI Agents
Clawbrowser - Anti-Detect Browser for AI Agents3 месяцев назад

finally an intern who can use both the browser and his hands

Фото профиля Ella Tech & Tool
Ella Tech & Tool3 месяцев назад

Smart move One brain, any hand. That's how you scale real robot dexterity.

Фото профиля Zane
Zane3 месяцев назад

More hands, more learning opportunities

Фото профиля Bblack
Bblack3 месяцев назад

One model, infinite hands 🤖 GEN-1 learning from all end effectors is huge

Фото профиля Akriti
Akriti3 месяцев назад

This is the future

Фото профиля Emma
Emma3 месяцев назад

If one policy can absorb a hand swap mid-rollout, embodiment starts looking like context rather than identity. The next leap is letting the robot choose and swap tools itself—turning hardware selection into inference-time reasoning.

Фото профиля SEAR
SEAR3 месяцев назад

single hand models are cool

Фото профиля Context
Context3 месяцев назад

The interesting metric isn’t how many end effectors it supports. It’s how much performance survives when you stop optimizing for just one.

Фото профиля Mi.lu.
Mi.lu.3 месяцев назад

OpenAI announced Project Camellia, a 3.2 GW data-center campus in Georgia. Construction is planned in phases from 2028 to 2032. OpenAI says it will cover the infrastructure costs, use closed-loop water systems, and fund $80M in local benefits. Those are firm commitments. Execution and local impact still need to be demonstrated. Source:

Фото профиля Lex
Lex3 месяцев назад

The many hands framing makes a lot of sense. Robots probably shouldn’t be forced into one human like hand design when different tasks need different tools.

Фото профиля Guillermo Duró
Guillermo Duró3 месяцев назад

This is awesome work

Фото профиля Nihal
Nihal3 месяцев назад

@huaijiangzhu So sick

Фото профиля Andy Wojcicki
Andy Wojcicki3 месяцев назад

that switch at ~1:00

Фото профиля ArtuR2 ⏩️⤴️
ArtuR2 ⏩️⤴️3 месяцев назад

@elonmusk buy them! 🙏🏼

Фото профиля Bela Becerra
Bela Becerra3 месяцев назад

incredible !!!

Фото профиля Sam W
Sam W3 месяцев назад

This is incredible. So I can apply this to robots I build? I am working on a cooking robot right now

Фото профиля Vivek Gopalan
Vivek Gopalan3 месяцев назад

@peteflorence akin to magic

Фото профиля Ramzi RAMZI
Ramzi RAMZI3 месяцев назад

Can startups use your models on there robots ??

Фото профиля Han
Han3 месяцев назад

Congratulations!

Фото профиля Julian Fried
Julian Fried3 месяцев назад

Very cool

Фото профиля Noor Tech
Noor Tech3 месяцев назад

GEN-1 learns from many, works with all

Похожие видео