正在加载视频...

视频加载失败

Introducing GEN-0, our latest 10B+ foundation model for robots ⏱️ built on Harmonic Reasoning, new architecture that can think & act seamlessly 📈 strong scaling laws: more pretraining & model size = better 🌍 unprecedented corpus of 270,000+ hrs of dexterous data Read more 👇

501,471 次观看 • 1 年前 •via X (Twitter)

41 条评论

Generalist 的头像
Generalist1 年前

Surpassing the intelligence threshold 🧠 in the high-data regime for robotics, we observe a phase transition ⚡️ at 7B params where smaller models exhibit ossification under data overload, while larger ones continue to improve and can quickly adapt to new tasks.

Generalist 的头像
Generalist1 年前

Robotics at Generalist is no longer limited by data. GEN-0 is pretrained on our growing dataset of over 270,000 hrs of real, diverse manipulation data (10,000 hrs/week & accelerating). 1,000s of data collection devices/robots in homes, warehouses, and workplaces worldwide🏠🏭💼

Generalist 的头像
Generalist1 年前

We’ve developed a new approach to training models, Harmonic Reasoning, which creates a "harmonic" interplay between asynchronous, continuous-time streams of sensing and acting tokens. ⚙️🎵 Watch GEN-0 pack a camera. 🤖📸

Generalist 的头像
Generalist1 年前

GEN-0 models exhibit strong scaling laws, in which more pretraining data and compute consistently (and predictably) improve downstream post-training performance of the model across many tasks. 🔬📈🧠

Generalist 的头像
Generalist1 年前

📱Packing the phone into the box: here GEN-0 is tasked with gently packing a phone (including its accessory box) into a snug-fit retail box. Slotting in the phone, inserting the accessory box, flipping, and closing the lid, with all tight fits.

Generalist 的头像
Generalist1 年前

📦🧠🤖🔄 Packing unseen objects - this evaluates GEN-0's generalization and “physical commonsense": reasoning over the highly varied geometry and physics of new objects, nudging and reorienting, packing in differently depending on shape, pushing objects around to make space.

Generalist 的头像
Generalist1 年前

Cross-Embodiment – GEN-0 architecture works on different robots by design. We have tested our models on various 6DoF, 7DoF, and 16+DoF semi-humanoid robots.

Generalist 的头像
Generalist1 年前

To scale GEN-0 capabilities, we are constructing the largest and most diverse real-world manipulation dataset ever built 🌍 including every manipulation task humans can think of – from peeling potatoes, to threading bolts – spanning homes, bakeries, warehouses, factories, & more

Generalist 的头像
Generalist1 年前

Read more in our blog post, including early notes from large-scale ablations on our pretraining data. Blog:

Ted Xiao 的头像
Ted Xiao1 年前

Amazing results and very promising scaling laws!

Dan James 的头像
Dan James1 年前

These demos are, as always from Generalist, incredible. Would love to see more detail on Harmonic Reasoning since that seems like your alternative to PI's real time action chunking. That seems significant enough of an achievement that it warrants a writeup of its own!

avi 的头像
avi1 年前

Amazing work! Where'd you source 270k hours of dexterous data?

Grant 的头像
Grant1 年前

Are y’all planning on incorporating hands for more complex assembly or just focusing on grippers?

Eugene Mironov 的头像
Eugene Mironov1 年前

wow, 270k hours is a lot, what is ratio sim/real?

Tianxing Chen 的头像
Tianxing Chen1 年前

Extremely large data scale.

Jingjing Gong(龚经经) 的头像
Jingjing Gong(龚经经)1 年前

Impressive work, I am curious about how Harmonic Reasoning works? Anybody any clue?

Sandhya Venkatachalam 的头像
Sandhya Venkatachalam1 年前

Amazing advances for robotics- congrats to the team!

Carlos DP 🤖🇺🇸 的头像
Carlos DP 🤖🇺🇸1 年前

jesus guys

Jonathan Scholz 的头像
Jonathan Scholz1 年前

There's a *lot* to be impressed by in this post, but the biggest thing for me is their early commitment to a scalable data collection strategy (UMI-style in their case) This is how robotics 2.0 companies should be built

underscore advait patel 的头像
underscore advait patel1 年前

awesome results!

jade 的头像
jade1 年前

impressive work! any plans to open source this, or at least provide an api/sdk to train and evaluate the policy? how can the community independently verify the scaling/ossification and power-law claims beyond the blog demos ; e.g. public checkpoints, eval suites, or third-party benchmarks?

ruleta 的头像
ruleta1 年前

it looks conscious

Himanshu Kumar 的头像
Himanshu Kumar1 年前

Wow, impressive stuff, Generalist! That Harmonic Reasoning sounds like a game-changer for robots, no?

Pratik 的头像
Pratik1 年前

Incredible leap. GEN-0’s reasoning and massive dataset set a new bar for robot intelligence and autonomy!

Sumeet 🎒 的头像
Sumeet 🎒1 年前

The 7B phase transition is critical - it's showing us the minimum viable intelligence threshold for embodied learning. Below 7B: models exhibit ossification under diverse sensorimotor data. The weights can't absorb new patterns without catastrophic forgetting. Above 7B: continued scaling improvements. This is the first time we're seeing LLM-style scaling laws validated for robotics foundation models with this level of rigor. But Harmonic Reasoning is the real innovation here. It solves a fundamental problem: language models can "pause to think" because digital time is discrete. Robots can't - physics doesn't stop. Solution: asynchronous, continuous-time streams of sensing and acting tokens. The model doesn't do "perceive → reason → act" sequentially. It harmonizes all three in parallel, like how humans process visual input while simultaneously planning and executing motor commands. This is architecturally different from traditional VLA models that still operate in discrete time steps. GEN-0 treats sensorimotor control as a continuous process, enabling: - Sub-100ms reactive reflexes - Predictive control (act on expected state, not just current) - Multi-timescale reasoning (strategic + reactive simultaneously) 270K+ hours of dexterous data + strong scaling laws + continuous control architecture = the first deployment-ready foundation model for generalist robotics. Mann!! If this holds at scale, sequential action models will look as outdated as batch processing in a streaming world.

IsraelWorrior 的头像
IsraelWorrior1 年前

Very exciting to see the success of your model!

Anirudha Majumdar 的头像
Anirudha Majumdar1 年前

Congratulations on this exciting milestone!

Kol Tregaskes 的头像
Kol Tregaskes1 年前

👀

Ansar Ullah Anas 的头像
Ansar Ullah Anas1 年前

270k+ hours of dexterous data is wild. Getting that much high-quality, multimodal training data must’ve been a huge undertaking. Curious how it generalizes across different robot platforms.

super Lewis 的头像
super Lewis1 年前

Whoa, GEN-0 sounds like the robot version of Tony Stark! 🤖✨ Can't wait to see it in action!

Lực Đỗ 的头像
Lực Đỗ1 年前

Tuyệt vời quá đi. Đây là những gì chúng ta mong đợi. Nhưng nếu tay robot giống người thì sẽ nhanh hơn không ? Vì 2 ngón tay thấy lâu quá.

Parav 的头像
Parav1 年前

will models trained on this data scale to other embodiments? for example if you add more DOFs to the gripper or make it more anthropomorphic?

NexGen Cloud 的头像
NexGen Cloud1 年前

Huge leap forward for robotics 🤖

cedric 的头像
cedric1 年前

Ginormous dex data. Quality > quantity. How well do the results translate from sim to real-world non-clinical environment?

Robonchu 的头像
Robonchu1 年前

@grok Can you guess the name of their wrist camera?

Songcun,PhD 的头像
Songcun,PhD1 年前

Great time!

Richard 的头像
Richard1 年前

only up from here

Saquib Mehmood 的头像
Saquib Mehmood1 年前

OK @GeneralistAI you have convinced me through your serial posts. Let me try.

Min Chon Chi 的头像
Min Chon Chi1 年前

Harmonic Reasoning sounds like an interesting architecture.

youliang 的头像
youliang1 年前

Very cool work by the team, and insightful technical blog on scaling and ossification phenomena. 👏Scaling UMI data is one pragmatic approach i think 🤔

LaserEyeRobot 的头像
LaserEyeRobot1 年前

Who needs feet, anyway?

相关视频