Skip navigation
What is the best data for training humanoid & robotics foundation models?
0:00 / 7:06

What is the best data for training humanoid & robotics foundation models?

Michelle Sun

@michellelsun12K followers

Visit on X
109 likesDownloadOriginal post

15,483 views

What is the best data for training humanoid & robotics foundation models? Pete Florence Pete Florence (CEO Eric Nehrlich, ex-Google DeepMind) dropped his live data tier list in this 7-minute clip on TBPN: - S-tier: Real-world robot experience (especially glove/sensor high-dexterity data) - A/B-tier: Internet/YouTube videos. Surprisingly powerful for transfer learning (the “web data” moment for physical AI) - B-tier: Text/common crawl (Reddit, books, etc.). Useful priors, but not enough alone - C-tier: Motion Capture. Great for whole-body motion, weak on finger dexterity - C or lower: Simulation / synthetic / world models. High potential, still waiting for strong real-world proof Generalist has collected 270,000+ hours of real-world manipulation data (scaling ~10k hours/week). And Pete stressed one key point: “The quality of data is incredibly important.” It’s not just about volume. It’s developing intuition for what actually drives performance through hands-on work. As Physical AI scales, curated real-world and high-quality internet video looks like a winning combo. h/t YUJI | AI Robotics

6 Comments

Comments from the original post on X (Twitter)

  • PrismaX's profile picture

    @PrismaXai

    @peteflorence @generalist @tbpn Real-world robot experience at S-tier is exactly right. The bottleneck was never the model. It was always the data layer.

    8 likes

  • ManUdata.ai's profile picture

    @Manudata_ai

    @peteflorence @generalist @tbpn Thats exactly what we are solving.

    1 like

  • Jason傑森 🇭🇰 | 🛠️'s profile picture

    @cheuk_baby

    @peteflorence @generalist @tbpn 有意思,B级视频挺強的。

    1 like

  • John Marbach's profile picture

    @jmarbach

    @peteflorence @generalist @tbpn Getting data off the sensors is the first step to training with it. For this there’s @hubble_network

  • Léo's profile picture

    @LeoKharon

    @peteflorence @generalist @tbpn What about @PrismaXai 's recently released standard for data? It argues that most exisitng robotics dataset do not meet the quality standards required in order to be useful

  • Nurvai - The Data Layer for Physical AI's profile picture

    @nurvai_ai

    @peteflorence @generalist @tbpn The quality point is key. Scaling physical AI will require more than collecting massive datasets. The real challenge is capturing the interactions and edge cases that create robust robot behavior.