Skip navigation
Introduce HumanPlus - Autonomous Skills part
0:00 / 0:46

Introduce HumanPlus - Autonomous Skills part

Zipeng Fu

@zipengfu13K followers

Visit on X
563 likesDownloadOriginal post

158,373 views

Introduce HumanPlus - Autonomous Skills part Humanoids are born for using human data. Imitating humans, our humanoid learns: - fold sweatshirts - unload objects from warehouse racks - diverse locomotion skills (squatting, jumping, standing) - greet another robot Open-sourced!

10 Comments

Comments from the original post on X (Twitter)

  • Zipeng Fu's profile picture

    @zipengfu

    We build our customized 33-DoF humanoid, and a data collection pipeline through real-time shadowing in the real world.

    24 likes

  • Zipeng Fu's profile picture

    @zipengfu

    Using the data collected through shadowing, we then perform supervised behavior cloning to train skill policies using egocentric vision. We introduce Humanoid Imitation Transformer. Based on ACT, HIT adds forward dynamics prediction on image feature space as a regularization.

    16 likes

  • Zipeng Fu's profile picture

    @zipengfu

    Compared to baselines, HIT uses - binocular vision, thus having implicit stereos for depth information - visual feedback better, avoiding overfitting to proprioception given small-sized demos

    8 likes

  • Zipeng Fu's profile picture

    @zipengfu

    Besides vision-based whole-body manipulation skills, our humanoid has strong locomotion skills: - outperforming H1 default standing controller under strong perturbation forces - enabling more whole-body skills like squatting and jumping

    6 likes

  • Zipeng Fu's profile picture

    @zipengfu

    This project is not possible without our team of experts, covering from computer graphics to robot learning to robot hardware: - co-leads: @qingqing_zhao_ @Qi_Wu577 - advisors: @chelseabfinn @GordonWetzstein project website: hardware: code:

    31 likes

  • Karol Hausman's profile picture

    @hausman_k

    Congrats @zipengfu !! 🎉

    2 likes

  • Yu Yang's profile picture

    @Yang_ML_Estate

    Pretty cool!

  • Joe Valentine's profile picture

    @SirSloppyJoe

    @DrDisrespect robodoc?

  • BotBot's profile picture

    @botbot_ai

    Wow! Incredible, is the demo unit the Unitree H1?

  • Ak's profile picture

    @LatentsExplored

    @heyjchu