Skip navigation
Introducing Open-World Mobile Manipulation 🦾🌍
0:00 / 1:28

Introducing Open-World Mobile Manipulation 🦾🌍

Haoyu Xiong

@Haoyu_Xiong_3.7K followers

Visit on X
743 likesDownloadOriginal post

169,888 views

Introducing Open-World Mobile Manipulation 🦾🌍 – A full-stack approach for operating articulated objects in open-ended unstructured environments: Unlocking doors with lever handles/ round knobs/ spring-loaded hinges 🔓🚪 Opening cabinets, drawers, and refrigerators 🗄️ 👇 Led by: @HaoyuXiong1 , Russell Mendonca , Kenny Shaw Deepak Pathak 1/n

10 Comments

Comments from the original post on X (Twitter)

  • Haoyu Xiong's profile picture

    @Haoyu_Xiong_

    Starting from a fixed set of demos on a fixed set of known objects, how do we deal with diverse unseen objects in the open world? Just keep adapting online! Our robot learns to operate new objects in under an hour via practice using RL, without requiring any new demos! 2/n

    11 likes

  • Haoyu Xiong's profile picture

    @Haoyu_Xiong_

    Realistic tasks like real-world door opening need good hardware: -- High payload for repeated interaction with real objects, e.g. a heavy, spring-loaded door, -- Agility to navigate around cluttered spaces. We provide low-cost hardware with around 25k USD 👇 3/n

    7 likes

  • Haoyu Xiong's profile picture

    @Haoyu_Xiong_

    We conducted a large field test around Carnegie Mellon Campus @SCSatCMU @CMU_Robotics to validate the effectiveness of our system. Our online adaptation framework improved the initial BC performance from 50% to 95%.

    11 likes

  • Ken Liu's profile picture

    @kenziyuliu

    @HaoyuXiong1 Congrats on the cool work!!

    4 likes

  • Haoyu Xiong's profile picture

    @Haoyu_Xiong_

    Thank you @kenziyuliu

    2 likes

  • Ted Xiao's profile picture

    @xiao_ted

    @HaoyuXiong1 Nice work!

    3 likes

  • Haoyu Xiong's profile picture

    @Haoyu_Xiong_

    thank you @xiao_ted

    2 likes

  • Simon Guo 🦝's profile picture

    @simonguozirui

    @HaoyuXiong1 @kenny__shaw Kenny this is so cool!! Great job!!

    2 likes

  • Karol Hausman's profile picture

    @hausman_k

    @HaoyuXiong1 Cool work, congrats!

    2 likes

  • Haoyu Xiong's profile picture

    @Haoyu_Xiong_

    Thank you ! @hausman_k

    1 like