Skip navigation
introducing openego the largest opensource POV manipulation dataset 1107 hours, 120M frames, 290…
0:00 / 0:23

introducing openego the largest opensource POV manipulation dataset 1107 hours, 120M frames, 290…

ahad

@ahadj01.9K followers

Visit on X
309 likesDownloadOriginal post

44,008 views

introducing openego the largest opensource POV manipulation dataset 1107 hours, 120M frames, 290 tasks, 600+ environments task, language actions & 3D hand pose annotations we are collecting egocentric data at scale using AI glasses dm me if your interested in egocentric data

36 Comments

Comments from the original post on X (Twitter)

  • ahad's profile picture

    @ahadj0

    currently there is a gap in robotics world models, VLAs, VLMs, and imitation learning require data to generalize we introduce openego to address this the largest collection of open source egocentric footage with fine-grained language and hand joint annotations

    15 likes

  • ahad's profile picture

    @ahadj0

    paper: code: website:

    17 likes

  • ahad's profile picture

    @ahadj0

    also would like to thank @chris_j_paxton and @svlevine for their blog posts on robotic data that inspired this work and all the authors that open sourced their datasets that make up openego

    7 likes

  • Bercan's profile picture

    @bercankilic

    Wait a second so you didnt collect any new data ?

    8 likes

  • ahad's profile picture

    @ahadj0

    yup, two of the dataset included was by our lab @IRVLUTD we are trying to make one place for ego manipulation data similar to open x-embodiment where anyone can contribute

    4 likes

  • Bercan's profile picture

    @bercankilic

    @IRVLUTD Great initiative. I love it, but maybe in your post, make it clear it became only clear when reading the paper.

    5 likes

  • Alberto Hojel's profile picture

    @AlbyHojel

    0:10s “right thumb pushes the power button…” is actually index finger VLM captioning ain’t there yet 😓

    5 likes

  • ahad's profile picture

    @ahadj0

    Yup, suprisingly a lot of this little errors you can address them with a better prompt.

    2 likes

  • maxleedev's profile picture

    @maxleedev

    this is sick

    2 likes

  • ahad's profile picture

    @ahadj0

    thanks! was inspired by your post 😂😂

  • Bruno Santos🇵🇹's profile picture

    @brunoeducsant

    @YuXiang_IRVL @pablovelagomez1

    2 likes

  • Pranav Rapelli's profile picture

    @pranavr2x

    great stuff

    2 likes

  • Chuck Petras's profile picture

    @Chuck_Petras

    @BrianRoemmele

    1 like

  • Diann💎🌹's profile picture

    @DiannmayK

    @TheShamdoo 😈 Fade hype, but never fade MONSTA.

    1 like

  • ζ Pedram ζ's profile picture

    @zenstyle

    Very cool, this is the way towards Embodied AI

    1 like

  • ahad's profile picture

    @ahadj0

    Yup, I believe egocentric videos is the key to scaling robot foundation models

  • towerofshadow's profile picture

    @towerofshadow

    this looks sick ahad

    1 like

  • ahad's profile picture

    @ahadj0

    thanks!

  • James Han's profile picture

    @jvmeshan

    goat

    1 like

  • Avi's profile picture

    @avizn_

    so goated

    1 like