introducing openego the largest opensource POV manipulation dataset 1107 hours, 120M frames, 290…
@ahadj01.9K followers
44,008 views
36 Comments
Comments from the original post on X (Twitter)

@ahadj0
currently there is a gap in robotics world models, VLAs, VLMs, and imitation learning require data to generalize we introduce openego to address this the largest collection of open source egocentric footage with fine-grained language and hand joint annotations
15 likes

@ahadj0
paper: code: website:
17 likes

@ahadj0
also would like to thank @chris_j_paxton and @svlevine for their blog posts on robotic data that inspired this work and all the authors that open sourced their datasets that make up openego
7 likes

@bercankilic
Wait a second so you didnt collect any new data ?
8 likes

@ahadj0
yup, two of the dataset included was by our lab @IRVLUTD we are trying to make one place for ego manipulation data similar to open x-embodiment where anyone can contribute
4 likes

@bercankilic
@IRVLUTD Great initiative. I love it, but maybe in your post, make it clear it became only clear when reading the paper.
5 likes

@AlbyHojel
0:10s “right thumb pushes the power button…” is actually index finger VLM captioning ain’t there yet 😓
5 likes

@ahadj0
Yup, suprisingly a lot of this little errors you can address them with a better prompt.
2 likes

@maxleedev
this is sick
2 likes

@ahadj0
thanks! was inspired by your post 😂😂

@brunoeducsant
@YuXiang_IRVL @pablovelagomez1
2 likes

@pranavr2x
great stuff
2 likes

@Chuck_Petras
@BrianRoemmele
1 like

@DiannmayK
@TheShamdoo 😈 Fade hype, but never fade MONSTA.
1 like

@zenstyle
Very cool, this is the way towards Embodied AI
1 like

@ahadj0
Yup, I believe egocentric videos is the key to scaling robot foundation models

@towerofshadow
this looks sick ahad
1 like

@ahadj0
thanks!

@jvmeshan
goat
1 like

@avizn_
so goated
1 like









