正在加载视频...

视频加载失败

MINT is now open source. From first-person RGB video, MINT reconstructs 3D camera trajectories and bimanual hand motion in a shared world coordinate system. Reconstructed human hand motion can also be retargeted to WUJI Hand. The release includes model weights, training and inference code, visualization and evaluation tools, EgoPipeline...

22,157 次观看 • 3 天前 •via X (Twitter)

4 条评论

安叫兽|Bird🕊️ 🔶 BNB 的头像
安叫兽|Bird🕊️ 🔶 BNB3 天前

这下第一视角到灵巧手动作,整条链路算是接上了

Paige 的头像
Paige3 天前

curious if you have trained some open weighted models on this dataset and what's the marginal improvement result?

Armeen 的头像
Armeen3 天前

Reconstructing trajectories and hand motion is a useful bridge from egocentric video to control; it does not by itself establish reliability across hours of varied interactions. The long-tail behavior is usually the more informative test.

Marius Laurusevicius 的头像
Marius Laurusevicius3 天前

1,021 hours across 560,649 episodes averages about 6.6 seconds per episode. Is that the intended clip length? And is the license on the annotations the same as on the code and weights? Ego datasets often split those.

相关视频