Загрузка видео...
Не удалось загрузить видео
Introducing ✨RigidFormer: Learning Rigid Dynamics with Transformers - our attempt to scale learning-based physical dynamics with Transformers. RigidFormer learns rigid dynamics with Transformers. It is a mesh-free, object-centric Transformer for multi-object rigid-body contact dynamics from point clouds. Learning physics with purely neural simulators, without relying on traditional physics engines,... show more
582,402 просмотров • 5 месяцев назад •via X (Twitter)
Комментарии: 8

One direction we are especially excited about is extending this type of dynamics modeling with richer action conditioning (I showcased action-condition dynamics modeling for humanoid robots in the video). We believe that such object-centric neural dynamics models can serve as a useful building block for future world models, where physical interaction, control signals, and scene-level/object-level dynamics are learned jointly from observations in a scalable way.

Impressive work!

@GROS17121524 Thank you, Yushi!

Mesh free, object centric dynamics feels like a really important direction for scalable learned physics. Interesting that transformers are starting to compete with graph approaches here. How far do you think this can scale before physical consistency becomes harder to preserve?

Amazing work, physical understanding is the way forward

impressive!

@atasteoff Thanks, Shilong!

Impressive work!
