Загрузка видео...
Не удалось загрузить видео
Nvidia presents Robota-Embed: Unified VLA Embeddings for Robot In-Context Learning and Evolution proj: abs:
14,331 просмотров • 11 дней назад •via X (Twitter)
Комментарии: 10

Action belongs in the retrieval key: matched DROID clip R@1 drops 18.9 points without it, only 1.9 without vision. Same embedding then lifts frozen GPT-6 Astra from 24% to 68% across five ManiSkill tasks.

Does the unified embedding transfer across robot morphologies, or is it setup-specific?

Unified embeddings across vision, language, and action is the direction that finally makes robot in-context learning plausible — if a VLA can retrieve and adapt from demonstration embeddings the way LLMs retrieve documents, you get generalist robots without retraining per task. The bottleneck I keep seeing is embedding quality for long-horizon manipulation. Which result in the paper convinced you most: the in-context adaptation or the evolution part?

unified vla embeddings show promise in simulation but out of distribution adaptation in dynamic physical environments remains the true bottleneck

This could make robot adaptation much more practical

unified VLA embeddings for robot in-context learning is a big deal. robots learning from a few demos is the dream

Shared embeddings could make robot demos reusable across embodiments.

Robots getting in-context learning now, while I still reread the docs every single time.

The frozen-policy result makes memory quality the interesting variable. Is there an ablation that keeps memory size fixed and changes only whether failed executions are retained?

the embedding space is built on top of their GR00T foundation model, which means the unified representations already map across multiple robot embodiments from the start

