Loading video...

Video Failed to Load

Go Home

RoboMME Benchmarking and Understanding Memory for Robotic Generalist Policies paper:

_akhaliq's profile picture

AK

493,378 subscribers

11,808 views • 4 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Can we build a generalist robotic policy that doesn’t just memorize training data and regurgitate it during test time, but instead remembers past actions as memory and conditions its decisions on them?🤖💡 Introducing SAM2Act—a multi-view robotic transformer-based policy that integrates a visual foundation model with a memory architecture for robotic manipulation. Project page: 🧵👇
1:28

Can we build a generalist robotic policy that doesn’t just memorize training data and regurgitate it during test time, but instead remembers past actions as memory and conditions its decisions on them?🤖💡 Introducing SAM2Act—a multi-view robotic transformer-based policy that integrates a visual foundation model with a memory architecture for robotic manipulation. Project page: 🧵👇

Jiafei Duan

87,573 views • 1 year ago

🪞Symmetry helps shape RL policies. 🧠Can it also improve memory and task understanding? ✅We introduce Symmetry-Guided Memory Augmentation, combining structured experience augmentation with memory-based context inference to boost learning efficiency. 🔗
2:23

🪞Symmetry helps shape RL policies. 🧠Can it also improve memory and task understanding? ✅We introduce Symmetry-Guided Memory Augmentation, combining structured experience augmentation with memory-based context inference to boost learning efficiency. 🔗

Chenhao Li

14,863 views • 3 months ago

DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects abs: paper page:
0:27

DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects abs: paper page:

AK

17,554 views • 3 years ago

Diffusion Policies and VLAs with Formal Safety Guarantees🛡️ We just released our new paper: “From Demonstrations to Safe Deployment: Path-Consistent Safety Filtering for Diffusion Policies” 📑Paper: 🌐Website:
0:34

Diffusion Policies and VLAs with Formal Safety Guarantees🛡️ We just released our new paper: “From Demonstrations to Safe Deployment: Path-Consistent Safety Filtering for Diffusion Policies” 📑Paper: 🌐Website:

Learning Systems and Robotics Lab (is hiring!)

20,356 views • 8 months ago

We've solved another piece of the generalist gaming agent puzzle! Mario requires different skills than Pokemon: reactive navigation, spatial reasoning, and safe exploration rather than long-term memory and zero-sum reasoning. Check out our new paper on finetuning VLMs to beat Mario via PPO. 👇
0:43

We've solved another piece of the generalist gaming agent puzzle! Mario requires different skills than Pokemon: reactive navigation, spatial reasoning, and safe exploration rather than long-term memory and zero-sum reasoning. Check out our new paper on finetuning VLMs to beat Mario via PPO. 👇

Seth Karten

80,747 views • 2 months ago

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding
0:30

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding

AK

34,729 views • 11 months ago

We’re releasing the RoboArena today!🤖🦾 Fair & scalable evaluation is a major bottleneck for research on generalist policies. We’re hoping that RoboArena can help! We provide data, model code & sim evals for debugging! Submit your policies today and join the leaderboard! :) 🧵
1:27

We’re releasing the RoboArena today!🤖🦾 Fair & scalable evaluation is a major bottleneck for research on generalist policies. We’re hoping that RoboArena can help! We provide data, model code & sim evals for debugging! Submit your policies today and join the leaderboard! :) 🧵

Karl Pertsch

111,325 views • 1 year ago

Excited to share our new work: StreamingVLM! 🚀 We tackle a major challenge for Vision-Language Models (VLMs): understanding infinite video streams in real-time without latency blowing up or running out of memory. Paper: Code:
2:26

Excited to share our new work: StreamingVLM! 🚀 We tackle a major challenge for Vision-Language Models (VLMs): understanding infinite video streams in real-time without latency blowing up or running out of memory. Paper: Code:

Guangxuan Xiao

91,987 views • 8 months ago

Apple's AI Reasoning Model Paper Explained Apple’s disruptive new AI reasoning model research paper, “The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models” explained, and what it means for AGI.
3:22

Apple's AI Reasoning Model Paper Explained Apple’s disruptive new AI reasoning model research paper, “The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models” explained, and what it means for AGI.

Harper Carroll

37,956 views • 1 year ago

Surgeon uses robotic arm to fold paper crane during laparoscopic surgery practice
1:30

Surgeon uses robotic arm to fold paper crane during laparoscopic surgery practice

Historic Vids

32,981,308 views • 2 years ago

Generalist robots need a generalist evaluator. But how do you test safety without breaking things? 💥 🌎 Introducing our new work from Google DeepMind: Evaluating Gemini Robotics Policies in a Veo World Simulator 🧵👇
0:48

Generalist robots need a generalist evaluator. But how do you test safety without breaking things? 💥 🌎 Introducing our new work from Google DeepMind: Evaluating Gemini Robotics Policies in a Veo World Simulator 🧵👇

Anirudha Majumdar

238,689 views • 7 months ago

Today, we publicly released RoboCasa365, a large-scale simulation benchmark for training and systematically evaluating generalist robot models. Built upon our original RoboCasa framework, it offers: • 2,500 realistic kitchen environments; • 365 everyday tasks (basic skills + long-horizon mobile manipulation); • Over 3,200 objects with many articulated fixtures/appliances. All are designed for fully controlled, reproducible benchmarking of robotic policies. Progress in robotic foundation models is real. But it’s still hard to answer basic questions like: How close are we to general-purpose autonomy? What factors drive generalization? What are the model/data scaling curves like? Real-world eval is slow and noisy, and existing sims (like LIBERO, which we built 3 years ago) often lack sufficient task and scene diversity. This benchmark comes with 2,200+ hours of demonstrations and 500K+ trajectories to support studies of multi-task training, pretraining, and continual learning at scale. Check it out at
1:16

Today, we publicly released RoboCasa365, a large-scale simulation benchmark for training and systematically evaluating generalist robot models. Built upon our original RoboCasa framework, it offers: • 2,500 realistic kitchen environments; • 365 everyday tasks (basic skills + long-horizon mobile manipulation); • Over 3,200 objects with many articulated fixtures/appliances. All are designed for fully controlled, reproducible benchmarking of robotic policies. Progress in robotic foundation models is real. But it’s still hard to answer basic questions like: How close are we to general-purpose autonomy? What factors drive generalization? What are the model/data scaling curves like? Real-world eval is slow and noisy, and existing sims (like LIBERO, which we built 3 years ago) often lack sufficient task and scene diversity. This benchmark comes with 2,200+ hours of demonstrations and 500K+ trajectories to support studies of multi-task training, pretraining, and continual learning at scale. Check it out at

Yuke Zhu

23,849 views • 4 months ago

Introducing o3-mini for understanding arXiv papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references
0:22

Introducing o3-mini for understanding arXiv papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references

alphaXiv

66,598 views • 1 year ago

Introducing GPT OSS for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references
0:22

Introducing GPT OSS for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references

alphaXiv

29,502 views • 11 months ago

Introducing GLM-5.1 for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references
0:31

Introducing GLM-5.1 for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references

alphaXiv

31,002 views • 3 months ago

Introducing Grok 4 for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references
0:24

Introducing Grok 4 for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references

alphaXiv

88,392 views • 1 year ago

VLAs offer an avenue for generalist robot policies; however, naively following the action predictions leads to brittle or unsafe behaviours. We introduce VLAPS, which integrates model-based search with pre-trained VLA policies to improve performance without additional training.
0:30

VLAs offer an avenue for generalist robot policies; however, naively following the action predictions leads to brittle or unsafe behaviours. We introduce VLAPS, which integrates model-based search with pre-trained VLA policies to improve performance without additional training.

Glen Berseth

13,374 views • 10 months ago

Introducing Gemini 3 Flash for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references
0:30

Introducing Gemini 3 Flash for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references

alphaXiv

48,596 views • 6 months ago

Introducing Qwen 3 Reasoning for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references
0:33

Introducing Qwen 3 Reasoning for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references

alphaXiv

24,011 views • 11 months ago

Introducing GLM 5 Turbo for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references
0:29

Introducing GLM 5 Turbo for understanding research papers 🚀 Highlight any section of a paper to ask questions and “@” other papers for quick context, comparisons, and benchmark references

alphaXiv

23,384 views • 3 months ago