Loading video...

Video Failed to Load

Go Home

Announcing Robostral Navigate, our first model for embodied navigation: an 8B robotics navigation model that guides robots to autonomously perform tasks specified with natural language. Single RGB camera. State-of-the-art on R2R-CE.

MistralAI's profile picture

Mistral AI

198,962 subscribers

196,906 views • 19 hours ago •via X (Twitter)

Science & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

DEEP Robotics launches DeepVLA 1.0, a breakthrough embodied navigation system! 🔹 Real-time semantic target extraction 🔹 “Door-to-door” navigation via topological maps 🔹 Dynamic obstacle avoidance Taking embodied robots from demo to real life!
2:58

DEEP Robotics launches DeepVLA 1.0, a breakthrough embodied navigation system! 🔹 Real-time semantic target extraction 🔹 “Door-to-door” navigation via topological maps 🔹 Dynamic obstacle avoidance Taking embodied robots from demo to real life!

DEEP Robotics

29,114 views • 8 months ago

One more thing 🚀 Qwen’s agentic capability is no longer limited to the digital world — we’re bringing it into physical world. With our in-house robotic agentic system and navigation model, Qwen can now control a robot to execute tasks in real-world. #qwen #embodied #robotics
1:16

One more thing 🚀 Qwen’s agentic capability is no longer limited to the digital world — we’re bringing it into physical world. With our in-house robotic agentic system and navigation model, Qwen can now control a robot to execute tasks in real-world. #qwen #embodied #robotics

xiong-hui (barry) chen

24,907 views • 1 month ago

We’re bringing powerful AI directly onto robots with Gemini Robotics On-Device. 🤖 It’s our first vision-language-action model to help make robots faster, highly efficient, and adaptable to new tasks and environments - without needing a constant internet connection. 🧵
0:35

We’re bringing powerful AI directly onto robots with Gemini Robotics On-Device. 🤖 It’s our first vision-language-action model to help make robots faster, highly efficient, and adaptable to new tasks and environments - without needing a constant internet connection. 🧵

Google DeepMind

819,309 views • 1 year ago

Big thanks to AK for highlighting our work! LEO marks our pioneering step towards building an embodied generalist agent that can really comprehend the 3D world! 🚀Leveraging LLMs, we train LEO with real and synthetic 3D data across a diverse spectrum of tasks. It's thrilling to see LEO surpass current state-of-the-art SOTA methods in most benchmarked tasks, all under a single, unified model. 🔥 #Generalist_Agent
1:00

Big thanks to AK for highlighting our work! LEO marks our pioneering step towards building an embodied generalist agent that can really comprehend the 3D world! 🚀Leveraging LLMs, we train LEO with real and synthetic 3D data across a diverse spectrum of tasks. It's thrilling to see LEO surpass current state-of-the-art SOTA methods in most benchmarked tasks, all under a single, unified model. 🔥 #Generalist_Agent

Siyuan Huang

22,710 views • 2 years ago

Best Systems Paper finalist at #RSS2025 🚀 Excited to share our work on a perceptive forward dynamics model for safe, platform-aware navigation. 📄 🌐 #Robotics #Planning #RSS
1:02

Best Systems Paper finalist at #RSS2025 🚀 Excited to share our work on a perceptive forward dynamics model for safe, platform-aware navigation. 📄 🌐 #Robotics #Planning #RSS

Robotic Systems Lab

15,089 views • 1 year ago

We got our robots to wash pans, clean windows, make peanut butter sandwiches, and more! Fine-tuning our latest model enables all of these tasks, and this has interesting implications for robotics, Moravec's paradox, and the future of large models in embodied AI. More below!
1:12

We got our robots to wash pans, clean windows, make peanut butter sandwiches, and more! Fine-tuning our latest model enables all of these tasks, and this has interesting implications for robotics, Moravec's paradox, and the future of large models in embodied AI. More below!

Physical Intelligence

542,687 views • 6 months ago

We just open-sourced G0 Plus VLA model & launched "Pick Up Anything" demo. See our robot perform diverse real-world tasks through pure language. No specialized training needed. That's zero-shot embodied intelligence. #VLA #Robotics #OpenSource 🔗Try now：
3:21

We just open-sourced G0 Plus VLA model & launched "Pick Up Anything" demo. See our robot perform diverse real-world tasks through pure language. No specialized training needed. That's zero-shot embodied intelligence. #VLA #Robotics #OpenSource 🔗Try now：

Galaxea Dynamics

98,822 views • 6 months ago

New paper introduces NaVILA, a vision-language-action (VLA) model that integrates high-level visual-language understanding and low-level locomotion control. It enables humanoid or quadruped robots to navigate unseen environments with natural language instructions.
0:45

New paper introduces NaVILA, a vision-language-action (VLA) model that integrates high-level visual-language understanding and low-level locomotion control. It enables humanoid or quadruped robots to navigate unseen environments with natural language instructions.

The Humanoid Hub

20,458 views • 1 year ago

Anyone skeptical about AI’s ability to perform diverse physical tasks should watch this. Physical Intelligence's π₀ model in action: 18 minutes of bimanual robots autonomously handling complex, dexterous chores.
18:06

Anyone skeptical about AI’s ability to perform diverse physical tasks should watch this. Physical Intelligence's π₀ model in action: 18 minutes of bimanual robots autonomously handling complex, dexterous chores.

The Humanoid Hub

210,404 views • 1 year ago

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️
0:31

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️

Ted Xiao

152,423 views • 1 year ago

We are excited to share new experiments with AgiBot @AgiBot_zhiyuan on multi-task, multi-embodiment VLAs! With one model that can perform many tasks with both two-finger grippers and multi-fingered hands, we take another step toward one model for all robots and tasks.
3:15

We are excited to share new experiments with AgiBot @AgiBot_zhiyuan on multi-task, multi-embodiment VLAs! With one model that can perform many tasks with both two-finger grippers and multi-fingered hands, we take another step toward one model for all robots and tasks.

Physical Intelligence

75,796 views • 1 year ago

🤖⚡️ UBTECH Robotics Walker S now integrates with Baidu’s ERNIE via AppBuilder. Experience the future where robots understand natural language and interact with people, autonomously handling complex tasks like folding clothes and object sorting. #AI #ERNIE #BaiduCreate2024
2:30

🤖⚡️ UBTECH Robotics Walker S now integrates with Baidu’s ERNIE via AppBuilder. Experience the future where robots understand natural language and interact with people, autonomously handling complex tasks like folding clothes and object sorting. #AI #ERNIE #BaiduCreate2024

Baidu Inc.

15,478 views • 2 years ago

Happy to share our new work on Navigation World Models! 🔥🔥 Navigation is a fundamental skill of agents with visual-motor capabilities. We train a single World Model across multiple environments and diverse agent data. w/ Gaoyue Zhou, Danny Tran, trevordarrell and Yann LeCun.
1:01

Happy to share our new work on Navigation World Models! 🔥🔥 Navigation is a fundamental skill of agents with visual-motor capabilities. We train a single World Model across multiple environments and diverse agent data. w/ Gaoyue Zhou, Danny Tran, trevordarrell and Yann LeCun.

Amir Bar

83,539 views • 1 year ago

Announcing multi-story autonomous navigation. Out of the box on ANY robot. Single pip install. Open source.
0:22

Announcing multi-story autonomous navigation. Out of the box on ANY robot. Single pip install. Open source.

stash

89,901 views • 8 months ago

Exciting progress on Vision-Language-Action models from a collaboration between San Francisco-based Physical Intelligence (π) and China’s AGIBOT: (π)’s single model can autonomously perform diverse tasks on the AGIBOT G1 robot, using both humanoid hands and two-finger grippers.
3:12

Exciting progress on Vision-Language-Action models from a collaboration between San Francisco-based Physical Intelligence (π) and China’s AGIBOT: (π)’s single model can autonomously perform diverse tasks on the AGIBOT G1 robot, using both humanoid hands and two-finger grippers.

The Humanoid Hub

32,575 views • 1 year ago

Qwen-VLA feels like one of the first real robotics foundation models. A single system trained across robot manipulation, navigation, egocentric human video, simulation, and vision-language reasoning instead of isolated robot policies.
2:52

Qwen-VLA feels like one of the first real robotics foundation models. A single system trained across robot manipulation, navigation, egocentric human video, simulation, and vision-language reasoning instead of isolated robot policies.

Robots Digest 🤖

14,663 views • 1 month ago

Very excited to share our first public release after I joined Robbyant! We present Lingbot-Depth 👀 — a state-of-the-art depth foundation model trained with RGB-D MAE on millions of real & simulated RGBD pairs. 🔹 Camera depths as natural masks for RGB-D MAE modeling 🔹 Large-scale real + sim RGBD data curation pipeline What surprised us most: ✨ Significant improvement on transparent, reflective surfaces, and thin structures — traditionally the hardest cases for depth models. 👇These are some of hard causal-capture images we tested on. The results are pretty good! #DepthEstimation #FoundationModels #EmbodiedAI #3DVision #Robotics #RobbyAnt
0:34

Very excited to share our first public release after I joined Robbyant! We present Lingbot-Depth 👀 — a state-of-the-art depth foundation model trained with RGB-D MAE on millions of real & simulated RGBD pairs. 🔹 Camera depths as natural masks for RGB-D MAE modeling 🔹 Large-scale real + sim RGBD data curation pipeline What surprised us most: ✨ Significant improvement on transparent, reflective surfaces, and thin structures — traditionally the hardest cases for depth models. 👇These are some of hard causal-capture images we tested on. The results are pretty good! #DepthEstimation #FoundationModels #EmbodiedAI #3DVision #Robotics #RobbyAnt

Yinghao Xu

22,574 views • 5 months ago

🚀 Meta FAIR is releasing several new research artifacts on our road to advanced machine intelligence (AMI). These latest advancements are transforming our understanding of perception. 1️⃣ Meta Perception Encoder: A large-scale vision encoder that excels across several image & video tasks. 2️⃣ Meta Perception Language Model: A fully open & reproducible vision-language model designed to tackle visual recognition tasks. 3️⃣ Meta Locate 3D: An end-to-end model for accurate object localization in 3D environments. 4️⃣ Releasing model weights for our 8B-parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. 5️⃣Collaborative Reasoner: A framework for evaluating & improving collaborative reasoning skills in language models. Download the code, datasets, and research papers and learn more about how these artifacts are paving the way for more efficient and accurate AI systems.➡️
2:10

🚀 Meta FAIR is releasing several new research artifacts on our road to advanced machine intelligence (AMI). These latest advancements are transforming our understanding of perception. 1️⃣ Meta Perception Encoder: A large-scale vision encoder that excels across several image & video tasks. 2️⃣ Meta Perception Language Model: A fully open & reproducible vision-language model designed to tackle visual recognition tasks. 3️⃣ Meta Locate 3D: An end-to-end model for accurate object localization in 3D environments. 4️⃣ Releasing model weights for our 8B-parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. 5️⃣Collaborative Reasoner: A framework for evaluating & improving collaborative reasoning skills in language models. Download the code, datasets, and research papers and learn more about how these artifacts are paving the way for more efficient and accurate AI systems.➡️

AI at Meta

163,214 views • 1 year ago

With about an hour of training you will be able to set up your Stretch to perform tasks around the home. Here: navigation and end-to-end door opening via Diffusion Policy.
1:23

With about an hour of training you will be able to set up your Stretch to perform tasks around the home. Here: navigation and end-to-end door opening via Diffusion Policy.

Chris Paxton

14,306 views • 1 year ago