Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Zero-shot fully autonomous drone flight from our scaled embodied foundation models (internal world model, embodied reasoning, direct control all in one)

Armen Aghajanyan

16,375 subscribers

20,746 views • 19 days ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

9 Comments

Jonathan Santilli19 days ago

This is beyond cool

Armen Aghajanyan19 days ago

Thanks!

Koustuv Sinha19 days ago

this is amazing 🤩

random guy passing by life18 days ago

What’s preventing it from going upwards until its surrounding is fully cleared?

Jeemit Patel19 days ago

Amazing !! I have a use case I need to try this with .

Armen Aghajanyan19 days ago

likely not releasing harness/code for drone control anytime soon but if you have a prompt you want me to try i can try it

Maclaine18 days ago

Hope we get to play with it ourselves eventually

فرنگ باز18 days ago

Nice bro! Whats the hardware?

Prasant Atluri18 days ago

Wow

Related Videos

Today we're releasing Isaac 0.5: 36B dynamic MoE, open weight 🤗 embodied foundation model. Isaac combines multimodal video understanding, embodied reasoning and robot control into a single, sparse backbone.

Today we're releasing Isaac 0.5: 36B dynamic MoE, open weight 🤗 embodied foundation model. Isaac combines multimodal video understanding, embodied reasoning and robot control into a single, sparse backbone.

Perceptron AI

274,413 views • 1 month ago

Unitree majorly fully open-sources the UnifoLM-WLA-1.0 embodied foundation model, achieving new SOTA results across multiple benchmarks among open-source models worldwide.

Unitree majorly fully open-sources the UnifoLM-WLA-1.0 embodied foundation model, achieving new SOTA results across multiple benchmarks among open-source models worldwide.

Unitree

7,346,498 views • 16 days ago

Control a robot in simulation with the Gemini Robotics Embodied Reasoning model 🤖 Direct tasks like object localization and placement by simply prompting a robotic arm to pick up and place objects.

Control a robot in simulation with the Gemini Robotics Embodied Reasoning model 🤖 Direct tasks like object localization and placement by simply prompting a robotic arm to pick up and place objects.

Google AI Developers

1,296,984 views • 8 months ago

We're releasing HY-Embodied-0.5, a family of foundation models for real-world embodied agents. The 2B model is now open source. It strengthens spatial-temporal perception and embodied reasoning for prediction, interaction, and planning. 🤖 The suite includes: 🔹 2B for edge deployment 🔹 32B for complex reasoning Key innovations: 🔹 Mixture-of-Transformers (MoT) architecture for modality-specific computation 🔹 Latent tokens for improved perceptual representation 🔹 Self-evolving post-training 🔹 On-policy distillation from large to small models Across 22 benchmarks, the 2B model outperforms similarly sized SOTA systems on 16 tasks. The 32B model approaches frontier-level performance. 🔗 GitHub: 🤗 Hugging Face:

We're releasing HY-Embodied-0.5, a family of foundation models for real-world embodied agents. The 2B model is now open source. It strengthens spatial-temporal perception and embodied reasoning for prediction, interaction, and planning. 🤖 The suite includes: 🔹 2B for edge deployment 🔹 32B for complex reasoning Key innovations: 🔹 Mixture-of-Transformers (MoT) architecture for modality-specific computation 🔹 Latent tokens for improved perceptual representation 🔹 Self-evolving post-training 🔹 On-policy distillation from large to small models Across 22 benchmarks, the 2B model outperforms similarly sized SOTA systems on 16 tasks. The 32B model approaches frontier-level performance. 🔗 GitHub: 🤗 Hugging Face:

Tencent Hy

34,317 views • 5 months ago

#AGIBOTAIWeek Day 3: Introducing GO-2: the next-generation foundation model for embodied AI, built to unify reasoning and action. To truly bridge “thinking” and “doing,” embodied AI must solve two challenges at once: • It generate executable action plans through deep spatial reasoning • It deliver stable execution in real-world environments GO-2 tackles both with a comprehensive architecture: Action Chain-of-Thought for action reasoning, and an Asynchronous Dual-System for robust execution. #AGIBOT #AGIBOTAIWeek #Foundation #model #EmbodiedAI Official account tags X: AGIBOT LinkedIn: agibot

#AGIBOTAIWeek Day 3: Introducing GO-2: the next-generation foundation model for embodied AI, built to unify reasoning and action. To truly bridge “thinking” and “doing,” embodied AI must solve two challenges at once: • It generate executable action plans through deep spatial reasoning • It deliver stable execution in real-world environments GO-2 tackles both with a comprehensive architecture: Action Chain-of-Thought for action reasoning, and an Asynchronous Dual-System for robust execution. #AGIBOT #AGIBOTAIWeek #Foundation #model #EmbodiedAI Official account tags X: AGIBOT LinkedIn: agibot

Hasan Toor

36,202 views • 5 months ago

Introducing MolmoSpaces, a large-scale, fully open platform + benchmark for embodied AI research. 🤖 230k+ indoor scenes, 130k+ object models, & 42M annotated robotic grasps—all in one ecosystem.

Introducing MolmoSpaces, a large-scale, fully open platform + benchmark for embodied AI research. 🤖 230k+ indoor scenes, 130k+ object models, & 42M annotated robotic grasps—all in one ecosystem.

Ai2

98,532 views • 7 months ago

One more thing 🚀 Qwen’s agentic capability is no longer limited to the digital world — we’re bringing it into physical world. With our in-house robotic agentic system and navigation model, Qwen can now control a robot to execute tasks in real-world. #qwen #embodied #robotics

One more thing 🚀 Qwen’s agentic capability is no longer limited to the digital world — we’re bringing it into physical world. With our in-house robotic agentic system and navigation model, Qwen can now control a robot to execute tasks in real-world. #qwen #embodied #robotics

barry (xiong-hui) chen

25,112 views • 4 months ago

We just open-sourced G0 Plus VLA model & launched "Pick Up Anything" demo. See our robot perform diverse real-world tasks through pure language. No specialized training needed. That's zero-shot embodied intelligence. #VLA #Robotics #OpenSource 🔗Try now：

We just open-sourced G0 Plus VLA model & launched "Pick Up Anything" demo. See our robot perform diverse real-world tasks through pure language. No specialized training needed. That's zero-shot embodied intelligence. #VLA #Robotics #OpenSource 🔗Try now：

Galaxea Dynamics

99,739 views • 9 months ago

Why create robot intelligence for just one hand, when we could have it learn from many? GEN-1, our latest embodied foundation model, now supports a broad range of end effectors from 5-finger hands, to specialized tools, and everything in between.

Why create robot intelligence for just one hand, when we could have it learn from many? GEN-1, our latest embodied foundation model, now supports a broad range of end effectors from 5-finger hands, to specialized tools, and everything in between.

Generalist

305,132 views • 2 months ago

🚀 MiniCPM enters the physical world — enabling robots to understand, remember, and act. We open-source MiniCPM-Robot, our first embodied AI model series, including: 🤖 MiniCPM-RobotManip — a 1.5B general-purpose Vision-Language-Action (VLA) model for robotic manipulation. 🐕 MiniCPM-RobotTrack — a compact model for real-world target tracking. ⚡ PhyAI — a high-performance inference framework built for embodied models. Together, they bring efficient, practical, and open embodied intelligence closer to real-world robots. ⭐ GitHub: 🤗 MiniCPM-RobotManip: 🤗 MiniCPM-RobotTrack:

🚀 MiniCPM enters the physical world — enabling robots to understand, remember, and act. We open-source MiniCPM-Robot, our first embodied AI model series, including: 🤖 MiniCPM-RobotManip — a 1.5B general-purpose Vision-Language-Action (VLA) model for robotic manipulation. 🐕 MiniCPM-RobotTrack — a compact model for real-world target tracking. ⚡ PhyAI — a high-performance inference framework built for embodied models. Together, they bring efficient, practical, and open embodied intelligence closer to real-world robots. ⭐ GitHub: 🤗 MiniCPM-RobotManip: 🤗 MiniCPM-RobotTrack:

OpenBMB

331,849 views • 2 months ago

The Qwen model family cyber atlas: a visual walkthrough of how AI really evolved — from large language models to embodied intelligence. It all begins with large language models. Watch the full video below.

The Qwen model family cyber atlas: a visual walkthrough of how AI really evolved — from large language models to embodied intelligence. It all begins with large language models. Watch the full video below.

Tongyi Lab

4,191,703 views • 2 months ago

We brought Dynasaur to The Clean Show and ran it live, 8 hours a day. Each deployment fuels our robotics foundation model — scaling data, accelerating iteration, and enabling real-world generalization. Embodied intelligence won’t come from lab demos, but from deployment-first robotics running continuously in the wild.

We brought Dynasaur to The Clean Show and ran it live, 8 hours a day. Each deployment fuels our robotics foundation model — scaling data, accelerating iteration, and enabling real-world generalization. Embodied intelligence won’t come from lab demos, but from deployment-first robotics running continuously in the wild.

Dyna Robotics

24,901 views • 1 year ago

Turn any world model from World Labs into a multi-user space for exploration and collaboration with FRAME. Voice chat, embodied AI agents, and tons more you can layer on top of the model foundation. This took all of 10 seconds to get going. The metaverse is so back. 😄

Turn any world model from World Labs into a multi-user space for exploration and collaboration with FRAME. Voice chat, embodied AI agents, and tons more you can layer on top of the model foundation. This took all of 10 seconds to get going. The metaverse is so back. 😄

Gabriel Baker

21,641 views • 1 year ago

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:

Chuang Gan

43,265 views • 1 year ago

The AV industry is hitting a “Data Wall.” Brute-force training on petabytes of data is reaching a dead end. As models improve, further gains get harder. We bypassed this wall with Factored Embodied AI—achieving zero-shot autonomous steering with just 1,000 hours of driving data.

The AV industry is hitting a “Data Wall.” Brute-force training on petabytes of data is reaching a dead end. As models improve, further gains get harder. We bypassed this wall with Factored Embodied AI—achieving zero-shot autonomous steering with just 1,000 hours of driving data.

Helm.ai

8,650,862 views • 9 months ago

Three in one! A young Chinese developer created software to control multiple Unitree robot dogs using a DJI drone controller, switching between them via a smartphone app. showcasing cross-brand innovation in Embodied AI.

China pulse 🇨🇳

12,415 views • 5 days ago

🤖✨ What if models that take action in the physical world could think through your instructions? Meet MolmoAct, our new fully open Action Reasoning Model (ARM) that does just that. 🧵

🤖✨ What if models that take action in the physical world could think through your instructions? Meet MolmoAct, our new fully open Action Reasoning Model (ARM) that does just that. 🧵

Ai2

180,624 views • 1 year ago

We got our robots to wash pans, clean windows, make peanut butter sandwiches, and more! Fine-tuning our latest model enables all of these tasks, and this has interesting implications for robotics, Moravec's paradox, and the future of large models in embodied AI. More below!

We got our robots to wash pans, clean windows, make peanut butter sandwiches, and more! Fine-tuning our latest model enables all of these tasks, and this has interesting implications for robotics, Moravec's paradox, and the future of large models in embodied AI. More below!

Physical Intelligence

547,268 views • 9 months ago