Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Zero-shot fully autonomous drone flight from our scaled embodied foundation models (internal world model, embodied reasoning, direct control all in one)

Armen Aghajanyan

16,375 subscribers

20,746 Aufrufe • vor 19 Tagen •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

9 Kommentare

Profilbild von Jonathan Santilli

Jonathan Santillivor 19 Tagen

This is beyond cool

Profilbild von Armen Aghajanyan

Armen Aghajanyanvor 19 Tagen

Thanks!

Profilbild von Koustuv Sinha

Koustuv Sinhavor 19 Tagen

this is amazing 🤩

Profilbild von random guy passing by life

random guy passing by lifevor 18 Tagen

What’s preventing it from going upwards until its surrounding is fully cleared?

Profilbild von Jeemit Patel

Jeemit Patelvor 19 Tagen

Amazing !! I have a use case I need to try this with .

Profilbild von Armen Aghajanyan

Armen Aghajanyanvor 19 Tagen

likely not releasing harness/code for drone control anytime soon but if you have a prompt you want me to try i can try it

Profilbild von Maclaine

Maclainevor 18 Tagen

Hope we get to play with it ourselves eventually

Profilbild von فرنگ باز

فرنگ بازvor 19 Tagen

Nice bro! Whats the hardware?

Profilbild von Prasant Atluri

Prasant Atlurivor 18 Tagen

Wow

Ähnliche Videos

Today we're releasing Isaac 0.5: 36B dynamic MoE, open weight 🤗 embodied foundation model. Isaac combines multimodal video understanding, embodied reasoning and robot control into a single, sparse backbone.

Today we're releasing Isaac 0.5: 36B dynamic MoE, open weight 🤗 embodied foundation model. Isaac combines multimodal video understanding, embodied reasoning and robot control into a single, sparse backbone.

Perceptron AI

274,413 Aufrufe • vor 1 Monat

Unitree majorly fully open-sources the UnifoLM-WLA-1.0 embodied foundation model, achieving new SOTA results across multiple benchmarks among open-source models worldwide.

Unitree majorly fully open-sources the UnifoLM-WLA-1.0 embodied foundation model, achieving new SOTA results across multiple benchmarks among open-source models worldwide.

Unitree

7,346,498 Aufrufe • vor 16 Tagen

Control a robot in simulation with the Gemini Robotics Embodied Reasoning model 🤖 Direct tasks like object localization and placement by simply prompting a robotic arm to pick up and place objects.

Control a robot in simulation with the Gemini Robotics Embodied Reasoning model 🤖 Direct tasks like object localization and placement by simply prompting a robotic arm to pick up and place objects.

Google AI Developers

1,296,984 Aufrufe • vor 8 Monaten

We're releasing HY-Embodied-0.5, a family of foundation models for real-world embodied agents. The 2B model is now open source. It strengthens spatial-temporal perception and embodied reasoning for prediction, interaction, and planning. 🤖 The suite includes: 🔹 2B for edge deployment 🔹 32B for complex reasoning Key innovations: 🔹 Mixture-of-Transformers (MoT) architecture for modality-specific computation 🔹 Latent tokens for improved perceptual representation 🔹 Self-evolving post-training 🔹 On-policy distillation from large to small models Across 22 benchmarks, the 2B model outperforms similarly sized SOTA systems on 16 tasks. The 32B model approaches frontier-level performance. 🔗 GitHub: 🤗 Hugging Face:

We're releasing HY-Embodied-0.5, a family of foundation models for real-world embodied agents. The 2B model is now open source. It strengthens spatial-temporal perception and embodied reasoning for prediction, interaction, and planning. 🤖 The suite includes: 🔹 2B for edge deployment 🔹 32B for complex reasoning Key innovations: 🔹 Mixture-of-Transformers (MoT) architecture for modality-specific computation 🔹 Latent tokens for improved perceptual representation 🔹 Self-evolving post-training 🔹 On-policy distillation from large to small models Across 22 benchmarks, the 2B model outperforms similarly sized SOTA systems on 16 tasks. The 32B model approaches frontier-level performance. 🔗 GitHub: 🤗 Hugging Face:

Tencent Hy

34,317 Aufrufe • vor 5 Monaten

#AGIBOTAIWeek Day 3: Introducing GO-2: the next-generation foundation model for embodied AI, built to unify reasoning and action. To truly bridge “thinking” and “doing,” embodied AI must solve two challenges at once: • It generate executable action plans through deep spatial reasoning • It deliver stable execution in real-world environments GO-2 tackles both with a comprehensive architecture: Action Chain-of-Thought for action reasoning, and an Asynchronous Dual-System for robust execution. #AGIBOT #AGIBOTAIWeek #Foundation #model #EmbodiedAI Official account tags X: AGIBOT LinkedIn: agibot

#AGIBOTAIWeek Day 3: Introducing GO-2: the next-generation foundation model for embodied AI, built to unify reasoning and action. To truly bridge “thinking” and “doing,” embodied AI must solve two challenges at once: • It generate executable action plans through deep spatial reasoning • It deliver stable execution in real-world environments GO-2 tackles both with a comprehensive architecture: Action Chain-of-Thought for action reasoning, and an Asynchronous Dual-System for robust execution. #AGIBOT #AGIBOTAIWeek #Foundation #model #EmbodiedAI Official account tags X: AGIBOT LinkedIn: agibot

Hasan Toor

36,202 Aufrufe • vor 5 Monaten

Introducing MolmoSpaces, a large-scale, fully open platform + benchmark for embodied AI research. 🤖 230k+ indoor scenes, 130k+ object models, & 42M annotated robotic grasps—all in one ecosystem.

Introducing MolmoSpaces, a large-scale, fully open platform + benchmark for embodied AI research. 🤖 230k+ indoor scenes, 130k+ object models, & 42M annotated robotic grasps—all in one ecosystem.

Ai2

98,532 Aufrufe • vor 7 Monaten

One more thing 🚀 Qwen’s agentic capability is no longer limited to the digital world — we’re bringing it into physical world. With our in-house robotic agentic system and navigation model, Qwen can now control a robot to execute tasks in real-world. #qwen #embodied #robotics

One more thing 🚀 Qwen’s agentic capability is no longer limited to the digital world — we’re bringing it into physical world. With our in-house robotic agentic system and navigation model, Qwen can now control a robot to execute tasks in real-world. #qwen #embodied #robotics

barry (xiong-hui) chen

25,112 Aufrufe • vor 4 Monaten

We just open-sourced G0 Plus VLA model & launched "Pick Up Anything" demo. See our robot perform diverse real-world tasks through pure language. No specialized training needed. That's zero-shot embodied intelligence. #VLA #Robotics #OpenSource 🔗Try now：

We just open-sourced G0 Plus VLA model & launched "Pick Up Anything" demo. See our robot perform diverse real-world tasks through pure language. No specialized training needed. That's zero-shot embodied intelligence. #VLA #Robotics #OpenSource 🔗Try now：

Galaxea Dynamics

99,739 Aufrufe • vor 9 Monaten

Why create robot intelligence for just one hand, when we could have it learn from many? GEN-1, our latest embodied foundation model, now supports a broad range of end effectors from 5-finger hands, to specialized tools, and everything in between.

Why create robot intelligence for just one hand, when we could have it learn from many? GEN-1, our latest embodied foundation model, now supports a broad range of end effectors from 5-finger hands, to specialized tools, and everything in between.

Generalist

305,132 Aufrufe • vor 2 Monaten

🚀 MiniCPM enters the physical world — enabling robots to understand, remember, and act. We open-source MiniCPM-Robot, our first embodied AI model series, including: 🤖 MiniCPM-RobotManip — a 1.5B general-purpose Vision-Language-Action (VLA) model for robotic manipulation. 🐕 MiniCPM-RobotTrack — a compact model for real-world target tracking. ⚡ PhyAI — a high-performance inference framework built for embodied models. Together, they bring efficient, practical, and open embodied intelligence closer to real-world robots. ⭐ GitHub: 🤗 MiniCPM-RobotManip: 🤗 MiniCPM-RobotTrack:

🚀 MiniCPM enters the physical world — enabling robots to understand, remember, and act. We open-source MiniCPM-Robot, our first embodied AI model series, including: 🤖 MiniCPM-RobotManip — a 1.5B general-purpose Vision-Language-Action (VLA) model for robotic manipulation. 🐕 MiniCPM-RobotTrack — a compact model for real-world target tracking. ⚡ PhyAI — a high-performance inference framework built for embodied models. Together, they bring efficient, practical, and open embodied intelligence closer to real-world robots. ⭐ GitHub: 🤗 MiniCPM-RobotManip: 🤗 MiniCPM-RobotTrack:

OpenBMB

331,849 Aufrufe • vor 2 Monaten

The Qwen model family cyber atlas: a visual walkthrough of how AI really evolved — from large language models to embodied intelligence. It all begins with large language models. Watch the full video below.

The Qwen model family cyber atlas: a visual walkthrough of how AI really evolved — from large language models to embodied intelligence. It all begins with large language models. Watch the full video below.

Tongyi Lab

4,191,703 Aufrufe • vor 2 Monaten

We brought Dynasaur to The Clean Show and ran it live, 8 hours a day. Each deployment fuels our robotics foundation model — scaling data, accelerating iteration, and enabling real-world generalization. Embodied intelligence won’t come from lab demos, but from deployment-first robotics running continuously in the wild.

We brought Dynasaur to The Clean Show and ran it live, 8 hours a day. Each deployment fuels our robotics foundation model — scaling data, accelerating iteration, and enabling real-world generalization. Embodied intelligence won’t come from lab demos, but from deployment-first robotics running continuously in the wild.

Dyna Robotics

24,901 Aufrufe • vor 1 Jahr

Turn any world model from World Labs into a multi-user space for exploration and collaboration with FRAME. Voice chat, embodied AI agents, and tons more you can layer on top of the model foundation. This took all of 10 seconds to get going. The metaverse is so back. 😄

Turn any world model from World Labs into a multi-user space for exploration and collaboration with FRAME. Voice chat, embodied AI agents, and tons more you can layer on top of the model foundation. This took all of 10 seconds to get going. The metaverse is so back. 😄

Gabriel Baker

21,641 Aufrufe • vor 1 Jahr

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:

Chuang Gan

43,265 Aufrufe • vor 1 Jahr

The AV industry is hitting a “Data Wall.” Brute-force training on petabytes of data is reaching a dead end. As models improve, further gains get harder. We bypassed this wall with Factored Embodied AI—achieving zero-shot autonomous steering with just 1,000 hours of driving data.

The AV industry is hitting a “Data Wall.” Brute-force training on petabytes of data is reaching a dead end. As models improve, further gains get harder. We bypassed this wall with Factored Embodied AI—achieving zero-shot autonomous steering with just 1,000 hours of driving data.

Helm.ai

8,650,862 Aufrufe • vor 9 Monaten

Three in one! A young Chinese developer created software to control multiple Unitree robot dogs using a DJI drone controller, switching between them via a smartphone app. showcasing cross-brand innovation in Embodied AI.

China pulse 🇨🇳

12,415 Aufrufe • vor 5 Tagen

🤖✨ What if models that take action in the physical world could think through your instructions? Meet MolmoAct, our new fully open Action Reasoning Model (ARM) that does just that. 🧵

🤖✨ What if models that take action in the physical world could think through your instructions? Meet MolmoAct, our new fully open Action Reasoning Model (ARM) that does just that. 🧵

Ai2

180,624 Aufrufe • vor 1 Jahr

We got our robots to wash pans, clean windows, make peanut butter sandwiches, and more! Fine-tuning our latest model enables all of these tasks, and this has interesting implications for robotics, Moravec's paradox, and the future of large models in embodied AI. More below!

We got our robots to wash pans, clean windows, make peanut butter sandwiches, and more! Fine-tuning our latest model enables all of these tasks, and this has interesting implications for robotics, Moravec's paradox, and the future of large models in embodied AI. More below!

Physical Intelligence

547,268 Aufrufe • vor 9 Monaten