正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Robot Learning from a Physical World Model

AK

505,221 subscribers

34,340 次观看 • 7 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:

Chuang Gan

43,265 次观看 • 1 年前

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos

AK

38,690 次观看 • 4 个月前

OpenDriveLab just dropped RISE — a new paradigm for robot learning. Instead of expensive real-world trials, robots learn in imagination. A compositional world model simulates futures → evaluates outcomes → updates policy.

OpenDriveLab just dropped RISE — a new paradigm for robot learning. Instead of expensive real-world trials, robots learn in imagination. A compositional world model simulates futures → evaluates outcomes → updates policy.

Robots Digest 🤖

23,754 次观看 • 1 个月前

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️

Ted Xiao

152,413 次观看 • 1 年前

3D-VLA A 3D Vision-Language-Action Generative World Model Recent vision-language-action (VLA) models rely on 2D inputs, lacking integration with the broader realm of the 3D physical world. Furthermore, they perform action prediction by learning a direct mapping from

3D-VLA A 3D Vision-Language-Action Generative World Model Recent vision-language-action (VLA) models rely on 2D inputs, lacking integration with the broader realm of the 3D physical world. Furthermore, they perform action prediction by learning a direct mapping from

AK

84,940 次观看 • 2 年前

Attention: this might be the video that opens the door to the future. When a SOTA agent model connects to a robot dog with no remote control— MiniMax M2.1 × Vbot, super-powered in action. A model trained in the virtual world now controls a robot in the physical world. Hello, humans. Welcome to the future.

Attention: this might be the video that opens the door to the future. When a SOTA agent model connects to a robot dog with no remote control— MiniMax M2.1 × Vbot, super-powered in action. A model trained in the virtual world now controls a robot in the physical world. Hello, humans. Welcome to the future.

MiniMax (official)

151,672 次观看 • 5 个月前

Introducing RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learning. 7 real robot tasks, 900/900 successes. Up to 250 consecutive trials in one task, running 2 hours nonstop without failure. High success rate against physical disturbances, zero-shot, and few-shot adaptation Our first step toward a deployable robot learning system.

Introducing RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learning. 7 real robot tasks, 900/900 successes. Up to 250 consecutive trials in one task, running 2 hours nonstop without failure. High success rate against physical disturbances, zero-shot, and few-shot adaptation Our first step toward a deployable robot learning system.

Kun Lei

80,824 次观看 • 8 个月前

Orange you glad our robot can stack? Other tasks GEN-1 can do: Read more about GEN-1, our latest foundation model for the physical world:

Orange you glad our robot can stack? Other tasks GEN-1 can do: Read more about GEN-1, our latest foundation model for the physical world:

Generalist

22,849 次观看 • 2 个月前

Φ-SO : Physical Symbolic Optimization - Learning Physics from Data 🧠 The Physical Symbolic Optimization package uses deep reinforcement learning to discover physical laws from data. Here is Φ-SO discovering the analytical expression of a damped harmonic oscillator.

Φ-SO : Physical Symbolic Optimization - Learning Physics from Data 🧠 The Physical Symbolic Optimization package uses deep reinforcement learning to discover physical laws from data. Here is Φ-SO discovering the analytical expression of a damped harmonic oscillator.

Jousef Murad

433,091 次观看 • 2 年前

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source

The Humanoid Hub

17,721 次观看 • 4 个月前

Put simply, the real world web onboards robots to new physical spaces instantly. Simplify robot deployment → scale robot deployment. Accelerate.

Put simply, the real world web onboards robots to new physical spaces instantly. Simplify robot deployment → scale robot deployment. Accelerate.

Auki

534,978 次观看 • 7 个月前

AGIBOT introduces AgiBot World, a large-scale open-source dataset for general-purpose robotic learning. ⦿ 1M+ trajectories from 100+ real-world scenarios ⦿ Scenarios include dexterous manipulation, tool use, and multi-robot collaboration

AGIBOT introduces AgiBot World, a large-scale open-source dataset for general-purpose robotic learning. ⦿ 1M+ trajectories from 100+ real-world scenarios ⦿ Scenarios include dexterous manipulation, tool use, and multi-robot collaboration

The Humanoid Hub

59,847 次观看 • 1 年前

Every home is different. That means that to build a useful home robot, we must be able to perform zero-shot generalization on a wide range of tasks. Humanoid company 1X has a solution: world models. 1X Director of Evaluations Daniel Ho joins us on RoboPapers to talk about: - why world models are the future for scaling robot learning - how to use world models for robot control - what world models unlock for evaluating robot model performance - how we can hill-climb from here to general purpose robots Watch Episode #61 of RoboPapers, with Michael Cho - Rbt/Acc and Chris Paxton, now!

Every home is different. That means that to build a useful home robot, we must be able to perform zero-shot generalization on a wide range of tasks. Humanoid company 1X has a solution: world models. 1X Director of Evaluations Daniel Ho joins us on RoboPapers to talk about: - why world models are the future for scaling robot learning - how to use world models for robot control - what world models unlock for evaluating robot model performance - how we can hill-climb from here to general purpose robots Watch Episode #61 of RoboPapers, with Michael Cho - Rbt/Acc and Chris Paxton, now!

RoboPapers

27,537 次观看 • 4 个月前

See our robot open doors, water plants, assemble a box, and more by learning from watching humans. Using <1hr of robot data.

See our robot open doors, water plants, assemble a box, and more by learning from watching humans. Using <1hr of robot data.

Skild AI

36,023 次观看 • 5 个月前

One more thing 🚀 Qwen’s agentic capability is no longer limited to the digital world — we’re bringing it into physical world. With our in-house robotic agentic system and navigation model, Qwen can now control a robot to execute tasks in real-world. #qwen #embodied #robotics

One more thing 🚀 Qwen’s agentic capability is no longer limited to the digital world — we’re bringing it into physical world. With our in-house robotic agentic system and navigation model, Qwen can now control a robot to execute tasks in real-world. #qwen #embodied #robotics

xiong-hui (barry) chen

24,797 次观看 • 1 个月前

Rosalía performing NOVIA ROBOT from Lux physical version #LUXTOUR

Rosalía performing NOVIA ROBOT from Lux physical version #LUXTOUR

LUX

17,902 次观看 • 3 个月前

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks

Yinghao Xu

46,380 次观看 • 4 个月前

Today mimic and friends are excited to share mimic-video, a new class of Video-Action Model that elevates video model backbones as first class citizens for robot learning!

Today mimic and friends are excited to share mimic-video, a new class of Video-Action Model that elevates video model backbones as first class citizens for robot learning!

Elvis Nava

86,908 次观看 • 6 个月前

Introducing GEN-1. Our latest milestone in scaling robot learning. We believe it to be the first general-purpose AI model to master simple physical tasks. 99% success rates, 3x faster speeds, adapts in real time to unexpected scenarios, w/ only 1 hour of robot data. More🧵👇

Introducing GEN-1. Our latest milestone in scaling robot learning. We believe it to be the first general-purpose AI model to master simple physical tasks. 99% success rates, 3x faster speeds, adapts in real time to unexpected scenarios, w/ only 1 hour of robot data. More🧵👇

Generalist

377,592 次观看 • 2 个月前

NEWS: Nvidia has just introduced "Cosmos," a world foundation model created to understand the physical world. The model can generate synthetic data to train robotics.

NEWS: Nvidia has just introduced "Cosmos," a world foundation model created to understand the physical world. The model can generate synthetic data to train robotics.

Sawyer Merritt

254,296 次观看 • 1 年前