Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Robot Learning from a Physical World Model

_akhaliq's profile picture

AK

504,733 subscribers

34,340 Aufrufe • vor 7 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:
0:32

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:

Chuang Gan

43,265 Aufrufe • vor 1 Jahr

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos
1:21

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos

AK

38,690 Aufrufe • vor 4 Monaten

OpenDriveLab just dropped RISE — a new paradigm for robot learning. Instead of expensive real-world trials, robots learn in imagination. A compositional world model simulates futures → evaluates outcomes → updates policy.
4:04

OpenDriveLab just dropped RISE — a new paradigm for robot learning. Instead of expensive real-world trials, robots learn in imagination. A compositional world model simulates futures → evaluates outcomes → updates policy.

Robots Digest 🤖

23,683 Aufrufe • vor 1 Monat

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️
0:31

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️

Ted Xiao

152,413 Aufrufe • vor 1 Jahr

🚨 NEW: TutorIntel unveils Data Factory 1 a 100 robot research farm to scale real world robot learning.
0:42

🚨 NEW: TutorIntel unveils Data Factory 1 a 100 robot research farm to scale real world robot learning.

Cointelegraph

31,995 Aufrufe • vor 1 Monat

3D-VLA A 3D Vision-Language-Action Generative World Model Recent vision-language-action (VLA) models rely on 2D inputs, lacking integration with the broader realm of the 3D physical world. Furthermore, they perform action prediction by learning a direct mapping from
1:43

3D-VLA A 3D Vision-Language-Action Generative World Model Recent vision-language-action (VLA) models rely on 2D inputs, lacking integration with the broader realm of the 3D physical world. Furthermore, they perform action prediction by learning a direct mapping from

AK

84,940 Aufrufe • vor 2 Jahren

Attention: this might be the video that opens the door to the future. When a SOTA agent model connects to a robot dog with no remote control— MiniMax M2.1 × Vbot, super-powered in action. A model trained in the virtual world now controls a robot in the physical world. Hello, humans. Welcome to the future.
0:49

Attention: this might be the video that opens the door to the future. When a SOTA agent model connects to a robot dog with no remote control— MiniMax M2.1 × Vbot, super-powered in action. A model trained in the virtual world now controls a robot in the physical world. Hello, humans. Welcome to the future.

MiniMax (official)

151,672 Aufrufe • vor 5 Monaten

Introducing RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learning. 7 real robot tasks, 900/900 successes. Up to 250 consecutive trials in one task, running 2 hours nonstop without failure. High success rate against physical disturbances, zero-shot, and few-shot adaptation Our first step toward a deployable robot learning system.
3:26

Introducing RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learning. 7 real robot tasks, 900/900 successes. Up to 250 consecutive trials in one task, running 2 hours nonstop without failure. High success rate against physical disturbances, zero-shot, and few-shot adaptation Our first step toward a deployable robot learning system.

Kun Lei

80,801 Aufrufe • vor 8 Monaten

Orange you glad our robot can stack? Other tasks GEN-1 can do: Read more about GEN-1, our latest foundation model for the physical world:
0:20

Orange you glad our robot can stack? Other tasks GEN-1 can do: Read more about GEN-1, our latest foundation model for the physical world:

Generalist

22,849 Aufrufe • vor 2 Monaten

Φ-SO : Physical Symbolic Optimization - Learning Physics from Data 🧠 The Physical Symbolic Optimization package uses deep reinforcement learning to discover physical laws from data. Here is Φ-SO discovering the analytical expression of a damped harmonic oscillator.
0:20

Φ-SO : Physical Symbolic Optimization - Learning Physics from Data 🧠 The Physical Symbolic Optimization package uses deep reinforcement learning to discover physical laws from data. Here is Φ-SO discovering the analytical expression of a damped harmonic oscillator.

Jousef Murad

433,091 Aufrufe • vor 2 Jahren

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source
1:33

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source

The Humanoid Hub

17,721 Aufrufe • vor 4 Monaten

Put simply, the real world web onboards robots to new physical spaces instantly. Simplify robot deployment → scale robot deployment. Accelerate.
1:11

Put simply, the real world web onboards robots to new physical spaces instantly. Simplify robot deployment → scale robot deployment. Accelerate.

Auki

534,978 Aufrufe • vor 7 Monaten

AGIBOT introduces AgiBot World, a large-scale open-source dataset for general-purpose robotic learning. ⦿ 1M+ trajectories from 100+ real-world scenarios ⦿ Scenarios include dexterous manipulation, tool use, and multi-robot collaboration
1:16

AGIBOT introduces AgiBot World, a large-scale open-source dataset for general-purpose robotic learning. ⦿ 1M+ trajectories from 100+ real-world scenarios ⦿ Scenarios include dexterous manipulation, tool use, and multi-robot collaboration

The Humanoid Hub

59,847 Aufrufe • vor 1 Jahr

Every home is different. That means that to build a useful home robot, we must be able to perform zero-shot generalization on a wide range of tasks. Humanoid company 1X has a solution: world models. 1X Director of Evaluations Daniel Ho joins us on RoboPapers to talk about: - why world models are the future for scaling robot learning - how to use world models for robot control - what world models unlock for evaluating robot model performance - how we can hill-climb from here to general purpose robots Watch Episode #61 of RoboPapers, with Michael Cho - Rbt/Acc and Chris Paxton, now!
54:52

Every home is different. That means that to build a useful home robot, we must be able to perform zero-shot generalization on a wide range of tasks. Humanoid company 1X has a solution: world models. 1X Director of Evaluations Daniel Ho joins us on RoboPapers to talk about: - why world models are the future for scaling robot learning - how to use world models for robot control - what world models unlock for evaluating robot model performance - how we can hill-climb from here to general purpose robots Watch Episode #61 of RoboPapers, with Michael Cho - Rbt/Acc and Chris Paxton, now!

RoboPapers

27,537 Aufrufe • vor 4 Monaten

See our robot open doors, water plants, assemble a box, and more by learning from watching humans. Using <1hr of robot data.
0:59

See our robot open doors, water plants, assemble a box, and more by learning from watching humans. Using <1hr of robot data.

Skild AI

36,023 Aufrufe • vor 5 Monaten

Rosalía performing NOVIA ROBOT from Lux physical version #LUXTOUR
0:43

Rosalía performing NOVIA ROBOT from Lux physical version #LUXTOUR

LUX

17,902 Aufrufe • vor 3 Monaten

One more thing 🚀 Qwen’s agentic capability is no longer limited to the digital world — we’re bringing it into physical world. With our in-house robotic agentic system and navigation model, Qwen can now control a robot to execute tasks in real-world. #qwen #embodied #robotics
1:16

One more thing 🚀 Qwen’s agentic capability is no longer limited to the digital world — we’re bringing it into physical world. With our in-house robotic agentic system and navigation model, Qwen can now control a robot to execute tasks in real-world. #qwen #embodied #robotics

xiong-hui (barry) chen

24,797 Aufrufe • vor 25 Tagen

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks
1:51

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks

Yinghao Xu

46,351 Aufrufe • vor 4 Monaten

NEWS: Nvidia has just introduced "Cosmos," a world foundation model created to understand the physical world. The model can generate synthetic data to train robotics.
2:34

NEWS: Nvidia has just introduced "Cosmos," a world foundation model created to understand the physical world. The model can generate synthetic data to train robotics.

Sawyer Merritt

254,296 Aufrufe • vor 1 Jahr

Introducing Stand’s World Model, a physics-native frontier model for the built environment. This is how we help the world survive catastrophe: by computing how physical force acts on a structure, protecting property from fire, wind, flood, or earthquake.
0:36

Introducing Stand’s World Model, a physics-native frontier model for the built environment. This is how we help the world survive catastrophe: by computing how physical force acts on a structure, protecting property from fire, wind, flood, or earthquake.

Dan Preston

11,547 Aufrufe • vor 1 Monat