正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Most AI world models can generate beautiful scenes. Keeping those scenes alive for an hour without falling apart is the real challenge. That's what caught my attention about LingBot-World 2.0 (LingBot-World-Infinity) from Robbyant Instead of chasing longer videos, it focuses on something much harder: persistent, interactive worlds that stay... coherent while you explore. A few highlights: • Generates worlds from a single frame and continuously responds to live user actions through a causal world model. • Streams stable 720p at 60 FPS in real time. The team reports a continuous 60 minute stress test across 20 different scenarios with no noticeable visual degradation. • Uses a Brain-Cerebellum co-simulation framework where a VLM plans events while the video model turns them into consistent world evolution. • Pilot and Director Agents help drive character behavior and introduce new objects and events. • Open sourced with a 14B flagship model, while the paper also describes a lightweight 1.3B version for a single consumer GPU. There is also an online interactive demo. The biggest takeaway? We're moving beyond AI that generates clips. We're getting closer to AI that generates living, evolving worlds you can actually interact with. And that feels like a much bigger shift than another jump in video quality. Explore more: 💻 Github: 🤗 Weights: 🌐 Website-with videos you can use : 🎮 Try it online: #Robbyant #LingBot #WorldModel #EmbodiedAI #OpenSource #Robotics #adshow more

Alif Khan

31,085 subscribers

84,542 次观看 • 2 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 条评论

Atul Kumar 的头像

Atul Kumar2 个月前

@robbyant_brain Grateful for this spotlight on LingBot-World 2.0. It's truly inspiring to see innovation that prioritizes coherent, interactive environments.

Alpha AI 的头像

Alpha AI2 个月前

@robbyant_brain Persistent, interactive AI worlds feel like a major leap beyond impressive video generation alone.

Patrick William 的头像

Patrick William2 个月前

@robbyant_brain This shift from generating videos to sustaining living worlds is genuinely exciting to watch.

Saif Ai 的头像

Saif Ai2 个月前

@robbyant_brain Nice

Emily Watson | AI Tools & Tech News 的头像

Emily Watson | AI Tools & Tech News2 个月前

@robbyant_brain Wow, thank you for highlighting LingBot-World 2.0! The focus on persistent, interactive worlds instead of just longer videos is a true paradigm shift.

Rahul Bais 的头像

Rahul Bais2 个月前

@robbyant_brain Great share

Tom Brandon 的头像

Tom Brandon2 个月前

@robbyant_brain WOW

Rohtas Dahiya 的头像

Rohtas Dahiya2 个月前

@robbyant_brain Your commitment to completing tasks is appreciated. Keep up the good work.

Usman 的头像

Usman2 个月前

@robbyant_brain Incredible Share

Shara 的头像

Shara2 个月前

@robbyant_brain Keeping a scene alive for an hour is the real hard problem.

相关视频

Everyone focused on AI that can generate videos. I think the real breakthrough is AI that generates worlds. Not clips. Not cutscenes. Not pre-rendered environments. Worlds you can actually move through, interact with, and keep exploring in real time. The jump from “video generation” to “world simulation” is going to be much bigger than most people realize. Robbyant is one of the first projects I’ve seen pushing in that direction. 💻 Github: 🎮 Try it online: 🤗 Weights: 🌐 Website:

Everyone focused on AI that can generate videos. I think the real breakthrough is AI that generates worlds. Not clips. Not cutscenes. Not pre-rendered environments. Worlds you can actually move through, interact with, and keep exploring in real time. The jump from “video generation” to “world simulation” is going to be much bigger than most people realize. Robbyant is one of the first projects I’ve seen pushing in that direction. 💻 Github: 🎮 Try it online: 🤗 Weights: 🌐 Website:

haytam

42,978 次观看 • 1 个月前

Most AI companies are still trying to generate better videos. The more interesting challenge is generating worlds. Not worlds that look impressive for 20 seconds. Worlds that stay coherent, respond to every action, and keep unfolding as you explore them. That's why LingBot-World 2.0 stands out. The engineering isn't just about visual quality. It's about solving one of the hardest problems in generative AI: keeping an interactive world stable over long horizons without falling apart. And the fact that Robbyant decided to open-source both the model and the agentic harness makes this release even more interesting. It feels less like another AI demo and more like infrastructure for what's coming next. Robbyant 💻 GitHub: 🎮 Try it: 🤗 Weights:

Most AI companies are still trying to generate better videos. The more interesting challenge is generating worlds. Not worlds that look impressive for 20 seconds. Worlds that stay coherent, respond to every action, and keep unfolding as you explore them. That's why LingBot-World 2.0 stands out. The engineering isn't just about visual quality. It's about solving one of the hardest problems in generative AI: keeping an interactive world stable over long horizons without falling apart. And the fact that Robbyant decided to open-source both the model and the agentic harness makes this release even more interesting. It feels less like another AI demo and more like infrastructure for what's coming next. Robbyant 💻 GitHub: 🎮 Try it: 🤗 Weights:

Darshal Jaitwar

136,591 次观看 • 2 个月前

🌍 What if an AI-generated world didn’t end after a few seconds—but kept running for hours, responded to every move, let you attack, cast spells, shoot, or summon storms, and continued evolving through AI agents? That’s LingBot-World 2.0: our open-source real-time interactive world model, scaling to 720p/60fps in our full setup. Today, we’re open-sourcing 3 more models: 🔹 LingBot-World 2.0 Small (1.3B) 🔹 LingBot-World 2.0 Bidirectional 🔹 LingBot-World 2.0 Causal Pretrain And now, with our 1.3B Small Model, that world can run in real time on a single consumer GPU. 🧵

🌍 What if an AI-generated world didn’t end after a few seconds—but kept running for hours, responded to every move, let you attack, cast spells, shoot, or summon storms, and continued evolving through AI agents? That’s LingBot-World 2.0: our open-source real-time interactive world model, scaling to 720p/60fps in our full setup. Today, we’re open-sourcing 3 more models: 🔹 LingBot-World 2.0 Small (1.3B) 🔹 LingBot-World 2.0 Bidirectional 🔹 LingBot-World 2.0 Causal Pretrain And now, with our 1.3B Small Model, that world can run in real time on a single consumer GPU. 🧵

Robbyant

1,989,239 次观看 • 8 天前

Most AI world models impress you for 20 seconds. The harder problem is making them stay coherent. That's what stood out to me in Robbyant's LingBot-World-Infinity. Instead of chasing another resolution headline, the paper focuses on reducing autoregressive drift the issue where small prediction errors compound until the world slowly falls apart. Their stress test is a single uninterrupted 60-minute rollout across 20 different scenarios with no visible quality decay. If you want to see the interactive system yourself, it's live on Reactor: 🎮 I also like that they don't pretend it's perfect. The paper openly says it doesn't have true long-term memory. Leave an area and come back later, and it regenerates something plausible instead of recalling the exact same place. That's a refreshingly honest limitation. Open weights make it even more interesting to dig into. Robbyant For anyone who wants to explore the research: 💻 GitHub: 🤗 Model Weights:

Most AI world models impress you for 20 seconds. The harder problem is making them stay coherent. That's what stood out to me in Robbyant's LingBot-World-Infinity. Instead of chasing another resolution headline, the paper focuses on reducing autoregressive drift the issue where small prediction errors compound until the world slowly falls apart. Their stress test is a single uninterrupted 60-minute rollout across 20 different scenarios with no visible quality decay. If you want to see the interactive system yourself, it's live on Reactor: 🎮 I also like that they don't pretend it's perfect. The paper openly says it doesn't have true long-term memory. Leave an area and come back later, and it regenerates something plausible instead of recalling the exact same place. That's a refreshingly honest limitation. Open weights make it even more interesting to dig into. Robbyant For anyone who wants to explore the research: 💻 GitHub: 🤗 Model Weights:

Shruti Codes

15,066 次观看 • 2 个月前

This World Model 'LingBot-World-Infinity (LingBot-World 2.0)' just released from Ant Group looks realy promising. It is an open causal world model with an Agentic harness. Most interactive world models hold together for a few minutes. Then textures smear and geometry warps. That's a video model, not a world — and Robbyant just drew the line at the attention mask. They released LingBot-World-Infinity (LingBot-World 2.0) — a 14B open causal video world model built on Wan2.2, trained with a Mixture of Bidirectional and Autoregressive (MoBA) attention mask, then distilled into a few-step real-time generator with no post-hoc drift filtering anywhere in the stack. Here's what's actually interesting: → Pure teacher forcing overfits — as context grows, the model leans on context instead of predicting frames. MoBA appends a bidirectional full-attention block as a regularizer → Leak-free cross-attention: AR rows attend to background prompt a_B plus chunk prompts a_≤i, lower-triangular. Bidirectional rows see one global prompt a_G → DMD runs over long self-rollout trajectories, not teacher-forced states — the student is optimized on the distribution its own errors induce → Director-Pilot harness: a VLM proposes event cards, the DiT generator renders physical dynamics. Mode B adds a SAM tracking loop for object-centric interaction → One 60-minute uninterrupted session, 20 distinct scenarios, no perceptible decay Full analysis: Paper: Model weight: GitHub Repo: Project: Ant Group Robbyant

This World Model 'LingBot-World-Infinity (LingBot-World 2.0)' just released from Ant Group looks realy promising. It is an open causal world model with an Agentic harness. Most interactive world models hold together for a few minutes. Then textures smear and geometry warps. That's a video model, not a world — and Robbyant just drew the line at the attention mask. They released LingBot-World-Infinity (LingBot-World 2.0) — a 14B open causal video world model built on Wan2.2, trained with a Mixture of Bidirectional and Autoregressive (MoBA) attention mask, then distilled into a few-step real-time generator with no post-hoc drift filtering anywhere in the stack. Here's what's actually interesting: → Pure teacher forcing overfits — as context grows, the model leans on context instead of predicting frames. MoBA appends a bidirectional full-attention block as a regularizer → Leak-free cross-attention: AR rows attend to background prompt a_B plus chunk prompts a_≤i, lower-triangular. Bidirectional rows see one global prompt a_G → DMD runs over long self-rollout trajectories, not teacher-forced states — the student is optimized on the distribution its own errors induce → Director-Pilot harness: a VLM proposes event cards, the DiT generator renders physical dynamics. Mode B adds a SAM tracking loop for object-centric interaction → One 60-minute uninterrupted session, 20 distinct scenarios, no perceptible decay Full analysis: Paper: Model weight: GitHub Repo: Project: Ant Group Robbyant

Marktechpost AI

233,376 次观看 • 2 个月前

🦾 From seeing to doing. We're closing the loop between video prediction and real-world action. On the final day of Robbyant Open Source Week, we bring you LingBot-VA—the world's first causal video-action world model for generalist robot control. 🔥 Key Highlights: 🤖 Predicts & Acts: A single model generates both future video and the actions to make it real. 🧠 Remembers the Past: True long-term memory for complex, sequential tasks. ⚡ Learns in a Snap: Masters new skills with just 30-50 real-world demos. The result? 📈 SOTA on RoboTwin (92.9%) and LIBERO (98.5%), +20% over π0.5 on challenging real-world long-horizon & high-precision tasks. More below 👇 #AI #Robotics #EmbodiedAI #WorldModel #OpenSource

🦾 From seeing to doing. We're closing the loop between video prediction and real-world action. On the final day of Robbyant Open Source Week, we bring you LingBot-VA—the world's first causal video-action world model for generalist robot control. 🔥 Key Highlights: 🤖 Predicts & Acts: A single model generates both future video and the actions to make it real. 🧠 Remembers the Past: True long-term memory for complex, sequential tasks. ⚡ Learns in a Snap: Masters new skills with just 30-50 real-world demos. The result? 📈 SOTA on RoboTwin (92.9%) and LIBERO (98.5%), +20% over π0.5 on challenging real-world long-horizon & high-precision tasks. More below 👇 #AI #Robotics #EmbodiedAI #WorldModel #OpenSource

Robbyant

704,157 次观看 • 7 个月前

Today, we're sharing new research on GWM Worlds 2. Our latest General World Model that generates interactive real-time simulations in continuous 720p video at 24 fps with 48000 Hz audio. Built on top of our foundational audio-visual generation model, GWM Worlds 2 allows you to define the environment, subjects, visual style, physical rules and ambience of any world. Once inside, you steer it with text actions addressed to any subject or to the scene itself, alongside continuous camera motion. The world continues from each new input instead of following a fixed clip or script so sessions have no preset length. GWM Worlds 2 creates a new foundation for interactive entertainment, virtual characters, robotics and embodied-agent simulation. Learn more about GWM Worlds 2 at the link below.

Today, we're sharing new research on GWM Worlds 2. Our latest General World Model that generates interactive real-time simulations in continuous 720p video at 24 fps with 48000 Hz audio. Built on top of our foundational audio-visual generation model, GWM Worlds 2 allows you to define the environment, subjects, visual style, physical rules and ambience of any world. Once inside, you steer it with text actions addressed to any subject or to the scene itself, alongside continuous camera motion. The world continues from each new input instead of following a fixed clip or script so sessions have no preset length. GWM Worlds 2 creates a new foundation for interactive entertainment, virtual characters, robotics and embodied-agent simulation. Learn more about GWM Worlds 2 at the link below.

Runway

303,037 次观看 • 14 天前

Meet LingBot-World 2.0.🌍A 1.3B world model, running continuous interactive generation in real time on a single consumer GPU. 🤖 ⚡ It responds to movement, camera control, combat, and text-driven events in real time, while the scene keeps unfolding instead of ending as a fixed video clip. 🌌 Causal pretraining and MoBA help preserve textures, geometry, and scene consistency over long autoregressive rollouts. 🧠 Consistency and distribution-matching distillation compress multi-step generation and train the model on its own rollouts, reducing accumulated drift. 🛠️ The 14B Causal Pretrain backbone and Bidirectional teacher are also open, giving developers a path to post-train, distill, compress, and adapt new world models. 🔒 CC BY-NC-SA 4.0. Non-commercial use only.

Meet LingBot-World 2.0.🌍A 1.3B world model, running continuous interactive generation in real time on a single consumer GPU. 🤖 ⚡ It responds to movement, camera control, combat, and text-driven events in real time, while the scene keeps unfolding instead of ending as a fixed video clip. 🌌 Causal pretraining and MoBA help preserve textures, geometry, and scene consistency over long autoregressive rollouts. 🧠 Consistency and distribution-matching distillation compress multi-step generation and train the model on its own rollouts, reducing accumulated drift. 🛠️ The 14B Causal Pretrain backbone and Bidirectional teacher are also open, giving developers a path to post-train, distill, compress, and adapt new world models. 🔒 CC BY-NC-SA 4.0. Non-commercial use only.

ModelScope

33,630 次观看 • 7 天前

🚀🚀🚀Introducing HY World 1.5 (WorldPlay)! We have now open-sourced the most systemized, comprehensive real-time world model framework in the industry. In HY World 1.5, we develop WorldPlay, a streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency, resolving the trade-off between speed and memory that limits current methods. You can generate and explore 3D worlds simply by inputting text or images. Walk, look around, and interact like you're playing a game. Highlights: 🔹Real-Time: Generates long-horizon streaming video at 24 FPS with superior consistency. 🔹Geometric Consistency: Achieved using a Reconstituted Context Memory mechanism to dynamically rebuild context from past frames to alleviate memory attenuation 🔹Robust Control: Uses a Dual Action Representation for robust response to user keyboard and mouse inputs. 🔹Versatile Applications: Supports both first-person and third-person perspectives, enabling applications like promptable events and infinite world extension. 👉🏻Try it now: 🌐Project Page: 🔗Github: 🤗Hugging Face: 📄Technical Report:

🚀🚀🚀Introducing HY World 1.5 (WorldPlay)! We have now open-sourced the most systemized, comprehensive real-time world model framework in the industry. In HY World 1.5, we develop WorldPlay, a streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency, resolving the trade-off between speed and memory that limits current methods. You can generate and explore 3D worlds simply by inputting text or images. Walk, look around, and interact like you're playing a game. Highlights: 🔹Real-Time: Generates long-horizon streaming video at 24 FPS with superior consistency. 🔹Geometric Consistency: Achieved using a Reconstituted Context Memory mechanism to dynamically rebuild context from past frames to alleviate memory attenuation 🔹Robust Control: Uses a Dual Action Representation for robust response to user keyboard and mouse inputs. 🔹Versatile Applications: Supports both first-person and third-person perspectives, enabling applications like promptable events and infinite world extension. 👉🏻Try it now: 🌐Project Page: 🔗Github: 🤗Hugging Face: 📄Technical Report:

Tencent Hy

189,802 次观看 • 9 个月前

🚀 Announcing Echo — our new frontier model for 3D world generation. Echo turns a simple text prompt or image into a fully explorable, 3D-consistent world. Instead of disconnected views, the result is a single, coherent spatial representation you can move through freely. This is part of a bigger shift in AI: from generating pixels and tokens to generating spaces. Echo predicts a geometry-grounded 3D scene at metric scale, meaning every novel view, depth map, and interaction comes from the same underlying world — not independent hallucinations. Once generated, the world is interactive in real time. You control the camera, explore from any angle, and render instantly — even on low-end hardware, directly in the browser. High-quality 3D world exploration is no longer gated by expensive equipment. Under the hood, Echo infers a physically grounded 3D representation and converts it into a renderable format. For our web demo, we use 3D Gaussian Splatting (3DGS) for fast, GPU-friendly rendering — but the representation itself is flexible and can be easily adapted. Why this matters: consistent 3D worlds unlock real workflows — digital twins, 3D design, game environments, robotics simulation, and more. From a single photo or a line of text, Echo builds worlds that are reliable, editable, and spatially faithful. Echo also enables scene editing and restyling. Change materials, remove or add objects, explore design variations — all while preserving global 3D consistency. Editing no longer breaks the world. This is only the beginning. Echo is the foundation for future world models with dynamics, physical reasoning, and richer interaction — environments that don’t just look right, but behave right. Explore the generated worlds on our website and sign up for the closed beta. The era of spatial intelligence starts here. 🌍 #Echo #WorldModels #SpatialAI #3DFoundationModels Check it out:

🚀 Announcing Echo — our new frontier model for 3D world generation. Echo turns a simple text prompt or image into a fully explorable, 3D-consistent world. Instead of disconnected views, the result is a single, coherent spatial representation you can move through freely. This is part of a bigger shift in AI: from generating pixels and tokens to generating spaces. Echo predicts a geometry-grounded 3D scene at metric scale, meaning every novel view, depth map, and interaction comes from the same underlying world — not independent hallucinations. Once generated, the world is interactive in real time. You control the camera, explore from any angle, and render instantly — even on low-end hardware, directly in the browser. High-quality 3D world exploration is no longer gated by expensive equipment. Under the hood, Echo infers a physically grounded 3D representation and converts it into a renderable format. For our web demo, we use 3D Gaussian Splatting (3DGS) for fast, GPU-friendly rendering — but the representation itself is flexible and can be easily adapted. Why this matters: consistent 3D worlds unlock real workflows — digital twins, 3D design, game environments, robotics simulation, and more. From a single photo or a line of text, Echo builds worlds that are reliable, editable, and spatially faithful. Echo also enables scene editing and restyling. Change materials, remove or add objects, explore design variations — all while preserving global 3D consistency. Editing no longer breaks the world. This is only the beginning. Echo is the foundation for future world models with dynamics, physical reasoning, and richer interaction — environments that don’t just look right, but behave right. Explore the generated worlds on our website and sign up for the closed beta. The era of spatial intelligence starts here. 🌍 #Echo #WorldModels #SpatialAI #3DFoundationModels Check it out:

SpAItial AI

176,903 次观看 • 9 个月前

Breaking news: Cosmos 3 is here. They are attempting to do something completely new 🤯 Why is Physical AI much harder than building a chatbot? Understanding the world is not enough, robots need to predict it and act inside it. That's the idea behind NVIDIA Cosmos 3: → Reasoning model understands what's happening from video, images, text, and actions. → World model generates future states of the environment. → Action model generates the actions needed to achieve a goal. Previous systems often stitched these capabilities together using separate models. Cosmos 3 combines them into a single architecture with two components: ▪️ Reasoner Tower Analyzes observations and builds an understanding of objects, motion, interactions, and physical context. ▪️ Generator Tower Uses that understanding to generate future videos and action sequences that obey physical constraints. So Cosmos 3 moves from: Perception → Model A Prediction → Model B Actions → Model C to: Perception + Prediction + Actions → One unified system. The goal is to make robots, autonomous vehicles, and smart environments better at answering three questions: 1. What is happening? 2. What will happen next? 3. What should I do? That's a big shift from today's AI, which mostly focuses on generating text. And check the benchmarks! Physical AI needs to generate decisions that survive contact with the real world. 🚗🤖

Breaking news: Cosmos 3 is here. They are attempting to do something completely new 🤯 Why is Physical AI much harder than building a chatbot? Understanding the world is not enough, robots need to predict it and act inside it. That's the idea behind NVIDIA Cosmos 3: → Reasoning model understands what's happening from video, images, text, and actions. → World model generates future states of the environment. → Action model generates the actions needed to achieve a goal. Previous systems often stitched these capabilities together using separate models. Cosmos 3 combines them into a single architecture with two components: ▪️ Reasoner Tower Analyzes observations and builds an understanding of objects, motion, interactions, and physical context. ▪️ Generator Tower Uses that understanding to generate future videos and action sequences that obey physical constraints. So Cosmos 3 moves from: Perception → Model A Prediction → Model B Actions → Model C to: Perception + Prediction + Actions → One unified system. The goal is to make robots, autonomous vehicles, and smart environments better at answering three questions: 1. What is happening? 2. What will happen next? 3. What should I do? That's a big shift from today's AI, which mostly focuses on generating text. And check the benchmarks! Physical AI needs to generate decisions that survive contact with the real world. 🚗🤖

Turing Post

13,836 次观看 • 3 个月前

SITUATION EXPLAINED: A new generation of AI labs are betting that world models are the path to general intelligence that can interact with the real world. We had General Intuition CEO Pim de Witte on MTS to explain what world models are, and why intuitively world models offer a clearer path towards general intelligence than LLMs. For humans, text is a technology for compressing information about the unfolding, three-dimensional world around us and communicating it to other people. When LLMs reason about the world, they do so by reconstructing the world through text. World models work by modeling the three-dimensional world at the architecture level and then allowing agents to interact with that world. Unlike an LLM, which understands space and time through text, world models perform spatial and temporal reasoning natively. General Intuition hopes to use world models to create embodied AI—machines that can reason and act in the real world. But other companies are also pushing the frontier in this space. Odyssey ML today announced a multi-agent world model, Agora-1. Their launch video shows four participants interacting with a real-time world model simulation of GoldenEye, a first-person shooter for the N64. A playable preview of the GoldenEye simulation is available on their site.

SITUATION EXPLAINED: A new generation of AI labs are betting that world models are the path to general intelligence that can interact with the real world. We had General Intuition CEO Pim de Witte on MTS to explain what world models are, and why intuitively world models offer a clearer path towards general intelligence than LLMs. For humans, text is a technology for compressing information about the unfolding, three-dimensional world around us and communicating it to other people. When LLMs reason about the world, they do so by reconstructing the world through text. World models work by modeling the three-dimensional world at the architecture level and then allowing agents to interact with that world. Unlike an LLM, which understands space and time through text, world models perform spatial and temporal reasoning natively. General Intuition hopes to use world models to create embodied AI—machines that can reason and act in the real world. But other companies are also pushing the frontier in this space. Odyssey ML today announced a multi-agent world model, Agora-1. Their launch video shows four participants interacting with a real-time world model simulation of GoldenEye, a first-person shooter for the N64. A playable preview of the GoldenEye simulation is available on their site.

MTS

11,676 次观看 • 4 个月前

World models are moving beyond offline generation towards interactive, real-time experiences. Introducing ⚡FlashDreams⚡: an open-source high-performance inference and serving library built for autoregressive world models: 🔥 Up to 3.10× faster LingBot-World inference 🔥 Up to 2.12× faster Self-Forcing inference 🔥 Up to 1.40× faster Wan2.1 inference 🔥 8 integrated models 🔥 Multi-GPU, streaming, low-latency serving 🔥 Agentic skills that teach you how to use it FlashDreams is designed for a new generation of AI systems that continuously evolve over time while responding to user interactions. It powers applications across robotics, autonomous vehicle simulation, gaming, and virtual worlds. Github: Docs: Research page: Join the #flashdreams Discord channel at FlashDreams is also the runtime backbone behind NVIDIA OmniDreams ( 1/n #AI #WorldModels #FastInference #PhysicalAI #OpenSource #NVIDIA

World models are moving beyond offline generation towards interactive, real-time experiences. Introducing ⚡FlashDreams⚡: an open-source high-performance inference and serving library built for autoregressive world models: 🔥 Up to 3.10× faster LingBot-World inference 🔥 Up to 2.12× faster Self-Forcing inference 🔥 Up to 1.40× faster Wan2.1 inference 🔥 8 integrated models 🔥 Multi-GPU, streaming, low-latency serving 🔥 Agentic skills that teach you how to use it FlashDreams is designed for a new generation of AI systems that continuously evolve over time while responding to user interactions. It powers applications across robotics, autonomous vehicle simulation, gaming, and virtual worlds. Github: Docs: Research page: Join the #flashdreams Discord channel at FlashDreams is also the runtime backbone behind NVIDIA OmniDreams ( 1/n #AI #WorldModels #FastInference #PhysicalAI #OpenSource #NVIDIA

Ruilong Li

99,443 次观看 • 3 个月前

Over the past two years, AI video models have been competing on realism, resolution, and duration. But no matter how impressive the results look, we remain passive viewers: we press play, watch the clip, and it ends. AlayaWorld Alaya Lab is attempting something fundamentally different. Instead of generating a fixed video, it generates a world that continues to unfold as you move through it. These three demos show the same journey toward a green village rendered in three distinct styles: photorealistic, oil painting, and line art. As the camera moves forward, the model continues generating the road, fences, trees, and distant village. This is not simply an existing video with different filters applied. The environment is generated continuously along the camera trajectory, allowing the scene to develop as the user explores it. AlayaWorld streams video at 720p and 24 FPS while supporting camera movement and viewpoint control. The real breakthrough is not just image quality. Once generation becomes fast enough to respond within an interactive loop, the user is no longer merely watching a video. They become a participant inside the generated world. The world can also respond to new instructions. During generation, users can introduce prompts that trigger spells, summon characters, create explosions, or transform the environment. Most video models follow an initial prompt and produce a predetermined clip. AlayaWorld can respond to changing intent while the world is still running, allowing subsequent events to evolve according to the user’s commands. Generating an attractive frame is relatively easy. Maintaining a coherent world over time is much harder. As a video model repeatedly predicts the next frame, small errors can accumulate until roads, buildings, and objects begin to distort or disappear. AlayaWorld combines spatial memory with compressed historical context, helping the model remember both where things are and what has already happened. This enables stable generation lasting more than one minute while improving consistency when the camera leaves an area and later returns. This may be the next step for AI video: not simply generating a longer movie, but generating a world that can be explored, changed, and interacted with. AlayaWorld is developed by Alaya Lab. The team is progressively releasing its inference code, training code, and datasets, with an online experience expected to launch near the end of the month. Project page:

Over the past two years, AI video models have been competing on realism, resolution, and duration. But no matter how impressive the results look, we remain passive viewers: we press play, watch the clip, and it ends. AlayaWorld Alaya Lab is attempting something fundamentally different. Instead of generating a fixed video, it generates a world that continues to unfold as you move through it. These three demos show the same journey toward a green village rendered in three distinct styles: photorealistic, oil painting, and line art. As the camera moves forward, the model continues generating the road, fences, trees, and distant village. This is not simply an existing video with different filters applied. The environment is generated continuously along the camera trajectory, allowing the scene to develop as the user explores it. AlayaWorld streams video at 720p and 24 FPS while supporting camera movement and viewpoint control. The real breakthrough is not just image quality. Once generation becomes fast enough to respond within an interactive loop, the user is no longer merely watching a video. They become a participant inside the generated world. The world can also respond to new instructions. During generation, users can introduce prompts that trigger spells, summon characters, create explosions, or transform the environment. Most video models follow an initial prompt and produce a predetermined clip. AlayaWorld can respond to changing intent while the world is still running, allowing subsequent events to evolve according to the user’s commands. Generating an attractive frame is relatively easy. Maintaining a coherent world over time is much harder. As a video model repeatedly predicts the next frame, small errors can accumulate until roads, buildings, and objects begin to distort or disappear. AlayaWorld combines spatial memory with compressed historical context, helping the model remember both where things are and what has already happened. This enables stable generation lasting more than one minute while improving consistency when the camera leaves an area and later returns. This may be the next step for AI video: not simply generating a longer movie, but generating a world that can be explored, changed, and interacted with. AlayaWorld is developed by Alaya Lab. The team is progressively releasing its inference code, training code, and datasets, with an online experience expected to launch near the end of the month. Project page:

Rachel🥥

78,293 次观看 • 2 个月前

AI for robotics has some monumental challenges, like high dimensionality and reasoning with the physical world. Ashok Elluswamy, AI lead at Tesla, thinks the hardest problem is Evaluation. - Loss isn't a perfect indicator of Policy Neural Network's quality. - Testing in the real world for all the long-tail failure cases is not possible. To solve the evaluation challenge, Tesla has developed a World Simulator Model. It is trained on state and action pairs, so for a given current camera feed and current action, the model generates the next frame in the cameras. Once the world simulation is good enough, it can be hooked up to the policy network for a closed-loop simulation. In this setup, the model generates the next video frames, and based on those, the policy network comes up with the next action, which feeds back into the world simulation; this continuous loop creates a coherent simulation. The world simulation neural network is not just applicable to self-driving but also to humanoids, because Tesla trains it on common data. The examples show Optimus navigating or manipulating inside the world simulation, with all the pixels being generated by the world simulation model. The robotic agents can be tested in an accurately reproduced edge case and in other potential variations of the same edge case.

AI for robotics has some monumental challenges, like high dimensionality and reasoning with the physical world. Ashok Elluswamy, AI lead at Tesla, thinks the hardest problem is Evaluation. - Loss isn't a perfect indicator of Policy Neural Network's quality. - Testing in the real world for all the long-tail failure cases is not possible. To solve the evaluation challenge, Tesla has developed a World Simulator Model. It is trained on state and action pairs, so for a given current camera feed and current action, the model generates the next frame in the cameras. Once the world simulation is good enough, it can be hooked up to the policy network for a closed-loop simulation. In this setup, the model generates the next video frames, and based on those, the policy network comes up with the next action, which feeds back into the world simulation; this continuous loop creates a coherent simulation. The world simulation neural network is not just applicable to self-driving but also to humanoids, because Tesla trains it on common data. The examples show Optimus navigating or manipulating inside the world simulation, with all the pixels being generated by the world simulation model. The robotic agents can be tested in an accurately reproduced edge case and in other potential variations of the same edge case.

The Humanoid Hub

17,065 次观看 • 7 个月前

Most video-action robot models are a content-creation video generator with an action module attached. LingBot-VA 2.0 from Robbyant, a video-action foundation model, throws that starting point out and trains the whole stack natively for control. And it runs closed-loop at a peak 225 Hz. It's so important because A robot cannot move responsively when its controller pauses to imagine the next few frames. LingBot-VA 2.0 predicts during execution, then corrects using each real observation. And it carries only about 13B video parameters while activating roughly 1.9B per token. Bigger robot models usually mean slower reactions, creating a direct conflict between intelligence and control. LingBot-VA 2.0 is trained from scratch for robot control rather than adapted from a video generator built for content creation. Robbyant, an embodied AI company under Ant Group, built it to learn how scenes change under actions, predict what should happen next, and turn those predictions into real-time robot movements. Most video-action systems inherit a tokenizer and video backbone trained mainly to reproduce visual appearance. LingBot-VA 2.0 rebuilds both parts around physical control. Its semantic visual-action tokenizer maps observations toward features from a frozen vision foundation model and learns compact latent actions from frame-to-frame changes using self-supervised inverse and forward dynamics. Unlabeled web video can therefore carry action-relevant training signals without robot action labels. The policy is causal from the start, so every prediction can use only past observations. Its sparse Mixture-of-Experts video backbone has about 13B total parameters, while about 1.9B are active per token, keeping the compute lower during each step. A high-level vision-language planner breaks long tasks into smaller instructions, while the low-level video-action policy handles continuous movement. Foresight Reasoning predicts future visual states while the robot is already acting, then replaces imagined states with every new real observation. Combined with few-step distillation and systems acceleration, the paper reports a peak asynchronous execution frequency of 225 Hz. The model adapts from 10–15 demonstrations, transfers across robot embodiments, and handles some new tasks zero-shot. In the paper’s own evaluations, it reaches 93.6 average on RoboTwin 2.0 and reports stronger real-world results than LingBot-VA and π0.5 across the tested tasks. 🧵 1.

Most video-action robot models are a content-creation video generator with an action module attached. LingBot-VA 2.0 from Robbyant, a video-action foundation model, throws that starting point out and trains the whole stack natively for control. And it runs closed-loop at a peak 225 Hz. It's so important because A robot cannot move responsively when its controller pauses to imagine the next few frames. LingBot-VA 2.0 predicts during execution, then corrects using each real observation. And it carries only about 13B video parameters while activating roughly 1.9B per token. Bigger robot models usually mean slower reactions, creating a direct conflict between intelligence and control. LingBot-VA 2.0 is trained from scratch for robot control rather than adapted from a video generator built for content creation. Robbyant, an embodied AI company under Ant Group, built it to learn how scenes change under actions, predict what should happen next, and turn those predictions into real-time robot movements. Most video-action systems inherit a tokenizer and video backbone trained mainly to reproduce visual appearance. LingBot-VA 2.0 rebuilds both parts around physical control. Its semantic visual-action tokenizer maps observations toward features from a frozen vision foundation model and learns compact latent actions from frame-to-frame changes using self-supervised inverse and forward dynamics. Unlabeled web video can therefore carry action-relevant training signals without robot action labels. The policy is causal from the start, so every prediction can use only past observations. Its sparse Mixture-of-Experts video backbone has about 13B total parameters, while about 1.9B are active per token, keeping the compute lower during each step. A high-level vision-language planner breaks long tasks into smaller instructions, while the low-level video-action policy handles continuous movement. Foresight Reasoning predicts future visual states while the robot is already acting, then replaces imagined states with every new real observation. Combined with few-step distillation and systems acceleration, the paper reports a peak asynchronous execution frequency of 225 Hz. The model adapts from 10–15 demonstrations, transfers across robot embodiments, and handles some new tasks zero-shot. In the paper’s own evaluations, it reaches 93.6 average on RoboTwin 2.0 and reports stronger real-world results than LingBot-VA and π0.5 across the tested tasks. 🧵 1.

Rohan Paul

11,253 次观看 • 2 个月前

At Avalon we are building "Real-time creating" - the ability to generate gameplay ready persistent worlds prompted from text. While others are building real-time video world models, Avalon is building real-time world generation inside a fully playable, persistent multiplayer engine. Internally running at 3840×2180 at 60 FPS. Built on Unreal Engine. Multiplayer by default. Persistent by default. Gameplay-ready by default. This is not a video latent replay. Not a simulation of interaction. It is a real 3D world with physics, logic, and authoritative multiplayer state. Avalon is trained on proprietary Avalon interaction data and powered by a hybrid system that combines language understanding, 3D model generation, procedural systems, and structured gameplay logic synthesis. Players can walk through a live world and generate environments, assets, mechanics, and entirely new gameplay modes using natural language. We accomplish this through a combination of 3D model generation, game logic generation based on our proprietary systems, and AI driven world creation. While other players are inside it. Changes persist instantly. State is synchronized in real time. Creation happens inside the world, not outside of it. Describe a biome. Spawn a civilization. Create a survival mode. Build a dungeon crawler. Launch a new game inside the world. Avalon interprets intent and integrates it directly into the live multiplayer environment. This is not a world model predicting video. This is a gameplay engine that understands language. If you can describe it, you can build it. And others can walk into it instantly.

At Avalon we are building "Real-time creating" - the ability to generate gameplay ready persistent worlds prompted from text. While others are building real-time video world models, Avalon is building real-time world generation inside a fully playable, persistent multiplayer engine. Internally running at 3840×2180 at 60 FPS. Built on Unreal Engine. Multiplayer by default. Persistent by default. Gameplay-ready by default. This is not a video latent replay. Not a simulation of interaction. It is a real 3D world with physics, logic, and authoritative multiplayer state. Avalon is trained on proprietary Avalon interaction data and powered by a hybrid system that combines language understanding, 3D model generation, procedural systems, and structured gameplay logic synthesis. Players can walk through a live world and generate environments, assets, mechanics, and entirely new gameplay modes using natural language. We accomplish this through a combination of 3D model generation, game logic generation based on our proprietary systems, and AI driven world creation. While other players are inside it. Changes persist instantly. State is synchronized in real time. Creation happens inside the world, not outside of it. Describe a biome. Spawn a civilization. Create a survival mode. Build a dungeon crawler. Launch a new game inside the world. Avalon interprets intent and integrates it directly into the live multiplayer environment. This is not a world model predicting video. This is a gameplay engine that understands language. If you can describe it, you can build it. And others can walk into it instantly.

AVALON

65,084 次观看 • 7 个月前

This is THE moment of Physical AI! We are officially announcing Cosmos 3: Omnimodal World Models for Physical AI 🚀 - Cosmos 3 is an omnimodal world model: within a unified architecture, it can understand and generate language, images, video, audio, and actions. - It is not just a VLM, not just a video generator, not just an audio-visual generative model, and not just a physics simulator / world-action model. It can understand images and videos, generate images, videos, and audio, simulate future worlds, predict actions, and generate robot policies—enabling models to truly begin to “touch the world.” - Cosmos 3 is the #1 open-weight reasoner / T2I / I2V / robot policy across many benchmarks. Huge thanks to every teammate who fought side by side on this journey—from architecture, data, training, infra, serving, and evaluation to post-training. Every part of this project carries an incredible amount of hard work. This was my first time leading a project as Tech Lead, and I feel truly fortunate. The future of Physical AI needs models that can not only “see” and “describe” the world, but also “imagine,” “simulate,” and “act”—and eventually close the loop with the real world. I hope Cosmos 3 can become an important starting point for this direction, and I’m excited to push Physical AI into its next stage together with the open-source community. Welcome to the era of Physical AI. HuggingFace: Project Website: Code:

This is THE moment of Physical AI! We are officially announcing Cosmos 3: Omnimodal World Models for Physical AI 🚀 - Cosmos 3 is an omnimodal world model: within a unified architecture, it can understand and generate language, images, video, audio, and actions. - It is not just a VLM, not just a video generator, not just an audio-visual generative model, and not just a physics simulator / world-action model. It can understand images and videos, generate images, videos, and audio, simulate future worlds, predict actions, and generate robot policies—enabling models to truly begin to “touch the world.” - Cosmos 3 is the #1 open-weight reasoner / T2I / I2V / robot policy across many benchmarks. Huge thanks to every teammate who fought side by side on this journey—from architecture, data, training, infra, serving, and evaluation to post-training. Every part of this project carries an incredible amount of hard work. This was my first time leading a project as Tech Lead, and I feel truly fortunate. The future of Physical AI needs models that can not only “see” and “describe” the world, but also “imagine,” “simulate,” and “act”—and eventually close the loop with the real world. I hope Cosmos 3 can become an important starting point for this direction, and I’m excited to push Physical AI into its next stage together with the open-source community. Welcome to the era of Physical AI. HuggingFace: Project Website: Code:

Max Zhaoshuo Li 李赵硕

1,079,765 次观看 • 3 个月前

Google DeepMind just dropped 'Genie', an AI that can generate interactive video games. This is a huge deal. Genie is trained on 200,000 hours of unsupervised public internet gaming videos and can generate video games from a single prompt or image. But here's what's insane: Despite not being trained on action or text annotations, the foundation model can determine who the main character is and enable a user to control that character in the generated world. It does this through its Latent Action Model, Video Tokenizer, and Dynamics Model (will go more in-depth on this in tomorrow's newsletter for those interested). And for those asking, yes, it's research-only and not publicly available (here come the Google memes), and it does come with some limitations, like only currently creating games at 1FPS. But this is the worst AI will ever be. Anyone will be able to create their own entirely imagined virtual worlds soon, and that's a wild sentence to say out loud.

Google DeepMind just dropped 'Genie', an AI that can generate interactive video games. This is a huge deal. Genie is trained on 200,000 hours of unsupervised public internet gaming videos and can generate video games from a single prompt or image. But here's what's insane: Despite not being trained on action or text annotations, the foundation model can determine who the main character is and enable a user to control that character in the generated world. It does this through its Latent Action Model, Video Tokenizer, and Dynamics Model (will go more in-depth on this in tomorrow's newsletter for those interested). And for those asking, yes, it's research-only and not publicly available (here come the Google memes), and it does come with some limitations, like only currently creating games at 1FPS. But this is the worst AI will ever be. Anyone will be able to create their own entirely imagined virtual worlds soon, and that's a wild sentence to say out loud.

Rowan Cheung

3,378,041 次观看 • 2 年前

AI video companies are no longer claiming they can simply generate better clips. They are claiming their models understand the world. So Peter and I put that claim to the test. We sat down with Yaron Inger, Co-Founder and CTO of LTX.io , for a direct conversation about LTX-2.5, its new open-weights video and world model. We asked what the model actually understands beyond producing plausible frames. Whether its physics are good enough for robotics. What native multi-shot generation really remembers across cuts. Whether its speed benchmarks are fair. What creators can expect on hardware they can realistically afford. And how LTX plans to build a business when the weights are available to download. This is not a product demo. It is a conversation about whether AI video is becoming genuine infrastructure for filmmaking, simulation, and physical AI. Watch the full interview:

AI video companies are no longer claiming they can simply generate better clips. They are claiming their models understand the world. So Peter and I put that claim to the test. We sat down with Yaron Inger, Co-Founder and CTO of LTX.io , for a direct conversation about LTX-2.5, its new open-weights video and world model. We asked what the model actually understands beyond producing plausible frames. Whether its physics are good enough for robotics. What native multi-shot generation really remembers across cuts. Whether its speed benchmarks are fair. What creators can expect on hardware they can realistically afford. And how LTX plans to build a business when the weights are available to download. This is not a product demo. It is a conversation about whether AI video is becoming genuine infrastructure for filmmaking, simulation, and physical AI. Watch the full interview:

Chubby♨️

22,391 次观看 • 15 天前