Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

Introducing LingBot-World: An open-source world simulator pushing the boundaries of video generation. 🚀 🌍 High-Fidelity: Realistic, scientific, & stylized. 🧠 Long-Term Memory: Minute-level consistency. ⚡ Real-Time: <1s latency at 16 FPS. 📜 Apache 2.0 Licensed. Model: Github:

ModelScope

6,182 subscribers

28,809 просмотров • 8 месяцев назад •via X (Twitter)

Игры Наука и технологии

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

No words. Just wow. LingBot-World: A playable open-source world model built on Wan2.2+Qwen3-VL-2B; - real-time interactive simulation at 720p@16fps, <1s latency; - minute-long contextual memory. - open source!

No words. Just wow. LingBot-World: A playable open-source world model built on Wan2.2+Qwen3-VL-2B; - real-time interactive simulation at 720p@16fps, <1s latency; - minute-long contextual memory. - open source!

Wildminder

36,918 просмотров • 8 месяцев назад

🔥 Very excited to share that we’re releasing LingBot-World 🌍 Robbyant — an open-source frontier world model! We’re pushing the limits of: 🔹 High-Fidelity Simulation & Precise Control 🔹 Long-Horizon Consistency & Memory 🔹 Modeling Physical & Game Worlds The most surprising part? The emergence of sophisticated behaviors that go beyond simple video generation. 👇I’m obsessed with this dragon demo 🐉. It can rollout for 1 min while maintaining crisp visual dynamics and consistent memory!

🔥 Very excited to share that we’re releasing LingBot-World 🌍 Robbyant — an open-source frontier world model! We’re pushing the limits of: 🔹 High-Fidelity Simulation & Precise Control 🔹 Long-Horizon Consistency & Memory 🔹 Modeling Physical & Game Worlds The most surprising part? The emergence of sophisticated behaviors that go beyond simple video generation. 👇I’m obsessed with this dragon demo 🐉. It can rollout for 1 min while maintaining crisp visual dynamics and consistent memory!

Yinghao Xu

41,657 просмотров • 8 месяцев назад

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source

The Humanoid Hub

17,721 просмотров • 8 месяцев назад

That was quick: last week Genie 3 was revealed. One week later Skywork AI releases Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model. Matrix-Game 2.0 can generate high-quality minute-level videos across diverse scenes at an ultra-fast speed of 25 FPS. They open-source our model weights and codebase to advance research in interactive world modeling. Some examples:

That was quick: last week Genie 3 was revealed. One week later Skywork AI releases Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model. Matrix-Game 2.0 can generate high-quality minute-level videos across diverse scenes at an ultra-fast speed of 25 FPS. They open-source our model weights and codebase to advance research in interactive world modeling. Some examples:

Chubby♨️

115,301 просмотров • 1 год назад

Introducing The Matrix --- a foundation world model for generating infinite-length, hyper-realistic videos with real-time, frame-level control: - Infinite-length video generation - 720p high-quality rendering - Real-time, frame-level control at 16 FPS - Generalization to real-world video control 🔗Blog: 📄Paper: 💻Code & Playable Demo: Coming soon! Key Innovation: A brand new technique called the shift-window denoise process model, enabling auto-regressive generation for diffusion and consistency models in real-time. Special thanks to project leader Ruili Feng and the entire Matrix team for their dedication and hard work over the year-long project.

Hongyang Zhang

178,482 просмотров • 1 год назад

Robbyant released LingBot-World 2.0 (Infinity), a new open-source World model capable of generating hour-long experiences. > No quality decay, stable 720p / 60 fps real-time output. > Users can interact with the world via Actions. > The world is dynamic, with built-in agents generating new events in real time. > Multiplayer is supported within the same world. Testing time 👀

Robbyant released LingBot-World 2.0 (Infinity), a new open-source World model capable of generating hour-long experiences. > No quality decay, stable 720p / 60 fps real-time output. > Users can interact with the world via Actions. > The world is dynamic, with built-in agents generating new events in real time. > Multiplayer is supported within the same world. Testing time 👀

🚨 AI News | TestingCatalog

15,272 просмотров • 3 месяцев назад

A real-time world simulator, now in 0.5B. ABot-World-0.5B-LF brings action-conditioned interactive rollout to ModelScope. 🎮License: Apache 2.0. 🤖 ⚡ Desktop-ready rollout: reported at 720p, 16 FPS, 1.2s latency, and 19GB GPU memory on a single-desktop setup. 🌍 Infinite interaction: responds to user actions continuously and keeps generating beyond fixed video-length limits. 🎬 LongForcing training helps the model expand new scenes and dynamics during rollout, without prompt switching or scene lock-in. 🛠️ Built on Wan2.2-TI2V-5B as a causal student model for lower-latency interactive world rollout.

A real-time world simulator, now in 0.5B. ABot-World-0.5B-LF brings action-conditioned interactive rollout to ModelScope. 🎮License: Apache 2.0. 🤖 ⚡ Desktop-ready rollout: reported at 720p, 16 FPS, 1.2s latency, and 19GB GPU memory on a single-desktop setup. 🌍 Infinite interaction: responds to user actions continuously and keeps generating beyond fixed video-length limits. 🎬 LongForcing training helps the model expand new scenes and dynamics during rollout, without prompt switching or scene lock-in. 🛠️ Built on Wan2.2-TI2V-5B as a causal student model for lower-latency interactive world rollout.

ModelScope

19,642 просмотров • 3 месяцев назад

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵

Chubby♨️

37,776 просмотров • 10 месяцев назад

Meet LingBot-World 2.0.🌍A 1.3B world model, running continuous interactive generation in real time on a single consumer GPU. 🤖 ⚡ It responds to movement, camera control, combat, and text-driven events in real time, while the scene keeps unfolding instead of ending as a fixed video clip. 🌌 Causal pretraining and MoBA help preserve textures, geometry, and scene consistency over long autoregressive rollouts. 🧠 Consistency and distribution-matching distillation compress multi-step generation and train the model on its own rollouts, reducing accumulated drift. 🛠️ The 14B Causal Pretrain backbone and Bidirectional teacher are also open, giving developers a path to post-train, distill, compress, and adapt new world models. 🔒 CC BY-NC-SA 4.0. Non-commercial use only.

Meet LingBot-World 2.0.🌍A 1.3B world model, running continuous interactive generation in real time on a single consumer GPU. 🤖 ⚡ It responds to movement, camera control, combat, and text-driven events in real time, while the scene keeps unfolding instead of ending as a fixed video clip. 🌌 Causal pretraining and MoBA help preserve textures, geometry, and scene consistency over long autoregressive rollouts. 🧠 Consistency and distribution-matching distillation compress multi-step generation and train the model on its own rollouts, reducing accumulated drift. 🛠️ The 14B Causal Pretrain backbone and Bidirectional teacher are also open, giving developers a path to post-train, distill, compress, and adapt new world models. 🔒 CC BY-NC-SA 4.0. Non-commercial use only.

ModelScope

33,630 просмотров • 1 месяц назад

🚀🚀🚀Introducing HY World 1.5 (WorldPlay)! We have now open-sourced the most systemized, comprehensive real-time world model framework in the industry. In HY World 1.5, we develop WorldPlay, a streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency, resolving the trade-off between speed and memory that limits current methods. You can generate and explore 3D worlds simply by inputting text or images. Walk, look around, and interact like you're playing a game. Highlights: 🔹Real-Time: Generates long-horizon streaming video at 24 FPS with superior consistency. 🔹Geometric Consistency: Achieved using a Reconstituted Context Memory mechanism to dynamically rebuild context from past frames to alleviate memory attenuation 🔹Robust Control: Uses a Dual Action Representation for robust response to user keyboard and mouse inputs. 🔹Versatile Applications: Supports both first-person and third-person perspectives, enabling applications like promptable events and infinite world extension. 👉🏻Try it now: 🌐Project Page: 🔗Github: 🤗Hugging Face: 📄Technical Report:

🚀🚀🚀Introducing HY World 1.5 (WorldPlay)! We have now open-sourced the most systemized, comprehensive real-time world model framework in the industry. In HY World 1.5, we develop WorldPlay, a streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency, resolving the trade-off between speed and memory that limits current methods. You can generate and explore 3D worlds simply by inputting text or images. Walk, look around, and interact like you're playing a game. Highlights: 🔹Real-Time: Generates long-horizon streaming video at 24 FPS with superior consistency. 🔹Geometric Consistency: Achieved using a Reconstituted Context Memory mechanism to dynamically rebuild context from past frames to alleviate memory attenuation 🔹Robust Control: Uses a Dual Action Representation for robust response to user keyboard and mouse inputs. 🔹Versatile Applications: Supports both first-person and third-person perspectives, enabling applications like promptable events and infinite world extension. 👉🏻Try it now: 🌐Project Page: 🔗Github: 🤗Hugging Face: 📄Technical Report:

Tencent Hy

190,264 просмотров • 10 месяцев назад

🦾 From seeing to doing. We're closing the loop between video prediction and real-world action. On the final day of Robbyant Open Source Week, we bring you LingBot-VA—the world's first causal video-action world model for generalist robot control. 🔥 Key Highlights: 🤖 Predicts & Acts: A single model generates both future video and the actions to make it real. 🧠 Remembers the Past: True long-term memory for complex, sequential tasks. ⚡ Learns in a Snap: Masters new skills with just 30-50 real-world demos. The result? 📈 SOTA on RoboTwin (92.9%) and LIBERO (98.5%), +20% over π0.5 on challenging real-world long-horizon & high-precision tasks. More below 👇 #AI #Robotics #EmbodiedAI #WorldModel #OpenSource

🦾 From seeing to doing. We're closing the loop between video prediction and real-world action. On the final day of Robbyant Open Source Week, we bring you LingBot-VA—the world's first causal video-action world model for generalist robot control. 🔥 Key Highlights: 🤖 Predicts & Acts: A single model generates both future video and the actions to make it real. 🧠 Remembers the Past: True long-term memory for complex, sequential tasks. ⚡ Learns in a Snap: Masters new skills with just 30-50 real-world demos. The result? 📈 SOTA on RoboTwin (92.9%) and LIBERO (98.5%), +20% over π0.5 on challenging real-world long-horizon & high-precision tasks. More below 👇 #AI #Robotics #EmbodiedAI #WorldModel #OpenSource

Robbyant

704,157 просмотров • 8 месяцев назад

🚀 Introducing Hy-Nomas: An Open Source Free-Form Interactive Video World Model Key Features: * Free-form interaction with text prompts and camera trajectories * Long-horizon generation with world memory * Lightweight LoRA adaptation for specialized domains such as robotics * Optimized for Inference on Consumer GPUs Test it and drop feedback anytime！ 🔗 Website: 💻 GitHub: 🤗 Hugging Face: 🎥 Demo: #Hy#WorldModels #VideoGeneration #GenerativeAI

🚀 Introducing Hy-Nomas: An Open Source Free-Form Interactive Video World Model Key Features: * Free-form interaction with text prompts and camera trajectories * Long-horizon generation with world memory * Lightweight LoRA adaptation for specialized domains such as robotics * Optimized for Inference on Consumer GPUs Test it and drop feedback anytime！ 🔗 Website: 💻 GitHub: 🤗 Hugging Face: 🎥 Demo: #Hy#WorldModels #VideoGeneration #GenerativeAI

Tencent Hy

27,361 просмотров • 10 часов назад

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks

Yinghao Xu

47,703 просмотров • 8 месяцев назад

World models are moving beyond offline generation towards interactive, real-time experiences. Introducing ⚡FlashDreams⚡: an open-source high-performance inference and serving library built for autoregressive world models: 🔥 Up to 3.10× faster LingBot-World inference 🔥 Up to 2.12× faster Self-Forcing inference 🔥 Up to 1.40× faster Wan2.1 inference 🔥 8 integrated models 🔥 Multi-GPU, streaming, low-latency serving 🔥 Agentic skills that teach you how to use it FlashDreams is designed for a new generation of AI systems that continuously evolve over time while responding to user interactions. It powers applications across robotics, autonomous vehicle simulation, gaming, and virtual worlds. Github: Docs: Research page: Join the #flashdreams Discord channel at FlashDreams is also the runtime backbone behind NVIDIA OmniDreams ( 1/n #AI #WorldModels #FastInference #PhysicalAI #OpenSource #NVIDIA

World models are moving beyond offline generation towards interactive, real-time experiences. Introducing ⚡FlashDreams⚡: an open-source high-performance inference and serving library built for autoregressive world models: 🔥 Up to 3.10× faster LingBot-World inference 🔥 Up to 2.12× faster Self-Forcing inference 🔥 Up to 1.40× faster Wan2.1 inference 🔥 8 integrated models 🔥 Multi-GPU, streaming, low-latency serving 🔥 Agentic skills that teach you how to use it FlashDreams is designed for a new generation of AI systems that continuously evolve over time while responding to user interactions. It powers applications across robotics, autonomous vehicle simulation, gaming, and virtual worlds. Github: Docs: Research page: Join the #flashdreams Discord channel at FlashDreams is also the runtime backbone behind NVIDIA OmniDreams ( 1/n #AI #WorldModels #FastInference #PhysicalAI #OpenSource #NVIDIA

Ruilong Li

100,308 просмотров • 4 месяцев назад

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

Yukang Chen

11,943 просмотров • 1 год назад

🚀 Excited to release LongLive 2.0! 🎬 An end-to-end infrastructure for long video generation, with FP4 and parallelism at the core of both training and inference. ⚡45.7 FPS generation speed on 5B model⚡ ✨ LongLive 2.0 supports real-video training, few-step distillation, multi-shot training/inference, sequence-parallel acceleration, NVFP4 KV cache, and async VAE decoding deployment. 🧩 To our knowledge, this is the first open-source 4-bit long video generation infra that covers both training and inference. 🙌 Welcome to check it out, try it, and share feedback! 🔗 Code: 📰 Paper: 🎥 Demo: #LongVideoGeneration #VideoGeneration #Realtime #AIInfra #EfficientAI #FP4 #Parallel #NVIDIA

🚀 Excited to release LongLive 2.0! 🎬 An end-to-end infrastructure for long video generation, with FP4 and parallelism at the core of both training and inference. ⚡45.7 FPS generation speed on 5B model⚡ ✨ LongLive 2.0 supports real-video training, few-step distillation, multi-shot training/inference, sequence-parallel acceleration, NVFP4 KV cache, and async VAE decoding deployment. 🧩 To our knowledge, this is the first open-source 4-bit long video generation infra that covers both training and inference. 🙌 Welcome to check it out, try it, and share feedback! 🔗 Code: 📰 Paper: 🎥 Demo: #LongVideoGeneration #VideoGeneration #Realtime #AIInfra #EfficientAI #FP4 #Parallel #NVIDIA

Yukang Chen

60,053 просмотров • 5 месяцев назад

This World Model 'LingBot-World-Infinity (LingBot-World 2.0)' just released from Ant Group looks realy promising. It is an open causal world model with an Agentic harness. Most interactive world models hold together for a few minutes. Then textures smear and geometry warps. That's a video model, not a world — and Robbyant just drew the line at the attention mask. They released LingBot-World-Infinity (LingBot-World 2.0) — a 14B open causal video world model built on Wan2.2, trained with a Mixture of Bidirectional and Autoregressive (MoBA) attention mask, then distilled into a few-step real-time generator with no post-hoc drift filtering anywhere in the stack. Here's what's actually interesting: → Pure teacher forcing overfits — as context grows, the model leans on context instead of predicting frames. MoBA appends a bidirectional full-attention block as a regularizer → Leak-free cross-attention: AR rows attend to background prompt a_B plus chunk prompts a_≤i, lower-triangular. Bidirectional rows see one global prompt a_G → DMD runs over long self-rollout trajectories, not teacher-forced states — the student is optimized on the distribution its own errors induce → Director-Pilot harness: a VLM proposes event cards, the DiT generator renders physical dynamics. Mode B adds a SAM tracking loop for object-centric interaction → One 60-minute uninterrupted session, 20 distinct scenarios, no perceptible decay Full analysis: Paper: Model weight: GitHub Repo: Project: Ant Group Robbyant

This World Model 'LingBot-World-Infinity (LingBot-World 2.0)' just released from Ant Group looks realy promising. It is an open causal world model with an Agentic harness. Most interactive world models hold together for a few minutes. Then textures smear and geometry warps. That's a video model, not a world — and Robbyant just drew the line at the attention mask. They released LingBot-World-Infinity (LingBot-World 2.0) — a 14B open causal video world model built on Wan2.2, trained with a Mixture of Bidirectional and Autoregressive (MoBA) attention mask, then distilled into a few-step real-time generator with no post-hoc drift filtering anywhere in the stack. Here's what's actually interesting: → Pure teacher forcing overfits — as context grows, the model leans on context instead of predicting frames. MoBA appends a bidirectional full-attention block as a regularizer → Leak-free cross-attention: AR rows attend to background prompt a_B plus chunk prompts a_≤i, lower-triangular. Bidirectional rows see one global prompt a_G → DMD runs over long self-rollout trajectories, not teacher-forced states — the student is optimized on the distribution its own errors induce → Director-Pilot harness: a VLM proposes event cards, the DiT generator renders physical dynamics. Mode B adds a SAM tracking loop for object-centric interaction → One 60-minute uninterrupted session, 20 distinct scenarios, no perceptible decay Full analysis: Paper: Model weight: GitHub Repo: Project: Ant Group Robbyant

Marktechpost AI

233,449 просмотров • 3 месяцев назад

Today’s the day🚀 We’re opening the doors to the Daydream platform - API + Playground Experience🌊 We’re the world’s first hosted StreamDiffusion platform: 1⃣ No GPU required 2⃣Sub-second latency 3⃣Advanced controls that let you experiment quickly and scale seamlessly. This is the start of an open ecosystem for real-time video and world models. Your home for open source, real-time video AI 👇🧵

Today’s the day🚀 We’re opening the doors to the Daydream platform - API + Playground Experience🌊 We’re the world’s first hosted StreamDiffusion platform: 1⃣ No GPU required 2⃣Sub-second latency 3⃣Advanced controls that let you experiment quickly and scale seamlessly. This is the start of an open ecosystem for real-time video and world models. Your home for open source, real-time video AI 👇🧵

Daydream

94,905 просмотров • 1 год назад