Loading video...

Video Failed to Load

Go Home

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!

theworldlabs's profile picture

World Labs

69,798 subscribers

339,753 views • 8 months ago •via X (Twitter)

Science & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing AI video you can watch and interact with, in real-time! Powering this is a new world model that imagines and streams video frames every 40ms(!). No game engine in sight. We call it interactive video, and it's free for anyone to try right now (GPUs permitting)!
0:32

Introducing AI video you can watch and interact with, in real-time! Powering this is a new world model that imagines and streams video frames every 40ms(!). No game engine in sight. We call it interactive video, and it's free for anyone to try right now (GPUs permitting)!

Odyssey

704,407 views • 1 year ago

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.
0:24

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.

World Labs

15,870 views • 8 months ago

Introducing Lemon Slice Live: the first real-time audio-video AI model Anyone can video chat with any character by just uploading a single photo. Every pixel on the screen is rendered at 25fps in real-time by a transformer model. Here’s how we built it + a live demo! 👇
0:23

Introducing Lemon Slice Live: the first real-time audio-video AI model Anyone can video chat with any character by just uploading a single photo. Every pixel on the screen is rendered at 25fps in real-time by a transformer model. Here’s how we built it + a live demo! 👇

LemonSlice

170,779 views • 1 year ago

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:
3:18

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

Yukang Chen

11,752 views • 8 months ago

Our third announcement is GWM Worlds. A world model for real-time environment simulation. You give the model a static scene, and it generates an immersive, infinite, explorable space as you move through it, with geometry, lighting and physics. All in real-time. You can travel to any place, real or imagined. You can become any agent, a person walking through a city, a drone flying over a snowy mountain or a robot navigating a warehouse.
1:15

Our third announcement is GWM Worlds. A world model for real-time environment simulation. You give the model a static scene, and it generates an immersive, infinite, explorable space as you move through it, with geometry, lighting and physics. All in real-time. You can travel to any place, real or imagined. You can become any agent, a person walking through a city, a drone flying over a snowy mountain or a robot navigating a warehouse.

Runway

80,279 views • 6 months ago

Introducing Agora-1, a multi-agent world model. Multiple participants—human or AI—can now interact inside the same world simulation, all in real-time. Try our playable research preview today, with Agora-1 simulating a multiplayer GoldenEye deathmatch!
1:39

Introducing Agora-1, a multi-agent world model. Multiple participants—human or AI—can now interact inside the same world simulation, all in real-time. Try our playable research preview today, with Agora-1 simulating a multiplayer GoldenEye deathmatch!

Odyssey

902,914 views • 26 days ago

It’s time to go beyond language models. Introducing Odyssey-2 Max, our most powerful world model yet. It materially advances the SOTA in physical accuracy. This is a big step toward models that simulate and interact with the world in real time. A new intelligence entirely!
1:08

It’s time to go beyond language models. Introducing Odyssey-2 Max, our most powerful world model yet. It materially advances the SOTA in physical accuracy. This is a big step toward models that simulate and interact with the world in real time. A new intelligence entirely!

Odyssey

2,180,434 views • 1 month ago

Odyssey releases AI interactive video technology that generates and streams frames every 40ms, offering free real-time interaction without game engines. - Introduces "interactive video" where users can both watch and interact with AI-generated content in real-time. - Technology bypasses traditional game engines, streaming video frames every 40 milliseconds. - Currently free to try, subject to GPU availability, representing an early stage of a new storytelling medium. - Combines elements of video games and films, hinting at future immersive digital experiences. This marks a pivotal advancement in digital storytelling, potentially transforming entertainment by enabling on-demand, interactive narratives. Quick demo below:
0:40

Odyssey releases AI interactive video technology that generates and streams frames every 40ms, offering free real-time interaction without game engines. - Introduces "interactive video" where users can both watch and interact with AI-generated content in real-time. - Technology bypasses traditional game engines, streaming video frames every 40 milliseconds. - Currently free to try, subject to GPU availability, representing an early stage of a new storytelling medium. - Combines elements of video games and films, hinting at future immersive digital experiences. This marks a pivotal advancement in digital storytelling, potentially transforming entertainment by enabling on-demand, interactive narratives. Quick demo below:

Kol Tregaskes

33,878 views • 1 year ago

StreamDiT Real-Time Streaming Text-to-Video Generation StreamDiT enables real-time text-to-video generation at 16 FPS on a single GPU (H100)
1:00

StreamDiT Real-Time Streaming Text-to-Video Generation StreamDiT enables real-time text-to-video generation at 16 FPS on a single GPU (H100)

AK

43,659 views • 11 months ago

Genie 3 generates minutes of consistent worlds in real-time at 720p!
1:59

Genie 3 generates minutes of consistent worlds in real-time at 720p!

Tim Rocktäschel

40,641 views • 10 months ago

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.
0:54

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.

Runway

1,160,410 views • 2 months ago

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.
1:33

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

CYANPUPPETS

28,871 views • 5 months ago

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.
0:39

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

CYANPUPPETS

15,968 views • 4 months ago

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.
0:23

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

CYANPUPPETS

28,846 views • 4 months ago

Generate persistent 3D worlds from a single image, bigger and better than ever! We’re excited to share our latest results and invite you to try out our world generation model in a limited beta preview.
0:34

Generate persistent 3D worlds from a single image, bigger and better than ever! We’re excited to share our latest results and invite you to try out our world generation model in a limited beta preview.

World Labs

833,699 views • 9 months ago

Marble is the first product from World Labs and is powered by our multimodal world model, which lets anyone create high-fidelity, persistent 3D worlds from just a single image, video, text prompt, or 3D layout. Read more at
0:51

Marble is the first product from World Labs and is powered by our multimodal world model, which lets anyone create high-fidelity, persistent 3D worlds from just a single image, video, text prompt, or 3D layout. Read more at

World Labs

117,016 views • 7 months ago

⚡️ Introducing Bolt3D ⚡️ Bolt3D generates interactive 3D scenes in less than 7 seconds on a single GPU from one or more images. It features a latent diffusion model that *directly* generates 3D Gaussians of seen and unseen regions, without any test time optimization. 🧵👇 (1/9)
0:20

⚡️ Introducing Bolt3D ⚡️ Bolt3D generates interactive 3D scenes in less than 7 seconds on a single GPU from one or more images. It features a latent diffusion model that *directly* generates 3D Gaussians of seen and unseen regions, without any test time optimization. 🧵👇 (1/9)

Stan Szymanowicz @ CVPR26

125,813 views • 1 year ago

🚨 PixVerse just dropped R1 and it's the end of game development as we know it. A Real-time World Model that generates interactive, voice-controlled worlds from raw video. No assets. No scripting. No waiting. Here's everything you need to know: 👇
0:29

🚨 PixVerse just dropped R1 and it's the end of game development as we know it. A Real-time World Model that generates interactive, voice-controlled worlds from raw video. No assets. No scripting. No waiting. Here's everything you need to know: 👇

Hasan Toor

56,786 views • 3 months ago

We present MotionStream — real-time, long-duration video generation that you can interactively control just by dragging your mouse. All videos here are raw, real-time screen captures without any post-processing. Model runs on a single H100 at 29 FPS and 0.4s latency.
0:42

We present MotionStream — real-time, long-duration video generation that you can interactively control just by dragging your mouse. All videos here are raw, real-time screen captures without any post-processing. Model runs on a single H100 at 29 FPS and 0.4s latency.

Xun Huang

98,047 views • 7 months ago

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source
1:33

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source

The Humanoid Hub

17,721 views • 4 months ago