Loading video...

Video Failed to Load

Go Home

Helios Real Real-Time Long Video Generation Model paper:

_akhaliq's profile picture

AK

508,727 subscribers

25,951 views • 5 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

LongLive Real-time Interactive Long Video Generation
0:59

LongLive Real-time Interactive Long Video Generation

AK

17,214 views • 10 months ago

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:
3:18

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

Yukang Chen

11,915 views • 10 months ago

Introducing The Matrix --- a foundation world model for generating infinite-length, hyper-realistic videos with real-time, frame-level control: - Infinite-length video generation - 720p high-quality rendering - Real-time, frame-level control at 16 FPS - Generalization to real-world video control 🔗Blog: 📄Paper: 💻Code & Playable Demo: Coming soon! Key Innovation: A brand new technique called the shift-window denoise process model, enabling auto-regressive generation for diffusion and consistency models in real-time. Special thanks to project leader Ruili Feng and the entire Matrix team for their dedication and hard work over the year-long project.
1:00

Introducing The Matrix --- a foundation world model for generating infinite-length, hyper-realistic videos with real-time, frame-level control: - Infinite-length video generation - 720p high-quality rendering - Real-time, frame-level control at 16 FPS - Generalization to real-world video control 🔗Blog: 📄Paper: 💻Code & Playable Demo: Coming soon! Key Innovation: A brand new technique called the shift-window denoise process model, enabling auto-regressive generation for diffusion and consistency models in real-time. Special thanks to project leader Ruili Feng and the entire Matrix team for their dedication and hard work over the year-long project.

Hongyang Zhang

178,382 views • 1 year ago

StreamDiT Real-Time Streaming Text-to-Video Generation StreamDiT enables real-time text-to-video generation at 16 FPS on a single GPU (H100)
1:00

StreamDiT Real-Time Streaming Text-to-Video Generation StreamDiT enables real-time text-to-video generation at 16 FPS on a single GPU (H100)

AK

43,682 views • 1 year ago

We present MotionStream — real-time, long-duration video generation that you can interactively control just by dragging your mouse. All videos here are raw, real-time screen captures without any post-processing. Model runs on a single H100 at 29 FPS and 0.4s latency.
0:42

We present MotionStream — real-time, long-duration video generation that you can interactively control just by dragging your mouse. All videos here are raw, real-time screen captures without any post-processing. Model runs on a single H100 at 29 FPS and 0.4s latency.

Xun Huang

98,837 views • 9 months ago

today, we're making another step towards the future. introducing our first Real-time Video generation model. join the beta 👇
0:21

today, we're making another step towards the future. introducing our first Real-time Video generation model. join the beta 👇

Krea

1,108,575 views • 11 months ago

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK
2:12

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK

Ziwei Liu

14,201 views • 1 year ago

MuseSteamer just leveled up! Our video generation model now supports real-time interactive long-form video generation. It breaks the traditional 10-second limit, creating videos of any length with greater speed and control—enabling users to pause, rewrite storylines, or extend transitions any time during the process.
0:22

MuseSteamer just leveled up! Our video generation model now supports real-time interactive long-form video generation. It breaks the traditional 10-second limit, creating videos of any length with greater speed and control—enabling users to pause, rewrite storylines, or extend transitions any time during the process.

Baidu Inc.

142,732 views • 10 months ago

Apparate Labs launched PROTEUS, a new real-time AI video generation model. It creates realistic avatars and lip-syncs from a single reference image, similar to VASA-1, but it's completely real-time.
1:05

Apparate Labs launched PROTEUS, a new real-time AI video generation model. It creates realistic avatars and lip-syncs from a single reference image, similar to VASA-1, but it's completely real-time.

Rowan Cheung

13,253 views • 2 years ago

ELON MUSK: Real-time AI videos, movies and video games i.e real-time video generation is the future. The AI video generation that I'm seeing of xAI and from others is pretty impressive.
0:39

ELON MUSK: Real-time AI videos, movies and video games i.e real-time video generation is the future. The AI video generation that I'm seeing of xAI and from others is pretty impressive.

DogeDesigner

42,672 views • 8 months ago

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.
1:33

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

CYANPUPPETS

28,871 views • 7 months ago

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.
0:39

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

CYANPUPPETS

15,968 views • 6 months ago

Glad to share Seaweed-7B, a cost-effective foundation model for video generation. Our tech report highlights the key designs that significantly improve compute efficiency and performance given limited resources, achieving comparable quality against other industry-level models. To unleash the power of the foundation model, Seaweed-7B further enables a wide range of downstream applications including image-to-video generation, human video generation, subject-consistent video generation, video-audio joint generation, long video generation and storytelling, real-time generation, super-resolution generation, camera controlled generation. Check out our webpage and report for more details: Webpage: Paper: It's a wonderful journey of the last year. Thanks to all teammates for their contributions, sincerely.
1:30

Glad to share Seaweed-7B, a cost-effective foundation model for video generation. Our tech report highlights the key designs that significantly improve compute efficiency and performance given limited resources, achieving comparable quality against other industry-level models. To unleash the power of the foundation model, Seaweed-7B further enables a wide range of downstream applications including image-to-video generation, human video generation, subject-consistent video generation, video-audio joint generation, long video generation and storytelling, real-time generation, super-resolution generation, camera controlled generation. Check out our webpage and report for more details: Webpage: Paper: It's a wonderful journey of the last year. Thanks to all teammates for their contributions, sincerely.

Ceyuan Yang

77,502 views • 1 year ago

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.
0:23

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

CYANPUPPETS

29,029 views • 7 months ago

Vidu S1, the World’s Most Advanced Model for Real-Time AI Interaction Vidu S1 introduces a new era of real-time interactive video. Voice-Driven Character Control: Go beyond voice-driven lip sync with real-time behavior generation. Characters understand, react, and respond naturally. Unlimited Real-Time Generation: Experience seamless real-time video generation with unlimited interaction duration. 540P at 25 FPS, built for live interaction: Generate video in real time at 540P / 25 FPS, with support for up to 42 FPS for even smoother experiences. Create Custom Characters from Images & Voices: Customize both appearance and voice. Bring humans, anime characters, pets, and more to life with personalized AI characters. Use code VIDUS1 to get started for free.
0:54

Vidu S1, the World’s Most Advanced Model for Real-Time AI Interaction Vidu S1 introduces a new era of real-time interactive video. Voice-Driven Character Control: Go beyond voice-driven lip sync with real-time behavior generation. Characters understand, react, and respond naturally. Unlimited Real-Time Generation: Experience seamless real-time video generation with unlimited interaction duration. 540P at 25 FPS, built for live interaction: Generate video in real time at 540P / 25 FPS, with support for up to 42 FPS for even smoother experiences. Create Custom Characters from Images & Voices: Customize both appearance and voice. Bring humans, anime characters, pets, and more to life with personalized AI characters. Use code VIDUS1 to get started for free.

Vidu AI

1,533,747 views • 1 month ago

Mode Seeking meets Mean Seeking for Fast Long Video Generation paper:
0:30

Mode Seeking meets Mean Seeking for Fast Long Video Generation paper:

AK

20,406 views • 5 months ago

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine
0:27

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine

fal

19,243 views • 7 months ago

Rolling Forcing Autoregressive Long Video Diffusion in Real Time
2:00

Rolling Forcing Autoregressive Long Video Diffusion in Real Time

AK

30,507 views • 10 months ago