Loading video...

Video Failed to Load

Go Home

Rolling Forcing Autoregressive Long Video Diffusion in Real Time

_akhaliq's profile picture

AK

460,618 subscribers

30,507 views • 8 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Block Diffusion Interpolating Between Autoregressive and Diffusion Language Models
0:23

Block Diffusion Interpolating Between Autoregressive and Diffusion Language Models

AK

160,553 views • 1 year ago

Epona Autoregressive Diffusion World Model for Autonomous Driving
0:32

Epona Autoregressive Diffusion World Model for Autonomous Driving

AK

18,839 views • 11 months ago

History-Guided Video Diffusion TL;DR: Diffuse long videos by performing guidance over different histories, enabled by Diffusion Forcing Transformer, a simple finetunable add-on to any existing sequence diffusion models.
0:51

History-Guided Video Diffusion TL;DR: Diffuse long videos by performing guidance over different histories, enabled by Diffusion Forcing Transformer, a simple finetunable add-on to any existing sequence diffusion models.

AK

20,914 views • 1 year ago

Announcing Diffusion Forcing Transformer (DFoT), our new video diffusion algorithm that generates ultra-long videos of 800+ frames. DFoT enables History Guidance, a simple add-on to any existing video diffusion models for a quality boost. Website: (1/7)
0:36

Announcing Diffusion Forcing Transformer (DFoT), our new video diffusion algorithm that generates ultra-long videos of 800+ frames. DFoT enables History Guidance, a simple add-on to any existing video diffusion models for a quality boost. Website: (1/7)

Boyuan Chen

175,996 views • 1 year ago

SongBloom Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinement
2:07

SongBloom Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinement

AK

28,118 views • 1 year ago

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space
0:40

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space

AK

43,387 views • 1 year ago

🪄 Magi-1: The Autoregressive Diffusion Video Generation Model - Now available at 🥇 The first autoregressive video model with top-tier quality output 🔓 100% open-source & tech report 📊 Exceptional performance on major benchmarks ⏳ 1/5
1:38

🪄 Magi-1: The Autoregressive Diffusion Video Generation Model - Now available at 🥇 The first autoregressive video model with top-tier quality output 🔓 100% open-source & tech report 📊 Exceptional performance on major benchmarks ⏳ 1/5

Sand.ai

913,953 views • 1 year ago

Autoregressive diffusion models drift for long videos? 📉 We fixed it.🚀 Speed + Stability = ✅ Meeting *Test-Time Correction (TTC)*. We stop error accumulation in its tracks without any retraining. ✅ Training-free ✅ 1 minute+ stable generation ✅ Negligible overhead
0:26

Autoregressive diffusion models drift for long videos? 📉 We fixed it.🚀 Speed + Stability = ✅ Meeting *Test-Time Correction (TTC)*. We stop error accumulation in its tracks without any retraining. ✅ Training-free ✅ 1 minute+ stable generation ✅ Negligible overhead

Tengfei Wang

16,460 views • 3 months ago

We're moving beyond autoregressive LLMs! Autoregressive LLMs generate text word-by-word, which can be slow and affect quality, while diffusion models refine noise step-by-step, allowing for faster iterations and error correction. Here's Gemini Diffusion running at 857 tokens/s:
0:40

We're moving beyond autoregressive LLMs! Autoregressive LLMs generate text word-by-word, which can be slow and affect quality, while diffusion models refine noise step-by-step, allowing for faster iterations and error correction. Here's Gemini Diffusion running at 857 tokens/s:

Akshay 🚀

34,524 views • 1 year ago

Video diffusion models generate high-quality videos but are too slow for interactive applications. We MIT CSAIL Adobe Research introduce CausVid, a fast autoregressive video diffusion model that starts playing the moment you hit "Generate"! A thread 🧵
0:31

Video diffusion models generate high-quality videos but are too slow for interactive applications. We MIT CSAIL Adobe Research introduce CausVid, a fast autoregressive video diffusion model that starts playing the moment you hit "Generate"! A thread 🧵

Tianwei Yin

83,714 views • 1 year ago

Can we use video diffusion to generate 3D scenes? 𝐖𝐨𝐫𝐥𝐝𝐄𝐱𝐩𝐥𝐨𝐫𝐞𝐫 (#SIGGRAPHAsia25) creates fully-navigable scenes via autoregressive video generation. Text input -> 3DGS scene output & interactive rendering! 🌍 📽️
0:28

Can we use video diffusion to generate 3D scenes? 𝐖𝐨𝐫𝐥𝐝𝐄𝐱𝐩𝐥𝐨𝐫𝐞𝐫 (#SIGGRAPHAsia25) creates fully-navigable scenes via autoregressive video generation. Text input -> 3DGS scene output & interactive rendering! 🌍 📽️

Matthias Niessner

30,787 views • 9 months ago

MinerU-Diffusion A 2.5B diffusion-based OCR model that replaces slow autoregressive decoding with parallel block-wise diffusion, achieving up to 3.2x faster inference while improving robustness on complex documents with tables, formulas, and layouts.
0:22

MinerU-Diffusion A 2.5B diffusion-based OCR model that replaces slow autoregressive decoding with parallel block-wise diffusion, achieving up to 3.2x faster inference while improving robustness on complex documents with tables, formulas, and layouts.

DailyPapers

15,304 views • 2 months ago

This is getting interesting. In this iteration, the magnifying glass is tracked in real-time, feeding only what is seen through it to the diffusion process, revealing the invisible within a piece of clay. Real-time diffusion with Stream Diffusion + SDXL Turbo. #StableDiffusion #SDXLTurbo #StreamDiffusion #StabilityAI #Realtime
1:16

This is getting interesting. In this iteration, the magnifying glass is tracked in real-time, feeding only what is seen through it to the diffusion process, revealing the invisible within a piece of clay. Real-time diffusion with Stream Diffusion + SDXL Turbo. #StableDiffusion #SDXLTurbo #StreamDiffusion #StabilityAI #Realtime

Hugues Bruyère

26,432 views • 2 years ago

Netflix just dropped Go-with-the-Flow Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise
4:10

Netflix just dropped Go-with-the-Flow Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise

AK

95,542 views • 1 year ago

Self-Forcing++ for minute-scale video generation ByteDance's new method generates high-quality videos up to 4 min 15 sec! It scales diffusion models without long-video teachers or retraining, preserving fidelity and consistency.
1:40

Self-Forcing++ for minute-scale video generation ByteDance's new method generates high-quality videos up to 4 min 15 sec! It scales diffusion models without long-video teachers or retraining, preserving fidelity and consistency.

DailyPapers

17,720 views • 8 months ago

This is amazing research result! Xun Huang and team trained a bidirectional teacher model for motion control, and used Self-Forcing to make it autoregressive. Xun recently gave a great talk at the Real Time Video AI summit about this work, and a few other projects around video world models. Here is the recording.
29:48

This is amazing research result! Xun Huang and team trained a bidirectional teacher model for motion control, and used Self-Forcing to make it autoregressive. Xun recently gave a great talk at the Real Time Video AI summit about this work, and a few other projects around video world models. Here is the recording.

Eric is Daydreaming

52,761 views • 7 months ago

🚨 British “journalist” SQUIRMS as she’s EXPOSED LYING in real time Too bad I had the receipts rolling the whole time. Full video:
0:40

🚨 British “journalist” SQUIRMS as she’s EXPOSED LYING in real time Too bad I had the receipts rolling the whole time. Full video:

Avi Yemini

25,733 views • 7 months ago

LongLive Real-time Interactive Long Video Generation
0:59

LongLive Real-time Interactive Long Video Generation

AK

17,191 views • 8 months ago

Tonight I grabbed some other ingredients: milk from the kitchen and black ink from my son. Watching the images emerge is like clearing my mind. Some parts of this video have been sped up 4x, while others are in real-time. Real-time diffusion with Stream Diffusion + SDXL Turbo. #StableDiffusion #SDXLTurbo #StreamDiffusion #StabilityAI #Realtime
1:46

Tonight I grabbed some other ingredients: milk from the kitchen and black ink from my son. Watching the images emerge is like clearing my mind. Some parts of this video have been sped up 4x, while others are in real-time. Real-time diffusion with Stream Diffusion + SDXL Turbo. #StableDiffusion #SDXLTurbo #StreamDiffusion #StabilityAI #Realtime

Hugues Bruyère

45,718 views • 2 years ago

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine
0:27

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine

fal

18,822 views • 4 months ago