Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

FramePack is out Packing Input Frame Context in Next-Frame Prediction Models for Video Generation

_akhaliq's profile picture

AK

428,014 subscribers

31,486 Aufrufe • vor 1 Jahr •via X (Twitter)

KunstComedy
LIVE

Anya Rossi• Live Now

Private livecam show

2 Kommentare

Profilbild von AK
AKvor 1 Jahr

discuss:

Profilbild von AK
AKvor 1 Jahr

local app:

Ähnliche Videos

Can we simplify video generation by decomposing it into interleaved text-video co-generation? Would explicit, repeated thinking in language improve generation in pixels? We introduce TV2TV: a unified model that jointly learns - language modeling (next-token prediction) - video flow matching (next-frame prediction) At inference, TV2TV dynamically alternates between textual thinking and video generation. Model generations below: interleaved text plans and video slices (~1–2s) are co-generated over time, conditioned on a single frame per sport. 📖
0:36

Can we simplify video generation by decomposing it into interleaved text-video co-generation? Would explicit, repeated thinking in language improve generation in pixels? We introduce TV2TV: a unified model that jointly learns - language modeling (next-token prediction) - video flow matching (next-frame prediction) At inference, TV2TV dynamically alternates between textual thinking and video generation. Model generations below: interleaved text plans and video slices (~1–2s) are co-generated over time, conditioned on a single frame per sport. 📖

Xiaochuang Han

28,925 Aufrufe • vor 6 Monaten

InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbing
1:01

InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbing

Purz.ai

16,711 Aufrufe • vor 9 Monaten

Half Sword is out now with #RTXOn. Enable DLSS 4 with Multi Frame Generation for maximum performance.
1:18

Half Sword is out now with #RTXOn. Enable DLSS 4 with Multi Frame Generation for maximum performance.

NVIDIA GeForce

54,345 Aufrufe • vor 4 Monaten

Seedance 2.0 Omni-ref → a cheat code for consistency 🔓 Choose any input - image or video. Build your story - frame to frame aligned. Short tutorial below👇
0:42

Seedance 2.0 Omni-ref → a cheat code for consistency 🔓 Choose any input - image or video. Build your story - frame to frame aligned. Short tutorial below👇

Framer 🇱🇹

19,353 Aufrufe • vor 1 Monat

Warhammer 40,000: Darktide's free update, Nightmares & Visions, is out now with #RTXOn! Featuring DLSS 4 with Multi Frame Generation, updated Frame Generation, and the transformer model Super Resolution.
2:11

Warhammer 40,000: Darktide's free update, Nightmares & Visions, is out now with #RTXOn! Featuring DLSS 4 with Multi Frame Generation, updated Frame Generation, and the transformer model Super Resolution.

NVIDIA GeForce

37,889 Aufrufe • vor 1 Jahr

- same context - same occasion - same frame by frame - same place
0:25

- same context - same occasion - same frame by frame - same place

Dear girl Tifa

16,295 Aufrufe • vor 1 Jahr

10/118 wins. Frame 1. Frame 2. Frame 3. Frame 4!!! Guess who the person in the video is. 100k for you if she replies your comment. Wrong answers only.
1:28

10/118 wins. Frame 1. Frame 2. Frame 3. Frame 4!!! Guess who the person in the video is. 100k for you if she replies your comment. Wrong answers only.

Sir Khaycee

14,575 Aufrufe • vor 6 Monaten

Jeff Dean says models hallucinate because their training data is “squishy.” But what’s in the context window is sharp, the exact text or video frame right in front of them. The goal is to bring more of the world into that context. Compression gives it intuition. Context gives it precision.
2:00

Jeff Dean says models hallucinate because their training data is “squishy.” But what’s in the context window is sharp, the exact text or video frame right in front of them. The goal is to bring more of the world into that context. Compression gives it intuition. Context gives it precision.

vitrupo

41,352 Aufrufe • vor 1 Monat

🔥 Booom... shipped! 🚀 VIDEO GENERATION is now live on Scenario. 20 video models, plus world-class #VEO3. ▶️ Animate any image ✨ Auto-prompting, first & last frame control ⚖️ Compare models side by side The MOST PRODUCTIVE video gen UX out there. 👉
0:48

🔥 Booom... shipped! 🚀 VIDEO GENERATION is now live on Scenario. 20 video models, plus world-class #VEO3. ▶️ Animate any image ✨ Auto-prompting, first & last frame control ⚖️ Compare models side by side The MOST PRODUCTIVE video gen UX out there. 👉

Emm | scenario.com

379,933 Aufrufe • vor 1 Jahr

"A-frame" is out now :) official video on youtube
0:27

"A-frame" is out now :) official video on youtube

chelsea cutler

24,735 Aufrufe • vor 1 Jahr

“Davido’s frame is insignificant. The size of his frame does not depict how great he is. But Wizkid command respect, power and greatness which is why he represent a symbol of hope in this generation and the next to come.” -Tina Mba
1:12

“Davido’s frame is insignificant. The size of his frame does not depict how great he is. But Wizkid command respect, power and greatness which is why he represent a symbol of hope in this generation and the next to come.” -Tina Mba

Arthur🇳🇬🇬🇧🇸🇳

189,961 Aufrufe • vor 1 Jahr

Announcing: Keyframe Conditioning. Drop in First Frame, Last Frame (any frame, really!) and create the exact video you were envisioning. Check out some of our favorite videos!
0:45

Announcing: Keyframe Conditioning. Drop in First Frame, Last Frame (any frame, really!) and create the exact video you were envisioning. Check out some of our favorite videos!

Haiper AI

18,405 Aufrufe • vor 1 Jahr

Next-generation features in a timeless Ray-Ban frame. Get your #RayBanMeta now, pre-order at the link in bio.
0:30

Next-generation features in a timeless Ray-Ban frame. Get your #RayBanMeta now, pre-order at the link in bio.

Ray-Ban

21,038 Aufrufe • vor 2 Jahren

Video might be the next intelligence substrate. Strikingly, video models are beginning to exhibit the same emergent reasoning behaviors first observed in LLMs—multi-path search, self-correction, and layer specialization. We demystify video reasoning and show it doesn’t happen frame-by-frame, but along diffusion steps. 🔗 📄 So, what's next? ;)
1:19

Video might be the next intelligence substrate. Strikingly, video models are beginning to exhibit the same emergent reasoning behaviors first observed in LLMs—multi-path search, self-correction, and layer specialization. We demystify video reasoning and show it doesn’t happen frame-by-frame, but along diffusion steps. 🔗 📄 So, what's next? ;)

Zhongang Cai @CVPR'26

70,490 Aufrufe • vor 2 Monaten

Ray2 Keyframes, Extend & Loop is now here. Create your visual story with precise frame-by-frame control, seamless transitions, spatial exploration and long-form video durations using #Ray2 Text-to-Video and Image-to-Video models in Dream Machine.
0:38

Ray2 Keyframes, Extend & Loop is now here. Create your visual story with precise frame-by-frame control, seamless transitions, spatial exploration and long-form video durations using #Ray2 Text-to-Video and Image-to-Video models in Dream Machine.

Luma

7,362,289 Aufrufe • vor 1 Jahr

Experience Stellar Blade on PC with #RTXOn! DLSS 4 with Multi Frame Generation boosts frame rates for maximum performance. Learn more:
1:16

Experience Stellar Blade on PC with #RTXOn! DLSS 4 with Multi Frame Generation boosts frame rates for maximum performance. Learn more:

NVIDIA GeForce

32,238 Aufrufe • vor 1 Jahr

Long video generation usually results in context increasing/scaling during chunk/frame-wise rollout. Considering context scaling may require context selection, we thus introduce the idea of MoE into long context modelling and propose Mixture of Contexts. All previous context/memory is considered while the chosen ones are computed in a data-driven manner. You can easily enjoy 7x compute savings.
1:44

Long video generation usually results in context increasing/scaling during chunk/frame-wise rollout. Considering context scaling may require context selection, we thus introduce the idea of MoE into long context modelling and propose Mixture of Contexts. All previous context/memory is considered while the chosen ones are computed in a data-driven manner. You can easily enjoy 7x compute savings.

Ceyuan Yang

22,064 Aufrufe • vor 9 Monaten

World of Tanks: HEAT is coming, featuring DLSS 4 with Multi Frame Generation to accelerate frame rates, and NVIDIA Reflex to reduce PC latency for more responsive gameplay.
1:20

World of Tanks: HEAT is coming, featuring DLSS 4 with Multi Frame Generation to accelerate frame rates, and NVIDIA Reflex to reduce PC latency for more responsive gameplay.

NVIDIA GeForce

35,833 Aufrufe • vor 9 Monaten

Goodnight, 𝕏..·˚ ༘ ☾ ⋆｡˚ ☄︎ Newscast about xAI, SpaceX, Starlink, Neuralink, 𝕏, and Grok. Created using the xAI Video API. I upscaled the final frame to use as the starting point for the next clip's generation, but it only helped marginally. However, I found a paper called "FreeInit: Bridging Initialization Gap in Video Diffusion Models" that I'm going to try tomorrow to fix the drifting problem. The approach: 1. FFT both images (anchor frame + last frame) 2. Low-pass filter on anchor (structure/color/layout) 3. High-pass filter on last frame (details/edges/motion) 4. Combine and IFFT back
1:09

Goodnight, 𝕏..·˚ ༘ ☾ ⋆｡˚ ☄︎ Newscast about xAI, SpaceX, Starlink, Neuralink, 𝕏, and Grok. Created using the xAI Video API. I upscaled the final frame to use as the starting point for the next clip's generation, but it only helped marginally. However, I found a paper called "FreeInit: Bridging Initialization Gap in Video Diffusion Models" that I'm going to try tomorrow to fix the drifting problem. The approach: 1. FFT both images (anchor frame + last frame) 2. Low-pass filter on anchor (structure/color/layout) 3. High-pass filter on last frame (details/edges/motion) 4. Combine and IFFT back

tetsuo

97,901 Aufrufe • vor 4 Monaten

FBC: Firebreak Major Update Breakpoint is out now on all platforms for free featuring path tracing and DLSS 4 with Multi Frame Generation. #RTXOn →
1:10

FBC: Firebreak Major Update Breakpoint is out now on all platforms for free featuring path tracing and DLSS 4 with Multi Frame Generation. #RTXOn →

NVIDIA GeForce

28,380 Aufrufe • vor 8 Monaten