正在加载视频...

视频加载失败

返回首页

FramePack is out Packing Input Frame Context in Next-Frame Prediction Models for Video Generation

_akhaliq's profile picture

AK

428,014 subscribers

31,486 次观看 • 1 年前 •via X (Twitter)

艺术喜剧
LIVE

Anya Rossi• Live Now

Private livecam show

2 条评论

AK 的头像
AK1 年前

discuss:

AK 的头像
AK1 年前

local app:

相关视频

Can we simplify video generation by decomposing it into interleaved text-video co-generation? Would explicit, repeated thinking in language improve generation in pixels? We introduce TV2TV: a unified model that jointly learns - language modeling (next-token prediction) - video flow matching (next-frame prediction) At inference, TV2TV dynamically alternates between textual thinking and video generation. Model generations below: interleaved text plans and video slices (~1–2s) are co-generated over time, conditioned on a single frame per sport. 📖
0:36

Can we simplify video generation by decomposing it into interleaved text-video co-generation? Would explicit, repeated thinking in language improve generation in pixels? We introduce TV2TV: a unified model that jointly learns - language modeling (next-token prediction) - video flow matching (next-frame prediction) At inference, TV2TV dynamically alternates between textual thinking and video generation. Model generations below: interleaved text plans and video slices (~1–2s) are co-generated over time, conditioned on a single frame per sport. 📖

Xiaochuang Han

29,080 次观看 • 6 个月前

InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbing
1:01

InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbing

Purz.ai

16,711 次观看 • 10 个月前

Half Sword is out now with #RTXOn. Enable DLSS 4 with Multi Frame Generation for maximum performance.
1:18

Half Sword is out now with #RTXOn. Enable DLSS 4 with Multi Frame Generation for maximum performance.

NVIDIA GeForce

54,345 次观看 • 4 个月前

Seedance 2.0 Omni-ref → a cheat code for consistency 🔓 Choose any input - image or video. Build your story - frame to frame aligned. Short tutorial below👇
0:42

Seedance 2.0 Omni-ref → a cheat code for consistency 🔓 Choose any input - image or video. Build your story - frame to frame aligned. Short tutorial below👇

Framer 🇱🇹

19,360 次观看 • 1 个月前

Warhammer 40,000: Darktide's free update, Nightmares & Visions, is out now with #RTXOn! Featuring DLSS 4 with Multi Frame Generation, updated Frame Generation, and the transformer model Super Resolution.
2:11

Warhammer 40,000: Darktide's free update, Nightmares & Visions, is out now with #RTXOn! Featuring DLSS 4 with Multi Frame Generation, updated Frame Generation, and the transformer model Super Resolution.

NVIDIA GeForce

37,889 次观看 • 1 年前

- same context - same occasion - same frame by frame - same place
0:25

- same context - same occasion - same frame by frame - same place

Dear girl Tifa

16,295 次观看 • 1 年前

10/118 wins. Frame 1. Frame 2. Frame 3. Frame 4!!! Guess who the person in the video is. 100k for you if she replies your comment. Wrong answers only.
1:28

10/118 wins. Frame 1. Frame 2. Frame 3. Frame 4!!! Guess who the person in the video is. 100k for you if she replies your comment. Wrong answers only.

Sir Khaycee

14,575 次观看 • 6 个月前

Jeff Dean says models hallucinate because their training data is “squishy.” But what’s in the context window is sharp, the exact text or video frame right in front of them. The goal is to bring more of the world into that context. Compression gives it intuition. Context gives it precision.
2:00

Jeff Dean says models hallucinate because their training data is “squishy.” But what’s in the context window is sharp, the exact text or video frame right in front of them. The goal is to bring more of the world into that context. Compression gives it intuition. Context gives it precision.

vitrupo

41,352 次观看 • 2 个月前

🔥 Booom... shipped! 🚀 VIDEO GENERATION is now live on Scenario. 20 video models, plus world-class #VEO3. ▶️ Animate any image ✨ Auto-prompting, first & last frame control ⚖️ Compare models side by side The MOST PRODUCTIVE video gen UX out there. 👉
0:48

🔥 Booom... shipped! 🚀 VIDEO GENERATION is now live on Scenario. 20 video models, plus world-class #VEO3. ▶️ Animate any image ✨ Auto-prompting, first & last frame control ⚖️ Compare models side by side The MOST PRODUCTIVE video gen UX out there. 👉

Emm | scenario.com

379,933 次观看 • 1 年前

"A-frame" is out now :) official video on youtube
0:27

"A-frame" is out now :) official video on youtube

chelsea cutler

24,735 次观看 • 1 年前

“Davido’s frame is insignificant. The size of his frame does not depict how great he is. But Wizkid command respect, power and greatness which is why he represent a symbol of hope in this generation and the next to come.” -Tina Mba
1:12

“Davido’s frame is insignificant. The size of his frame does not depict how great he is. But Wizkid command respect, power and greatness which is why he represent a symbol of hope in this generation and the next to come.” -Tina Mba

Arthur🇳🇬🇬🇧🇸🇳

189,961 次观看 • 1 年前

Announcing: Keyframe Conditioning. Drop in First Frame, Last Frame (any frame, really!) and create the exact video you were envisioning. Check out some of our favorite videos!
0:45

Announcing: Keyframe Conditioning. Drop in First Frame, Last Frame (any frame, really!) and create the exact video you were envisioning. Check out some of our favorite videos!

Haiper AI

18,405 次观看 • 1 年前

Next-generation features in a timeless Ray-Ban frame. Get your #RayBanMeta now, pre-order at the link in bio.
0:30

Next-generation features in a timeless Ray-Ban frame. Get your #RayBanMeta now, pre-order at the link in bio.

Ray-Ban

21,038 次观看 • 2 年前

Video might be the next intelligence substrate. Strikingly, video models are beginning to exhibit the same emergent reasoning behaviors first observed in LLMs—multi-path search, self-correction, and layer specialization. We demystify video reasoning and show it doesn’t happen frame-by-frame, but along diffusion steps. 🔗 📄 So, what's next? ;)
1:19

Video might be the next intelligence substrate. Strikingly, video models are beginning to exhibit the same emergent reasoning behaviors first observed in LLMs—multi-path search, self-correction, and layer specialization. We demystify video reasoning and show it doesn’t happen frame-by-frame, but along diffusion steps. 🔗 📄 So, what's next? ;)

Zhongang Cai @CVPR'26

70,490 次观看 • 3 个月前

Ray2 Keyframes, Extend & Loop is now here. Create your visual story with precise frame-by-frame control, seamless transitions, spatial exploration and long-form video durations using #Ray2 Text-to-Video and Image-to-Video models in Dream Machine.
0:38

Ray2 Keyframes, Extend & Loop is now here. Create your visual story with precise frame-by-frame control, seamless transitions, spatial exploration and long-form video durations using #Ray2 Text-to-Video and Image-to-Video models in Dream Machine.

Luma

7,362,289 次观看 • 1 年前

Experience Stellar Blade on PC with #RTXOn! DLSS 4 with Multi Frame Generation boosts frame rates for maximum performance. Learn more:
1:16

Experience Stellar Blade on PC with #RTXOn! DLSS 4 with Multi Frame Generation boosts frame rates for maximum performance. Learn more:

NVIDIA GeForce

32,238 次观看 • 1 年前

Long video generation usually results in context increasing/scaling during chunk/frame-wise rollout. Considering context scaling may require context selection, we thus introduce the idea of MoE into long context modelling and propose Mixture of Contexts. All previous context/memory is considered while the chosen ones are computed in a data-driven manner. You can easily enjoy 7x compute savings.
1:44

Long video generation usually results in context increasing/scaling during chunk/frame-wise rollout. Considering context scaling may require context selection, we thus introduce the idea of MoE into long context modelling and propose Mixture of Contexts. All previous context/memory is considered while the chosen ones are computed in a data-driven manner. You can easily enjoy 7x compute savings.

Ceyuan Yang

22,064 次观看 • 9 个月前

World of Tanks: HEAT is coming, featuring DLSS 4 with Multi Frame Generation to accelerate frame rates, and NVIDIA Reflex to reduce PC latency for more responsive gameplay.
1:20

World of Tanks: HEAT is coming, featuring DLSS 4 with Multi Frame Generation to accelerate frame rates, and NVIDIA Reflex to reduce PC latency for more responsive gameplay.

NVIDIA GeForce

35,833 次观看 • 10 个月前

Goodnight, 𝕏..·˚ ༘ ☾ ⋆｡˚ ☄︎ Newscast about xAI, SpaceX, Starlink, Neuralink, 𝕏, and Grok. Created using the xAI Video API. I upscaled the final frame to use as the starting point for the next clip's generation, but it only helped marginally. However, I found a paper called "FreeInit: Bridging Initialization Gap in Video Diffusion Models" that I'm going to try tomorrow to fix the drifting problem. The approach: 1. FFT both images (anchor frame + last frame) 2. Low-pass filter on anchor (structure/color/layout) 3. High-pass filter on last frame (details/edges/motion) 4. Combine and IFFT back
1:09

Goodnight, 𝕏..·˚ ༘ ☾ ⋆｡˚ ☄︎ Newscast about xAI, SpaceX, Starlink, Neuralink, 𝕏, and Grok. Created using the xAI Video API. I upscaled the final frame to use as the starting point for the next clip's generation, but it only helped marginally. However, I found a paper called "FreeInit: Bridging Initialization Gap in Video Diffusion Models" that I'm going to try tomorrow to fix the drifting problem. The approach: 1. FFT both images (anchor frame + last frame) 2. Low-pass filter on anchor (structure/color/layout) 3. High-pass filter on last frame (details/edges/motion) 4. Combine and IFFT back

tetsuo

97,901 次观看 • 4 个月前

FBC: Firebreak Major Update Breakpoint is out now on all platforms for free featuring path tracing and DLSS 4 with Multi Frame Generation. #RTXOn →
1:10

FBC: Firebreak Major Update Breakpoint is out now on all platforms for free featuring path tracing and DLSS 4 with Multi Frame Generation. #RTXOn →

NVIDIA GeForce

28,380 次观看 • 8 个月前