Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

StreamDiT Real-Time Streaming Text-to-Video Generation StreamDiT enables real-time text-to-video generation at 16 FPS on a single GPU (H100)

_akhaliq's profile picture

AK

511,911 subscribers

43,682 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:
3:18

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

Yukang Chen

11,915 Aufrufe • vor 11 Monaten

We present MotionStream — real-time, long-duration video generation that you can interactively control just by dragging your mouse. All videos here are raw, real-time screen captures without any post-processing. Model runs on a single H100 at 29 FPS and 0.4s latency.
0:42

We present MotionStream — real-time, long-duration video generation that you can interactively control just by dragging your mouse. All videos here are raw, real-time screen captures without any post-processing. Model runs on a single H100 at 29 FPS and 0.4s latency.

Xun Huang

98,902 Aufrufe • vor 9 Monaten

🤯Real-time video generation just got HUGE. Introducing Helios: A 14B parameter model running at 19.5 FPS on a single H100. Cheaper, Faster, and Stronger than 1.3B models, generating minute-long videos without the usual tricks (even no quantization).
0:50

🤯Real-time video generation just got HUGE. Introducing Helios: A 14B parameter model running at 19.5 FPS on a single H100. Cheaper, Faster, and Stronger than 1.3B models, generating minute-long videos without the usual tricks (even no quantization).

Bin Lin

27,761 Aufrufe • vor 5 Monaten

Vidu S1, the World’s Most Advanced Model for Real-Time AI Interaction Vidu S1 introduces a new era of real-time interactive video. Voice-Driven Character Control: Go beyond voice-driven lip sync with real-time behavior generation. Characters understand, react, and respond naturally. Unlimited Real-Time Generation: Experience seamless real-time video generation with unlimited interaction duration. 540P at 25 FPS, built for live interaction: Generate video in real time at 540P / 25 FPS, with support for up to 42 FPS for even smoother experiences. Create Custom Characters from Images & Voices: Customize both appearance and voice. Bring humans, anime characters, pets, and more to life with personalized AI characters. Use code VIDUS1 to get started for free.
0:54

Vidu S1, the World’s Most Advanced Model for Real-Time AI Interaction Vidu S1 introduces a new era of real-time interactive video. Voice-Driven Character Control: Go beyond voice-driven lip sync with real-time behavior generation. Characters understand, react, and respond naturally. Unlimited Real-Time Generation: Experience seamless real-time video generation with unlimited interaction duration. 540P at 25 FPS, built for live interaction: Generate video in real time at 540P / 25 FPS, with support for up to 42 FPS for even smoother experiences. Create Custom Characters from Images & Voices: Customize both appearance and voice. Bring humans, anime characters, pets, and more to life with personalized AI characters. Use code VIDUS1 to get started for free.

Vidu AI

1,533,747 Aufrufe • vor 1 Monat

Ovi is out on Hugging Face Twin Backbone Cross-Modal Fusion for Audio-Video Generation Ovi is a veo-3 like, video+audio generation model that simultaneously generates both video and audio content from text or text+image inputs. Video+Audio Generation: Generate synchronized video and audio content simultaneously Flexible Input: Supports text-only or text+image conditioning 5-second Videos: Generates 5-second videos at 24 FPS, area of 720×720, at various aspect ratios (9:16, 16:9, 1:1, etc)
2:08

Ovi is out on Hugging Face Twin Backbone Cross-Modal Fusion for Audio-Video Generation Ovi is a veo-3 like, video+audio generation model that simultaneously generates both video and audio content from text or text+image inputs. Video+Audio Generation: Generate synchronized video and audio content simultaneously Flexible Input: Supports text-only or text+image conditioning 5-second Videos: Generates 5-second videos at 24 FPS, area of 720×720, at various aspect ratios (9:16, 16:9, 1:1, etc)

AK

23,082 Aufrufe • vor 11 Monaten

VideoComposer brings ControlNet guidance to text and video-to-video. The model enables to combine multiple modalities like text, sketch, style and even motion to drive video generation. The results look extremely good.
2:40

VideoComposer brings ControlNet guidance to text and video-to-video. The model enables to combine multiple modalities like text, sketch, style and even motion to drive video generation. The results look extremely good.

Dreaming Tulpa 🥓👑

18,045 Aufrufe • vor 3 Jahren

ELON: THE FUTURE OF AI IS REAL-TIME VIDEO COMPREHENSION AND GENERATION Elon said most human-AI interaction will soon happen through real-time video, both in understanding and creating it. He explained that while text carries higher information density, video already dominates the internet in both data generation and compute demand: “Most interaction is going to be real-time video with AI, real-time video comprehension and real-time video generation. That’s going to be most of the load, and that’s how it is for most of the internet right now. Most of the internet is video. Text is a pretty small percentage, but it tends to be higher value or more densely compressed information. If you look at the most bits generated and compute spent, it’s certainly going to be video.” Source: Nikhil Kamath
1:05

ELON: THE FUTURE OF AI IS REAL-TIME VIDEO COMPREHENSION AND GENERATION Elon said most human-AI interaction will soon happen through real-time video, both in understanding and creating it. He explained that while text carries higher information density, video already dominates the internet in both data generation and compute demand: “Most interaction is going to be real-time video with AI, real-time video comprehension and real-time video generation. That’s going to be most of the load, and that’s how it is for most of the internet right now. Most of the internet is video. Text is a pretty small percentage, but it tends to be higher value or more densely compressed information. If you look at the most bits generated and compute spent, it’s certainly going to be video.” Source: Nikhil Kamath

Mario Nawfal

15,670 Aufrufe • vor 9 Monaten

Introducing SDXL Turbo: A real-time text-to-image generation model. SDXL Turbo achieves state-of-the-art performance with a new distillation technology, enabling single-step image generation with unprecedented quality, reducing the required step count from 50 to just one. The code, research paper, and weights for non-commercial use are now available on our website. You can test SDXL Turbo on Stability AI’s image editing platform Clipdrop, with a beta demonstration of the real-time text-to-image generation capabilities. Learn more:
0:23

Introducing SDXL Turbo: A real-time text-to-image generation model. SDXL Turbo achieves state-of-the-art performance with a new distillation technology, enabling single-step image generation with unprecedented quality, reducing the required step count from 50 to just one. The code, research paper, and weights for non-commercial use are now available on our website. You can test SDXL Turbo on Stability AI’s image editing platform Clipdrop, with a beta demonstration of the real-time text-to-image generation capabilities. Learn more:

Stability AI

976,610 Aufrufe • vor 2 Jahren

Helios Real Real-Time Long Video Generation Model paper:
1:13

Helios Real Real-Time Long Video Generation Model paper:

AK

25,951 Aufrufe • vor 5 Monaten

🚀Generate a 30-second 1080p video in just 7 seconds! We’re open-sourcing FastVideo Dreamverse: real-time vibe directing for video generation on a single NVIDIA B200 GPU with LTX-2 model LTX Repo: Blog:
0:38

🚀Generate a 30-second 1080p video in just 7 seconds! We’re open-sourcing FastVideo Dreamverse: real-time vibe directing for video generation on a single NVIDIA B200 GPU with LTX-2 model LTX Repo: Blog:

Hao AI Lab

226,187 Aufrufe • vor 3 Monaten

Can we simplify video generation by decomposing it into interleaved text-video co-generation? Would explicit, repeated thinking in language improve generation in pixels? We introduce TV2TV: a unified model that jointly learns - language modeling (next-token prediction) - video flow matching (next-frame prediction) At inference, TV2TV dynamically alternates between textual thinking and video generation. Model generations below: interleaved text plans and video slices (~1–2s) are co-generated over time, conditioned on a single frame per sport. 📖
0:36

Can we simplify video generation by decomposing it into interleaved text-video co-generation? Would explicit, repeated thinking in language improve generation in pixels? We introduce TV2TV: a unified model that jointly learns - language modeling (next-token prediction) - video flow matching (next-frame prediction) At inference, TV2TV dynamically alternates between textual thinking and video generation. Model generations below: interleaved text plans and video slices (~1–2s) are co-generated over time, conditioned on a single frame per sport. 📖

Xiaochuang Han

32,217 Aufrufe • vor 8 Monaten

Apparate Labs launched PROTEUS, a new real-time AI video generation model. It creates realistic avatars and lip-syncs from a single reference image, similar to VASA-1, but it's completely real-time.
1:05

Apparate Labs launched PROTEUS, a new real-time AI video generation model. It creates realistic avatars and lip-syncs from a single reference image, similar to VASA-1, but it's completely real-time.

Rowan Cheung

13,253 Aufrufe • vor 2 Jahren

⚡️Generating 3DGS scenes in 5 seconds on a single GPU⚡️ #FlashWorld enables ⚡️*fast*⚡️ (10~100x faster than previous methods) and 🔥*high-quality*🔥 3D world generation, from a single image or text prompt. Code: Page:
0:56

⚡️Generating 3DGS scenes in 5 seconds on a single GPU⚡️ #FlashWorld enables ⚡️*fast*⚡️ (10~100x faster than previous methods) and 🔥*high-quality*🔥 3D world generation, from a single image or text prompt. Code: Page:

Tengfei Wang

119,877 Aufrufe • vor 10 Monaten

Collaborative Video Diffusion Consistent Multi-video Generation with Camera Control Research on video generation has recently made tremendous progress, enabling high-quality videos to be generated from text prompts or images. Adding control to the video generation
2:16

Collaborative Video Diffusion Consistent Multi-video Generation with Camera Control Research on video generation has recently made tremendous progress, enabling high-quality videos to be generated from text prompts or images. Adding control to the video generation

AK

29,278 Aufrufe • vor 2 Jahren

Excited to announce LTX-Video! Our new text-to-video model generates stunning, high-quality videos faster than real-time—5 seconds of 24fps video at 768x512 in just 4 seconds on an Nvidia H100! ⚡ We’re open-sourcing the code & weights. Check out the results 🎥👇
0:26

Excited to announce LTX-Video! Our new text-to-video model generates stunning, high-quality videos faster than real-time—5 seconds of 24fps video at 768x512 in just 4 seconds on an Nvidia H100! ⚡ We’re open-sourcing the code & weights. Check out the results 🎥👇

Yoav HaCohen

50,374 Aufrufe • vor 1 Jahr

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!
2:21

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!

World Labs

340,986 Aufrufe • vor 10 Monaten

ELON MUSK: Real-time AI videos, movies and video games i.e real-time video generation is the future. The AI video generation that I'm seeing of xAI and from others is pretty impressive.
0:39

ELON MUSK: Real-time AI videos, movies and video games i.e real-time video generation is the future. The AI video generation that I'm seeing of xAI and from others is pretty impressive.

DogeDesigner

42,672 Aufrufe • vor 9 Monaten