正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

We present MotionStream — real-time, long-duration video generation that you can interactively control just by dragging your mouse. All videos here are raw, real-time screen captures without any post-processing. Model runs on a single H100 at 29 FPS and 0.4s latency.

Xun Huang

6,484 subscribers

98,757 次观看 • 9 个月前 •via X (Twitter)

教育科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

🤯Real-time video generation just got HUGE. Introducing Helios: A 14B parameter model running at 19.5 FPS on a single H100. Cheaper, Faster, and Stronger than 1.3B models, generating minute-long videos without the usual tricks (even no quantization).

🤯Real-time video generation just got HUGE. Introducing Helios: A 14B parameter model running at 19.5 FPS on a single H100. Cheaper, Faster, and Stronger than 1.3B models, generating minute-long videos without the usual tricks (even no quantization).

Bin Lin

27,761 次观看 • 5 个月前

We are just scratching the surface of precise control over AI video generation. MotionStream unlocks real-time video with interactive motion controls. You can interactively generate video based on motion inputs (like drawn trajectories, camera movements, or motion transfer). 29fps generation w/ 0.4 second latency on a single H100, oh and infinite length streaming. So much more intuitive than text prompts. Almost feels like performance capture - painting motion paths and watching AI generated video follow those paths instantly. Amazing work by Xun Huang et al. Feels like we're on the cusp of a new type of creation engine. And let me tell you - it ain't all nodes :-)

We are just scratching the surface of precise control over AI video generation. MotionStream unlocks real-time video with interactive motion controls. You can interactively generate video based on motion inputs (like drawn trajectories, camera movements, or motion transfer). 29fps generation w/ 0.4 second latency on a single H100, oh and infinite length streaming. So much more intuitive than text prompts. Almost feels like performance capture - painting motion paths and watching AI generated video follow those paths instantly. Amazing work by Xun Huang et al. Feels like we're on the cusp of a new type of creation engine. And let me tell you - it ain't all nodes :-)

Bilawal Sidhu

46,079 次观看 • 9 个月前

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

Yukang Chen

11,899 次观看 • 10 个月前

Introducing Lemon Slice Live: the first real-time audio-video AI model Anyone can video chat with any character by just uploading a single photo. Every pixel on the screen is rendered at 25fps in real-time by a transformer model. Here’s how we built it + a live demo! 👇

Introducing Lemon Slice Live: the first real-time audio-video AI model Anyone can video chat with any character by just uploading a single photo. Every pixel on the screen is rendered at 25fps in real-time by a transformer model. Here’s how we built it + a live demo! 👇

LemonSlice

171,007 次观看 • 1 年前

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!

World Labs

340,867 次观看 • 9 个月前

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

Yasir Ai

253,656 次观看 • 24 天前

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

Superman

1,448,911 次观看 • 26 天前

🎶 Lyria RealTime is a new experimental interactive music generation model that allows anyone to interactively create, control and perform music in real time. Available via the Gemini API and you can try the demo app on Google AI Studio.

🎶 Lyria RealTime is a new experimental interactive music generation model that allows anyone to interactively create, control and perform music in real time. Available via the Gemini API and you can try the demo app on Google AI Studio.

Google AI Developers

25,739 次观看 • 1 年前

Vidu S1, the World’s Most Advanced Model for Real-Time AI Interaction Vidu S1 introduces a new era of real-time interactive video. Voice-Driven Character Control: Go beyond voice-driven lip sync with real-time behavior generation. Characters understand, react, and respond naturally. Unlimited Real-Time Generation: Experience seamless real-time video generation with unlimited interaction duration. 540P at 25 FPS, built for live interaction: Generate video in real time at 540P / 25 FPS, with support for up to 42 FPS for even smoother experiences. Create Custom Characters from Images & Voices: Customize both appearance and voice. Bring humans, anime characters, pets, and more to life with personalized AI characters. Use code VIDUS1 to get started for free.

Vidu S1, the World’s Most Advanced Model for Real-Time AI Interaction Vidu S1 introduces a new era of real-time interactive video. Voice-Driven Character Control: Go beyond voice-driven lip sync with real-time behavior generation. Characters understand, react, and respond naturally. Unlimited Real-Time Generation: Experience seamless real-time video generation with unlimited interaction duration. 540P at 25 FPS, built for live interaction: Generate video in real time at 540P / 25 FPS, with support for up to 42 FPS for even smoother experiences. Create Custom Characters from Images & Voices: Customize both appearance and voice. Bring humans, anime characters, pets, and more to life with personalized AI characters. Use code VIDUS1 to get started for free.

Vidu AI

1,533,081 次观看 • 1 个月前

MuseSteamer just leveled up! Our video generation model now supports real-time interactive long-form video generation. It breaks the traditional 10-second limit, creating videos of any length with greater speed and control—enabling users to pause, rewrite storylines, or extend transitions any time during the process.

MuseSteamer just leveled up! Our video generation model now supports real-time interactive long-form video generation. It breaks the traditional 10-second limit, creating videos of any length with greater speed and control—enabling users to pause, rewrite storylines, or extend transitions any time during the process.

Baidu Inc.

142,732 次观看 • 10 个月前

Introducing The Matrix --- a foundation world model for generating infinite-length, hyper-realistic videos with real-time, frame-level control: - Infinite-length video generation - 720p high-quality rendering - Real-time, frame-level control at 16 FPS - Generalization to real-world video control 🔗Blog: 📄Paper: 💻Code & Playable Demo: Coming soon! Key Innovation: A brand new technique called the shift-window denoise process model, enabling auto-regressive generation for diffusion and consistency models in real-time. Special thanks to project leader Ruili Feng and the entire Matrix team for their dedication and hard work over the year-long project.

Hongyang Zhang

178,382 次观看 • 1 年前

🚨 Forget LIDAR. The Robbyant team just dropped a streaming 3D model that reconstructs scenes live, at ~20 FPS, over long sequences. One single camera. Runs in real time. Open-source. Entirely end-to-end. NO iterative optimization tricks and no post-processing cleanup steps! It outperforms both existing streaming approaches and several offline methods. 100% Free and open-source. Repo, paper and model weights in 🧵↓

🚨 Forget LIDAR. The Robbyant team just dropped a streaming 3D model that reconstructs scenes live, at ~20 FPS, over long sequences. One single camera. Runs in real time. Open-source. Entirely end-to-end. NO iterative optimization tricks and no post-processing cleanup steps! It outperforms both existing streaming approaches and several offline methods. 100% Free and open-source. Repo, paper and model weights in 🧵↓

Charly Wargnier

36,165 次观看 • 1 个月前

Whoa, this is Temporal Gaussian Hierarchy (TGH). This AI can real-time render long volumetric videos in 1080p at 450 fps on a single RTX 4090 GPU. And 18,000 frames (around 10 minutes) long 🤯 7 wild demos: 1. Real-time demos on MobileStage dataset

Whoa, this is Temporal Gaussian Hierarchy (TGH). This AI can real-time render long volumetric videos in 1080p at 450 fps on a single RTX 4090 GPU. And 18,000 frames (around 10 minutes) long 🤯 7 wild demos: 1. Real-time demos on MobileStage dataset

Min Choi

464,115 次观看 • 1 年前

Cyansdk is a free Blender AI motion capture plugin that runs locally on your computer. It requires 8GB of GPU memory for real-time processing and has a model size of 4.2GB. It supports real-time motion capture via webcam and video upload.

Cyansdk is a free Blender AI motion capture plugin that runs locally on your computer. It requires 8GB of GPU memory for real-time processing and has a model size of 4.2GB. It supports real-time motion capture via webcam and video upload.

CYANPUPPETS

16,350 次观看 • 1 年前

NVIDIA built a AI that nukes 30 years of animation technology. They open-sourced a model that generates 350,000 motion skills in real-time, at 15,000 fps with just 2ms latency. It’s called MotionBricks, an AI framework built to generate real-time character and humanoid motion at scale. → Intuitive smart primitives for quick scene authoring. → Integrated into NVIDIA's GR00T robotics stack. → Zero mocap. Zero rigging. → Runs in real-time

NVIDIA built a AI that nukes 30 years of animation technology. They open-sourced a model that generates 350,000 motion skills in real-time, at 15,000 fps with just 2ms latency. It’s called MotionBricks, an AI framework built to generate real-time character and humanoid motion at scale. → Intuitive smart primitives for quick scene authoring. → Integrated into NVIDIA's GR00T robotics stack. → Zero mocap. Zero rigging. → Runs in real-time

How To Prompt

1,037,291 次观看 • 3 天前

Introducing MirageLSD: The First Live-Stream Diffusion (LSD) AI Model Input any video stream, from a camera or video chat to a computer screen or game, and transform it into any world you desire, in real-time (<40ms latency). Here’s how it works (w/ demo you can use!):

Introducing MirageLSD: The First Live-Stream Diffusion (LSD) AI Model Input any video stream, from a camera or video chat to a computer screen or game, and transform it into any world you desire, in real-time (<40ms latency). Here’s how it works (w/ demo you can use!):

Decart

1,011,981 次观看 • 1 年前

Our research team just released Flex-Forcing: a video generation method that lets a single model switch between generation methods at inference time. Right now there are two main approaches to video generation. Bidirectional diffusion models attend to every frame at once, holding structure well at the cost of speed. Autoregressive models generate frame by frame, so they stream fast and scale to long clips, but accumulate error and drift over time. Flex-Forcing trains a single model to do both, letting you choose from the range at inference based on your compute budget.

Our research team just released Flex-Forcing: a video generation method that lets a single model switch between generation methods at inference time. Right now there are two main approaches to video generation. Bidirectional diffusion models attend to every frame at once, holding structure well at the cost of speed. Autoregressive models generate frame by frame, so they stream fast and scale to long clips, but accumulate error and drift over time. Flex-Forcing trains a single model to do both, letting you choose from the range at inference based on your compute budget.

NVIDIA AI

31,412 次观看 • 1 个月前

Xmax X1, the first real-time interactive video model, is here. Powered by autoregressive streaming generation, X1 achieves millisecond ultra-low latency and infinite-length generation, enabling truly natural spatial interaction. Camera is redefined. It’s no longer just a lens, but a magic wand that breaks the barrier between dimensions. Summon virtual beings into your reality and interact with them in real-time. Live implementation video is below, truely amazing work! Definitely one to watch.

Xmax X1, the first real-time interactive video model, is here. Powered by autoregressive streaming generation, X1 achieves millisecond ultra-low latency and infinite-length generation, enabling truly natural spatial interaction. Camera is redefined. It’s no longer just a lens, but a magic wand that breaks the barrier between dimensions. Summon virtual beings into your reality and interact with them in real-time. Live implementation video is below, truely amazing work! Definitely one to watch.

机器之心 JIQIZHIXIN

91,853 次观看 • 6 个月前

another example: a developer used the exact same $8 ESP32-S3 chip and local AI setup to build a real-time object recognition camera the fact that this is running entirely offline, on an eight-dollar microcontroller, without any cloud API calls, is wild... it captures the video feed, processes it locally through the model, and identifies objects in real-time. we are entering an era where you can just glue intelligence onto any physical object for less than $10. the hardware barrier is completely shattered.

another example: a developer used the exact same $8 ESP32-S3 chip and local AI setup to build a real-time object recognition camera the fact that this is running entirely offline, on an eight-dollar microcontroller, without any cloud API calls, is wild... it captures the video feed, processes it locally through the model, and identifies objects in real-time. we are entering an era where you can just glue intelligence onto any physical object for less than $10. the hardware barrier is completely shattered.

ard

222,360 次观看 • 17 天前