Loading video...

Video Failed to Load

Go Home

MotionStream Real-Time Video Generation with Interactive Motion Controls model runs in real time on a single NVIDIA H100 GPU (29 FPS, 0.4s Latency)

_akhaliq's profile picture

AK

476,097 subscribers

22,304 views • 7 months ago •via X (Twitter)

Science & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Cool new work on real-time video generation with motion control. MotionStream enables sub-second latency streaming on a single GPU. You can also control what parts of an image do & don't move, like the video below. 👏 to Xun Huang, Joonghyuk Shin, and team!
0:16

Cool new work on real-time video generation with motion control. MotionStream enables sub-second latency streaming on a single GPU. You can also control what parts of an image do & don't move, like the video below. 👏 to Xun Huang, Joonghyuk Shin, and team!

Justine Moore

21,780 views • 7 months ago

Free Blender AI Motion Capture Plugin: Runs a 1-billion-parameter model on a GPU with 8GB VRAM, supporting real-time capture and video uploads — no cost required.
0:10

Free Blender AI Motion Capture Plugin: Runs a 1-billion-parameter model on a GPU with 8GB VRAM, supporting real-time capture and video uploads — no cost required.

CYANPUPPETS

15,761 views • 1 year ago

A real-time AI motion capture model with 1B parameters. Connects to a 1080P camera or processes uploaded video to generate 3D motion data in real time. Supports Unreal Engine, Unity, and Blender, requiring 8GB of GPU VRAM for real-time processing.
0:13

A real-time AI motion capture model with 1B parameters. Connects to a 1080P camera or processes uploaded video to generate 3D motion data in real time. Supports Unreal Engine, Unity, and Blender, requiring 8GB of GPU VRAM for real-time processing.

CYANPUPPETS

36,608 views • 2 months ago

Trained a simple world model for my robot arm. It predicts the future over 20000 times faster than real time on a single NVIDIA RTX 3090 GPU (128 batch -> 160x faster each).
0:11

Trained a simple world model for my robot arm. It predicts the future over 20000 times faster than real time on a single NVIDIA RTX 3090 GPU (128 batch -> 160x faster each).

Alexander Koch

39,700 views • 2 years ago

Real-time video generation is officially here 👀 Krea AI just opened the waitlist for their new real-time video engine 😮 👉 What they’re promising: 1️⃣ 12+ FPS generation: True real-time 2️⃣ Multi-input control: Use text prompts, images, your screen, or even your webcam as a source 3️⃣ “World Model” Engine: “systems that learn how scenes evolve and how actions ripple forward in time” (c) A huge step for real-time storytelling and interactive experiences is here Take a look yourself 👇 (Video credit: Krea AI)
0:17

Real-time video generation is officially here 👀 Krea AI just opened the waitlist for their new real-time video engine 😮 👉 What they’re promising: 1️⃣ 12+ FPS generation: True real-time 2️⃣ Multi-input control: Use text prompts, images, your screen, or even your webcam as a source 3️⃣ “World Model” Engine: “systems that learn how scenes evolve and how actions ripple forward in time” (c) A huge step for real-time storytelling and interactive experiences is here Take a look yourself 👇 (Video credit: Krea AI)

AmirMušić

17,328 views • 9 months ago

A 1-billion-parameter motion model trained on NVIDIA CUDA that converts webcam or video footage into real-time XYZ skeletal point data and rotation values, enabling a fast 3D animation workflow.
0:13

A 1-billion-parameter motion model trained on NVIDIA CUDA that converts webcam or video footage into real-time XYZ skeletal point data and rotation values, enabling a fast 3D animation workflow.

CYANPUPPETS

62,091 views • 7 months ago

We're excited to power LemonSlice's new video agent product. Turn your real-time voice agent into a video agent using a single photo. The underlying model—which autoscales on Modal 😉—streams infinite-length talking video at 20fps using a single GPU.
0:17

We're excited to power LemonSlice's new video agent product. Turn your real-time voice agent into a video agent using a single photo. The underlying model—which autoscales on Modal 😉—streams infinite-length talking video at 20fps using a single GPU.

Modal

17,225 views • 5 months ago

it's open source time, with a real leap for world models 🎉 NVIDIA's SANA-WM: a camera-conditioned world model that fits on one GPU. 60s of 720p in 34s on a single 5090 - 2.6B params and Apache 2.0!
0:20

it's open source time, with a real leap for world models 🎉 NVIDIA's SANA-WM: a camera-conditioned world model that fits on one GPU. 60s of 720p in 34s on a single 5090 - 2.6B params and Apache 2.0!

Victor M

34,220 views • 17 days ago

The leading model runnable on a single cloud H100 GPU now fits on a single home GPU! 🔥 We've optimized Gemma 3 27B with QAT so you can run our best-in-class open model on your desktop RTX 3090 or similar. See how easy it is to try via ollama! 👇
0:16

The leading model runnable on a single cloud H100 GPU now fits on a single home GPU! 🔥 We've optimized Gemma 3 27B with QAT so you can run our best-in-class open model on your desktop RTX 3090 or similar. See how easy it is to try via ollama! 👇

Glenn Cameron Jr

81,427 views • 1 year ago

this is not a drill 🚨, real-time open source video generation is here 🔥 Self-Forcing - a real-time video distilled model from Wan 2.1 by Adobe is out, and they open sourced it 🐐 I've built a live real time demo on Hugging Face Spaces 📹💨
0:12

this is not a drill 🚨, real-time open source video generation is here 🔥 Self-Forcing - a real-time video distilled model from Wan 2.1 by Adobe is out, and they open sourced it 🐐 I've built a live real time demo on Hugging Face Spaces 📹💨

apolinario 🌐

52,153 views • 11 months ago

Real Human support for Seedance 2.0 is now available in ComfyUI. Unlock real human video generation with Seedance 2.0 now in ComfyUI. This unlocks real-person video generation with consistent identity and authentic facial expressions — after a one-time verification.
0:14

Real Human support for Seedance 2.0 is now available in ComfyUI. Unlock real human video generation with Seedance 2.0 now in ComfyUI. This unlocks real-person video generation with consistent identity and authentic facial expressions — after a one-time verification.

ComfyUI

48,271 views • 1 month ago

As announced in partnership with NVIDIA at CES, we’re excited to introduce Stable Point Aware 3D (SPAR3D), setting a new standard in 3D generation. Ideal for running on NVIDIA RTX AI PCs, SPAR3D enables real-time editing and complete structure generation of 3D objects from a single image in under a second. You can download the weights on Hugging Face and code on GitHub, or access the model through the Stability AI API. Learn more here: (1/3)
0:13

As announced in partnership with NVIDIA at CES, we’re excited to introduce Stable Point Aware 3D (SPAR3D), setting a new standard in 3D generation. Ideal for running on NVIDIA RTX AI PCs, SPAR3D enables real-time editing and complete structure generation of 3D objects from a single image in under a second. You can download the weights on Hugging Face and code on GitHub, or access the model through the Stability AI API. Learn more here: (1/3)

Stability AI

181,392 views • 1 year ago

Imagine Grok 3 Voice Mode with our real-time animation tech that runs purely on-device! Low latency, low power consumption. The tech is already working! Elon Musk
0:16

Imagine Grok 3 Voice Mode with our real-time animation tech that runs purely on-device! Low latency, low power consumption. The tech is already working! Elon Musk

Sergey Gonchar

74,964 views • 1 year ago

We're releasing OVIE, a novel view generation model trained entirely on single images. No multi-view datasets needed. Given a single image, it generates novel views of any scene in real time, running orders of magnitude faster than competing approaches.
0:16

We're releasing OVIE, a novel view generation model trained entirely on single images. No multi-view datasets needed. Given a single image, it generates novel views of any scene in real time, running orders of magnitude faster than competing approaches.

kyutai

30,917 views • 1 month ago

Real-time, generative motion design with Fable
0:12

Real-time, generative motion design with Fable

Fable

365,129 views • 2 years ago

Made interactive water surface in #AR. Works in real-time.
0:17

Made interactive water surface in #AR. Works in real-time.

Denis Rossiev ᯅ/acc

215,646 views • 2 years ago

You can play around with this interactive wiring diagram in Service Mode Tap any connector to see what each wire does & where it runs, all in real time
0:12

You can play around with this interactive wiring diagram in Service Mode Tap any connector to see what each wire does & where it runs, all in real time

Cybertruck

132,257 views • 4 months ago

A 1-billion-parameter AI real-time motion model that connects to a 1080P camera or uploaded videos, supports UE/Unity/Blender, and requires 8GB of VRAM for real-time processing.
0:18

A 1-billion-parameter AI real-time motion model that connects to a 1080P camera or uploaded videos, supports UE/Unity/Blender, and requires 8GB of VRAM for real-time processing.

CYANPUPPETS

63,433 views • 3 months ago

Video generation is powerful but too slow for real-world robotic tasks. How can we enable both video and action generation while ensuring real-time policy inference? Check out our work on the Unified Video Action Model (UVA) to find out! (1/7)
0:13

Video generation is powerful but too slow for real-world robotic tasks. How can we enable both video and action generation while ensuring real-time policy inference? Check out our work on the Unified Video Action Model (UVA) to find out! (1/7)

Shuang Li

67,367 views • 1 year ago

The Blender AI motion capture plugin requires a graphics card with 8GB of VRAM for real-time processing. It supports both real-time capture and video uploads, and is compatible with multi-camera setups.
0:13

The Blender AI motion capture plugin requires a graphics card with 8GB of VRAM for real-time processing. It supports both real-time capture and video uploads, and is compatible with multi-camera setups.

Cyanpuppets

11,322 views • 1 year ago