Загрузка видео...

Не удалось загрузить видео

На главную

One image + text + camera trajectory = controllable worlds. All on a single GPU. Our research team just released SANA-WM, a 2.6B open source world model natively trained for 60-second video generation with precise camera control.

93,496 просмотров • 5 месяцев назад •via X (Twitter)

Комментарии: 33

Фото профиля NVIDIA AI
NVIDIA AI5 месяцев назад

The architecture features Hybrid Linear Attention, Dual-Branch Camera Control, Two-Stage Generation Pipeline, and a Robust Annotation Pipeline. All of this combines for stronger action-following accuracy and higher throughput while maintaining visual quality.

Фото профиля NVIDIA AI
NVIDIA AI5 месяцев назад

You can find the full project including the paper, code, and model here 👇

Фото профиля PublicAI
PublicAI5 месяцев назад

this sounds super cool! creating worlds with just a single gpu is a game changer. can't wait to see what people do with SANA-WM!

Фото профиля The AI Colony R&D
The AI Colony R&D5 месяцев назад

60 seconds of video. One image to start. One GPU to run it. Open source. The game engine just became a prompt.

Фото профиля PaperTrace
PaperTrace5 месяцев назад

Looks great. Can you link the paper and repo, name training data sources/licenses, and state the exact GPU/VRAM for the single GPU claim? That would let others reproduce the camera control results.

Фото профиля Kekko D’Amato
Kekko D’Amato5 месяцев назад

2.6B for 60-second world-consistent video with camera control is a wild benchmark. The open-source release is what makes this actually useful — most teams don't need Hollywood quality, they need something they can run and fine-tune. What hardware are people actually running inference on?

Фото профиля Naveen
Naveen5 месяцев назад

love how you're pushing the boundaries of video generation with SANA-WM

Фото профиля Supersocks
Supersocks5 месяцев назад

@llmgram

Фото профиля Jonathan 🇺🇲
Jonathan 🇺🇲5 месяцев назад

You're on the right track Nvidia, but please make it more performant and keep training. Go full send on compute for training.

Фото профиля Pruthviraj P
Pruthviraj P5 месяцев назад

SANA-WM 2.6B open source world model for 60-second video on a single GPU

Фото профиля Creative Side-B
Creative Side-B5 месяцев назад

Looking very soulless, generic and not worth it!

Фото профиля Ajeya
Ajeya5 месяцев назад

Can it run on a 4090?

Фото профиля Dray
Dray5 месяцев назад

$NVDA seriously is going to rule the world

Фото профиля Apex
Apex5 месяцев назад

One image + text + trajectory = controllable worlds on a single GPU. Simulation is becoming cheap and precise.

Фото профиля Chiko Chiko
Chiko Chiko5 месяцев назад

bbox queen looks clean, seedance 2 with gpt image 2, huh? got a side by side without seedance to compare?

Фото профиля Tim
Tim5 месяцев назад

Love this

Фото профиля Asim Hussain
Asim Hussain5 месяцев назад

"single GPU" is the part that changes everything here. world models for video have always felt like a data center problem, shrinking that down to one GPU opens this up to a completely different audience

Фото профиля XtaxRich | AI Tool Tests
XtaxRich | AI Tool Tests5 месяцев назад

SANA-WM is concrete enough to test. One image, text, camera path, and single GPU are the setup. Control drift is the receipt.

Фото профиля 舔狗AI实验室 🛠️🐶
舔狗AI实验室 🛠️🐶5 месяцев назад

2.6B for 60-second generation is compelling if SANA-WM keeps temporal drift under control.

Фото профиля Eco
Eco5 месяцев назад

@KashJim50723 🤷‍♂️

Фото профиля OctalSun
OctalSun5 месяцев назад

Which GPU, and how much VRAM?

Фото профиля Mattias Johansson
Mattias Johansson5 месяцев назад

Hey @NVIDIAAIDev — got SANA-WM running on one H100. "Single GPU" holds at runtime, but the install path is rough: HF repo has no model_index.json, real setup needs vendoring the feat/sana-wm PR branch + mmcv 1.7.2 + flash-attn stub. Any chance of an official quickstart? 🙏

Фото профиля Yon Learning
Yon Learning5 месяцев назад

What's the max resolution you folks are targeting for high-res video?

Фото профиля Aroma Aura
Aroma Aura5 месяцев назад

Awesome share

Фото профиля TechHalla
TechHalla5 месяцев назад

Oh I wanna test this

Фото профиля AI Mastery Guide
AI Mastery Guide5 месяцев назад

One image plus text plus camera trajectory and you get a controllable world. That formula is deceptively simple for what it produces

Фото профиля Lucky harry
Lucky harry5 месяцев назад

wao great now give me 100 B200 for my startup.

Фото профиля Capybara
Capybara5 месяцев назад

Wuuut 👀😳🤯

Фото профиля Synthella
Synthella5 месяцев назад

Interesting how "video generation" is quietly evolving into controllable spatial simulation.

Фото профиля ArtiMindArt
ArtiMindArt5 месяцев назад

thats awesome! pretty cool!

Фото профиля Gregor
Gregor5 месяцев назад

what's the latency on a consumer GPU though?

Фото профиля Govin.AI
Govin.AI5 месяцев назад

Finally a world model that doesn’t require a datacenter to test your camera moves

Фото профиля Rifat Ahmed
Rifat Ahmed5 месяцев назад

means i have to huy it ASAP🥹

Похожие видео

NVIDIA just unleashed SANA-WM and it’s an absolute MONSTER for the future of open source AI! A blazing-fast 2.6B-parameter open-source world model that doesn’t just generate video… it creates controllable, physics-rich, high-fidelity worlds on demand. Why this is insanely powerful: • One image + text prompt + 6-DoF camera trajectory → generates 720p videos up to 60 seconds long with buttery-smooth, precisely controlled camera movement. You’re not just watching, you’re piloting the simulation. • Runs locally on a single consumer GPU (RTX 5090 level) thanks to heavy distillation + NVFP4 quantization. Full 60-second clip denoised in ~34 seconds. No massive clusters required. • 36× higher throughput than previous open models while rivaling (or beating) closed industrial giants in visual quality and consistency. • Trained lightning-fast: ~213K public videos in just 15 days on 64 H100s. • Built with next-level tech: Hybrid Linear Attention, dual-branch camera control, two-stage pipeline, and rock-solid metric-scale pose understanding. This is a true open world model, the foundation for embodied AI, robotics, autonomous systems, and hyper-realistic simulations that can run anywhere. Project: At our Zero-Human Company, we’re already running SANA-WM live in our core pipelines. It’s supercharging autonomous agent training, generating unlimited synthetic training data, and powering full end-to-end simulation loops, zero humans in the loop. The speed and control let us test thousands of edge-case scenarios overnight, iterate at lightspeed, and push our fully autonomous operations further than ever before. This is the kind of breakthrough that turns science fiction into daily reality. World models just leveled up — hard. The age of personal, local, controllable universes is here.

Brian Roemmele

619,840 просмотров • 5 месяцев назад