Загрузка видео...

Не удалось загрузить видео

На главную

Bytedance first to the holodeck with a steerable real time video generation world model. Up to a minute long videos 24 fps in HD resolution on 8xH100s. It's only an 8 billion param model...

8teAPi's profile picture

Prakash (Ate-a-Pi)

53,017 subscribers

34,144 просмотров • 1 год назад •via X (Twitter)

Наука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 9

Фото профиля Lucid Scientific, Inc.
Lucid Scientific, Inc.1 год назад

Expand the possibilities of your metabolic research. Resipher tracks real-time cellular oxygen consumption rate (OCR) in standard 96-well plates, delivering continuous data directly from your incubator. Learn more about Resipher and the impact of OCR >>

Фото профиля Mark Kretschmann
Mark Kretschmann1 год назад

Wow.

Фото профиля Maxime Chevalier
Maxime Chevalier1 год назад

Only 8B??? 😯

Фото профиля Richand Handsome
Richand Handsome1 год назад

So in a year or two this will be a background or screensaver.

Фото профиля 🏦 Christopher 🏦 📣READ PINNED📢
🏦 Christopher 🏦 📣READ PINNED📢1 год назад

Looks like it was trained on street view

Фото профиля Profresher ¥€$ ॐ
Profresher ¥€$ ॐ1 год назад

Que!?

Фото профиля yes_ducks_rule
yes_ducks_rule1 год назад

don't go claiming they're the "first" if you don't know what you're talking about.

Фото профиля Vivek Ponnaiyan
Vivek Ponnaiyan1 год назад

Wow… very cool.

Фото профиля blake smith 🇺🇸
blake smith 🇺🇸1 год назад

Is this better than the odyssey thing?

Похожие видео

bytedance just released a new real-time video-to-depth model for long videos 🔥
0:45

bytedance just released a new real-time video-to-depth model for long videos 🔥

Dreaming Tulpa 🥓👑

30,745 просмотров • 1 год назад

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.
0:54

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.

Runway

1,160,597 просмотров • 3 месяцев назад

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵
1:06

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵

Chubby♨️

37,776 просмотров • 6 месяцев назад

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:
3:18

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

Yukang Chen

11,752 просмотров • 8 месяцев назад

🤯Real-time video generation just got HUGE. Introducing Helios: A 14B parameter model running at 19.5 FPS on a single H100. Cheaper, Faster, and Stronger than 1.3B models, generating minute-long videos without the usual tricks (even no quantization).
0:50

🤯Real-time video generation just got HUGE. Introducing Helios: A 14B parameter model running at 19.5 FPS on a single H100. Cheaper, Faster, and Stronger than 1.3B models, generating minute-long videos without the usual tricks (even no quantization).

Bin Lin

27,703 просмотров • 3 месяцев назад

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️
0:31

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️

Ted Xiao

152,413 просмотров • 1 год назад

Introducing LingBot-World: An open-source world simulator pushing the boundaries of video generation. 🚀 🌍 High-Fidelity: Realistic, scientific, & stylized. 🧠 Long-Term Memory: Minute-level consistency. ⚡ Real-Time: <1s latency at 16 FPS. 📜 Apache 2.0 Licensed. Model: Github:
0:29

Introducing LingBot-World: An open-source world simulator pushing the boundaries of video generation. 🚀 🌍 High-Fidelity: Realistic, scientific, & stylized. 🧠 Long-Term Memory: Minute-level consistency. ⚡ Real-Time: <1s latency at 16 FPS. 📜 Apache 2.0 Licensed. Model: Github:

ModelScope

28,809 просмотров • 4 месяцев назад

Introducing The Matrix --- a foundation world model for generating infinite-length, hyper-realistic videos with real-time, frame-level control: - Infinite-length video generation - 720p high-quality rendering - Real-time, frame-level control at 16 FPS - Generalization to real-world video control 🔗Blog: 📄Paper: 💻Code & Playable Demo: Coming soon! Key Innovation: A brand new technique called the shift-window denoise process model, enabling auto-regressive generation for diffusion and consistency models in real-time. Special thanks to project leader Ruili Feng and the entire Matrix team for their dedication and hard work over the year-long project.
1:00

Introducing The Matrix --- a foundation world model for generating infinite-length, hyper-realistic videos with real-time, frame-level control: - Infinite-length video generation - 720p high-quality rendering - Real-time, frame-level control at 16 FPS - Generalization to real-world video control 🔗Blog: 📄Paper: 💻Code & Playable Demo: Coming soon! Key Innovation: A brand new technique called the shift-window denoise process model, enabling auto-regressive generation for diffusion and consistency models in real-time. Special thanks to project leader Ruili Feng and the entire Matrix team for their dedication and hard work over the year-long project.

Hongyang Zhang

178,322 просмотров • 1 год назад

The upcoming OpenAI's open model is mixture of expert model. They take their proprietary training process and train a model with an model architecture that only contains publicly well known model arch layers & optimizations similar. This allows OpenAI to keep their internal model architecture an secret while they open weight an SOTA model. Thus, none of their long context optimizations needed for acutal real world production serving are in the open model architecture. OpenAI has created multiple different sizes of open weights distilled o3 including an 120B param that fits on a single node and 20B param that fits on a single chip.
0:32

The upcoming OpenAI's open model is mixture of expert model. They take their proprietary training process and train a model with an model architecture that only contains publicly well known model arch layers & optimizations similar. This allows OpenAI to keep their internal model architecture an secret while they open weight an SOTA model. Thus, none of their long context optimizations needed for acutal real world production serving are in the open model architecture. OpenAI has created multiple different sizes of open weights distilled o3 including an 120B param that fits on a single node and 20B param that fits on a single chip.

SemiAnalysis

80,891 просмотров • 10 месяцев назад

🔥Ultra-Long Video World Model up to 5min🔥 ✨ We introduce #LongVie2, an end-to-end autoregressive video world model that supports continuous video generation lasting up to 5min with: 🕹️ Strong Controllability 📷 Long-term Visual Fidelity 🔒 Temporal Consistency - Project: - Code: - Paper: . Thanks to AK !
0:29

🔥Ultra-Long Video World Model up to 5min🔥 ✨ We introduce #LongVie2, an end-to-end autoregressive video world model that supports continuous video generation lasting up to 5min with: 🕹️ Strong Controllability 📷 Long-term Visual Fidelity 🔒 Temporal Consistency - Project: - Code: - Paper: . Thanks to AK !

Ziwei Liu

82,381 просмотров • 5 месяцев назад

Runway has unveiled a massive breakthrough in AI video generation at NVIDIA's GTC event, showcasing a new model capable of generating high-definition video in genuine real-time. The new model boasts a "time-to-first-frame" of under 100 milliseconds. This means HD video begins generating and playing almost the instant a command is given. This research preview was co-developed with NVIDIA and runs on their newly announced Vera Rubin architecture. This real-time capability is a foundational step for Runway's General World Model (GWM-1). It pushes the technology beyond simple video generation and into the realm of live, interactive environments.
0:54

Runway has unveiled a massive breakthrough in AI video generation at NVIDIA's GTC event, showcasing a new model capable of generating high-definition video in genuine real-time. The new model boasts a "time-to-first-frame" of under 100 milliseconds. This means HD video begins generating and playing almost the instant a command is given. This research preview was co-developed with NVIDIA and runs on their newly announced Vera Rubin architecture. This real-time capability is a foundational step for Runway's General World Model (GWM-1). It pushes the technology beyond simple video generation and into the realm of live, interactive environments.

Wes Roth

82,368 просмотров • 3 месяцев назад

StreamDiT Real-Time Streaming Text-to-Video Generation StreamDiT enables real-time text-to-video generation at 16 FPS on a single GPU (H100)
1:00

StreamDiT Real-Time Streaming Text-to-Video Generation StreamDiT enables real-time text-to-video generation at 16 FPS on a single GPU (H100)

AK

43,659 просмотров • 11 месяцев назад

We present MotionStream — real-time, long-duration video generation that you can interactively control just by dragging your mouse. All videos here are raw, real-time screen captures without any post-processing. Model runs on a single H100 at 29 FPS and 0.4s latency.
0:42

We present MotionStream — real-time, long-duration video generation that you can interactively control just by dragging your mouse. All videos here are raw, real-time screen captures without any post-processing. Model runs on a single H100 at 29 FPS and 0.4s latency.

Xun Huang

98,047 просмотров • 7 месяцев назад

It's over. Bytedance just dropped Seedance 1.0, the best AI video model in the world. Nothing is real anymore... Here are 10 insane examples:
0:20

It's over. Bytedance just dropped Seedance 1.0, the best AI video model in the world. Nothing is real anymore... Here are 10 insane examples:

Angry Tom

371,407 просмотров • 1 год назад

🚨🇮🇳 INDIA LAUNCHES WORLD’S MOST PRECISE WEATHER MODEL India is the first in the world to roll out a 6 KM resolution forecast system — delivering hyperlocal, real-time weather updates to every panchayat.
3:17

🚨🇮🇳 INDIA LAUNCHES WORLD’S MOST PRECISE WEATHER MODEL India is the first in the world to roll out a 6 KM resolution forecast system — delivering hyperlocal, real-time weather updates to every panchayat.

Sputnik India

263,192 просмотров • 1 год назад

UE5.6 real-time motion capture plugin with native MetaHuman support. It requires only a webcam or uploaded video, and uses a 1-billion-parameter model to convert video into 3D motion data in real time, enabling automatic retargeting.
0:55

UE5.6 real-time motion capture plugin with native MetaHuman support. It requires only a webcam or uploaded video, and uses a 1-billion-parameter model to convert video into 3D motion data in real time, enabling automatic retargeting.

CYANPUPPETS

47,564 просмотров • 2 месяцев назад

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source
1:33

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source

The Humanoid Hub

17,721 просмотров • 4 месяцев назад

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.
0:25

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

Akshay 🚀

65,784 просмотров • 5 месяцев назад

Today, we’re excited to introduce Miso One, the most emotive voice model in the world. Miso One is an 8-billion-parameter text-to-speech model for highly expressive speech generation. It emotes like a human and responds faster than a human, with just 110 milliseconds of latency. We’ve open-sourced the model weights, with API access coming soon. Hear how Miso One sounds in the thread below.
0:57

Today, we’re excited to introduce Miso One, the most emotive voice model in the world. Miso One is an 8-billion-parameter text-to-speech model for highly expressive speech generation. It emotes like a human and responds faster than a human, with just 110 milliseconds of latency. We’ve open-sourced the model weights, with API access coming soon. Hear how Miso One sounds in the thread below.

Aoden Teo

5,045,930 просмотров • 14 дней назад