正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Bytedance first to the holodeck with a steerable real time video generation world model. Up to a minute long videos 24 fps in HD resolution on 8xH100s. It's only an 8 billion param model...

Prakash (Ate-a-Pi)

53,017 subscribers

34,144 次观看 • 1 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

9 条评论

Lucid Scientific, Inc. 的头像

Lucid Scientific, Inc.1 年前

Expand the possibilities of your metabolic research. Resipher tracks real-time cellular oxygen consumption rate (OCR) in standard 96-well plates, delivering continuous data directly from your incubator. Learn more about Resipher and the impact of OCR >>

Mark Kretschmann 的头像

Mark Kretschmann1 年前

Wow.

Maxime Chevalier 的头像

Maxime Chevalier1 年前

Only 8B??? 😯

Richand Handsome 的头像

Richand Handsome1 年前

So in a year or two this will be a background or screensaver.

🏦 Christopher 🏦 📣READ PINNED📢 的头像

🏦 Christopher 🏦 📣READ PINNED📢1 年前

Looks like it was trained on street view

Profresher ¥€$ ॐ 的头像

Profresher ¥€$ ॐ1 年前

Que!?

yes_ducks_rule 的头像

yes_ducks_rule1 年前

don't go claiming they're the "first" if you don't know what you're talking about.

Vivek Ponnaiyan 的头像

Vivek Ponnaiyan1 年前

Wow… very cool.

blake smith 🇺🇸 的头像

blake smith 🇺🇸1 年前

Is this better than the odyssey thing?

相关视频

bytedance just released a new real-time video-to-depth model for long videos 🔥

bytedance just released a new real-time video-to-depth model for long videos 🔥

Dreaming Tulpa 🥓👑

30,745 次观看 • 1 年前

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.

Runway

1,162,923 次观看 • 4 个月前

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵

Chubby♨️

37,776 次观看 • 7 个月前

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

Yukang Chen

11,835 次观看 • 10 个月前

🤯Real-time video generation just got HUGE. Introducing Helios: A 14B parameter model running at 19.5 FPS on a single H100. Cheaper, Faster, and Stronger than 1.3B models, generating minute-long videos without the usual tricks (even no quantization).

🤯Real-time video generation just got HUGE. Introducing Helios: A 14B parameter model running at 19.5 FPS on a single H100. Cheaper, Faster, and Stronger than 1.3B models, generating minute-long videos without the usual tricks (even no quantization).

Bin Lin

27,737 次观看 • 5 个月前

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️

Ted Xiao

152,458 次观看 • 1 年前

Introducing LingBot-World: An open-source world simulator pushing the boundaries of video generation. 🚀 🌍 High-Fidelity: Realistic, scientific, & stylized. 🧠 Long-Term Memory: Minute-level consistency. ⚡ Real-Time: <1s latency at 16 FPS. 📜 Apache 2.0 Licensed. Model: Github:

Introducing LingBot-World: An open-source world simulator pushing the boundaries of video generation. 🚀 🌍 High-Fidelity: Realistic, scientific, & stylized. 🧠 Long-Term Memory: Minute-level consistency. ⚡ Real-Time: <1s latency at 16 FPS. 📜 Apache 2.0 Licensed. Model: Github:

ModelScope

28,809 次观看 • 6 个月前

Action-controllable world models are evolving fast. LingBot-World-Infinity can run an unbroken session of real-time world generation for up to an hour. A distilled model can stream 720p at 60 fps. World models are going to be a critical piece in training robotic agents for unseen worlds.

Action-controllable world models are evolving fast. LingBot-World-Infinity can run an unbroken session of real-time world generation for up to an hour. A distilled model can stream 720p at 60 fps. World models are going to be a critical piece in training robotic agents for unseen worlds.

The Humanoid Hub

14,007 次观看 • 22 天前

Introducing The Matrix --- a foundation world model for generating infinite-length, hyper-realistic videos with real-time, frame-level control: - Infinite-length video generation - 720p high-quality rendering - Real-time, frame-level control at 16 FPS - Generalization to real-world video control 🔗Blog: 📄Paper: 💻Code & Playable Demo: Coming soon! Key Innovation: A brand new technique called the shift-window denoise process model, enabling auto-regressive generation for diffusion and consistency models in real-time. Special thanks to project leader Ruili Feng and the entire Matrix team for their dedication and hard work over the year-long project.

Hongyang Zhang

178,372 次观看 • 1 年前

The upcoming OpenAI's open model is mixture of expert model. They take their proprietary training process and train a model with an model architecture that only contains publicly well known model arch layers & optimizations similar. This allows OpenAI to keep their internal model architecture an secret while they open weight an SOTA model. Thus, none of their long context optimizations needed for acutal real world production serving are in the open model architecture. OpenAI has created multiple different sizes of open weights distilled o3 including an 120B param that fits on a single node and 20B param that fits on a single chip.

The upcoming OpenAI's open model is mixture of expert model. They take their proprietary training process and train a model with an model architecture that only contains publicly well known model arch layers & optimizations similar. This allows OpenAI to keep their internal model architecture an secret while they open weight an SOTA model. Thus, none of their long context optimizations needed for acutal real world production serving are in the open model architecture. OpenAI has created multiple different sizes of open weights distilled o3 including an 120B param that fits on a single node and 20B param that fits on a single chip.

SemiAnalysis

80,891 次观看 • 1 年前

🔥Ultra-Long Video World Model up to 5min🔥 ✨ We introduce #LongVie2, an end-to-end autoregressive video world model that supports continuous video generation lasting up to 5min with: 🕹️ Strong Controllability 📷 Long-term Visual Fidelity 🔒 Temporal Consistency - Project: - Code: - Paper: . Thanks to AK !

🔥Ultra-Long Video World Model up to 5min🔥 ✨ We introduce #LongVie2, an end-to-end autoregressive video world model that supports continuous video generation lasting up to 5min with: 🕹️ Strong Controllability 📷 Long-term Visual Fidelity 🔒 Temporal Consistency - Project: - Code: - Paper: . Thanks to AK !

Ziwei Liu

82,656 次观看 • 7 个月前

Runway has unveiled a massive breakthrough in AI video generation at NVIDIA's GTC event, showcasing a new model capable of generating high-definition video in genuine real-time. The new model boasts a "time-to-first-frame" of under 100 milliseconds. This means HD video begins generating and playing almost the instant a command is given. This research preview was co-developed with NVIDIA and runs on their newly announced Vera Rubin architecture. This real-time capability is a foundational step for Runway's General World Model (GWM-1). It pushes the technology beyond simple video generation and into the realm of live, interactive environments.

Runway has unveiled a massive breakthrough in AI video generation at NVIDIA's GTC event, showcasing a new model capable of generating high-definition video in genuine real-time. The new model boasts a "time-to-first-frame" of under 100 milliseconds. This means HD video begins generating and playing almost the instant a command is given. This research preview was co-developed with NVIDIA and runs on their newly announced Vera Rubin architecture. This real-time capability is a foundational step for Runway's General World Model (GWM-1). It pushes the technology beyond simple video generation and into the realm of live, interactive environments.

Wes Roth

82,506 次观看 • 4 个月前

StreamDiT Real-Time Streaming Text-to-Video Generation StreamDiT enables real-time text-to-video generation at 16 FPS on a single GPU (H100)

StreamDiT Real-Time Streaming Text-to-Video Generation StreamDiT enables real-time text-to-video generation at 16 FPS on a single GPU (H100)

AK

43,682 次观看 • 1 年前

We present MotionStream — real-time, long-duration video generation that you can interactively control just by dragging your mouse. All videos here are raw, real-time screen captures without any post-processing. Model runs on a single H100 at 29 FPS and 0.4s latency.

We present MotionStream — real-time, long-duration video generation that you can interactively control just by dragging your mouse. All videos here are raw, real-time screen captures without any post-processing. Model runs on a single H100 at 29 FPS and 0.4s latency.

Xun Huang

98,703 次观看 • 9 个月前

Vidu S1, the World’s Most Advanced Model for Real-Time AI Interaction Vidu S1 introduces a new era of real-time interactive video. Voice-Driven Character Control: Go beyond voice-driven lip sync with real-time behavior generation. Characters understand, react, and respond naturally. Unlimited Real-Time Generation: Experience seamless real-time video generation with unlimited interaction duration. 540P at 25 FPS, built for live interaction: Generate video in real time at 540P / 25 FPS, with support for up to 42 FPS for even smoother experiences. Create Custom Characters from Images & Voices: Customize both appearance and voice. Bring humans, anime characters, pets, and more to life with personalized AI characters. Use code VIDUS1 to get started for free.

Vidu S1, the World’s Most Advanced Model for Real-Time AI Interaction Vidu S1 introduces a new era of real-time interactive video. Voice-Driven Character Control: Go beyond voice-driven lip sync with real-time behavior generation. Characters understand, react, and respond naturally. Unlimited Real-Time Generation: Experience seamless real-time video generation with unlimited interaction duration. 540P at 25 FPS, built for live interaction: Generate video in real time at 540P / 25 FPS, with support for up to 42 FPS for even smoother experiences. Create Custom Characters from Images & Voices: Customize both appearance and voice. Bring humans, anime characters, pets, and more to life with personalized AI characters. Use code VIDUS1 to get started for free.

Vidu AI

1,529,413 次观看 • 1 个月前

🚨🇮🇳 INDIA LAUNCHES WORLD’S MOST PRECISE WEATHER MODEL India is the first in the world to roll out a 6 KM resolution forecast system — delivering hyperlocal, real-time weather updates to every panchayat.

🚨🇮🇳 INDIA LAUNCHES WORLD’S MOST PRECISE WEATHER MODEL India is the first in the world to roll out a 6 KM resolution forecast system — delivering hyperlocal, real-time weather updates to every panchayat.

Sputnik India

263,201 次观看 • 1 年前

UE5.6 real-time motion capture plugin with native MetaHuman support. It requires only a webcam or uploaded video, and uses a 1-billion-parameter model to convert video into 3D motion data in real time, enabling automatic retargeting.

UE5.6 real-time motion capture plugin with native MetaHuman support. It requires only a webcam or uploaded video, and uses a 1-billion-parameter model to convert video into 3D motion data in real time, enabling automatic retargeting.

CYANPUPPETS

47,851 次观看 • 4 个月前

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source

World Model meets robot policy! Robbyant's LingBot-VA: unifies video world modeling and robotic policy learning. - A single model generates both future video and the actions to make it real. - Long-term memory enables long-horizon tasks. - Claims significant outperformance over π₀.₅ in real-world tasks. - It's open-source

The Humanoid Hub

17,721 次观看 • 6 个月前

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

Akshay 🚀

66,088 次观看 • 6 个月前