Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Yume An Interactive World Generation Model

_akhaliq's profile picture

AK

416,697 subscribers

16,582 görüntüleme • 10 ay önce •via X (Twitter)

Bilim & TeknolojiEğitim
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Yume-1.5 A Text-Controlled Interactive World Generation Model
1:30

Yume-1.5 A Text-Controlled Interactive World Generation Model

AK

20,443 görüntüleme • 5 ay önce

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK
2:12

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK

Ziwei Liu

14,150 görüntüleme • 10 ay önce

It only took a week for an open source interactive world model to release🤯
0:24

It only took a week for an open source interactive world model to release🤯

noah

385,879 görüntüleme • 9 ay önce

One nice thing you can do with an interactive world model, look down and see your footwear ... and if the model understands what puddles are. Genie 3 creation.
0:30

One nice thing you can do with an interactive world model, look down and see your footwear ... and if the model understands what puddles are. Genie 3 creation.

Matt McGill

1,620,291 görüntüleme • 10 ay önce

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:
1:04

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:

Tencent Hy

368,172 görüntüleme • 1 ay önce

Introducing Universal Simulator (UniSim), an interactive simulator of the real world. Interactive website: Paper:
1:57

Introducing Universal Simulator (UniSim), an interactive simulator of the real world. Interactive website: Paper:

Sherry Yang

440,007 görüntüleme • 2 yıl önce

That was quick: last week Genie 3 was revealed. One week later Skywork AI releases Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model. Matrix-Game 2.0 can generate high-quality minute-level videos across diverse scenes at an ultra-fast speed of 25 FPS. They open-source our model weights and codebase to advance research in interactive world modeling. Some examples:
0:24

That was quick: last week Genie 3 was revealed. One week later Skywork AI releases Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model. Matrix-Game 2.0 can generate high-quality minute-level videos across diverse scenes at an ultra-fast speed of 25 FPS. They open-source our model weights and codebase to advance research in interactive world modeling. Some examples:

Chubby♨️

114,897 görüntüleme • 9 ay önce

We're thrilled to release & open-source Hunyuan3D World Model 1.0! This model enables you to generate immersive, explorable, and interactive 3D worlds from just a sentence or an image. It's the industry's first open-source 3D world generation model, compatible with CG pipelines for full editability & simulation. Set to transform game development, VR, digital content creation and so on. Get started now👇🏻 Project Page： Try it now： Github： Hugging Face：
1:24

We're thrilled to release & open-source Hunyuan3D World Model 1.0! This model enables you to generate immersive, explorable, and interactive 3D worlds from just a sentence or an image. It's the industry's first open-source 3D world generation model, compatible with CG pipelines for full editability & simulation. Set to transform game development, VR, digital content creation and so on. Get started now👇🏻 Project Page： Try it now： Github： Hugging Face：

Tencent Hy

1,229,913 görüntüleme • 10 ay önce

Snow World - Yume Nikki
0:20

Snow World - Yume Nikki

Images with Yume Nikki Music

52,881 görüntüleme • 6 ay önce

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine
0:27

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine

fal

18,822 görüntüleme • 4 ay önce

Microsoft just dropped MineWorld on Hugging Face a Real-Time and Open-Source Interactive World Model on Minecraft
0:31

Microsoft just dropped MineWorld on Hugging Face a Real-Time and Open-Source Interactive World Model on Minecraft

AK

95,035 görüntüleme • 1 yıl önce

LongLive Real-time Interactive Long Video Generation
0:59

LongLive Real-time Interactive Long Video Generation

AK

17,191 görüntüleme • 8 ay önce

Bytedance first to the holodeck with a steerable real time video generation world model. Up to a minute long videos 24 fps in HD resolution on 8xH100s. It's only an 8 billion param model...
0:22

Bytedance first to the holodeck with a steerable real time video generation world model. Up to a minute long videos 24 fps in HD resolution on 8xH100s. It's only an 8 billion param model...

Prakash (Ate-a-Pi)

34,144 görüntüleme • 1 yıl önce

The Next Generation of Payments Is Here! Today, Razorpay becomes India’s first payment gateway with an Official MCP (Model Context Protocol) Server, designed for an AI-first world. Here is how it works 👇
0:37

The Next Generation of Payments Is Here! Today, Razorpay becomes India’s first payment gateway with an Official MCP (Model Context Protocol) Server, designed for an AI-first world. Here is how it works 👇

Razorpay

158,097 görüntüleme • 1 yıl önce

VMem Consistent Interactive Video Scene Generation with Surfel-Indexed View Memory
0:59

VMem Consistent Interactive Video Scene Generation with Surfel-Indexed View Memory

AK

83,550 görüntüleme • 11 ay önce

GameFactory Creating New Games with Generative Interactive Videos present GameFactory, a generalizable world model that learns from a small-scale dataset of Minecraft game videos. By leveraging the prior knowledge of a pretrained video diffusion model, it can create new games in an open domain.
1:14

GameFactory Creating New Games with Generative Interactive Videos present GameFactory, a generalizable world model that learns from a small-scale dataset of Minecraft game videos. By leveraging the prior knowledge of a pretrained video diffusion model, it can create new games in an open domain.

AK

70,029 görüntüleme • 1 yıl önce

Introducing Starchild-1 from Odyssey, the first ever real-time multimodal world model. This a model that can generate interactive simulations of the world that you can—for the first time ever—hear. Starchild-1 represents a big step towards a general-purpose world simulator.
2:15

Introducing Starchild-1 from Odyssey, the first ever real-time multimodal world model. This a model that can generate interactive simulations of the world that you can—for the first time ever—hear. Starchild-1 represents a big step towards a general-purpose world simulator.

Oliver Cameron

242,333 görüntüleme • 20 gün önce

Tencent presents GameGen-O Open-world Video Game Generation We introduce GameGen-O, the first diffusion transformer model tailored for the generation of open-world video games. This model facilitates high-quality, open-domain generation by simulating a wide array of game engine features, such as innovative characters, dynamic environments, complex actions, and diverse events. Additionally, it provides interactive controllability, thus allowing for the gameplay simulation. The development of GameGen-O involves a comprehensive data collection and processing effort from scratch. We collect and build the first Open-World Video Game Dataset (OGameData), amassed extensive data from over a hundred of next-generation open-world games, employing a proprietary data pipeline for efficient sorting, scoring, filtering, and decoupled captioning. This robust and extensive OGameData forms the foundation of our model's training process. GameGen-O undergoes a two-stage training process, consisting of foundation model pretraining and instruction tuning. In the first phase, the model is pre-trained on the OGameData via the text-to-video and video continuation, endowing GameGen-O with the capability for open-domain video game generation. In the second phase, the pre-trained model is frozen, and we fine-tuned using a trainable InstructNet, which enables the production of subsequent frames based on multimodal structural instructions. This whole training process imparts the model with the ability to generate and interactively control content. In summary, GameGen-O represents a notable initial step forward in the realm of open-world video game generation via generative models. It underscores the potential of generative models to serve as an alternative to rendering techniques, which can efficiently combine creative generation with interactive capabilities.
0:51

Tencent presents GameGen-O Open-world Video Game Generation We introduce GameGen-O, the first diffusion transformer model tailored for the generation of open-world video games. This model facilitates high-quality, open-domain generation by simulating a wide array of game engine features, such as innovative characters, dynamic environments, complex actions, and diverse events. Additionally, it provides interactive controllability, thus allowing for the gameplay simulation. The development of GameGen-O involves a comprehensive data collection and processing effort from scratch. We collect and build the first Open-World Video Game Dataset (OGameData), amassed extensive data from over a hundred of next-generation open-world games, employing a proprietary data pipeline for efficient sorting, scoring, filtering, and decoupled captioning. This robust and extensive OGameData forms the foundation of our model's training process. GameGen-O undergoes a two-stage training process, consisting of foundation model pretraining and instruction tuning. In the first phase, the model is pre-trained on the OGameData via the text-to-video and video continuation, endowing GameGen-O with the capability for open-domain video game generation. In the second phase, the pre-trained model is frozen, and we fine-tuned using a trainable InstructNet, which enables the production of subsequent frames based on multimodal structural instructions. This whole training process imparts the model with the ability to generate and interactively control content. In summary, GameGen-O represents a notable initial step forward in the realm of open-world video game generation via generative models. It underscores the potential of generative models to serve as an alternative to rendering techniques, which can efficiently combine creative generation with interactive capabilities.

AK

366,858 görüntüleme • 1 yıl önce

Hunyuan-GameCraft High-dynamic Interactive Game Video Generation with Hybrid History Condition
1:02

Hunyuan-GameCraft High-dynamic Interactive Game Video Generation with Hybrid History Condition

AK

91,039 görüntüleme • 11 ay önce

🔥Ultra-Long Video World Model up to 5min🔥 ✨ We introduce #LongVie2, an end-to-end autoregressive video world model that supports continuous video generation lasting up to 5min with: 🕹️ Strong Controllability 📷 Long-term Visual Fidelity 🔒 Temporal Consistency - Project: - Code: - Paper: . Thanks to AK !
0:29

🔥Ultra-Long Video World Model up to 5min🔥 ✨ We introduce #LongVie2, an end-to-end autoregressive video world model that supports continuous video generation lasting up to 5min with: 🕹️ Strong Controllability 📷 Long-term Visual Fidelity 🔒 Temporal Consistency - Project: - Code: - Paper: . Thanks to AK !

Ziwei Liu

82,381 görüntüleme • 5 ay önce