正在加载视频...

视频加载失败

Google presents Genie Generative Interactive Environments introduce Genie, the first generative interactive environment trained in an unsupervised manner from unlabelled Internet videos. The model can be prompted to generate an endless variety of action-controllable virtual worlds described through text, synthetic images, photographs, and even sketches. At 11B parameters, Genie...

684,259 次观看 • 2 年前 •via X (Twitter)

9 条评论

AK 的头像
AK2 年前

paper page:

AK 的头像
AK2 年前

project page:

XR Multiverse 的头像
XR Multiverse2 年前

Google's warehouse of unused tech

crispyshh 的头像
crispyshh2 年前

@apples_jimmy Text to Mario achieved externally

meowbooks --🩸/acc 的头像
meowbooks --🩸/acc2 年前

that's so cool

Matt Griswold 的头像
Matt Griswold2 年前

Can it make Wolfenstein? If not, why not.

Smoke-away 的头像
Smoke-away2 年前

🔥🔥🔥

Mat 的头像
Mat2 年前

all these papers, no public releases 🫠

Ollin Boer Bohan 的头像
Ollin Boer Bohan2 年前

Demo page with more videos.

相关视频

Tencent presents GameGen-O Open-world Video Game Generation We introduce GameGen-O, the first diffusion transformer model tailored for the generation of open-world video games. This model facilitates high-quality, open-domain generation by simulating a wide array of game engine features, such as innovative characters, dynamic environments, complex actions, and diverse events. Additionally, it provides interactive controllability, thus allowing for the gameplay simulation. The development of GameGen-O involves a comprehensive data collection and processing effort from scratch. We collect and build the first Open-World Video Game Dataset (OGameData), amassed extensive data from over a hundred of next-generation open-world games, employing a proprietary data pipeline for efficient sorting, scoring, filtering, and decoupled captioning. This robust and extensive OGameData forms the foundation of our model's training process. GameGen-O undergoes a two-stage training process, consisting of foundation model pretraining and instruction tuning. In the first phase, the model is pre-trained on the OGameData via the text-to-video and video continuation, endowing GameGen-O with the capability for open-domain video game generation. In the second phase, the pre-trained model is frozen, and we fine-tuned using a trainable InstructNet, which enables the production of subsequent frames based on multimodal structural instructions. This whole training process imparts the model with the ability to generate and interactively control content. In summary, GameGen-O represents a notable initial step forward in the realm of open-world video game generation via generative models. It underscores the potential of generative models to serve as an alternative to rendering techniques, which can efficiently combine creative generation with interactive capabilities.

AK

366,858 次观看 • 1 年前