Navigation überspringen
Google presents Genie
0:00 / 0:27

Google presents Genie

AK

@_akhaliq528.977 Follower

Auf X besuchen
2.275 LikesHerunterladenOriginalbeitrag

684.738 Aufrufe

Google presents Genie Generative Interactive Environments introduce Genie, the first generative interactive environment trained in an unsupervised manner from unlabelled Internet videos. The model can be prompted to generate an endless variety of action-controllable virtual worlds described through text, synthetic images, photographs, and even sketches. At 11B parameters, Genie can be considered a foundation world model. It is comprised of a spatiotemporal video tokenizer, an autoregressive dynamics model, and a simple and scalable latent action model. Genie enables users to act in the generated environments on a frame-by-frame basis despite training without any ground-truth action labels or other domain-specific requirements typically found in the world model literature. Further the resulting learned latent action space facilitates training agents to imitate behaviors from unseen videos, opening the path for training generalist agents of the future.

9 Kommentare

Kommentare aus dem Originalbeitrag auf X (Twitter)

  • Profilbild von AK

    @_akhaliq

    paper page:

    124 Likes

  • Profilbild von AK

    @_akhaliq

    project page:

    70 Likes

  • Profilbild von XR Multiverse

    @XRMultiverse

    Google's warehouse of unused tech

    21 Likes

  • Profilbild von crispyshh

    @crispyshh

    @apples_jimmy Text to Mario achieved externally

    19 Likes

  • Profilbild von meowbooks --🩸/acc

    @untitled01ipynb

    that's so cool

    14 Likes

  • Profilbild von Matt Griswold

    @griswold

    Can it make Wolfenstein? If not, why not.

    11 Likes

  • Profilbild von Smoke-away

    @SmokeAwayyy

    🔥🔥🔥

    10 Likes

  • Profilbild von Mat

    @matgee01

    all these papers, no public releases 🫠

    7 Likes

  • Profilbild von Ollin Boer Bohan

    @madebyollin

    Demo page with more videos.

    6 Likes