We built a real-time multiplayer game generated entirely by a neural network—and now you can actually play it. In collaboration with Modal, we just launched the live demo for MultiGen, our diffusion-based multiplayer game engine. Grab some friends and try it here 👇

@modal Super excited about releasing this! We've been having so much fun playing Multigen with our friends and now everyone can try it from their browser (and phones)

How do we keep multiple players perfectly synced in an environment generated by video diffusion models? The secret is a shared external memory that acts as a single source of truth for the map layout and player poses. We built this engine upon the research from our recent paper in collaboration with folks at Google (@natanielruizg, @JunhaoZHANG19, Amir Hertz, and @neal_wadhwa).

A unique disadvantage of video world models is that they tend to drift when faced with out-of-distribution states. Instead of fighting this, we embraced it as a core gameplay feature. Try to stay in distribution—if you drift too far, “reality will collapse” and reset your character!

Demo built by @Po_lhr, @alecyiu1, and @fnmee. Sponsored by @modal. Experience the real-time generative capabilities of MultiGen. The interactive demo is fully web-based, requiring no local hardware, and is optimized for both desktop and mobile clients. Link here:

Game on!

@modal Drifting is slow in F1 🏎️, and breaks reality in world models. Super excited to see the drift detector in action! Experience drift yourself by walking into walls! Here’s how it works:

@modal i am very impressed of the work Po and collaborators put in on this, congratulations! it plays really great

@modal That’s amazing! It might be the first multiplayer ai game which we can play online

@modal How do I try it out with friends? There's no option to create a private lobby.

@modal very cool guys! congrats on the release! I'm more of a partisan of having the model small enough so it can be run by the players but love to see this playable as well

@StanfordAILab @modal A wild project!! Any planned future code release?