Video wird geladen...
Video konnte nicht geladen werden
Midjourney Office hours: They're working on a 3d system that will allow you to move into Midjourney images. Not polygons, not NeRF, not Gaussians. But a new NeRF-like format, with a team lead by someone who played an important part in the rollout of NeRF technology. Sorry polygons, but... show more
218,262 Aufrufe • vor 1 Jahr •via X (Twitter)
10 Kommentare

that Alex Evans? He is working at midjourney!

Oh yes I know! He's been there a few years. Very exciting stuff.

Or as Unity’s @3duaun says: “real time hallucinated reality.” I shorten it to “Holodeck.” :-)

I don't know enough about game development, but are the Polygons JUST for rendering visuals? I always thought of the polygon as the base wireframe that did collision detection and things like that, so the logic of the game could work. If they are sort of using 2d images to make 3d predictions, it sounds like it would look amazing for video, but can you build a game off that if there isn't an a real 3d model underneath?

I'm sorry but the success of Elden Ring and Black Myth Wukong have already proven what gamers want in a game. Wukong is full of photoscanned polygons rendered in full detail by UE5 Nanite. The future is already here and it's not NeRF.

"the success of Mario and Sonic have already proven what gamers want in a game and it's not 3D".. 😉 The future is difficult to predict, but polygons are not the pinnacle of immersive 3d. Gameplay and storytelling will continue to be key though, no matter what.

Polygons will be around for as long time. They are useful for semantically segmenting the scene and providing temporal stability and for art directing. They just won't be rendered to the screen.

You still need polygonal entites for collisions, shadow catching, scene segmentation for fast rendering rejections and so on.

For real, who needs polygons. I tried a simple (very optimized) gaussian spat on the Quest 3, and well, it literally tricked my brain in feeling smell and touch.

Representing Scenes as Neural Radiance Fields for View Synthesis - 1/6 people comes to mind
