Runway quietly released their version of NeRFs today. It's called "3D Captures" How it works:

Best practices for capturing your object/scene 👉 Disable HDR. 👉 Move the camera slowly to reduce blur. 👉 Keep your tilt locked as you do your loops 👉 30-second video or longer (1 to 3 minutes is best) 👉 Choose camera settings that have a high FPS (slow-mo works great)

Upload your video to train the model. It takes a little while for your model to train, but once you have it you'll be able to do limitless reshoots.

Once you're model is trained you'll be able to create animations in the Runway Editor.

In the editor you can see your model represented in two ways: 👉 as a mesh 👉 as a point cloud

A nice little feature they have is single frame rendering, so you can quickly see what your composition looks like in the selected canvas resolution as you edit.

You can preview your video at any point. Once you've finished, just hit export.

There are some unique features, like the ability to control depth of field and view the model as a point cloud in editor. They seem to still have some work to do on the camera pathing, but the results are pretty good already. Excited to see where this goes. I love NeRFs.

Whaat?!! Omg, I’m dumping (or parking) everything else I’m working on to dig into this. Thank you Nick for sharing and including tips! I love NeRFs!

Okay, okay. NOT even close to the truth with this meme. Luma AI has a UE5 plugin, an awesome app, and so much more. I just wanted to be the first. It's all getting very interesting!

👀woah

Nice - this is the first I've heard of this. Will put this on my long list of things to test.

This is cool, all this progression in 3D creation seems like the perfect route to fill the Metaverse with content when it inevitably arrives.

very exciting!

It is moving so fast. Let's pretend what will be released in 2030? INPUT: Describe a short story, make it 3d, style anime 80's movie. OUTPUT: You get a full rendered movie file and a USD files for import into UE 15.2

i’ve been out of it for a hot minute here working on LLM stuff, i had no idea runway was doing this!!

It's an in-browser editor, right? I'm curious about the hardware required for rendering? Does it use the GPU or CPU? Is chrome better than Firefox for this?

Meanwhile my 1660ti and 10 edge tabs

@SaveToNotion #tweet #runway

@Scobleizer I can't wait to try it out!

So awesome, thanks!

is it free?

Thanks for sharing Nick, I will try later😍

This is impressive!

Is runaway free?

I think it is also a message to Nvidia, that they are the AI platform first.

wait what? that's big!

Runway releasing back to back crazy updates

Looks awesome, need to try it!!

nice, a controlnet for video is here 🤯

Been trying to catch up on sleep…guess not

@memdotai mem it

sneaky sneaky gots to check it out

Releasing movie soon