Took a simple fluid sim scene that I set up in Blender using a python script made in o3-mini. And then I ran it through several styles with vid2vid in Runway 🧵1/5

Here’s the source video. Note that it’s not rendered and there’s no lighting. I used OBS to screen record the UX in solid view with all the overlays removed. Then I just zoomed into the camera view in video editing software. 2/5

I made the script that built the scene using o3-mini. The scene is made using the fluid sim tools and physics libraries in Blender, but by using Python and prompts we can set up the scene without having to go through whole UX. 3/5

This is useful if you’re not too familiar with Blender or setting up fluid sims, or if you’re juggling a lot of different apps and interface switching is burning you out. It can be tough to navigate all the UXs from memory and using AI prompts + Python/scripting can make it easier. 4/5

That said it’s not 100% ready to go. Sometimes I’ll get errors and the Blender API docs won’t be enough even for o3-mini or R1. But I’m hoping in the future a prompt > scripting > API approach gives us more flexibility with using programs without needing perfect UX recall. 5/5

OP3N brings you an immersive experience across multiple biomes, each with its unique game modes. Join the Adventure!

@runwayml This is great. I haven't done enough with the cg->ai workflow but this is so good.

I feel like a lot of friction with 3D, or maybe programs in general, is having to know the interface. If we have some more tools to bypass the arbitrary navigation layouts, I feel like we can do so much more. Like we can understand how something works conceptually but hunting down buttons and fields sucks lol

@runwayml Whoa. Very cool workflow. Thanks for sharing! Perfect use of Runway's vid2vid.

@runwayml Great results, thanks for sharing this

@runwayml Very cool. What prompt did you use for the vid to vid? Thanks!

Thank you! The prompts weren’t anything special. I just described the aesthetic. So the black and white one was something like “black and white pencil sketch, illustration” And I had some prompts that weren’t giving me interesting stuff, so it was just tinkering and experimenting. I usually try to keep them short.