Having fun testing #gen2 and created a trailer for (the first ever?) spoof #ai Horror Film : 'Spaghetti Terror'. Hard work, but learn't a lot of what works and what doesn't. Anyone want me to make the full length movie of this? 🤪 #aiart #gen2community #ai Runway #aifilmmaking

1/ Since I've posted, i've been asked on a few DM's for a some insights on how this was made, as #Gen2 its still in beta/via invite on Discord.

2/ Its currently free, but you're restricted to 3s clips per prompt - but can generate pretty much an unlimited number of clips (although only allows you to batch 5 per minute). Its relatively slow to generate - perhaps 5 mins per clip. Prompt docs are pretty basic!

3/ How you control/guide the output is currently limited. You have cfg_scale, seed and the ability supply a ref image and thats about it! Your going to be generating a hell of a lot of images to get something passable. I gen'd 150 source clips to get 45 secs of useful video!

4/ Continuity is challenging. Took a while to get the main character looking vaguely consistent. Similar prompts often can give wildly different outputs. Still lots of continuity errors if you look closely! But cunning editing, grading and a bit of post can help!

5/ Above all, I did this in about 3-4 evenings with a vague outline of what i wanted to do re: story/shots etc.. Still rough around the edges and was a bit like 'monkeys pulling scrabble letters out of a bag trying to write a novel' - but hopefully works as a sequence!

6/ My main takeaway is feels like early crude days of AI art last year (with Disco Diffusion) - a bit rough in places, limited control, but i'm sure the tools will improve to allow Directors to compose shots more effectively (i.e. a gen-2 equiv of ControlNets would be nice!)

7/ Hope this was vaguely useful - but do follow as i'll keep posting more experiments/insights with AI art stuff. Thank you! :-)

@runwayml This is awesome Andy. Great to see people pushing the boundaries of what #Gen2 can do and sharing it with the community.

@runwayml Thank you for the kind words Steve. Hopefully will inspire more people to get onboard the pasta horror genre 😉

@runwayml Awesome work dude, can image that it's quite a challenge. "in the deli aisle no one can hear you scream" genius reference. 😁

@Strangebox_ltd @runwayml Glad you like it Phil - a homage indeed! 😉