正在加载视频...

视频加载失败

This is "Eve & Adam" Tips below on how I made this using Gemini, JSON prompts (and why), Runway Aleph, and Veo3. Spoilers below. Watch before reading 🤘

216,558 次观看 • 1 年前 •via X (Twitter)

81 条评论

MetaPuppet 的头像
MetaPuppet1 年前

Eve and Adam is a story about a brother and sister who are part human, part machine—the first of what could be the next evolution of the human species. It all started with an idea of someone shooting at the moon. I asked myself, why would anyone do that? Each answer led to another question, and the story of "Eve and Adam" began to unfold. I wanted to capture the nostalgia of films like Close Encounters of the Third Kind and Escape to Witch Mountain, so I used Gemini to research the equipment those films were shot on and to help craft prompts that would maintain that classic look. I used Veo3 text-to-video and image-to-video for the visuals.

MetaPuppet 的头像
MetaPuppet1 年前

This project marked my first experience with JSON prompting. While I skipped the social media debate about whether JSON prompting gives better results —after three years of crafting natural language prompts in paragraph form, the structure this format provided simply made sense to my brain. First, I described the shot I wanted to create to Gemini, which then gave me a prompt in JSON format that I would feed into Veo3. I'd run an initial generation without even reading the prompt, just to see the output. Once I saw how far off the initial generation was from my vision, I'd then read the prompt and find the exact category I needed to tweak—be it lighting, composition, or the subject itself—thanks to the prompt's structured format. To me, this was far easier than revising a block of natural language text. Another advantage: I could copy and paste the entire JSON prompt into Veo3 due to its large token limit, whereas other platforms would hit their character count maximum. Example prompt: { "shot_name": "Aerial Shot (AS) - Car on Dirt Road into Forest", "camera": { "type": "Wide Shot", "movement": "Aerial shot, car turns right off highway onto dirt road, following the car then craning up at the moon in the sky above the forest trees", "lens": "Panavision lenses", "focus": "Car and forest in focus, then car fading", "lighting_direction": "Backlit by evening sky" }, "setting": { "environment": "Highway and a Narrow dirt road leading into dense, overgrown Pacific Northwest forest", "time_of_day": "Night", "atmosphere": "Shifting from isolated to mysterious and ominous" }, "subject": { "main_subject": "Late 1970s muscle car", "details": "Kicking up significant dust, becoming a tiny, fading speck, tail lights receding" }, "visual_style": { "genre": "Action/Sci-Fi Drama", "film_stock": "Kodak 35mm film (Eastman 100T 5247)", "color_grade": "Gritty, natural with deepening purple shadows, cinematic", "rating_tone": "PG-13", "overall_feel": "Cinematic masterpiece" }, "composition": { "elements": "Car swallowed by immense, looming trees; road disappearing into wilderness" }, "implied_elements": { "sound": "Crunch of tires on dirt, rustling leaves, growing silence" } } ]

MetaPuppet 的头像
MetaPuppet1 年前

I did this shot by shot, in a linear fashion. I added clips to my timeline in Premiere until the entire story was roughly laid out. On this first pass, the quality of the shots wasn't the priority; I just needed placeholders to begin understanding the film's flow, pacing, and tone. Then I went back to the start of the timeline and regenerated and refined each shot. I did this hundreds of times. I used Runway Aleph to fix inconsistencies in certain shots, as well as change lighting from day to night featuring the same characters. It came out right as I was nearing the end of making this, so I definitely need to spend more time with it, but this kind of natural language in-painting is amazing. Veo3 provides an 8-second clip with sound effects, dialogue, and sometimes even baked-in music. For better sound design and mixing control, we need to export individual stems, so I used Lalal to split the audio. Veo3’s audio often reflects the scene’s tone—for example, tense scenes get tense music—but it cuts off abruptly at the 8-second mark. One trick I used was to upload the 8 second clip’s audio to Suno and use it as inspiration for a longer sound design or music track. This gave me better better audio consistency when cutting between shots in a particular scene. The main theme music is an original song I wrote years ago when I was in a band. I uploaded the recording to Suno and created variations in different styles that serve as Adam's theme song. I love how this tech isn't just helping me visualize new ideas; it's also breathing new life into old ones. I don't think of this as a finished short film, but instead as a starting point. I can pitch this concept to a studio as a TV series or a feature and show this as a teaser. If it gets picked up, we can shoot it for real. This is exactly why this technology needs to be taught in film schools today. Students can pre-visualize their scripts with AI, see what’s working and what isn’t, then shoot it with real actors on set for intimate scenes, while leveraging AI for any big-budget special effects shots. If you're currently in film school and these tools aren't being taught, I have two words for you: Curious Refuge. One question I know I'll be asked is, "How long did this take to make?" The misleading answer is three weeks. But the real answer, as anyone who has worked in production knows, is years. Years of film school and working as an editor on traditional productions cannot be discounted or ignored, because while generative AI excels at creating visuals, it's currently terrible at storytelling. It's not great at writing scripts and definitely can't edit well yet, so those aspects were done traditionally using the skills I learned from a career in post-production. The good news is you don't have to spend years learning every aspect. There are plenty of knowledgeable people in this space looking to connect and collaborate. Team up. Lastly, I don't believe AI cinema will replace traditional cinema; instead, they will co-exist as separate mediums or merge as an evolution of VFX. We’re still going to need actors, writers, editors, and VFX artists, likely even more than before, given the increased demand for productions that these tools will facilitate. Whether it's AI, CGI, live-action film, or theater, at its core, it's all just storytelling. But to me, having this level of visual effects available and affordable is a dream come true. So, experiment, ask questions, and most importantly, have fun! ✌️

MetaPuppet 的头像
MetaPuppet1 年前

Tools used: Gemini, Veo3, Freepik, Runway, Magnific, Midjourney, ElevenLabs, Suno, Kling, Hailuo, Dreamina, Luma, Topaz

MetaPuppet 的头像
MetaPuppet1 年前

Link to 4K video on Youtube:

FERA 的头像
FERA1 年前

I know it’s not “complete” but it is One the best I’ve seen in this space. 7 minutes or so I didn’t stop to check on something else. An insta retweet deserved right here.

MetaPuppet 的头像
MetaPuppet1 年前

Much appreciated 🙏 so good to hear thank u!

Dave Clark 的头像
Dave Clark1 年前

Masterful brother. Shared! Hopefully this gets millions of hits.

MetaPuppet 的头像
MetaPuppet1 年前

Always appreciate you bro! 🫶

TomLikesRobots🤖 的头像
TomLikesRobots🤖1 年前

This is great - really high quality. More compelling than many TV productions I've seen. Character consistency is definitely good enough to tell the story.

MetaPuppet 的头像
MetaPuppet1 年前

Appreciate it, thanks!

PZF 的头像
PZF1 年前

This is such quality work. The care and detail that you’ve put into it shines through. I was gripped to the very end. It’s so well done in every aspect. Thanks for the detailed insights into your workflow. I learned a lot reading the entire thread.

MetaPuppet 的头像
MetaPuppet1 年前

Thank you for saying so and for taking the time to read the posts and watch the entire thing. Much appreciated brother! 🤘

PZF 的头像
PZF1 年前

Pleasure. It was so easy to watch the whole thing because it was so good! I loved it. You’re operating at a higher level.

frank 的头像
frank1 年前

Thanks for sharing. I would trim a couple lines and leave a bit more suspense with the eve reveal.

MetaPuppet 的头像
MetaPuppet1 年前

Like the black and white treatment. Always room to trim!

Halim Alrasihi 的头像
Halim Alrasihi1 年前

Great story! I love the acting, you really know how to make a character interesting. Tbh, I was a bit sad when the video ended. I hope we’ll see the next part soon!

MetaPuppet 的头像
MetaPuppet1 年前

Thanks Halim, much appreciated! Who knows maybe I’ll pitch this to Promise and see what happens!

Afro Futcha ( Diane ) 的头像
Afro Futcha ( Diane )1 年前

I think I breathed about 3 times during the whole film. Great work, at times I forgot it was Ai the story drew me in.

MetaPuppet 的头像
MetaPuppet1 年前

So awesome to hear thank u! Keep breathing 😁

Marco 的头像
Marco1 年前

@imagineFERA This is really great man. Appreciate the run down of process and example JSON. I actually did a comparison recently between natural language prompts vs JSON so it was cool to see it being used to good effect and the rationale behind it too.

MetaPuppet 的头像
MetaPuppet1 年前

@imagineFERA Thanks Marco! I’m all for people using whatever works for them. For me the structured breakdown of the prompt just made sense and allowed me to quickly find and tweak what I needed!

Marco 的头像
Marco1 年前

@imagineFERA you mention you used Aleph to relight - how did you work around the 8s Veo3 output vs the 5s allowed in Aleph? split it in 2?

MetaPuppet 的头像
MetaPuppet1 年前

@imagineFERA Yeah I already had the piece cut in Premiere so there weren’t any clips longer than 5 seconds at that point. The I just exported the clip I needed into Aleph and made the fix. Saved the inpainting for the end!

Marco 的头像
Marco1 年前

@imagineFERA Sick! How did you find output quality? Did you just do a final update in topaz?

MetaPuppet 的头像
MetaPuppet1 年前

@imagineFERA Dude… i put each clip through Astra, clip by clip. It was mind numbing. Then I unpressed the whole finished video in Topaz. We needed 1080p raw outputs yesterday 😂

Marco 的头像
Marco1 年前

@imagineFERA Wow

🔺DaRk Orchestra 的头像
🔺DaRk Orchestra1 年前

Yooo this 🔥 🔥

MetaPuppet 的头像
MetaPuppet1 年前

🙌

Charlie Fink 的头像
Charlie Fink1 年前

You sir, are a beast! 👏👏👏 Send me the YT so I can feature it next week.

MetaPuppet 的头像
MetaPuppet1 年前

Here you go sir. Appreciate it! Eve and Adam - AI Cinema

Bill Platt aka @PlattGPT 的头像
Bill Platt aka @PlattGPT1 年前

@MetaPuppet #AIFilmmaking Singularity achieved right here. Spectacular! John Carpenter take note. 👏🔥

MetaPuppet 的头像
MetaPuppet1 年前

@plattcreative 😂 That's high praise. Thank you!

Afro Futcha ( Diane ) 的头像
Afro Futcha ( Diane )1 年前

Also really good sound design

MetaPuppet 的头像
MetaPuppet1 年前

Sound design is so overlooked in AI film!

Alin Cristian Tiganus (eyes2AI) 的头像
Alin Cristian Tiganus (eyes2AI)1 年前

This is as good as it can be right now. I didn't skipped a second. In one year we will have full movies that are great to watch. Really-really great job!

MetaPuppet 的头像
MetaPuppet1 年前

Appreciate it! Yes eventually the stories will be louder than the tools used to tell it. Working on it!

Farhoud Meybodi 的头像
Farhoud Meybodi1 年前

By far the best example of story, character, pacing and artistry with generative AI. Bravo.

MetaPuppet 的头像
MetaPuppet1 年前

Much appreciated!

Sharath Dasari 的头像
Sharath Dasari1 年前

@MetaPuppet amazing bro!! Would love to see you explain these two things briefly… what’s the workflow?and how did you achieve character consistency? Did you used txt—>vid or img—> vid

MetaPuppet 的头像
MetaPuppet1 年前

Thank you! A lot of failed gens. But once I had the character I liked using t2v, I saved the frame as an asset in Flow and then would prompt for that character to be in whatever different setting I needed and veo did a decent job of switching the setting but keeping the character.

Sharath Dasari 的头像
Sharath Dasari1 年前

Got it! thanks. Bro this is one of the brilliant stories told using AI! keep going! would love a detailed breakdown in your coming posts!!

michael vicenzino 的头像
michael vicenzino1 年前

This is probably the most amazing use of AI for filmmaking I’ve seen. Game changer

MetaPuppet 的头像
MetaPuppet1 年前

Appreciate it!

michael vicenzino 的头像
michael vicenzino1 年前

Would love to learn more from you. Great content and storytelling.

weliveblandatnow 的头像
weliveblandatnow1 年前

This is by far the best movie I have seen with AI.😳🙌 The story telling and character consistency is next level. Thank you for taking this to a level above a raccoon riding a surfboard.

MetaPuppet 的头像
MetaPuppet1 年前

😂 Appreciate it!

Jae 的头像
Jae1 年前

underrated part of this short is the dialogue, it's superb. Loved the FBI interactions with the locals, felt really natural!

MetaPuppet 的头像
MetaPuppet1 年前

Appreciate you saying so, thanks!

paul bozymowski 的头像
paul bozymowski1 年前

How did you keep character consistency?

MetaPuppet 的头像
MetaPuppet1 年前

I used runway references for some shots and also image to video in Flow and prompt for the same character in a different setting, veo3 can pull it off

Robert Scoble 的头像
Robert Scoble1 年前

Wow.

MetaPuppet 的头像
MetaPuppet1 年前

Robert! Thanks ✌️

Mentis 🇦🇺 的头像
Mentis 🇦🇺1 年前

Incredible. And thanks for the detailed write up!!

MetaPuppet 的头像
MetaPuppet1 年前

Thank you for reading it!

AirOneWan 的头像
AirOneWan1 年前

@LudovicCreator Impressive, so good

MetaPuppet 的头像
MetaPuppet1 年前

@LudovicCreator Thanks!

Episodex 的头像
Episodex1 年前

This is the first AI movie I saw that is coherent and looks mostly "not-AI". One feedback: it's way too dark. I had to go to completely dark room to enjoy it. In well lit room I couldn't see half of what was happening 😁

MetaPuppet 的头像
MetaPuppet1 年前

Thanks! I should have it color corrected by a professional!

someone random 的头像
someone random1 年前

granny wilding😂

MetaPuppet 的头像
MetaPuppet1 年前

😂

Giridhari Das 的头像
Giridhari Das1 年前

How does this only have 373 likes? Amazing work.

MetaPuppet 的头像
MetaPuppet1 年前

Thank u!

RNA Parts 的头像
RNA Parts1 年前

I just watched the future

MetaPuppet 的头像
MetaPuppet1 年前

🙌

Umesh 的头像
Umesh1 年前

Wonderful work 👏

MetaPuppet 的头像
MetaPuppet1 年前

Thank you Umesh!

wolf 的头像
wolf1 年前

Stunning and creative. One can see your history of experience and really great to share the making of story. It’s going to inspire and empower a lot of creative minds

MetaPuppet 的头像
MetaPuppet1 年前

Thank u!

Rich Silver 的头像
Rich Silver1 年前

Ahmazing work.. wow!!!! I'm curious about how much you think this cost to produce.. especially having used Veo3, which is so expensive.

MetaPuppet 的头像
MetaPuppet1 年前

Appreciate it! Hard to calculate as I didn't keep track of the gens, but Imagine the cost of doing this as a traditional production 😳

Rich Silver 的头像
Rich Silver1 年前

Ohh.. I totally get that, the cost is a tiny fraction of what it would be with a traditional production. You really did SUCH a great job w/ this.. I'm inspired!

David Ely 的头像
David Ely1 年前

Please tell us you’re already working on the next 90 minutes!!!

MetaPuppet 的头像
MetaPuppet1 年前

Need a little sun first 😂

Sevy Silva 的头像
Sevy Silva1 年前

Man, this is by far the best thing I've watched yet, you've been cooking!!! Totally agree about the process & your insights about it, this is the way! Congrats mate, it's extremely good!!! 🖤🖤🖤

MetaPuppet 的头像
MetaPuppet1 年前

Yo! Thank you Silva! Much appreciated sir!

Robert Youssef 的头像
Robert Youssef1 年前

really impressive how you structured everything, especially the linear approach with placeholders. makes total sense for pacing. excited to see more from you!

MetaPuppet 的头像
MetaPuppet1 年前

Thanks man appreciate it!

David Colombo 的头像
David Colombo1 年前

WoW this is Wild! All the shots are great and it's the first time i see such consistent caracters! I guess u used image to video in veo 3 for having this consistency, but the first image? Did It came from midjourney? Did u use omniref to keep the caracters or maybe references in Runway? Thanks for explaining the process, It helps a lot!

Ivan Ooze 的头像
Ivan Ooze1 年前

This is incredible, well done!

MetaPuppet 的头像
MetaPuppet1 年前

@DeeterGaming Thank u!

相关视频