Loading video...

Video Failed to Load

Go Home

Mini tutorial for Google DeepMind 's VEO 2 Prompt Buddy. (Works well with other AI video tools as well). I’ve created my VEO 2 Prompt Buddy Custom GPT to help me go beyond my own brain and prompts. It can describe your images, enhance your prompts, be creative and...

58,509 views • 1 year ago •via X (Twitter)

11 Comments

Allar Haltsonen's profile picture
Allar Haltsonen1 year ago

Veo 2 Prompt Buddy

Yang's profile picture
Yang1 year ago

Build powerful AI agents and automations for your business today. Check out our step-by-step video tutorials 100% FREE 🥳

LongLimbsLenore's profile picture
LongLimbsLenore1 year ago

@GoogleDeepMind So much effort just to be an unethical poser

TomLikesRobots🤖's profile picture
TomLikesRobots🤖1 year ago

@GoogleDeepMind Cool. I'll give this a go. I've been using Sora Storyboard to caption images and expand prompts. I'd planned on putting together a Custom GPT but didn't around to it.

Allar Haltsonen's profile picture
Allar Haltsonen1 year ago

@GoogleDeepMind Sounds good! Thanks man!

Farhan's profile picture
Farhan1 year ago

@GoogleDeepMind Gonna try this bro. Thank you

Allar Haltsonen's profile picture
Allar Haltsonen1 year ago

@GoogleDeepMind Your welcome bro!!

James D Phillips 2's profile picture
James D Phillips 21 year ago

@GoogleDeepMind Incredible, Allar. Thanks so much. I'm in! 🔥🧯🚒🔥

Allar Haltsonen's profile picture
Allar Haltsonen1 year ago

@GoogleDeepMind Let’s go man! Let me know how it goes 🔥🙏🏼

Brent Lynch's profile picture
Brent Lynch1 year ago

It did a great job, for Minimax on this. I try out all the prompt helpers and this blew most of them out of the water and is right up there Google VEO2 however refused to generate this prompt. You may want it to review prompt for compatibility with VEO2 standards (which I admit are hard to pin down) but allow flexibility to keep as or tone down as needed. I would say my other note is if you ask it to generate a series of shots, it won't describe the character again, so possibly if you could tweak it to always include the character descriptions. Prompt: Character Description: The assassin is a striking woman in her late 20s, with piercing green eyes, a chiseled jawline, and lips painted a deep crimson. Her dark, form-fitting tactical suit is adorned with hidden holsters, ammo clips, and sleek combat boots that barely make a sound against the metal floor. A long, black coat trails behind her, tattered at the edges from past battles. Her hair, a wild cascade of golden waves, bounces with each determined step. 🔹 Scene & Motion: [Tracking shot,Shake]The long, sterile hallway is bathed in flickering fluorescent light, red alarm sirens pulsing against the walls. Smoke billows from distant gunfire, and the camera starts at a low angle, tracking backward in slow motion as she sprints toward the lens, twin pistols in hand. Her breath is steady, her expression unreadable—this is a woman who never misses.

Allar Haltsonen's profile picture
Allar Haltsonen1 year ago

@GoogleDeepMind Noted, thanks a lot!

Related Videos

VEO 2 by Google DeepMind : MY CHEAT SHEET Alright, so after 500h-ish spent on VEO and giving birth to both "Kitsune" and "Banished", tons of people asked for a making-of. Instead, I decided to give you what I actually know of VEO 2 to this day. Please share! it's made to be spread around! 1/ If you're not using a LLM (Gemini, ChatGPT, whatever), you're doing it wrong. VEO 2 currently has a sweet spot when it comes to prompt length: too short is poor, too long drops information, action, description etc. I did a lot of back and forth to find my sweet spot, but once I got in a place I thought felt right, I used a LLM to help me keep my structure, length, and help me draft actions. I would then spent an extensive amount of time tweaking, iterating, removing words, changing order, adding others, but the draft would come from a LLM and a conversation I built and trained to understand what my structure looked like, what was a success, or a failure. I would also share the prompts working well for further reference, and sharing the failures also for further reference. This would ensure my LLM conversation became a true companion. 2/ Structure, structure, structure Structure is important. Each recipe is different but same as any GenAI text-to something, it looks like the "higher on the prompt has more weight" rule applies. So, in my case I would start by describing the aesthetics I am looking for, time of day, colors, mood, then move to camera, subject, action, and all the rest. Once again, you might have a different experience but what is important is to stick to whatever structure you have as you move forward. Keeping it organized also makes it easier to edit later. 3/ Only describe what you see in the frame If you have a character you want to keep consistent, but you want a close-up on the face for example, your reflex will be to describe the character from head to toe and then mention you want a close-up...It's not that simple. If I tell VEO I want a face close-up but then proceed to describe the character's feet, the close-up mention will be dropped by VEO... Once again, the LLM can help you in this by giving it the instruction to only describe what is in the frame. 4/ Patience Well, it can get costly to be patient, but even if you repeat the same structure, sometimes changing one word can still throw the entire thing out and totally change the aesthetics of your scene. It is by nature extremely consistent if you conserve most words, but sometimes it happens. In those situations, trace your steps back and try to figure out which words are triggering a larger change. 5/ Documenting When I started "Kitsune" (and did the same for all others), the first thing I did was start a Figjam file so I could save the successful prompts and come back to them for future reference. Why Figjam? So I could also upload 1 to 4 generations from this prompt, and browse through them in the future. 6/ VEO is the Midjourney of video Currently, no text-to-video tool (Minimax being the closest behind) gave me a feeling I could provide strong art directions and actually get them. I have been a designer for nearly 20 years, and art direction to me has been one of the strongest foundations of most of my work. Dark, light, happy, sad, colorful or not, it doesn't matter as long as you have a point of view and please...have a point of view. Recently watched a great video about the slow death of art direction in film (link in comments) and oh boy, did VEO 2 deliver on giving me the feeling I was listened. Try starting your prompts with different kinds of medium (watercolor for example), the mood you are trying to achieve, the kind of lighting you want, the dust in the rays of light, etc... which gets me to the next one 7/ You can direct your colors in VEO It's as simple as mentioning the hues you want to have in the final result, in which quantity, and where. When I direct shots, I am constantly describing colors for two reasons: 1. Well, having a point of view and 2. reaching better consistency through text-to-video. If I have a strong and consistent mood but my character is slightly different because of text-to-video, the impact won't be dramatic because a strong art direction helps a lot with consistency. 8/ Describe your life away Some people asked me how I achieved a good consistency between shots knowing it's only text-to-video and the answer is simple: I describe my characters, their unique traits, their clothing, their haircut, etc..anything which could help someone visually impaired have a very precise mental representation of the subject. 9/ But don't describe too much either... It would be magical if you could stuff 3000 words in the window and have exactly what you asked for, right? Well, it turns out VEO is amazing with its prompt adherence, but there is always a moment where it starts dropping animations or visual elements when your prompt stretches for a tad too long. This actually happens way before the character limit allowed by VEO is reached, so don't overdo it, it's no use and will play against the results. For info, 200-250 words seems like a sweet spot! 10/ Natural movements but... VEO is great with natural movements and this is also one of the reasons why I used it so extensively: people walking don't walk in slow-motion. That being said, don't try to be too ambitious on some of the expected movements: multiple camera movements won't work, full 360 revolutions around a subject won't work, anime-style crazy camera movements won't work, etc... what it can do is already great, but there are still some limitations...

Henry Daubrez 🌸💀

30,841 views • 1 year ago

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

Lovis Odin

58,571 views • 9 months ago