Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

MJFH x Home Alone Thumbnail Workflow Using Weavy + Nano Banana Pro. (Full workflow in thread) PROCESS: 01. Build Characters 02. Swap Outfits 03. Create Character Sheets 04. Build + Iterate Scenes 05. Add Text + Iterate 06. Keyframe animation (for fun). System prompts are the 👌 here. #nanobanana #promptshare

42,287 görüntüleme • 8 ay önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

Lovis Odin

58,841 görüntüleme • 1 yıl önce

steal my full workflow to create ultra-realistic AI videos with GPT-6 Astra... higgsfield just released their API, so i took it into real conditions i generated a vlog-style video set in Paris... it looks like raw footage a friend shot on a phone here's the workflow, step by step: > step 1: steal the structure, not the pixels i captured 3-5 scenes from a hotels and river views, then pulled character inspiration from pinterest and real vlogs > step 2: analyze the reference with Gemini i sent Gemini everything i'd collected... videos, audio, keyframes and it gave me a shot-by-shot breakdown, i turned that into instructions > step 3: swap the world, keep the bones i changed a lot on the character and the environment until it felt like something of my own, not a copy > step 4: build reference images first, this is where you iterate images are cheap, video is expensive so i built a character sheet, one image per location in the same mood, then the exact start frame the video opens on, all Nano Banana Pro > step 5: one 30-second video run, not ten 3-second clips the full timestamped script goes to Seedance 2.5 through the API as ONE generation start frame as the anchor, one action per beat, camera and audio described concretely, identity locks at the end so her face, outfit and makeup is locked in Seedance handles the cuts internally > step 6: revise like a director, not a gambler the first cut came back good but not right instead of re-rolling the whole 30 seconds i regenerated only the scenes that needed changes as short clips from their own start frames, then cut them into the master with ffmpeg change one variable at a time, never re-roll what already works > step 7: finish like normal footage i assembled the final cut with ffmpeg from the best takes, added ambient music from a free library and done the rules that made it work: - the reference's structure is the asset, prompt archaeology beats prompt writing - iterate on images, commit on video, the start frame decides 80% of the shot - one action per timestamped beat, crowded beats get skipped or invented - lock identity explicitly or it drifts between cuts - fix failed shots by changing one variable, redo scenes, never the whole video - the last 10% is boring editing: trim, splice, music, encode (save this workflow)

Machina

24,863 görüntüleme • 11 gün önce