正在加载视频...

视频加载失败

How to get consistent characters + solid lipsync One of my fave artists, Simon Meyer, tested pretty much every tool out there such as Hedra, HeyGen, Dreamina, Higgsfield but landed on this workflow: Characters → Seadream in Freepik (Prompt 👇) Video → Seadance (20+ gens per shot) Music →...

37,082 次观看 • 11 个月前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

Lovis Odin

58,769 次观看 • 10 个月前

Seedance 2.0 is allowing us to enter a new era of music video creation. Here is how I created HONEY. It was a quick test to see how well this workflow holds up. 🐝 1 - Write your song and generate the music with Suno 5.5. 2 - Use an image generator of your choice. For HONEY I combined both Grok Imagine for aesthetics and Nano Banana Pro for refined editing. 3 - In Capcut I import my audio and just save out a blank video video containing the audio. This step is important because this video file containing audio will now be used with Seedance 2.0 as a video reference with Omni. This allows the AI to apply automatic and realistic lipsync and movement to the music, it's extremely powerful! 4 - Once I have a both my image and video with audio as reference, I use Seedance 2.0 Omni and upload my starting image and then the video reference with the audio. 5 - From here I'm simply prompting like normal, specifying what's happening in my scene with detailed instructions, mentioning multi shots and camera angle changes and then specifying that the person is singing along to the song. I type out the lyrics that are present to have better lipsync accuracy. 6 - Once I have generated a video and like the result, I do video to video, so i upload that video that just got generated and type "The scene continues" and prompt new actions to take place. This allows you to expand on a narrative. These new shots can be used as B-ROLL and since I uploaded my video as reference I have full consistency of everything it saw in the video. This is also extremely powerful. 7 - This is actually the most difficult part. Edit in Capcut. This is where you need to understand pacing and shot selection from all the scenes you generated to bring it all together. You must be strategic with the editing. Goodluck! I'll probably record a video tutorial at some point as it's easier to see what is being done.

Travis Davids

19,081 次观看 • 3 个月前

Most of the obituaries and tributes to David Hockney will, I imagine, focus primarily on his extraordinary craft and brilliance as an artist. Perhaps they might also mention his brilliance as a communicator (he was such a fine writer and speaker). But there was something else rather unique about him too. He was also strikingly honest about the tricks/techniques artists use and used to paint. His book Secret Knowledge is a rather wonderful detective work into how renaissance and Dutch golden age painters used glass and mirrors to help them master perspective. It's a pretty compelling case (see this video clip from a BBC doc he made alongside the book👇) though I'm sure some art historians will raise their eyebrows. Many will be aghast at the notion that greats like Vermeer might have been using lenses and camera obscuras to help them draw and paint. As if it were in some way "cheating". But Hockney was so self-evidently brilliant he was one of the few people who could document this without anyone gainsaying his own talent. There are very few artists, living or dead, who have this degree of self-confidence. Not just to know their craft, but to be bracingly honest about how it works. One other who comes to mind is Paul Simon: not just an extraordinary musician but is also an extraordinary communicator about the tricks and techniques of how to write and perform music. For many great artists, the temptation is to cloak their crafts in mystery, like a member of the magic circle. Hockney wasn't having any of it. So yes, he was a legend in all the obvious ways. But also in a few other less obvious ways as well. RIP.

Ed Conway

143,617 次观看 • 1 个月前