Loading video...

Video Failed to Load

Go Home

The biggest mistake people make with Seedance 2.0 is writing prompts at all. Sounds strange, but the model wasn't built for describing things in words - it was built for multimodal direction: up to 12 references at once, combining images, video, and audio. Each reference type controls a different...

72,877 views • 2 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

Lovis Odin

58,841 views • 1 year ago

Seedance 2.0 is allowing us to enter a new era of music video creation. Here is how I created HONEY. It was a quick test to see how well this workflow holds up. 🐝 1 - Write your song and generate the music with Suno 5.5. 2 - Use an image generator of your choice. For HONEY I combined both Grok Imagine for aesthetics and Nano Banana Pro for refined editing. 3 - In Capcut I import my audio and just save out a blank video video containing the audio. This step is important because this video file containing audio will now be used with Seedance 2.0 as a video reference with Omni. This allows the AI to apply automatic and realistic lipsync and movement to the music, it's extremely powerful! 4 - Once I have a both my image and video with audio as reference, I use Seedance 2.0 Omni and upload my starting image and then the video reference with the audio. 5 - From here I'm simply prompting like normal, specifying what's happening in my scene with detailed instructions, mentioning multi shots and camera angle changes and then specifying that the person is singing along to the song. I type out the lyrics that are present to have better lipsync accuracy. 6 - Once I have generated a video and like the result, I do video to video, so i upload that video that just got generated and type "The scene continues" and prompt new actions to take place. This allows you to expand on a narrative. These new shots can be used as B-ROLL and since I uploaded my video as reference I have full consistency of everything it saw in the video. This is also extremely powerful. 7 - This is actually the most difficult part. Edit in Capcut. This is where you need to understand pacing and shot selection from all the scenes you generated to bring it all together. You must be strategic with the editing. Goodluck! I'll probably record a video tutorial at some point as it's easier to see what is being done.

Travis Davids

19,236 views • 5 months ago

Nobody's talking about the Claude trick that fixes every Seedance 2.0 video mistake. A cinematic action scene, an animated sequence, a product ad, and a dialogue scene are completely different types of content. Different camera language, different pacing, different reference logic. Most people try to force all of it through one universal prompt. The fix turns out to be simpler than expected: Claude Skills. It's not some secret hack. It's a file of instructions you load into Claude for one specific type of task. Once it's loaded, Claude stops acting like a general assistant and starts thinking like an expert in that one niche — with its own set of rules for that scene type. Here's what that looks like in practice: ▪ Cinematic skill — generates real camera language: dolly moves, crane shots, rack focus, shot discipline across multiple cuts. Test: a medieval battle between two armies, 15 seconds, dark fantasy. Result — three shots with the shot logic of an actual film, not just "epic battle" typed as text. ▪ Animation skill — locks in style and physics before a single shot is built. One test: a rain-soaked shonen fight in the style of Tokyo Revengers. Another: a quiet Ghibli-style farm scene. Same skill, completely different visual output — because the style gets fixed at the very top of the prompt. ▪ Product ad skill — keeps the product front and center in every shot: clean hero framing, commercial lighting, a full product description built from the reference image before any shots are generated. ▪ Dialogue skill — this is where most people fall apart. Lip sync, emotional direction, shot structure, and audio cues all have to work together. Test: an interrogation scene with a fourth-wall break — and the moment landed exactly as written, down to the pause and tone. The core idea is simple: instead of writing a prompt from scratch every time and hoping for the best, you build one skill per content type — and Claude asks the right setup questions (genre, tone, shot count, camera energy) before generating a fully structured Seedance 2.0 prompt. One prompt template for everything is exactly why 90% of AI videos look the same. This 13-minute video is free, and it's more useful than a $500 course. YouTube: "Skai Generated" - Thank you for sharing this invaluable material with us.

Zentrix⌚️

45,874 views • 2 months ago