Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Claude Code can ship a 45-second animated explainer ad in 30 minutes. No video editor needed, just CC + skills. Here's how I made this video for Soteri Skin 👇 1. /plan Concept Brief (Claude Code) I handwrite a concept brief, then chat with the agent to iterate on... it. The agent gathers any raw materials we might need - context about the brand, product images, end card, etc. The concept brief details the concept, characters, visual style, script, etc 2. /prepare a moodboard (CC + GPT Image 2 + ElevenLabs) After reviewing the script, generate: - character reference images - voiceover samples for the characters / narrator - the storyboard (scene by scene grid) - a few keyframe scenes 3. /generate Keyframes for each scene (CC uses Nano Banana or GPT Image 2) Uses the character references from the previous step to generate keyframes for each scene. I probably should have done a round of iteration at this step – there's some character drift and the pH meter representation could have been better. 4. /animate Keyframe → Animated Clip (CC uses Fal Seedance) Generate 2-4 representative scenes first to see a preview. If it looks good, then generate everything. 5. /stitch (CC + ffmpeg + ElevenLabs) - Stitch clips together with hard cut - Add a music score + SFX - Sync clips to the VO - Add captions - Review and edit timing / pacing issues 6. /watch the final cut and review it - as a video editor for technical errors (mismatched voiceover and visuals, AI hallucinations, etc) - as a viewer (ICP). I delegate most of the review to the agent because it catches more things and keeps me out of the loop as much as possible. It also fixes any issues found in the review. That's it. This video took me 30 minutes because I have already created skills for everything I described above. Some day, this will be < 5 minutes. I just review and chat to provide direction and feedback. The skills do all the technical work. 7. /learn Extracts learnings and updates the skills. This final step is really important. It turns this process into a closed loop system that makes the next video much easier to create because all the learnings from the human-in-the-loop process get encoded into code. Skills are code too. If you want access to the skill, drop a comment, and I'll DM it to you (must be following). If you want to make AI video ads like this, DM me.show more

Shiv

57,249 subscribers

11,760 views • 5 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

24 Comments

Miguel Ángel5 months ago

@SoteriSkin Try @HyperFrames_, I think ton of steps would have been made easier using it

Shiv5 months ago

@SoteriSkin @HyperFrames_ Been using it for some other video styles - it’s awesome! 🔥

Miguel Ángel5 months ago

@SoteriSkin @HyperFrames_ Lfg!! 🙌

Jace J Perry5 months ago

@SoteriSkin What do you charge?

Shiv4 months ago

@SoteriSkin Here’s my cal:

Adel Bucetta5 months ago

@SoteriSkin that's not the most impressive part it's how claud code's output can be refined and iterated upon in real-time by a human without needing hours of video editing work

Shiv5 months ago

@SoteriSkin yep - if you have the source files, edits and new videos are just 1 prompt away

JA | Ազատ5 months ago

@SoteriSkin Great works bro Let me show you my method Who allows you to have a more personalized render, a French voice, and full control over every scene

Shiv5 months ago

@aubonheurdeja @SoteriSkin yes please

JA | Ազատ5 months ago

@SoteriSkin Look dm bro

Francis Teo5 months ago

@SoteriSkin Please send skill thanks!

Eren Suner5 months ago

@SoteriSkin Can you send the skill?

dopo.eth 💸5 months ago

@SoteriSkin the /learn step is genius

Gold Pulse Crypto5 months ago

@SoteriSkin Interesting application of AI tooling. Curious how on-chain attribution or developer activity metrics might track efficiency gains like this in the smart contract audit space.

Karima5 months ago

@SoteriSkin Skill

GANSS5 months ago

@SoteriSkin Impresionante, Claude Code sigue innovando en la creación de contenido rápido y eficiente. ¡Las habilidades de edición en tiempo real son increíbles!

Lucky5 months ago

@SoteriSkin Thank you, highly interested

Sofia Koziolas5 months ago

@SoteriSkin I loved the result of your video! I've been trying to do something similar, but I'm having trouble. Could you explain how you changed the scenes, how you connected them, and how you added subtitles? Did you do it with Claude and Seedance? Just those two?

nullably5 months ago

@SoteriSkin Nice work! Can you please share the skills, many thanks!

Recul Perçant5 months ago

@SoteriSkin Please send the skill

Shiv4 months ago

Here's the skill:

0215 months ago

@SoteriSkin Nice work I’d love more! 🙏🏻

Gold Pulse Crypto5 months ago

@SoteriSkin Interesting productivity angle, but wonder about the on-chain carry cost vs. traditional video production given ETH at $2,087 and gas fees still variable on L1.

Tom5 months ago

@SoteriSkin Step four's where this breaks, yeah? Character drift and the pH meter thing you mentioned are fine in isolation, but once you're three scenes deep and the agent's seeing its own mistakes as reference material for the next shot, you're just compounding hallucinations.

Related Videos

Vizard Agent just changed how I think about AI video creation. Most AI video tools help you with one part of the process. Vizard Agent can take responsibility for the entire video job. For this demo, I gave it a single brief: → A 30-second emotional story → Scene-by-scene direction → Camera movements → Voiceover → Visual style → Character details → Music + final text And instead of manually piecing everything together, the Agent handled the workflow. It understood the brief, planned the video, created the scenes, made creative decisions, assembled the story, and delivered the final result. The interesting part? I didn't have to tell it every editing step. I just gave it the goal. That’s what makes Vizard Agent different. You can give it: 🎬 Raw footage 📝 A script or idea 🔗 A reference video or website 📸 Images and brand assets ✨ Or a combination of everything And let the Agent figure out what needs to happen next. This feels like the “Claude Code moment” for video. You don't operate the workflow. You brief the Agent. #Vizard #AIVideo #VideoEditing #AIAgents #ContentCreation

Krishna Agrawal

41,888 views • 2 months ago

Created this video in just 20 minutes. One thing I've noticed with HyperFrame + Claude is that if you understand the technical aspects of video creation, it's much easier to generate the results you want. For this video, I simply asked it to create a storyboard-style whiteboard animation with a handwritten effect and a hand appearing as it writes, while explaining the concept I wanted to cover. If I don't explicitly mention the storyboard/whiteboard style, I'll end up prompting over and over again and still won't get the video I'm looking for.

Created this video in just 20 minutes. One thing I've noticed with HyperFrame + Claude is that if you understand the technical aspects of video creation, it's much easier to generate the results you want. For this video, I simply asked it to create a storyboard-style whiteboard animation with a handwritten effect and a hand appearing as it writes, while explaining the concept I wanted to cover. If I don't explicitly mention the storyboard/whiteboard style, I'll end up prompting over and over again and still won't get the video I'm looking for.

Ankur | NoCode Talks

31,772 views • 3 months ago

I'm proud to present this video created with Grok. Here are the main steps in the making of this video: 1. I wrote a draft script by hand. 2. I reworked the script with Grok to eliminate inconsistencies and add technical details (what I have them say about the Apollo missions and the stones is accurate). 3. Grok broke it down into scenes. 4. I switched to Grok Imagine's Agent mode: transforming each scene into a prompt. 5. I animated each scene in Agent mode using video, as well as cropping and image selection. 6. I edited it. Here's the result; it's hard to call it AI. I look forward to reading your comments. Grok Imagine Elon Musk

I'm proud to present this video created with Grok. Here are the main steps in the making of this video: 1. I wrote a draft script by hand. 2. I reworked the script with Grok to eliminate inconsistencies and add technical details (what I have them say about the Apollo missions and the stones is accurate). 3. Grok broke it down into scenes. 4. I switched to Grok Imagine's Agent mode: transforming each scene into a prompt. 5. I animated each scene in Agent mode using video, as well as cropping and image selection. 6. I edited it. Here's the result; it's hard to call it AI. I look forward to reading your comments. Grok Imagine Elon Musk

Déborah

69,706 views • 4 months ago

Most AI video tools give you a clip and leave the rest to you. I used Pexo to make this launch-style video for Nvestiq. Pexo is a conversational AI video agent. You give it a brief, a URL, or source files, and it helps bring the script, scenes, motion, voiceover, captions, and music together into a complete video. What clicked for me isn’t just the output. You can talk through the goal, review the direction, and keep asking for changes in the same conversation. With Mark to Fix, you can circle a detail on the video and leave a comment about what needs changing. It feels closer to giving feedback on a doc than learning another editor. For a small team, that’s the appeal: focus on what the video needs to say, without having to learn After Effects first. You still need to review the result and refine it. Here’s the video 👇 Pexo

Most AI video tools give you a clip and leave the rest to you. I used Pexo to make this launch-style video for Nvestiq. Pexo is a conversational AI video agent. You give it a brief, a URL, or source files, and it helps bring the script, scenes, motion, voiceover, captions, and music together into a complete video. What clicked for me isn’t just the output. You can talk through the goal, review the direction, and keep asking for changes in the same conversation. With Mark to Fix, you can circle a detail on the video and leave a comment about what needs changing. It feels closer to giving feedback on a doc than learning another editor. For a small team, that’s the appeal: focus on what the video needs to say, without having to learn After Effects first. You still need to review the result and refine it. Here’s the video 👇 Pexo

MR. SHAHBAZ

40,234 views • 1 month ago

i built a tool that lets you clone ANY video with AI saw a movie scene you want to recreate? a commercial? a music video? just upload it to this tool and get the exact structured prompt to generate it in sora 2 you no longer need to guess how to describe what you want to generate. show the tool the reference and it engineers the prompt for you. the tool analyzes: - camera movements and angles - lighting and color grading - scene composition and timing then converts everything into sora-optimized prompt structure this is how you recreate any visual style without prompt engineering experience RT + reply 'TOOL' and i'll send you access (must follow so i can dm)

i built a tool that lets you clone ANY video with AI saw a movie scene you want to recreate? a commercial? a music video? just upload it to this tool and get the exact structured prompt to generate it in sora 2 you no longer need to guess how to describe what you want to generate. show the tool the reference and it engineers the prompt for you. the tool analyzes: - camera movements and angles - lighting and color grading - scene composition and timing then converts everything into sora-optimized prompt structure this is how you recreate any visual style without prompt engineering experience RT + reply 'TOOL' and i'll send you access (must follow so i can dm)

Miko

43,253 views • 1 year ago

CLAUDE CODE CAN NOW TURN HIGGSFIELD INTO A ONE-PERSON AI VIDEO STUDIO. install this 19 skills, connect Claude Code to Higgsfield, then tell Claude what you want to create. run /ugc-hot-girl and let it create the character, generate the visuals, and produce the Seedance video for you. Claude controls Higgsfield through Playwright. you just review the output and make changes when needed. this is useful if you want to make UGC ads for brands without spending hours doing everything manually. you could even turn the workflow into a service and sell the finished content. if you’re building toward the solo creator income path, save this. repo below 👇

CLAUDE CODE CAN NOW TURN HIGGSFIELD INTO A ONE-PERSON AI VIDEO STUDIO. install this 19 skills, connect Claude Code to Higgsfield, then tell Claude what you want to create. run /ugc-hot-girl and let it create the character, generate the visuals, and produce the Seedance video for you. Claude controls Higgsfield through Playwright. you just review the output and make changes when needed. this is useful if you want to make UGC ads for brands without spending hours doing everything manually. you could even turn the workflow into a service and sell the finished content. if you’re building toward the solo creator income path, save this. repo below 👇

MIKE

30,231 views • 21 days ago

Inspiration is everywhere. Creation should be just as easy. Drop in a reference, a video, or a scene you like, and Hedra Agent understands the character, the mood, and the visual style. Generate variations. Change the aesthetic. Turn a single image into a fully animated video. No complex prompts. Just describe what you want to create. Agent builds the visuals. The era of vibe creation is here. Try it now:

Inspiration is everywhere. Creation should be just as easy. Drop in a reference, a video, or a scene you like, and Hedra Agent understands the character, the mood, and the visual style. Generate variations. Change the aesthetic. Turn a single image into a fully animated video. No complex prompts. Just describe what you want to create. Agent builds the visuals. The era of vibe creation is here. Try it now:

Hedra

12,813 views • 7 months ago

I just tested Motion Sync on Yapper and I like the cinematic Video made in minutes. Let me show you how you can do it 👇 Step 1: Open Step 2: Click on video and select Motion Sync. Then, ✅️Select base video Pick a video with the movement you want — this will drive the animation. ✅️Add reference image Upload your character or image you want to bring to life. ✅️Generate video Hit generate and watch your idea turn into a smooth motion sync clip. Simple, fast, and actually fun to experiment with.

I just tested Motion Sync on Yapper and I like the cinematic Video made in minutes. Let me show you how you can do it 👇 Step 1: Open Step 2: Click on video and select Motion Sync. Then, ✅️Select base video Pick a video with the movement you want — this will drive the animation. ✅️Add reference image Upload your character or image you want to bring to life. ✅️Generate video Hit generate and watch your idea turn into a smooth motion sync clip. Simple, fast, and actually fun to experiment with.

Leonardo

50,931 views • 5 months ago

Wow. I just put a formula together for the video generator agent and it just output this, really interesting: Running a few more tests before I implement properly. Remember, it's creating the entire logline, prompts, clips - everything by itself AND editing the clips together. Currently in the Replit app, I tweaked the app so that you could see each individual scene in addition to the final video and have the prompt for the scene. However, that makes waiting like 15-20 minutes as opposed to like, 6-8 minutes. Thoughts? Do you all want to wait longer for your prompts at first to try this thing out? I'm getting ready to push soon, there's just a few bugs.

Wow. I just put a formula together for the video generator agent and it just output this, really interesting: Running a few more tests before I implement properly. Remember, it's creating the entire logline, prompts, clips - everything by itself AND editing the clips together. Currently in the Replit app, I tweaked the app so that you could see each individual scene in addition to the final video and have the prompt for the scene. However, that makes waiting like 15-20 minutes as opposed to like, 6-8 minutes. Thoughts? Do you all want to wait longer for your prompts at first to try this thing out? I'm getting ready to push soon, there's just a few bugs.

Kiri

15,653 views • 1 year ago

I just cracked the code on AI UGC ads 🤯 This ad is nearly THREE minutes long, and it has perfect character, voice, and product consistency across the entire video. I found a winning authority-style ad running on Meta, recreated it shot-for-shot with AI, and ended up with what you see below. Two consistent characters, consistent voice, real product in hand. If you've been stuck generating 8 second clips that look fine but can't hold attention for a full funnel ad, this is the workflow you're missing. Here's exactly how I did it: → Find a winning ad in Meta Ad Library and download it → Upload to Loom to get a timestamped transcript (this becomes your script) → Screenshot each character → clean in ChatGPT Images 2.0 → upload as Seedance Elements → Generate your first clip per character to lock in their voice → Extract that voice as an MP3 via CapCut, attach it to every clip after → Edit in CapCut: remove dead zones, speed up to 1.1x, done → Drop final video in the Captions app, add subtitles, export 2 minutes and 40 seconds, perfect character & product consistency. I put together the full step-by-step playbook with exact Seedance prompts, the CapCut speed trick, and a voiceover technique most people don't know about. Want access completely for free? > Comment "UGC" > Like this post And I'll send it over (must be following so I can DM)

I just cracked the code on AI UGC ads 🤯 This ad is nearly THREE minutes long, and it has perfect character, voice, and product consistency across the entire video. I found a winning authority-style ad running on Meta, recreated it shot-for-shot with AI, and ended up with what you see below. Two consistent characters, consistent voice, real product in hand. If you've been stuck generating 8 second clips that look fine but can't hold attention for a full funnel ad, this is the workflow you're missing. Here's exactly how I did it: → Find a winning ad in Meta Ad Library and download it → Upload to Loom to get a timestamped transcript (this becomes your script) → Screenshot each character → clean in ChatGPT Images 2.0 → upload as Seedance Elements → Generate your first clip per character to lock in their voice → Extract that voice as an MP3 via CapCut, attach it to every clip after → Edit in CapCut: remove dead zones, speed up to 1.1x, done → Drop final video in the Captions app, add subtitles, export 2 minutes and 40 seconds, perfect character & product consistency. I put together the full step-by-step playbook with exact Seedance prompts, the CapCut speed trick, and a voiceover technique most people don't know about. Want access completely for free? > Comment "UGC" > Like this post And I'll send it over (must be following so I can DM)

Mike Futia

40,148 views • 5 months ago

The World Cup + Sports betting affiliate is f*cking gold mine I made $20k with a TikTok account, a VA and Google Omni it takes me 2 hours a day to generate about 20 videos and costs me about $0.30 per video the best part is there's is literally 0 competition because no one knows how to make AI videos that look this good for this cheap All I do is: Get the script from a Claude skill I wrote, edit it a bit and send it to my jeet who then generates me the images based of the script using Pinterest and GPT 2 She then sends me the images, I generate the full AI video using my Omni method and I upload them across my TikTok accounts which funnels them to my domain The crazy thing is literally anyone could come in and run this by themselves and a few hours spare a day I put the whole method into a video for everyone including >How to generate AI UGC that is realistic enough to trick a 18 year old >How to creative direct a TikTok video so it goes viral >How to structure yapper style content to actually convert and go viral >The offer I'm using and my Claude skill I wrote as a bonus RT + Comment "YAPP" and I'll send you the video over (must be following so I can DM)

The World Cup + Sports betting affiliate is f*cking gold mine I made $20k with a TikTok account, a VA and Google Omni it takes me 2 hours a day to generate about 20 videos and costs me about $0.30 per video the best part is there's is literally 0 competition because no one knows how to make AI videos that look this good for this cheap All I do is: Get the script from a Claude skill I wrote, edit it a bit and send it to my jeet who then generates me the images based of the script using Pinterest and GPT 2 She then sends me the images, I generate the full AI video using my Omni method and I upload them across my TikTok accounts which funnels them to my domain The crazy thing is literally anyone could come in and run this by themselves and a few hours spare a day I put the whole method into a video for everyone including >How to generate AI UGC that is realistic enough to trick a 18 year old >How to creative direct a TikTok video so it goes viral >How to structure yapper style content to actually convert and go viral >The offer I'm using and my Claude skill I wrote as a bonus RT + Comment "YAPP" and I'll send you the video over (must be following so I can DM)

Pounds

43,540 views • 3 months ago

I found a Claude skill that plans my entire AI ad before I even open Gemini Omni. I just send it: → the product → the ad style (LEGO, crochet, cartoon, Pixar, etc.) that’s it. a few seconds later it gives me: → a complete script → a scene-by-scene breakdown → Gemini Omni prompts ready to generate I don’t waste time figuring out what each scene should look like or rewriting prompts until they work. I just generate the ad. It’s the exact workflow I’ve been using to make AI ads for affiliate offers, and it’s cut my creation time by more than half. RT + comment “SKILL” and I’ll DM you the exact workflow I use to make these ads (Claude skill included). (must be following for DM)

I found a Claude skill that plans my entire AI ad before I even open Gemini Omni. I just send it: → the product → the ad style (LEGO, crochet, cartoon, Pixar, etc.) that’s it. a few seconds later it gives me: → a complete script → a scene-by-scene breakdown → Gemini Omni prompts ready to generate I don’t waste time figuring out what each scene should look like or rewriting prompts until they work. I just generate the ad. It’s the exact workflow I’ve been using to make AI ads for affiliate offers, and it’s cut my creation time by more than half. RT + comment “SKILL” and I’ll DM you the exact workflow I use to make these ads (Claude skill included). (must be following for DM)

Bruno

59,533 views • 3 months ago

I finally cracked the code for automating ai ads for your brand I made this in under 30 mins including coming up with the concept, scripting and video gen Up until now the gap was translating the creative strategy into intentional visuals the human aspect, the taste that gave every part of the video a reason to exist So I broke the process down to a workflow that carries this strategy into every scene Once you do it the first time you can turn it into a repeatable process: All i did was give astra: > product > customer/avatar > problem thats being solved > how the problem affects customers daily life and it > built a hook based on parameters for virality and a hyper specific feeling they recognize > designed a character, script, and story concept around visual metaphors that make the customers problem, the product and the transformation instantly understandable > locked the character, setting and product references > broke down each beat of the script and turned it into visual gut punches with physical actions, expressions, and interactions that make the meaning clear > generated the clips its not 100% automated because at this stage you still need human QA to make good ads that actually get spend but its damn near 90% > it was infinitely cheaper to make > no start frames needed > almost zero regens (maybe had like 1 because of ocd) drop a comment if you want the setup (follow so i can dm)

ZED

30,888 views • 27 days ago

RIP Arcads 🤯 I built a Claude skill that vibe-codes UGC ads on demand. One product + one prompt = the AI creator, the script, the scene-by-scene shot list, and finished video. All inside Claude. Perfect for DTC brands and agencies who can't afford to keep paying $500-$1,500 per UGC video and waiting 2 weeks for revisions. If you're briefing creators, mailing PR boxes, waiting on first cuts, then asking for re-shoots because the hook didn't land... This skill eliminates the entire loop: → Tell Claude the product, ad angle, and length → Skill writes the GPT Image 2.0 prompt to generate the AI creator from scratch → Skill writes every scene prompt, dialogue line, and delivery direction → Pipe it into Seedance 2.0 with character + product + voice locked → Speed up + caption in CapCut → Ship the ad in 20 minutes No more paying $11 per video on Arcads. What you get: → Perfect character consistency across every scene → Voice consistency that holds clip-to-clip (small CapCut hack inside the tutorial) → Real product fidelity using your actual product photo as a reference → Multi-scene day-in-life, testimonial, and action-shot formats out of the box Built 100% with a Claude skill + Seedance 2.0. I recorded a full step-by-step tutorial showing the exact workflow + the 3 finished AI UGC ads I made for Rhode, AG1, and Barebells. Want to see the full breakdown? > Like this post > Comment "UGC" And I'll send it over (must be following so I can DM)

RIP Arcads 🤯 I built a Claude skill that vibe-codes UGC ads on demand. One product + one prompt = the AI creator, the script, the scene-by-scene shot list, and finished video. All inside Claude. Perfect for DTC brands and agencies who can't afford to keep paying $500-$1,500 per UGC video and waiting 2 weeks for revisions. If you're briefing creators, mailing PR boxes, waiting on first cuts, then asking for re-shoots because the hook didn't land... This skill eliminates the entire loop: → Tell Claude the product, ad angle, and length → Skill writes the GPT Image 2.0 prompt to generate the AI creator from scratch → Skill writes every scene prompt, dialogue line, and delivery direction → Pipe it into Seedance 2.0 with character + product + voice locked → Speed up + caption in CapCut → Ship the ad in 20 minutes No more paying $11 per video on Arcads. What you get: → Perfect character consistency across every scene → Voice consistency that holds clip-to-clip (small CapCut hack inside the tutorial) → Real product fidelity using your actual product photo as a reference → Multi-scene day-in-life, testimonial, and action-shot formats out of the box Built 100% with a Claude skill + Seedance 2.0. I recorded a full step-by-step tutorial showing the exact workflow + the 3 finished AI UGC ads I made for Rhode, AG1, and Barebells. Want to see the full breakdown? > Like this post > Comment "UGC" And I'll send it over (must be following so I can DM)

Mike Futia

34,739 views • 6 months ago

last week I talked about claude code being my video editor, but it was only a small 30 second clip - here is my FULL workflow on how i have claude code edit ~30 minutes of raw video into a tight 10 minutes it uses STT for captions, then uses remotion to add the captions & cut!

last week I talked about claude code being my video editor, but it was only a small 30 second clip - here is my FULL workflow on how i have claude code edit ~30 minutes of raw video into a tight 10 minutes it uses STT for captions, then uses remotion to add the captions & cut!

BOOTOSHI 👑

14,107 views • 8 months ago

i created this WWII documentary just with AI video models no After Effects no Remotion or complex setups no $1000 spent on an editor it took Calliope 30 seconds (yes, 30 seconds) to animate all the clips in parallel here's how: 1- reuse the image + video prompts from this article 2- write the story around one real person and check the facts 3- generate the narration with ElevenLabs v3 and the images in Extra High 4- review the stills in the editor 5- choose Extra High + All Clips to animate them in batch the images come first. animation is a separate step, so you can fix a bad frame before paying to animate it all inside the same tool the prompts are in the article below ⬇️

i created this WWII documentary just with AI video models no After Effects no Remotion or complex setups no $1000 spent on an editor it took Calliope 30 seconds (yes, 30 seconds) to animate all the clips in parallel here's how: 1- reuse the image + video prompts from this article 2- write the story around one real person and check the facts 3- generate the narration with ElevenLabs v3 and the images in Extra High 4- review the stills in the editor 5- choose Extra High + All Clips to animate them in batch the images come first. animation is a separate step, so you can fix a bad frame before paying to animate it all inside the same tool the prompts are in the article below ⬇️

Sergio Gil

102,232 views • 1 month ago

Seedance 2.0 is allowing us to enter a new era of music video creation. Here is how I created HONEY. It was a quick test to see how well this workflow holds up. 🐝 1 - Write your song and generate the music with Suno 5.5. 2 - Use an image generator of your choice. For HONEY I combined both Grok Imagine for aesthetics and Nano Banana Pro for refined editing. 3 - In Capcut I import my audio and just save out a blank video video containing the audio. This step is important because this video file containing audio will now be used with Seedance 2.0 as a video reference with Omni. This allows the AI to apply automatic and realistic lipsync and movement to the music, it's extremely powerful! 4 - Once I have a both my image and video with audio as reference, I use Seedance 2.0 Omni and upload my starting image and then the video reference with the audio. 5 - From here I'm simply prompting like normal, specifying what's happening in my scene with detailed instructions, mentioning multi shots and camera angle changes and then specifying that the person is singing along to the song. I type out the lyrics that are present to have better lipsync accuracy. 6 - Once I have generated a video and like the result, I do video to video, so i upload that video that just got generated and type "The scene continues" and prompt new actions to take place. This allows you to expand on a narrative. These new shots can be used as B-ROLL and since I uploaded my video as reference I have full consistency of everything it saw in the video. This is also extremely powerful. 7 - This is actually the most difficult part. Edit in Capcut. This is where you need to understand pacing and shot selection from all the scenes you generated to bring it all together. You must be strategic with the editing. Goodluck! I'll probably record a video tutorial at some point as it's easier to see what is being done.

Seedance 2.0 is allowing us to enter a new era of music video creation. Here is how I created HONEY. It was a quick test to see how well this workflow holds up. 🐝 1 - Write your song and generate the music with Suno 5.5. 2 - Use an image generator of your choice. For HONEY I combined both Grok Imagine for aesthetics and Nano Banana Pro for refined editing. 3 - In Capcut I import my audio and just save out a blank video video containing the audio. This step is important because this video file containing audio will now be used with Seedance 2.0 as a video reference with Omni. This allows the AI to apply automatic and realistic lipsync and movement to the music, it's extremely powerful! 4 - Once I have a both my image and video with audio as reference, I use Seedance 2.0 Omni and upload my starting image and then the video reference with the audio. 5 - From here I'm simply prompting like normal, specifying what's happening in my scene with detailed instructions, mentioning multi shots and camera angle changes and then specifying that the person is singing along to the song. I type out the lyrics that are present to have better lipsync accuracy. 6 - Once I have generated a video and like the result, I do video to video, so i upload that video that just got generated and type "The scene continues" and prompt new actions to take place. This allows you to expand on a narrative. These new shots can be used as B-ROLL and since I uploaded my video as reference I have full consistency of everything it saw in the video. This is also extremely powerful. 7 - This is actually the most difficult part. Edit in Capcut. This is where you need to understand pacing and shot selection from all the scenes you generated to bring it all together. You must be strategic with the editing. Goodluck! I'll probably record a video tutorial at some point as it's easier to see what is being done.

Travis Davids

19,236 views • 6 months ago

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

This is probably the most complex workflow I’ve ever built, only with open-source tools. It took my 4 days. It takes four inputs: author, title, and style; and generates a full visual animated story in one click in ComfyUI . I worked on it for four days. There are still some bugs, but here’s the first preview. Here’s a quick breakdown: - The four inputs are sent to LLMs with precise instructions to generate: first, prompts for images and image modifications; second, prompts for animations; third, prompts for generating music. - All voices are generated from the text and timed precisely, as they determine the length of each animation segment. - The first image and video are generated to serve as the title, but also as the guide for all other images created for the video. - Titles and subtitles are also added automatically in Comfy. - I also developed a lot of custom nodes for minor frame calculations, mostly to match audio and video. - The full system is a large loop that, for each line of text, generates an image and then a video from that image. The loop was the hardest part to build in this workflow, so it can process either a 20-second video or a 2-minute video with the same input. - There are multiple combinations of LLMs that try to understand the text in the best way to provide the best prompts for images and video. - The final video is assembled entirely within ComfyUI. - The music is generated based on the LLM output and matches the exact timing of the full animation. - Done! For reference, this workflow uses a lot of models and only works on an RTX 6000 Pro with plenty of RAM. My goal is not to replace humans, as I’ll try to explain later, this workflow is highly controlled and can be adapted or reworked at any point by real artists! My aim was to create a tool that can animate text in one go, allowing the AI some freedom while keeping a strict flow. I don’t know yet how I’ll share this workflow with people, I still need to polish it properly, but maybe through Patreon. Anyway, I hope you enjoy my research, and let’s always keep pushing further! :)

Lovis Odin

58,950 views • 1 year ago

My favorite way of interacting with Claude Code is to have it generate static HTML files as outputs (reports, explorations, code structure, mockups etc.) I wanted to iterate on the file by commenting in browser and having Claude update the output live. So, I built this Claude Skill👇 How it works: - Install Claude Code skill (ask it to clone repo) - Build an HTML page for anything (e.g. research coding agents and generate HTML report) - Ask it to make the page interactive That's it. CC will launch a localhost server and allow you to then leave comments on the page itself and once it updates, will give you a tour of changes. It's like Google Docs kind of comments/iteration but for HTML pages.

My favorite way of interacting with Claude Code is to have it generate static HTML files as outputs (reports, explorations, code structure, mockups etc.) I wanted to iterate on the file by commenting in browser and having Claude update the output live. So, I built this Claude Skill👇 How it works: - Install Claude Code skill (ask it to clone repo) - Build an HTML page for anything (e.g. research coding agents and generate HTML report) - Ask it to make the page interactive That's it. CC will launch a localhost server and allow you to then leave comments on the page itself and once it updates, will give you a tour of changes. It's like Google Docs kind of comments/iteration but for HTML pages.

Paras Chopra

216,705 views • 5 months ago

A simple story idea can turn into a complete video. I wanted to see what Pollo AI Story Video could do with an idea from scratch, so I gave it a story and let it bring the concept to life. I could choose the spoken language and visual style, then generate a video up to 90 seconds without having to build everything scene by scene. Left: the final video Right: the creation process It’s pretty cool seeing the idea go from a simple concept to a finished story video.

A simple story idea can turn into a complete video. I wanted to see what Pollo AI Story Video could do with an idea from scratch, so I gave it a story and let it bring the concept to life. I could choose the spoken language and visual style, then generate a video up to 90 seconds without having to build everything scene by scene. Left: the final video Right: the creation process It’s pretty cool seeing the idea go from a simple concept to a finished story video.

Zara

29,722 views • 2 months ago