Loading video...

Video Failed to Load

Go Home

How to use custom voice AND face with Seedance 2? step by step workflow. bookmark this thread 🧵

28,253 views • 6 months ago •via X (Twitter)

17 Comments

ink404's profile picture
ink4046 months ago

tools we'll use: * seedance 2: * voice-cloner: both has to be on mitte. other platforms (runway etc) don't support audio properly.

ink404's profile picture
ink4046 months ago

step 1. clone your voice. entirely for education purposes, I'll clone @xueqinjiang's voice. I love him and it'd be a great demo ❤️ so open voice cloner: and upload a voice sample (45 seconds), type name + description, and choose an avatar

ink404's profile picture
ink4046 months ago

step 2. generate speech once the voice is cloned, mitte places your new voice character under "Voice Library" tab in the model menu. open that and type any script in your new voice model. you can optionally choose emotion and speed. it produces incredibly realistic result

ink404's profile picture
ink4046 months ago

step 3. create the video you have the audio now, and video is next. select "seedance 2" again from the model menu. add your character's image first. then right click in the audio you made and click "add to prompt" enter the prompt like in the image below

ink404's profile picture
ink4046 months ago

step 4. done make sure your prompt tags the audio properly. my prompt was "lecture by the teacher in @image1 speaks the given @audio1" make sure your video length matches the audio. enjoy the result 🥳

Kōda's profile picture
Kōda6 months ago

Great tutorial, Ink! Thanks for sharing!

ink404's profile picture
ink4046 months ago

you’re welcome 🫶

Ananay Batra's profile picture
Ananay Batra6 months ago

illegal, it's people like you that give ai art a bad name

((Dan Gilles (假老外Dan))) e/acc's profile picture
((Dan Gilles (假老外Dan))) e/acc5 months ago

Mitte is great, hope they will release an API soon to enable automation

DEE's profile picture
DEE6 months ago

hmmm, i see voice cloner. Btw, if i make a video, should i make them mute then inster the voice? or use the voice as reference? Which one should i do first?

ink404's profile picture
ink4046 months ago

create the voice first, then add it to the video. as i explain here

DEE's profile picture
DEE6 months ago

oh ok, should i match each second of the word with his mouth or just let it read from previous video? I sticthed several videos into a video.

ink404's profile picture
ink4046 months ago

model does the lipsync for you

DEE's profile picture
DEE6 months ago

oh okayy. i will try when i need it. Thanks Ink!

ink404's profile picture
ink4046 months ago

@brubbleR stick with your ltx and localhost then lol

The AI Guy's profile picture
The AI Guy6 months ago

Great 😸

ink404's profile picture
ink4046 months ago

ty

Related Videos