Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

How to use custom voice AND face with Seedance 2? step by step workflow. bookmark this thread 🧵

28,253 Aufrufe • vor 6 Monaten •via X (Twitter)

17 Kommentare

Profilbild von ink404
ink404vor 6 Monaten

tools we'll use: * seedance 2: * voice-cloner: both has to be on mitte. other platforms (runway etc) don't support audio properly.

Profilbild von ink404
ink404vor 6 Monaten

step 1. clone your voice. entirely for education purposes, I'll clone @xueqinjiang's voice. I love him and it'd be a great demo ❤️ so open voice cloner: and upload a voice sample (45 seconds), type name + description, and choose an avatar

Profilbild von ink404
ink404vor 6 Monaten

step 2. generate speech once the voice is cloned, mitte places your new voice character under "Voice Library" tab in the model menu. open that and type any script in your new voice model. you can optionally choose emotion and speed. it produces incredibly realistic result

Profilbild von ink404
ink404vor 6 Monaten

step 3. create the video you have the audio now, and video is next. select "seedance 2" again from the model menu. add your character's image first. then right click in the audio you made and click "add to prompt" enter the prompt like in the image below

Profilbild von ink404
ink404vor 6 Monaten

step 4. done make sure your prompt tags the audio properly. my prompt was "lecture by the teacher in @image1 speaks the given @audio1" make sure your video length matches the audio. enjoy the result 🥳

Profilbild von Kōda
Kōdavor 6 Monaten

Great tutorial, Ink! Thanks for sharing!

Profilbild von ink404
ink404vor 6 Monaten

you’re welcome 🫶

Profilbild von Ananay Batra
Ananay Batravor 6 Monaten

illegal, it's people like you that give ai art a bad name

Profilbild von ((Dan Gilles (假老外Dan))) e/acc
((Dan Gilles (假老外Dan))) e/accvor 5 Monaten

Mitte is great, hope they will release an API soon to enable automation

Profilbild von DEE
DEEvor 6 Monaten

hmmm, i see voice cloner. Btw, if i make a video, should i make them mute then inster the voice? or use the voice as reference? Which one should i do first?

Profilbild von ink404
ink404vor 6 Monaten

create the voice first, then add it to the video. as i explain here

Profilbild von DEE
DEEvor 6 Monaten

oh ok, should i match each second of the word with his mouth or just let it read from previous video? I sticthed several videos into a video.

Profilbild von ink404
ink404vor 6 Monaten

model does the lipsync for you

Profilbild von DEE
DEEvor 6 Monaten

oh okayy. i will try when i need it. Thanks Ink!

Profilbild von ink404
ink404vor 6 Monaten

@brubbleR stick with your ltx and localhost then lol

Profilbild von The AI Guy
The AI Guyvor 6 Monaten

Great 😸

Profilbild von ink404
ink404vor 6 Monaten

ty

Ähnliche Videos