Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

This workflow gave me best lip sync on a moving character. Workflow below.

68,857 Aufrufe • vor 1 Jahr •via X (Twitter)

12 Kommentare

Profilbild von madpencil_
madpencil_vor 1 Jahr

~ created the image, I used @freepik imagen 3 model for the most realistic outputs. ~ Animated the initial 5 sec clip using @LumaLabsAI Ray2 it's the best realistic body and camera motion currently.

Profilbild von madpencil_
madpencil_vor 1 Jahr

@LumaLabsAI ~ Then Use @PixVerse_ it is very underrated it has an incredible extend and lip sync feature, we just need to smartly decide which clip might work best. Using Pixverse extend your luma clip a bit longer by your length of Audio file to counter the pace of the video later.

Profilbild von madpencil_
madpencil_vor 1 Jahr

@LumaLabsAI @PixVerse_ If you find your extended parts to be a bit slower speed it up using editing tools to make it look like natural movement, I used Capcut.

Profilbild von madpencil_
madpencil_vor 1 Jahr

@LumaLabsAI @PixVerse_ Now again Upload your edited clip to Pixverse using the lip sync feature, it can lip sync up to 30 seconds. And you're done.

Profilbild von madpencil_
madpencil_vor 1 Jahr

For voice i used "Zonos" It has a voice cloning feature and inbuilt voice tamplates and different accents. It gives you 100 free minutes.

Profilbild von madpencil_
madpencil_vor 1 Jahr

Bonus Expand or experiment with styles on @runwayml , but wish we could get longer outputs, I love its incredible tools.

Profilbild von madpencil_
madpencil_vor 1 Jahr

Wish I had Topaz sub the end output might have looked freaking good 😅 Anyway if you find it interesting or useful give samsh the follow button 🙌

Profilbild von opensourceCM
opensourceCMvor 1 Jahr

What’s the cost of mistakes in your contracts? If you work with contracts day-to-day, it’s time to automate. Track every detail, streamline workflows ... ✨ Make managing contracts as easy as a few clicks. Visit our new website & book your demo today!

Profilbild von Serge Doubinski
Serge Doubinskivor 1 Jahr

Ok wow I thought that was lip sync on top of existing video, but the whole scene is synthetic? Very cool.

Profilbild von madpencil_
madpencil_vor 1 Jahr

Yes, as you can see it's from an image generated to the final result, thank you.

Profilbild von Royght
Royghtvor 1 Jahr

This is amazingly realistic!

Profilbild von madpencil_
madpencil_vor 1 Jahr

Turned out nice , thank you

Ähnliche Videos