正在加载视频...

视频加载失败

This workflow gave me best lip sync on a moving character. Workflow below.

68,857 次观看 • 1 年前 •via X (Twitter)

12 条评论

madpencil_ 的头像
madpencil_1 年前

~ created the image, I used @freepik imagen 3 model for the most realistic outputs. ~ Animated the initial 5 sec clip using @LumaLabsAI Ray2 it's the best realistic body and camera motion currently.

madpencil_ 的头像
madpencil_1 年前

@LumaLabsAI ~ Then Use @PixVerse_ it is very underrated it has an incredible extend and lip sync feature, we just need to smartly decide which clip might work best. Using Pixverse extend your luma clip a bit longer by your length of Audio file to counter the pace of the video later.

madpencil_ 的头像
madpencil_1 年前

@LumaLabsAI @PixVerse_ If you find your extended parts to be a bit slower speed it up using editing tools to make it look like natural movement, I used Capcut.

madpencil_ 的头像
madpencil_1 年前

@LumaLabsAI @PixVerse_ Now again Upload your edited clip to Pixverse using the lip sync feature, it can lip sync up to 30 seconds. And you're done.

madpencil_ 的头像
madpencil_1 年前

For voice i used "Zonos" It has a voice cloning feature and inbuilt voice tamplates and different accents. It gives you 100 free minutes.

madpencil_ 的头像
madpencil_1 年前

Bonus Expand or experiment with styles on @runwayml , but wish we could get longer outputs, I love its incredible tools.

madpencil_ 的头像
madpencil_1 年前

Wish I had Topaz sub the end output might have looked freaking good 😅 Anyway if you find it interesting or useful give samsh the follow button 🙌

opensourceCM 的头像
opensourceCM1 年前

What’s the cost of mistakes in your contracts? If you work with contracts day-to-day, it’s time to automate. Track every detail, streamline workflows ... ✨ Make managing contracts as easy as a few clicks. Visit our new website & book your demo today!

Serge Doubinski 的头像
Serge Doubinski1 年前

Ok wow I thought that was lip sync on top of existing video, but the whole scene is synthetic? Very cool.

madpencil_ 的头像
madpencil_1 年前

Yes, as you can see it's from an image generated to the final result, thank you.

Royght 的头像
Royght1 年前

This is amazingly realistic!

madpencil_ 的头像
madpencil_1 年前

Turned out nice , thank you

相关视频