正在加载视频...
视频加载失败
This workflow gave me best lip sync on a moving character. Workflow below.
68,857 次观看 • 1 年前 •via X (Twitter)
12 条评论

~ created the image, I used @freepik imagen 3 model for the most realistic outputs. ~ Animated the initial 5 sec clip using @LumaLabsAI Ray2 it's the best realistic body and camera motion currently.

@LumaLabsAI ~ Then Use @PixVerse_ it is very underrated it has an incredible extend and lip sync feature, we just need to smartly decide which clip might work best. Using Pixverse extend your luma clip a bit longer by your length of Audio file to counter the pace of the video later.

@LumaLabsAI @PixVerse_ If you find your extended parts to be a bit slower speed it up using editing tools to make it look like natural movement, I used Capcut.

@LumaLabsAI @PixVerse_ Now again Upload your edited clip to Pixverse using the lip sync feature, it can lip sync up to 30 seconds. And you're done.

For voice i used "Zonos" It has a voice cloning feature and inbuilt voice tamplates and different accents. It gives you 100 free minutes.

Bonus Expand or experiment with styles on @runwayml , but wish we could get longer outputs, I love its incredible tools.

Wish I had Topaz sub the end output might have looked freaking good 😅 Anyway if you find it interesting or useful give samsh the follow button 🙌

What’s the cost of mistakes in your contracts? If you work with contracts day-to-day, it’s time to automate. Track every detail, streamline workflows ... ✨ Make managing contracts as easy as a few clicks. Visit our new website & book your demo today!

Ok wow I thought that was lip sync on top of existing video, but the whole scene is synthetic? Very cool.

Yes, as you can see it's from an image generated to the final result, thank you.

This is amazingly realistic!

Turned out nice , thank you
