today we're introducing lipsync-2, the world's first zero-shot lipsyncing model that preserves a speaker's unique style w/o additional training or fine-tuning lipsync-2 is a leap forward in realism, expressiveness, control, quality, and speed across live-action, animated, and AI-generated video lipsync-2 is rolling out in GA today 🧵

with lipsync-2, we introduce a new capability in zero-shot lipsync: style preservation. we learn a representation of how a person speaks by watching how they speak from the input notice how even across different languages, we preserve the speaking style of Nicolas Cage. we are the first zero-shot lipsyncing model to achieve this

we also added an additional control in lipsync-2: temperature, or the ability to control how expressive the lipsync generates keep lipsync concise, or generate with more expression this feature is in private beta, we're rolling out gradually to paid users

lipsync-2 works seamlessly across live-action, animated, or AI generated content try it at

Positivity, creativity, doing, singing, writing, painting, sketching, pottering (making pots) weaving, dancing, playing. Welcome to the Shire of Here and There's podcast featuring RR. @TheShellies

the plot twist in the beginning is crazy

you can't even tell.

April 1st, but thankfully this AINT april fools!!!! Hell yeah! Keep crushing it!

🫡

Quality is insanely good!

insanely good.

👀

👀