正在加载视频...

视频加载失败

Experimenting with the magic of open-source! Whisper for text translation, XTTS for audio, and Video-retalker for seamless mouth sync in a short video Its not perfect, but I think we're close with open source #buildinpublic #opensource

80,983 次观看 • 2 年前 •via X (Twitter)

10 条评论

Luis C 的头像
Luis C2 年前

For reference these were my runs on @replicate: Curious to see what you all come up with!

Michael Aubry — BasedLabs.ai 的头像
Michael Aubry — BasedLabs.ai2 年前

Do you know how d-id or heygen works? Wondering if there is a good oss model

Bilawal Sidhu 的头像
Bilawal Sidhu2 年前

this is awesome, but gosh i wish it worked better for beards

Luis C 的头像
Luis C2 年前

Likewise. There seems to be limits when using the video-retalking model

AP 的头像
AP2 年前

Really cool! @artificialguybr

Luis C 的头像
Luis C2 年前

@artificialguybr Thanks! It was cool enough that I just had to share it

⟁ndrew V 的头像
⟁ndrew V2 年前

Pretty damn good for a first pass, impressive!

Luis C 的头像
Luis C2 年前

Right? All these models have been open source for a while too, just needed to chain them together

Crypto Industry 的头像
Crypto Industry2 年前

The magic of open source is real, and you're the tech wizard making it happen! 🧙‍♀️

Luis C 的头像
Luis C2 年前

Thanks! Im just testing out ideas tbh

相关视频