ๆญฃๅœจๅŠ ่ฝฝ่ง†้ข‘...

่ง†้ข‘ๅŠ ่ฝฝๅคฑ่ดฅ

Announcing ๐•๐จ๐ข๐œ๐ž๐‚๐ซ๐š๐Ÿ๐ญ๐Ÿช„ SotA for both speech editing and zero-shot text-to-speech, Outperforming VALL-E, XTTS-v2, etc. VoiceCraft works on in-the-wild data such as movies, random videos and podcasts We fully open source it at

160,424 ๆฌก่ง‚็œ‹ โ€ข 2 ๅนดๅ‰ โ€ขvia X (Twitter)

10 ๆก่ฏ„่ฎบ

Puyuan Peng ็š„ๅคดๅƒ
Puyuan Peng2 ๅนดๅ‰

๐•๐จ๐ข๐œ๐ž๐‚๐ซ๐š๐Ÿ๐ญ works well on recordings with diverse accents, emotions, styles, content, background noise, recording conditions. Demo: Paper: code, model, data:

Vaibhav (VB) Srivastav ็š„ๅคดๅƒ
Vaibhav (VB) Srivastav2 ๅนดๅ‰

@rdesh26 Wow! love itt! I'd love to add this on the TTS Arena: Let's chat in DMs?

Puyuan Peng ็š„ๅคดๅƒ
Puyuan Peng2 ๅนดๅ‰

@rdesh26 Yea letโ€™s do that!

mrfakename ็š„ๅคดๅƒ
mrfakename2 ๅนดๅ‰

Thank you for releasing! Any possibility of switching to an open source license?

Puyuan Peng ็š„ๅคดๅƒ
Puyuan Peng2 ๅนดๅ‰

Thanks! Have been discussing the licensing issue, might change it in the coming days

Kaashika Prajaapat ็š„ๅคดๅƒ
Kaashika Prajaapat2 ๅนดๅ‰

I tried out. Insane!!! Amazing work @PuyuanPeng Can the license be commercially available? Would love to incorporate this into our product.

Jonathan Fly ๐Ÿ‘พ ็š„ๅคดๅƒ
Jonathan Fly ๐Ÿ‘พ2 ๅนดๅ‰

Cool practical solutions done in sampling: discarding longest/shortest, special cases for silence tokens, rep penalties and silence tokens interacting. Might be able to even penalize the scratching sound if it's consistent enough (or maybe CFG negative prompt?).

Paulo Vasconcellos ็š„ๅคดๅƒ
Paulo Vasconcellos2 ๅนดๅ‰

Wish it had a more permissive license. Is it possible to change it to be used commercially?

Puyuan Peng ็š„ๅคดๅƒ
Puyuan Peng2 ๅนดๅ‰

have been discussing the licensing issue, might change it in the coming days

Siddharth Sharma ็š„ๅคดๅƒ
Siddharth Sharma2 ๅนดๅ‰

Great work! Would love to connect with you

็›ธๅ…ณ่ง†้ข‘