Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine github: EmotiVoice is a powerful and modern open-source text-to-speech engine. EmotiVoice speaks both English and Chinese, and with over 2000 different voices. The most prominent feature is emotional synthesis, allowing you to create speech with a wide range of emotions, including...

312,299 Aufrufe • vor 2 Jahren •via X (Twitter)

10 Kommentare

Profilbild von Furkan Gözükara
Furkan Gözükaravor 2 Jahren

Even demo is low sound quality

Profilbild von Andrzej Białecki
Andrzej Białeckivor 2 Jahren

I wonder when we'll have singing voice synthesis guided by text and midi notes of a lead sound.

Profilbild von Jeff Araujo
Jeff Araujovor 2 Jahren

@camenduru, would be awesome to have a Colab available using this Engine 🥹

Profilbild von Fran Abenza
Fran Abenzavor 2 Jahren

Would it run in M1, 8Gb Ram?

Profilbild von Nathan Odle
Nathan Odlevor 2 Jahren

I tried running it locally and didn't get much variation between emotion prompts. Tried different (english) voices and happy/angry pretty much sounded the same most of the time. Maybe it works better with chinese?

Profilbild von Youdao Open Source
Youdao Open Sourcevor 2 Jahren

Author here. Thanks for your interest in the project. We will post a roadmap for future updates shortly.

Profilbild von Patrick's AIBuzzNews
Patrick's AIBuzzNewsvor 2 Jahren

Does it outperform Bark?

Profilbild von Ai News 24/7
Ai News 24/7vor 2 Jahren

EmotiVoice sounds amazing, especially with its prompt-controlled feature. Gonna give it a try!

Profilbild von Ping Chen
Ping Chenvor 2 Jahren

@Memdotai mem it

Profilbild von tinyfish
tinyfishvor 2 Jahren

Should try

Ähnliche Videos

🇨🇳 Another great Chinese Model, OmniHuman-1.5 from ByteDance Turns 1 image plus a voice track into expressive avatar video by pairing a System 1 and System 2 inspired planner with a Diffusion Transformer, Produces coherent motion for over 1 minute with moving camera and multi character scenes. Most avatar models move to the beat of the audio but miss meaning, so gestures feel generic and emotions feel shallow. The fix here is a Multimodal LLM planner that listens to the speech and drafts a structured plan describing intent, emotions, beats, and high level actions, which gives the motion engine clear semantic targets instead of only rhythm. The motion engine is a Multimodal Diffusion Transformer that fuses the plan with audio, the single reference image, and optional text prompts, then synthesizes continuous body, face, and head motion that matches both words and tone. A key trick is a Pseudo Last Frame, a synthetic target that summarizes the next expected state, which stabilizes fusion across modalities and keeps motion consistent over long spans. From just 1 image and speech, the system outputs speaking avatars with synchronized lips, context aware gestures, and continuous camera movement, and it also supports multi character interactions without manual choreography. Reported results show strong lip sync accuracy, high video quality, natural motion, and close match to text prompts, and the same setup works on nonhuman characters too.

Rohan Paul

63,859 Aufrufe • vor 10 Monaten