Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introduce OpenVoice V2 - a Text-to-Speech model that can clone any voice and speak in any language. Developed by MyShell and MIT CSAIL researchers. 🌐 Imagine your voice going global in multiple languages. 🔊 OpenVoice V2 breaks the language barrier and redefines voice interaction.

MyShell.AI

189,708 subscribers

292,515 views • 2 years ago •via X (Twitter)

Science & Technology Education News & Politics

Anya Rossi• Live Now

Private livecam show

10 Comments

MyShell.AI2 years ago

1/ Several applications of OpenVoice V2 are: 🟪 Customized digital voice interface 🟪 Multilingual virtual assistants 🟪 Automatic dubbing in any language

MyShell.AI2 years ago

2/ OpenVoice V2 is fully open-sourced, and allows free commercial use. Usage:

MyShell.AI2 years ago

3/ We welcome collaboration. Contact @qinzytech to make things happen.

Semih (🛠, 🤖)2 years ago

@MIT_CSAIL maşallah

mohamed mez2 years ago

@MIT_CSAIL Does it support Arabic language?

Bigman2 years ago

@MIT_CSAIL Dmed !

h12 years ago

@MIT_CSAIL awesome

hexsecurity2 years ago

@MIT_CSAIL Open voice clone

随机漫步的傻瓜2 years ago

@MIT_CSAIL @PublicAI_ #AI

鳄鱼头领2 years ago

@MIT_CSAIL great

Related Videos

Introducing OpenVoice 🔊 Instant voice cloning that requires only a short audio clip to replicate voice and generate speech in multiple languages and tones Listen to the examples They are able to replicate voices with only one sentence Demo to try below:

Introducing OpenVoice 🔊 Instant voice cloning that requires only a short audio clip to replicate voice and generate speech in multiple languages and tones Listen to the examples They are able to replicate voices with only one sentence Demo to try below:

Allen T.

32,935 views • 2 years ago

Introducing Soniox TTS v2, our most powerful text-to-speech model yet. Soniox TTS v2 brings extraordinary voice quality, expressive control through audio tags, exceptional precision, high-fidelity voice cloning, more than 60 languages, natural language mixing, and low-latency streaming together in one model. Built from the ground up with a new model architecture, audio codec, and highly optimized inference engine, Soniox TTS v2 delivers frontier TTS at just $0.70 per generated hour. Available globally today as tts-rt-v2. Try it out: Turn the sound on and hear what’s possible. 🔊

Introducing Soniox TTS v2, our most powerful text-to-speech model yet. Soniox TTS v2 brings extraordinary voice quality, expressive control through audio tags, exceptional precision, high-fidelity voice cloning, more than 60 languages, natural language mixing, and low-latency streaming together in one model. Built from the ground up with a new model architecture, audio codec, and highly optimized inference engine, Soniox TTS v2 delivers frontier TTS at just $0.70 per generated hour. Available globally today as tts-rt-v2. Try it out: Turn the sound on and hear what’s possible. 🔊

Soniox

624,344 views • 12 days ago

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.

AK

290,517 views • 3 years ago

In this demo, we show real-time voice translation between Indian languages. The user can speak in their preferred language, and the system translates and responds in another, preserving both meaning and natural delivery. Speech recognition, translation, and expressive text-to-speech work together seamlessly.

In this demo, we show real-time voice translation between Indian languages. The user can speak in their preferred language, and the system translates and responds in another, preserving both meaning and natural delivery. Speech recognition, translation, and expressive text-to-speech work together seamlessly.

Pratyush Kumar

15,206 views • 6 months ago

🎙️ Dictate in Multiple Languages in #VSCode Dictation can detect your language and turn your speech into text using a local model. You can use it in Chat, the editor, and the integrated terminal.

🎙️ Dictate in Multiple Languages in #VSCode Dictation can detect your language and turn your speech into text using a local model. You can use it in Chat, the editor, and the integrated terminal.

Visual Studio Code

27,733 views • 10 days ago

INTRODUCING DABABEL. THE UNIVERSAL REAL TIME TEXT AND VOICE TRANSLATION TOOL. SPEAK ANY LANGUAGE, WITH ANYBODY, ANYWHERE. AVAILABLE RIGHT NOW.

INTRODUCING DABABEL. THE UNIVERSAL REAL TIME TEXT AND VOICE TRANSLATION TOOL. SPEAK ANY LANGUAGE, WITH ANYBODY, ANYWHERE. AVAILABLE RIGHT NOW.

Quackity

7,651,880 views • 1 year ago

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊

calle 🟥

34,514 views • 13 days ago

We’re finally breaking the silence 🔊 Meet Higgsfield Audio, our all-in-one AI audio generator. Higgsfield is now the ultimate full-cycle AI content production platform. 🧩 Give a voice to any of your text with 21 voice presets 🧩 Change the voice in any of your videos 🧩 Translate and lip-sync any speech in 10 built-in languages An end-to-end AI workflow under one subscription.

We’re finally breaking the silence 🔊 Meet Higgsfield Audio, our all-in-one AI audio generator. Higgsfield is now the ultimate full-cycle AI content production platform. 🧩 Give a voice to any of your text with 21 voice presets 🧩 Change the voice in any of your videos 🧩 Translate and lip-sync any speech in 10 built-in languages An end-to-end AI workflow under one subscription.

Higgsfield AI 🧩

89,429 views • 5 months ago

You can now literally clone your voice in the Grok API and use it instantly for voice-powered services Build your own assistant and customer support that takes your calls and runs your business with your voice It’s incredibly easy to set up and takes less than 4 mins to train your voice Just select "Clone a Voice" and read the prompt exactly as shown For the best results, record in a quiet room so Grok can capture your voice as clearly as possible You can also choose from an amazing built-in voice library, with support for 20+ languages and multiple expressive voice options

You can now literally clone your voice in the Grok API and use it instantly for voice-powered services Build your own assistant and customer support that takes your calls and runs your business with your voice It’s incredibly easy to set up and takes less than 4 mins to train your voice Just select "Clone a Voice" and read the prompt exactly as shown For the best results, record in a quiet room so Grok can capture your voice as clearly as possible You can also choose from an amazing built-in voice library, with support for 20+ languages and multiple expressive voice options

X Freeze

79,165 views • 3 months ago

Meet EVI 3, another step toward general voice intelligence. EVI 3 is a speech-language model that can understand and generate any human voice, not just a handful of speakers. With this broader voice intelligence comes greater expressiveness and a deeper understanding of tune, rhythm, timbre, and speaking style.

Meet EVI 3, another step toward general voice intelligence. EVI 3 is a speech-language model that can understand and generate any human voice, not just a handful of speakers. With this broader voice intelligence comes greater expressiveness and a deeper understanding of tune, rhythm, timbre, and speaking style.

Hume AI

832,639 views • 1 year ago

Introducing Scribe v2 Realtime – the most accurate real-time Speech to Text model. Built for voice agents, meeting notetakers, and live applications, it transcribes in 150ms across 90+ languages, including English, French, German, Italian, Spanish, Portuguese, Hindi, and Japanese. Available today by API and through ElevenLabs Agents.

Introducing Scribe v2 Realtime – the most accurate real-time Speech to Text model. Built for voice agents, meeting notetakers, and live applications, it transcribes in 150ms across 90+ languages, including English, French, German, Italian, Spanish, Portuguese, Hindi, and Japanese. Available today by API and through ElevenLabs Agents.

ElevenLabs

318,093 views • 9 months ago

Voice Design v3 is here. Create any voice you can imagine with a prompt. We’ve rebuilt the underlying Voice Design model to deliver higher quality and broader expressive range. Generate production-ready voices in 70+ languages with support for hundreds of localized accents.

Voice Design v3 is here. Create any voice you can imagine with a prompt. We’ve rebuilt the underlying Voice Design model to deliver higher quality and broader expressive range. Generate production-ready voices in 70+ languages with support for hundreds of localized accents.

ElevenLabs

153,918 views • 1 year ago

I've just tested the EVI 3 speech-to-speech model by Hume Hume AI, and this is the most realistic voice cloning I’ve heard. It doesn’t just clone the sound of your voice — it captures your tone, your speech patterns, your personality. Feels like your voice is thinking in real time. What’s wild is: — It’s not text-to-speech. It’s speech-to-speech. — You speak → it clones your voice + vibe — And it’s compatible with LLMs like Groq, Anthropic, Deepseek - Try talking to a voice clone: - Want more control? Customize it here: This changes how we’ll interact with AI voices. No more robotic replies — these sound human.

I've just tested the EVI 3 speech-to-speech model by Hume Hume AI, and this is the most realistic voice cloning I’ve heard. It doesn’t just clone the sound of your voice — it captures your tone, your speech patterns, your personality. Feels like your voice is thinking in real time. What’s wild is: — It’s not text-to-speech. It’s speech-to-speech. — You speak → it clones your voice + vibe — And it’s compatible with LLMs like Groq, Anthropic, Deepseek - Try talking to a voice clone: - Want more control? Customize it here: This changes how we’ll interact with AI voices. No more robotic replies — these sound human.

Aaliya

28,046 views • 1 year ago

i was playing around the newest TTS (text to speech) model 'kokoro' which has just 82M parameters! by adding only 1 line of code you can create a custom voice that mixes any two (out of ten voices) in any ratio example: mixing one male and one female voice in the 60-40 ratio

i was playing around the newest TTS (text to speech) model 'kokoro' which has just 82M parameters! by adding only 1 line of code you can create a custom voice that mixes any two (out of ten voices) in any ratio example: mixing one male and one female voice in the 60-40 ratio

maharshi

88,729 views • 1 year ago

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.

Rowan Cheung

55,915 views • 2 years ago

Podcasters - what if I told you could offer your pod to any listener around the world, in their own local language but still keep it in your own voice? That’s the pilot we’re launching Spotify! It’s called Voice Translation and using AI, translates podcasts episodes into alternate languages, all in the podcaster’s voice. It’s pretty insane. Take a look and let me know what you think!

Podcasters - what if I told you could offer your pod to any listener around the world, in their own local language but still keep it in your own voice? That’s the pilot we’re launching Spotify! It’s called Voice Translation and using AI, translates podcasts episodes into alternate languages, all in the podcaster’s voice. It’s pretty insane. Take a look and let me know what you think!

Daniel Ek

3,174,404 views • 2 years ago

That's my face - but I never said any of this. 🔊 Sound on. I made my avatar speak every language in this thread, powered by Sonic 3.5, the model that just went #1 in the world for text-to-speech.

Mira

33,874 views • 2 months ago

Typing just became… Typeless. Meet Typeless 1.0.2 for Mac — a tool that transforms your voice into clear, accurate writing across your Mac. Speak naturally and let Typeless handle the typing, corrections, and structure for you. With Typeless, you can dictate, translate, or ask for quick edits in any language or accent. It converts your speech into polished text up to 10× faster than traditional typing, while automatically fixing mistakes along the way. --- 1️⃣ Dictation Typeless acts as a powerful voice keyboard that works across all applications on your Mac. When you speak, it understands your intent, organizes your ideas, and converts your natural speech into well-structured writing. Whether you're drafting emails, notes, documents, or messages, Typeless helps you turn spoken thoughts into clean text instantly. Controls - Press Fn to start or stop dictation - Hold Fn for quick, short dictation --- 2️⃣ Translation Typeless makes writing in other languages effortless. You can speak in your native language and have Typeless translate your words instantly into the language you want. This allows you to communicate, write, and respond in foreign languages smoothly and naturally. Controls - Press Fn + Space to start translation - Press Fn to stop translation --- 3️⃣ Ask Anything Typeless Typeless also lets you interact with your text using voice commands. You can select any text and simply say how you want it changed. Typeless can edit, rewrite, answer questions, or perform quick actions based on your request, making editing and improving text much faster. Controls - Press Fn + Space to start Ask Anything - Press Fn to stop Ask Anything --- With Typeless, your voice becomes the fastest and easiest way to write, edit, and communicate on your Mac. Your voice is now your keyboard. Get Typeless → Available now on Mac, Windows, iOS, and Android. #Typeless

Typing just became… Typeless. Meet Typeless 1.0.2 for Mac — a tool that transforms your voice into clear, accurate writing across your Mac. Speak naturally and let Typeless handle the typing, corrections, and structure for you. With Typeless, you can dictate, translate, or ask for quick edits in any language or accent. It converts your speech into polished text up to 10× faster than traditional typing, while automatically fixing mistakes along the way. --- 1️⃣ Dictation Typeless acts as a powerful voice keyboard that works across all applications on your Mac. When you speak, it understands your intent, organizes your ideas, and converts your natural speech into well-structured writing. Whether you're drafting emails, notes, documents, or messages, Typeless helps you turn spoken thoughts into clean text instantly. Controls - Press Fn to start or stop dictation - Hold Fn for quick, short dictation --- 2️⃣ Translation Typeless makes writing in other languages effortless. You can speak in your native language and have Typeless translate your words instantly into the language you want. This allows you to communicate, write, and respond in foreign languages smoothly and naturally. Controls - Press Fn + Space to start translation - Press Fn to stop translation --- 3️⃣ Ask Anything Typeless Typeless also lets you interact with your text using voice commands. You can select any text and simply say how you want it changed. Typeless can edit, rewrite, answer questions, or perform quick actions based on your request, making editing and improving text much faster. Controls - Press Fn + Space to start Ask Anything - Press Fn to stop Ask Anything --- With Typeless, your voice becomes the fastest and easiest way to write, edit, and communicate on your Mac. Your voice is now your keyboard. Get Typeless → Available now on Mac, Windows, iOS, and Android. #Typeless

Kuria Chronicles

43,623 views • 5 months ago

🌐Say hello to easy localization design✨ Introduce our new multi-language UI generation. Create your design in Galileo, say the magic word, and boom - your text flips to French, German, Chinese, Japanese, Hindi, or any other languages you’d like.

🌐Say hello to easy localization design✨ Introduce our new multi-language UI generation. Create your design in Galileo, say the magic word, and boom - your text flips to French, German, Chinese, Japanese, Hindi, or any other languages you’d like.

Stitch by Google

10,133 views • 2 years ago

Your app talks back. Lovable now supports text-to-speech and-speech-to-text, so you can seamlessly add AI voice features to your projects. Make a voice assistant, a hands-free tool, or an app you can literally speak to. Sound on:

Your app talks back. Lovable now supports text-to-speech and-speech-to-text, so you can seamlessly add AI voice features to your projects. Make a voice assistant, a hands-free tool, or an app you can literally speak to. Sound on:

Lovable

22,283 views • 2 months ago