Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

MIT CSAIL and MyShell.AI researchers introduce OpenVoice V2, a text-to-speech model that can clone any voice and speak in many languages. Imagine your voice going global in multiple languages. OpenVoice V2 breaks the language barrier and redefines voice interactions.

MIT CSAIL

330,318 subscribers

66,460 views • 2 years ago •via X (Twitter)

Science & Technology Education Arts

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing OpenVoice 🔊 Instant voice cloning that requires only a short audio clip to replicate voice and generate speech in multiple languages and tones Listen to the examples They are able to replicate voices with only one sentence Demo to try below:

Introducing OpenVoice 🔊 Instant voice cloning that requires only a short audio clip to replicate voice and generate speech in multiple languages and tones Listen to the examples They are able to replicate voices with only one sentence Demo to try below:

Allen T.

32,935 views • 2 years ago

In this demo, we show real-time voice translation between Indian languages. The user can speak in their preferred language, and the system translates and responds in another, preserving both meaning and natural delivery. Speech recognition, translation, and expressive text-to-speech work together seamlessly.

In this demo, we show real-time voice translation between Indian languages. The user can speak in their preferred language, and the system translates and responds in another, preserving both meaning and natural delivery. Speech recognition, translation, and expressive text-to-speech work together seamlessly.

Pratyush Kumar

15,206 views • 5 months ago

You can now literally clone your voice in the Grok API and use it instantly for voice-powered services Build your own assistant and customer support that takes your calls and runs your business with your voice It’s incredibly easy to set up and takes less than 4 mins to train your voice Just select "Clone a Voice" and read the prompt exactly as shown For the best results, record in a quiet room so Grok can capture your voice as clearly as possible You can also choose from an amazing built-in voice library, with support for 20+ languages and multiple expressive voice options

You can now literally clone your voice in the Grok API and use it instantly for voice-powered services Build your own assistant and customer support that takes your calls and runs your business with your voice It’s incredibly easy to set up and takes less than 4 mins to train your voice Just select "Clone a Voice" and read the prompt exactly as shown For the best results, record in a quiet room so Grok can capture your voice as clearly as possible You can also choose from an amazing built-in voice library, with support for 20+ languages and multiple expressive voice options

X Freeze

79,060 views • 3 months ago

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.

AK

290,517 views • 3 years ago

Introducing Scribe v2 Realtime – the most accurate real-time Speech to Text model. Built for voice agents, meeting notetakers, and live applications, it transcribes in 150ms across 90+ languages, including English, French, German, Italian, Spanish, Portuguese, Hindi, and Japanese. Available today by API and through ElevenLabs Agents.

Introducing Scribe v2 Realtime – the most accurate real-time Speech to Text model. Built for voice agents, meeting notetakers, and live applications, it transcribes in 150ms across 90+ languages, including English, French, German, Italian, Spanish, Portuguese, Hindi, and Japanese. Available today by API and through ElevenLabs Agents.

ElevenLabs

317,764 views • 8 months ago

Voice Design v3 is here. Create any voice you can imagine with a prompt. We’ve rebuilt the underlying Voice Design model to deliver higher quality and broader expressive range. Generate production-ready voices in 70+ languages with support for hundreds of localized accents.

Voice Design v3 is here. Create any voice you can imagine with a prompt. We’ve rebuilt the underlying Voice Design model to deliver higher quality and broader expressive range. Generate production-ready voices in 70+ languages with support for hundreds of localized accents.

ElevenLabs

153,918 views • 1 year ago

We’re finally breaking the silence 🔊 Meet Higgsfield Audio, our all-in-one AI audio generator. Higgsfield is now the ultimate full-cycle AI content production platform. 🧩 Give a voice to any of your text with 21 voice presets 🧩 Change the voice in any of your videos 🧩 Translate and lip-sync any speech in 10 built-in languages An end-to-end AI workflow under one subscription.

We’re finally breaking the silence 🔊 Meet Higgsfield Audio, our all-in-one AI audio generator. Higgsfield is now the ultimate full-cycle AI content production platform. 🧩 Give a voice to any of your text with 21 voice presets 🧩 Change the voice in any of your videos 🧩 Translate and lip-sync any speech in 10 built-in languages An end-to-end AI workflow under one subscription.

Higgsfield AI 🧩

89,006 views • 4 months ago

Scira Voice is a voice agent that can chat, search the web and X posts in real time, and supports over 100 languages. Try it out → Powered by @Grok.

Scira Voice is a voice agent that can chat, search the web and X posts in real time, and supports over 100 languages. Try it out → Powered by @Grok.

Zaid

13,285 views • 7 months ago

Ani speaks many languages and can teach you how to speak almost any language too. Learn new languages the super easy way, with Grok Companions.

Ani speaks many languages and can teach you how to speak almost any language too. Learn new languages the super easy way, with Grok Companions.

DogeDesigner

9,577,602 views • 7 months ago

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.

Rowan Cheung

55,777 views • 2 years ago

Your app talks back. Lovable now supports text-to-speech and-speech-to-text, so you can seamlessly add AI voice features to your projects. Make a voice assistant, a hands-free tool, or an app you can literally speak to. Sound on:

Your app talks back. Lovable now supports text-to-speech and-speech-to-text, so you can seamlessly add AI voice features to your projects. Make a voice assistant, a hands-free tool, or an app you can literally speak to. Sound on:

Lovable

21,999 views • 1 month ago

BUILD 🔥: Microsoft is preparing new image and voice models for the announcement on June 2. > MAI Voice 2, a multilingual model supporting 15 news languages and a wider range of emotional spectrum (check voice samples in the article) > MAI Transcribe 1.5, a new model for speech-to-text use cases. > MAI Image 2.5, already announced last week, is now available on LM Arena in preview. Compared to MAI Image 2, it supports file uploads and can be used for image editing.

BUILD 🔥: Microsoft is preparing new image and voice models for the announcement on June 2. > MAI Voice 2, a multilingual model supporting 15 news languages and a wider range of emotional spectrum (check voice samples in the article) > MAI Transcribe 1.5, a new model for speech-to-text use cases. > MAI Image 2.5, already announced last week, is now available on LM Arena in preview. Compared to MAI Image 2, it supports file uploads and can be used for image editing.

🚨 AI News | TestingCatalog

46,535 views • 2 months ago

Instant dubbing + lip sync with @HeyGen_Official 80% of the worlds population does not speak English. Having the ability to not only voice clone and dub your content into more languages but also do lip sync is a game changer! Below I (AI) speak 8 languages... 🧵 A thread

Instant dubbing + lip sync with @HeyGen_Official 80% of the worlds population does not speak English. Having the ability to not only voice clone and dub your content into more languages but also do lip sync is a game changer! Below I (AI) speak 8 languages... 🧵 A thread

Linus ✦ Ekenstam

422,462 views • 2 years ago

Podcasters - what if I told you could offer your pod to any listener around the world, in their own local language but still keep it in your own voice? That’s the pilot we’re launching Spotify! It’s called Voice Translation and using AI, translates podcasts episodes into alternate languages, all in the podcaster’s voice. It’s pretty insane. Take a look and let me know what you think!

Podcasters - what if I told you could offer your pod to any listener around the world, in their own local language but still keep it in your own voice? That’s the pilot we’re launching Spotify! It’s called Voice Translation and using AI, translates podcasts episodes into alternate languages, all in the podcaster’s voice. It’s pretty insane. Take a look and let me know what you think!

Daniel Ek

3,174,296 views • 2 years ago

The new open-source Text to Speech model: Fish Speech 1.4 is brilliant! Trained on a massive 700K hours of multilingual speech data in 8 languages - Instant voice cloning 🗣️ - Ultra-low latency ⚡ - Compact model (~1GB weights) 🏋️‍♂️

The new open-source Text to Speech model: Fish Speech 1.4 is brilliant! Trained on a massive 700K hours of multilingual speech data in 8 languages - Instant voice cloning 🗣️ - Ultra-low latency ⚡ - Compact model (~1GB weights) 🏋️‍♂️

Rohan Paul

228,836 views • 1 year ago

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.

Sudarshan Kamath

71,298 views • 4 months ago

SILENCIO!!! Account Setup & Profile Optimization Sign Up: Create an account on the Silencio Voice AI platform. Language Selection: Go to your Profile and select the languages you speak fluently.

wr⚡️zz

12,850 views • 6 months ago

Typing just became… Typeless. Meet Typeless 1.0.2 for Mac — a tool that transforms your voice into clear, accurate writing across your Mac. Speak naturally and let Typeless handle the typing, corrections, and structure for you. With Typeless, you can dictate, translate, or ask for quick edits in any language or accent. It converts your speech into polished text up to 10× faster than traditional typing, while automatically fixing mistakes along the way. --- 1️⃣ Dictation Typeless acts as a powerful voice keyboard that works across all applications on your Mac. When you speak, it understands your intent, organizes your ideas, and converts your natural speech into well-structured writing. Whether you're drafting emails, notes, documents, or messages, Typeless helps you turn spoken thoughts into clean text instantly. Controls - Press Fn to start or stop dictation - Hold Fn for quick, short dictation --- 2️⃣ Translation Typeless makes writing in other languages effortless. You can speak in your native language and have Typeless translate your words instantly into the language you want. This allows you to communicate, write, and respond in foreign languages smoothly and naturally. Controls - Press Fn + Space to start translation - Press Fn to stop translation --- 3️⃣ Ask Anything Typeless Typeless also lets you interact with your text using voice commands. You can select any text and simply say how you want it changed. Typeless can edit, rewrite, answer questions, or perform quick actions based on your request, making editing and improving text much faster. Controls - Press Fn + Space to start Ask Anything - Press Fn to stop Ask Anything --- With Typeless, your voice becomes the fastest and easiest way to write, edit, and communicate on your Mac. Your voice is now your keyboard. Get Typeless → Available now on Mac, Windows, iOS, and Android. #Typeless

Typing just became… Typeless. Meet Typeless 1.0.2 for Mac — a tool that transforms your voice into clear, accurate writing across your Mac. Speak naturally and let Typeless handle the typing, corrections, and structure for you. With Typeless, you can dictate, translate, or ask for quick edits in any language or accent. It converts your speech into polished text up to 10× faster than traditional typing, while automatically fixing mistakes along the way. --- 1️⃣ Dictation Typeless acts as a powerful voice keyboard that works across all applications on your Mac. When you speak, it understands your intent, organizes your ideas, and converts your natural speech into well-structured writing. Whether you're drafting emails, notes, documents, or messages, Typeless helps you turn spoken thoughts into clean text instantly. Controls - Press Fn to start or stop dictation - Hold Fn for quick, short dictation --- 2️⃣ Translation Typeless makes writing in other languages effortless. You can speak in your native language and have Typeless translate your words instantly into the language you want. This allows you to communicate, write, and respond in foreign languages smoothly and naturally. Controls - Press Fn + Space to start translation - Press Fn to stop translation --- 3️⃣ Ask Anything Typeless Typeless also lets you interact with your text using voice commands. You can select any text and simply say how you want it changed. Typeless can edit, rewrite, answer questions, or perform quick actions based on your request, making editing and improving text much faster. Controls - Press Fn + Space to start Ask Anything - Press Fn to stop Ask Anything --- With Typeless, your voice becomes the fastest and easiest way to write, edit, and communicate on your Mac. Your voice is now your keyboard. Get Typeless → Available now on Mac, Windows, iOS, and Android. #Typeless

Kuria Chronicles

43,623 views • 4 months ago

Eleven v3 (alpha) is the most expressive Text to Speech model. v3 introduces: • Multi-speaker dialogue with contextual awareness • Support for 70+ languages, up from 33 in v2 • Audio tags such as [excited], [sighs], [laughing], and [whispers]

Eleven v3 (alpha) is the most expressive Text to Speech model. v3 introduces: • Multi-speaker dialogue with contextual awareness • Support for 70+ languages, up from 33 in v2 • Audio tags such as [excited], [sighs], [laughing], and [whispers]

ElevenLabs

39,346 views • 1 year ago

Flux Multilingual is live. Real-time conversational speech-to-text for voice agents in 10 languages, with monolingual-grade accuracy, turn detection, and code-switching. Deploy once and launch globally. Learn more →

Flux Multilingual is live. Real-time conversational speech-to-text for voice agents in 10 languages, with monolingual-grade accuracy, turn detection, and code-switching. Deploy once and launch globally. Learn more →

Deepgram

15,544 views • 3 months ago