Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Meet the new Soniox voice library. Soniox Text-to-Speech now includes more than 200 built-in voices, carefully curated for different applications, styles, accents, ages, and voice characteristics. Every voice works across 60+ languages, so you can choose the voice that fits your product and use that same voice globally while...

soniox_ai's profile picture

Soniox

1,906 subscribers

126,206 Aufrufe • vor 13 Tagen •via X (Twitter)

Nachrichten & PolitikBildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

3 Kommentare

Profilbild von Yonatan Gross
Yonatan Grossvor 13 Tagen

I love it, I use it for a personal assistant, now I'll have the ability to fire one every couple of days ^^

Profilbild von RAZA | AI EXPLORER
RAZA | AI EXPLORERvor 13 Tagen

200+ voices across 60+ languages is a huge upgrade for global voice experiences.

Profilbild von Kumar Deepanshu
Kumar Deepanshuvor 13 Tagen

nice 👍

Ähnliche Videos

Different languages. Different accents. One voice experience built to understand them. At the #HUMAIN booth at #LEAP26, visitors put HUMAIN Voice to the test, recording their own voices, in their own languages and accents, and experiencing how AI can make every interaction feel more natural and human. This is voice AI built for the way the world speaks. #LEAP26 #TheEndOfLimits
1:04

Different languages. Different accents. One voice experience built to understand them. At the #HUMAIN booth at #LEAP26, visitors put HUMAIN Voice to the test, recording their own voices, in their own languages and accents, and experiencing how AI can make every interaction feel more natural and human. This is voice AI built for the way the world speaks. #LEAP26 #TheEndOfLimits

HUMAIN

30,306 Aufrufe • vor 18 Tagen

You can now literally clone your voice in the Grok API and use it instantly for voice-powered services Build your own assistant and customer support that takes your calls and runs your business with your voice It’s incredibly easy to set up and takes less than 4 mins to train your voice Just select "Clone a Voice" and read the prompt exactly as shown For the best results, record in a quiet room so Grok can capture your voice as clearly as possible You can also choose from an amazing built-in voice library, with support for 20+ languages and multiple expressive voice options
0:53

You can now literally clone your voice in the Grok API and use it instantly for voice-powered services Build your own assistant and customer support that takes your calls and runs your business with your voice It’s incredibly easy to set up and takes less than 4 mins to train your voice Just select "Clone a Voice" and read the prompt exactly as shown For the best results, record in a quiet room so Grok can capture your voice as clearly as possible You can also choose from an amazing built-in voice library, with support for 20+ languages and multiple expressive voice options

X Freeze

79,165 Aufrufe • vor 4 Monaten

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.
1:41

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.

Rowan Cheung

55,915 Aufrufe • vor 3 Jahren

A complete character isn't just how they look. It's also about how they sound. Introducing Characters with Voices - clone your own voice, design one from a text description, or choose from the library. Attach it to your character once, and it follows them across every workflow. Characters with Voices is live on OpenArt. 🎤
0:25

A complete character isn't just how they look. It's also about how they sound. Introducing Characters with Voices - clone your own voice, design one from a text description, or choose from the library. Attach it to your character once, and it follows them across every workflow. Characters with Voices is live on OpenArt. 🎤

OpenArt

3,394,360 Aufrufe • vor 3 Monaten

Introducing Multilingual Voices We partnered with Baklavastory, our neighbor in the Mission, to show what it sounds like when a business's character and warmth stay consistent, no matter who calls or what language they speak. It's easy to translate speech, but much harder to preserve a single identity across languages. Every language has different rhythms, tones, and emphasis. When you change the language, identity tends to get lost in that shift, and your voice ends up sounding like someone else. With Multilingual Voices, pick a voice and keep one brand identity in every market you serve:
1:32

Introducing Multilingual Voices We partnered with Baklavastory, our neighbor in the Mission, to show what it sounds like when a business's character and warmth stay consistent, no matter who calls or what language they speak. It's easy to translate speech, but much harder to preserve a single identity across languages. Every language has different rhythms, tones, and emphasis. When you change the language, identity tends to get lost in that shift, and your voice ends up sounding like someone else. With Multilingual Voices, pick a voice and keep one brand identity in every market you serve:

Karan Goel

5,396,266 Aufrufe • vor 5 Tagen

You can now create a REAL-TIME chatbot with any voice and customize its personality. Steps: 1. Go to ElevenLabs 2. Click on voices 3. you can type in a name for the voice 4. then you can drag in an audio file to use for your voice 5. then go to the agents tab in side panel 6. and create a new agent 7. the voice 8. Create system instructions 9. Optional (Upload knowledge docs) 10. Test This can be easily implemented into your applications. I'll make a tutorial on that soon.
1:24

You can now create a REAL-TIME chatbot with any voice and customize its personality. Steps: 1. Go to ElevenLabs 2. Click on voices 3. you can type in a name for the voice 4. then you can drag in an audio file to use for your voice 5. then go to the agents tab in side panel 6. and create a new agent 7. the voice 8. Create system instructions 9. Optional (Upload knowledge docs) 10. Test This can be easily implemented into your applications. I'll make a tutorial on that soon.

Riley Brown

40,108 Aufrufe • vor 1 Jahr

Introducing Soniox TTS v2, our most powerful text-to-speech model yet. Soniox TTS v2 brings extraordinary voice quality, expressive control through audio tags, exceptional precision, high-fidelity voice cloning, more than 60 languages, natural language mixing, and low-latency streaming together in one model. Built from the ground up with a new model architecture, audio codec, and highly optimized inference engine, Soniox TTS v2 delivers frontier TTS at just $0.70 per generated hour. Available globally today as tts-rt-v2. Try it out: Turn the sound on and hear what’s possible. 🔊
2:13

Introducing Soniox TTS v2, our most powerful text-to-speech model yet. Soniox TTS v2 brings extraordinary voice quality, expressive control through audio tags, exceptional precision, high-fidelity voice cloning, more than 60 languages, natural language mixing, and low-latency streaming together in one model. Built from the ground up with a new model architecture, audio codec, and highly optimized inference engine, Soniox TTS v2 delivers frontier TTS at just $0.70 per generated hour. Available globally today as tts-rt-v2. Try it out: Turn the sound on and hear what’s possible. 🔊

Soniox

664,741 Aufrufe • vor 1 Monat

Text-to-speech is moving way too fast. Just a few days ago, I tweeted about PersonaPlex-7B, NVIDIA's new open source TTS ( And today, Qwen just open-sourced Qwen3-TTS 🤯 It’s a revolutionary text-to-speech model built for control. Not just about generating speech, but about shaping how it sounds directly from language. You can guide the pace, the tone, and the expressiveness straight from text, without touching audio graphs or hand-tuning parameters. That’s the real shift! What makes Qwen3-TTS stand out is how practical it already is: → voice cloning from just a few seconds of audio → voice creation without any reference sample → support for 10 languages out of the box → end-to-end latency down to ~97ms → works in both streaming and non-streaming setups The models come in two sizes (0.6B and 1.7B), so you can trade off quality and hardware cost depending on your setup. You can work with curated voices, designed voices, or cloned ones, and it integrates cleanly with vLLM for production use. It also ships as a simple Python package you can pip install. If you’re building real-time voice systems, this removes a lot of friction! 100% free and open source. I put the repo in the 🧵↓
0:41

Text-to-speech is moving way too fast. Just a few days ago, I tweeted about PersonaPlex-7B, NVIDIA's new open source TTS ( And today, Qwen just open-sourced Qwen3-TTS 🤯 It’s a revolutionary text-to-speech model built for control. Not just about generating speech, but about shaping how it sounds directly from language. You can guide the pace, the tone, and the expressiveness straight from text, without touching audio graphs or hand-tuning parameters. That’s the real shift! What makes Qwen3-TTS stand out is how practical it already is: → voice cloning from just a few seconds of audio → voice creation without any reference sample → support for 10 languages out of the box → end-to-end latency down to ~97ms → works in both streaming and non-streaming setups The models come in two sizes (0.6B and 1.7B), so you can trade off quality and hardware cost depending on your setup. You can work with curated voices, designed voices, or cloned ones, and it integrates cleanly with vLLM for production use. It also ships as a simple Python package you can pip install. If you’re building real-time voice systems, this removes a lot of friction! 100% free and open source. I put the repo in the 🧵↓

Charly Wargnier

59,144 Aufrufe • vor 8 Monaten

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.
1:33

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.

Sudarshan Kamath

71,298 Aufrufe • vor 6 Monaten

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?
3:29

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

Melvin Vivas

27,722 Aufrufe • vor 1 Jahr

Introducing the Hedra x Voice Your Character Competition! With ElevenLabs’ new Voice Design feature now in Hedra, you can create unique voices from a simple text prompt. Bring your characters to life with voices that truly match their personalities with Hedra and ElevenLabs! Prizes: 🏆 Grand Prize: $2,000 🥈 Runner-Up: $1,000 🥉 Second Place: $600 🎖️ Third Place: $400 How to enter: 1. Create your character's voice with the new Voice Design feature, available in ElevenLabs or directly within Hedra for paid users. 2. Upload that audio to Hedra and create a talking character. 3. Post your video on X with #VoiceYourCharacter and tag Hedra & . 4. Submit here We can’t wait to see—and hear—what you create!
0:43

Introducing the Hedra x Voice Your Character Competition! With ElevenLabs’ new Voice Design feature now in Hedra, you can create unique voices from a simple text prompt. Bring your characters to life with voices that truly match their personalities with Hedra and ElevenLabs! Prizes: 🏆 Grand Prize: $2,000 🥈 Runner-Up: $1,000 🥉 Second Place: $600 🎖️ Third Place: $400 How to enter: 1. Create your character's voice with the new Voice Design feature, available in ElevenLabs or directly within Hedra for paid users. 2. Upload that audio to Hedra and create a talking character. 3. Post your video on X with #VoiceYourCharacter and tag Hedra & . 4. Submit here We can’t wait to see—and hear—what you create!

Hedra

185,456 Aufrufe • vor 1 Jahr

I've just tested the EVI 3 speech-to-speech model by Hume Hume AI, and this is the most realistic voice cloning I’ve heard. It doesn’t just clone the sound of your voice — it captures your tone, your speech patterns, your personality. Feels like your voice is thinking in real time. What’s wild is: — It’s not text-to-speech. It’s speech-to-speech. — You speak → it clones your voice + vibe — And it’s compatible with LLMs like Groq, Anthropic, Deepseek - Try talking to a voice clone: - Want more control? Customize it here: This changes how we’ll interact with AI voices. No more robotic replies — these sound human.
1:09

I've just tested the EVI 3 speech-to-speech model by Hume Hume AI, and this is the most realistic voice cloning I’ve heard. It doesn’t just clone the sound of your voice — it captures your tone, your speech patterns, your personality. Feels like your voice is thinking in real time. What’s wild is: — It’s not text-to-speech. It’s speech-to-speech. — You speak → it clones your voice + vibe — And it’s compatible with LLMs like Groq, Anthropic, Deepseek - Try talking to a voice clone: - Want more control? Customize it here: This changes how we’ll interact with AI voices. No more robotic replies — these sound human.

Aaliya

28,046 Aufrufe • vor 1 Jahr

There will always be two voices competing for your attention: the voice of doubt and the voice of faith. Now you get to choose. Will you let the voice of doubt play? Or will you decide, “God, I will never doubt what You can do in my life.” Be inspired by this message from Joel, "A Never Doubt Mindset".
0:57

There will always be two voices competing for your attention: the voice of doubt and the voice of faith. Now you get to choose. Will you let the voice of doubt play? Or will you decide, “God, I will never doubt what You can do in my life.” Be inspired by this message from Joel, "A Never Doubt Mindset".

Joel Osteen

50,723 Aufrufe • vor 1 Jahr

Typing just became… Typeless. Meet Typeless 1.0.2 for Mac — a tool that transforms your voice into clear, accurate writing across your Mac. Speak naturally and let Typeless handle the typing, corrections, and structure for you. With Typeless, you can dictate, translate, or ask for quick edits in any language or accent. It converts your speech into polished text up to 10× faster than traditional typing, while automatically fixing mistakes along the way. --- 1️⃣ Dictation Typeless acts as a powerful voice keyboard that works across all applications on your Mac. When you speak, it understands your intent, organizes your ideas, and converts your natural speech into well-structured writing. Whether you're drafting emails, notes, documents, or messages, Typeless helps you turn spoken thoughts into clean text instantly. Controls - Press Fn to start or stop dictation - Hold Fn for quick, short dictation --- 2️⃣ Translation Typeless makes writing in other languages effortless. You can speak in your native language and have Typeless translate your words instantly into the language you want. This allows you to communicate, write, and respond in foreign languages smoothly and naturally. Controls - Press Fn + Space to start translation - Press Fn to stop translation --- 3️⃣ Ask Anything Typeless Typeless also lets you interact with your text using voice commands. You can select any text and simply say how you want it changed. Typeless can edit, rewrite, answer questions, or perform quick actions based on your request, making editing and improving text much faster. Controls - Press Fn + Space to start Ask Anything - Press Fn to stop Ask Anything --- With Typeless, your voice becomes the fastest and easiest way to write, edit, and communicate on your Mac. Your voice is now your keyboard. Get Typeless → Available now on Mac, Windows, iOS, and Android. #Typeless
5:30

Typing just became… Typeless. Meet Typeless 1.0.2 for Mac — a tool that transforms your voice into clear, accurate writing across your Mac. Speak naturally and let Typeless handle the typing, corrections, and structure for you. With Typeless, you can dictate, translate, or ask for quick edits in any language or accent. It converts your speech into polished text up to 10× faster than traditional typing, while automatically fixing mistakes along the way. --- 1️⃣ Dictation Typeless acts as a powerful voice keyboard that works across all applications on your Mac. When you speak, it understands your intent, organizes your ideas, and converts your natural speech into well-structured writing. Whether you're drafting emails, notes, documents, or messages, Typeless helps you turn spoken thoughts into clean text instantly. Controls - Press Fn to start or stop dictation - Hold Fn for quick, short dictation --- 2️⃣ Translation Typeless makes writing in other languages effortless. You can speak in your native language and have Typeless translate your words instantly into the language you want. This allows you to communicate, write, and respond in foreign languages smoothly and naturally. Controls - Press Fn + Space to start translation - Press Fn to stop translation --- 3️⃣ Ask Anything Typeless Typeless also lets you interact with your text using voice commands. You can select any text and simply say how you want it changed. Typeless can edit, rewrite, answer questions, or perform quick actions based on your request, making editing and improving text much faster. Controls - Press Fn + Space to start Ask Anything - Press Fn to stop Ask Anything --- With Typeless, your voice becomes the fastest and easiest way to write, edit, and communicate on your Mac. Your voice is now your keyboard. Get Typeless → Available now on Mac, Windows, iOS, and Android. #Typeless

Kuria Chronicles

43,623 Aufrufe • vor 6 Monaten

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:
2:41

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:

Andrew Ng

87,868 Aufrufe • vor 1 Jahr

Introducing Indic Parler-TTS: Open-Source Text-to-Speech for Over a Billion Indic Speakers! 🌏 In collaboration with Hugging Face, we are excited to release Indic Parler-TTS, a state-of-the-art open-source text-to-speech system designed to bring accessible and high-quality speech technology to India’s diverse linguistic community. Supporting 20 of the 22 scheduled Indian languages—and English in various accents (US, British, Indian)—it’s built to serve over a billion speakers and empower companies, developers, researchers, and communities. Why Indic Parler-TTS Stands Out: 1. Open and Accessible: Fully open-source with permissive licensing for unrestricted usage. 2. Wide Language Support: Includes a vast range of Indic languages, with rich diversity in voices. 3. High-Quality Audio: Produces natural, clear, and lifelike speech. 4. Adaptable and Fine-Tunable: Customize it to new languages, accents, or specific applications. 5. State-of-the-Art Performance: Proven through rigorous evaluation. 6. Versatile and Inclusive: Indic Parler-TTS offers 69 unique voices across 18 Indian languages, making it a perfect fit for diverse use cases like audiobooks, virtual assistants, and educational tools. Let's democratize speech technology together and make speech technology more inclusive and accessible for everyone. ▶️ Experience it now: Demo: Model page:
1:06

Introducing Indic Parler-TTS: Open-Source Text-to-Speech for Over a Billion Indic Speakers! 🌏 In collaboration with Hugging Face, we are excited to release Indic Parler-TTS, a state-of-the-art open-source text-to-speech system designed to bring accessible and high-quality speech technology to India’s diverse linguistic community. Supporting 20 of the 22 scheduled Indian languages—and English in various accents (US, British, Indian)—it’s built to serve over a billion speakers and empower companies, developers, researchers, and communities. Why Indic Parler-TTS Stands Out: 1. Open and Accessible: Fully open-source with permissive licensing for unrestricted usage. 2. Wide Language Support: Includes a vast range of Indic languages, with rich diversity in voices. 3. High-Quality Audio: Produces natural, clear, and lifelike speech. 4. Adaptable and Fine-Tunable: Customize it to new languages, accents, or specific applications. 5. State-of-the-Art Performance: Proven through rigorous evaluation. 6. Versatile and Inclusive: Indic Parler-TTS offers 69 unique voices across 18 Indian languages, making it a perfect fit for diverse use cases like audiobooks, virtual assistants, and educational tools. Let's democratize speech technology together and make speech technology more inclusive and accessible for everyone. ▶️ Experience it now: Demo: Model page:

AI4Bharat

28,681 Aufrufe • vor 1 Jahr

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison @matiii ElevenLabs
1:09

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison @matiii ElevenLabs

Stripe

18,605 Aufrufe • vor 5 Monaten

Today, we’re making Sarvam Content Studio available to everyone. Content Studio brings everything you need to create, edit and transform voice and video content across languages into one workspace. You can turn a script into natural speech, clone a voice from a short recording, or dub a video into multiple languages while preserving the original speaker’s voice, tone and rhythm. You also have far more control over what happens after generation, with the ability to review every line, create subtitles, make precise edits and keep each version consistent before it goes out. We built Content Studio to help teams create content and effortlessly transform it for wider audiences, languages, and formats. Start creating:
1:27

Today, we’re making Sarvam Content Studio available to everyone. Content Studio brings everything you need to create, edit and transform voice and video content across languages into one workspace. You can turn a script into natural speech, clone a voice from a short recording, or dub a video into multiple languages while preserving the original speaker’s voice, tone and rhythm. You also have far more control over what happens after generation, with the ability to review every line, create subtitles, make precise edits and keep each version consistent before it goes out. We built Content Studio to help teams create content and effortlessly transform it for wider audiences, languages, and formats. Start creating:

Sarvam

43,809 Aufrufe • vor 25 Tagen

New course: Add voice to your AI agents and applications, built with Vocal Bridge (disclosure: an AI Fund portfolio company) and taught by its CEO Ashwyn Sharma. Voice applications historically required making a hard tradeoff: using fast voice-to-voice models that sacrifice reliability, or accurate speech-to-text pipelines that add latency. This course teaches you how to build voice agents that are both reliable and fast. You'll build three types of voice-enabled applications: a voice-interactive game where voice commands and mouse clicks work together over a single channel, an agent that gains a voice in about 10 lines of code without touching its prompts or tools, and an agent that places outbound phone calls using a make_phone_call function. Skills you'll gain: - Add a voice layer to an existing agent without rewriting your prompts, RAG pipeline, or tools - Give an agent the ability to place outbound calls and stream transcripts back live - Set up voice evaluation to score calls, catch regressions, and improve quality before deployment Join and add voice to your agents without overhauling your architecture:
2:27

New course: Add voice to your AI agents and applications, built with Vocal Bridge (disclosure: an AI Fund portfolio company) and taught by its CEO Ashwyn Sharma. Voice applications historically required making a hard tradeoff: using fast voice-to-voice models that sacrifice reliability, or accurate speech-to-text pipelines that add latency. This course teaches you how to build voice agents that are both reliable and fast. You'll build three types of voice-enabled applications: a voice-interactive game where voice commands and mouse clicks work together over a single channel, an agent that gains a voice in about 10 lines of code without touching its prompts or tools, and an agent that places outbound phone calls using a make_phone_call function. Skills you'll gain: - Add a voice layer to an existing agent without rewriting your prompts, RAG pipeline, or tools - Give an agent the ability to place outbound calls and stream transcripts back live - Set up voice evaluation to score calls, catch regressions, and improve quality before deployment Join and add voice to your agents without overhauling your architecture:

Andrew Ng

96,370 Aufrufe • vor 3 Monaten