Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Amazon introduced a new speech-to-speech voice model called Nova Sonic. "Nova Sonic even understands the nuances of human conversation, including the speaker’s natural pauses and hesitations, waiting to speak until the appropriate time, and gracefully handling barge-ins."

TestingCatalog News 🗞

26,528 subscribers

48,395 views • 1 year ago •via X (Twitter)

News & Politics Education Science & Technology

Anya Rossi• Live Now

Private livecam show

8 Comments

Anton P. 🇮🇹1 year ago

Sounds natural? Yes, for 2024 😅

Eddie1 year ago

Wow, 🤯

Karl Mehta1 year ago

Handling pauses, turn-taking, and barge-ins gracefully is crucial for truly natural voice AI interactions!

Bughunter Nerd 🌎🌍🌏☮️❤️1 year ago

Super impressive! I love the current AI state! We are witnessing incredible jumps in intelligence in the newer models from all the serious AI labs.

Yashjit1 year ago

Amazon AI flopped

ブラックホル1 year ago

Sooooo Alexa with AI & different voice?

Sam Bischof1 year ago

Meanwhile, Alexa is still the most retarded voice assistant device on the market.

TH_DA1 year ago

that video does not showcase anything new or interesting.

Related Videos

Natural speech? AI's got it down. 💻🎯 With Amazon Nova Sonic, a state-of-the-art speech-to-speech foundation model, you can transform customer interactions & virtual assistants with AI that delivers human-like conversations with contextual richness. 👉

Natural speech? AI's got it down. 💻🎯 With Amazon Nova Sonic, a state-of-the-art speech-to-speech foundation model, you can transform customer interactions & virtual assistants with AI that delivers human-like conversations with contextual richness. 👉

Amazon Web Services

14,038 views • 1 year ago

Meet Hibiki, our simultaneous speech-to-speech translation model, currently supporting 🇫🇷➡️🇬🇧. Hibiki produces spoken and text translations of the input speech in real-time, while preserving the speaker’s voice and optimally adapting its pace based on the semantic content of the source speech. Based on objective and human evaluations, Hibiki outperforms previous systems for quality, naturalness and speaker similarity and approaches human interpreters. 🧵

Meet Hibiki, our simultaneous speech-to-speech translation model, currently supporting 🇫🇷➡️🇬🇧. Hibiki produces spoken and text translations of the input speech in real-time, while preserving the speaker’s voice and optimally adapting its pace based on the semantic content of the source speech. Based on objective and human evaluations, Hibiki outperforms previous systems for quality, naturalness and speaker similarity and approaches human interpreters. 🧵

kyutai

167,364 views • 1 year ago

We released Sonic-3.5 and Ink-2, the #1 streaming models for text to speech and speech to text you can use in your voice agents today. New architectures enable new frontiers for speed and quality. We're now the only provider to have #1 models for both speaking and listening.

We released Sonic-3.5 and Ink-2, the #1 streaming models for text to speech and speech to text you can use in your voice agents today. New architectures enable new frontiers for speed and quality. We're now the only provider to have #1 models for both speaking and listening.

Karan Goel

6,984,176 views • 9 days ago

Google just did the unthinkable. They built a voice search model that doesn’t understand words it understands intent. It’s called Speech-to-Retrieval (S2R), and it might mark the death of speech-to-text forever. Here’s how it works (and why it matters way more than it sounds) ↓

Google just did the unthinkable. They built a voice search model that doesn’t understand words it understands intent. It’s called Speech-to-Retrieval (S2R), and it might mark the death of speech-to-text forever. Here’s how it works (and why it matters way more than it sounds) ↓

Chris Laub

745,864 views • 8 months ago

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.

PlayAI

105,616 views • 2 years ago

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.

Rowan Cheung

55,777 views • 2 years ago

How did a tiny, scrappy team build one of the most powerful AI voice models? In a deep dive with Sesame CTO Ankit Kumar and a16z's Anjney Midha, we explore how Sesame is pushing the boundaries of AI conversation, why it open-sourced its speech generation model, and the power of small teams to outdo much larger AI labs on product focus. A part of their secret: a relentless focus on real-time, natural conversations over raw intelligence, and a deep commitment to voice, personality, and user experience. By opening up its speech generation model, Sesame is paving the way for even more breakthroughs in AI-native conversation 👇

How did a tiny, scrappy team build one of the most powerful AI voice models? In a deep dive with Sesame CTO Ankit Kumar and a16z's Anjney Midha, we explore how Sesame is pushing the boundaries of AI conversation, why it open-sourced its speech generation model, and the power of small teams to outdo much larger AI labs on product focus. A part of their secret: a relentless focus on real-time, natural conversations over raw intelligence, and a deep commitment to voice, personality, and user experience. By opening up its speech generation model, Sesame is paving the way for even more breakthroughs in AI-native conversation 👇

a16z

29,880 views • 1 year ago

🚨 New model alert! Dialog by vibx — a leading text-to-speech model — now runs on GroqCloud™. That means natural-sounding speech with ultra-low latency, making real-time voice applications smoother and more responsive. Learn more & build fast — links in the comments!

🚨 New model alert! Dialog by vibx — a leading text-to-speech model — now runs on GroqCloud™. That means natural-sounding speech with ultra-low latency, making real-time voice applications smoother and more responsive. Learn more & build fast — links in the comments!

Groq Inc

47,183 views • 1 year ago

In this demo, we show real-time voice translation between Indian languages. The user can speak in their preferred language, and the system translates and responds in another, preserving both meaning and natural delivery. Speech recognition, translation, and expressive text-to-speech work together seamlessly.

In this demo, we show real-time voice translation between Indian languages. The user can speak in their preferred language, and the system translates and responds in another, preserving both meaning and natural delivery. Speech recognition, translation, and expressive text-to-speech work together seamlessly.

Pratyush Kumar

15,206 views • 4 months ago

Introducing our unified Voice Agent API! ⚡️ Quickly and easily build voice agents that listen, think, and respond in real-time, as naturally as a human can. Powered by the industry's fastest, most performant speech recognition and voice synthesis models to deliver: -Natural-sounding real-time conversations -Revolutionary interruption handling -Choice of open source, closed source, or BYO LLM -Low cost See our drive-thru agent in action, smoothly handling interruptions and complex orders in the noisy streets of SF. Learn how to get access (🧵)

Introducing our unified Voice Agent API! ⚡️ Quickly and easily build voice agents that listen, think, and respond in real-time, as naturally as a human can. Powered by the industry's fastest, most performant speech recognition and voice synthesis models to deliver: -Natural-sounding real-time conversations -Revolutionary interruption handling -Choice of open source, closed source, or BYO LLM -Low cost See our drive-thru agent in action, smoothly handling interruptions and complex orders in the noisy streets of SF. Learn how to get access (🧵)

Deepgram

726,214 views • 1 year ago

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.

AK

290,517 views • 3 years ago

Multilingual voice AI tutor using the new Cartesia Sonic-2 voice model and Google DeepMind Gemini 2.0 Flash native audio understanding ...

Multilingual voice AI tutor using the new Cartesia Sonic-2 voice model and Google DeepMind Gemini 2.0 Flash native audio understanding ...

kwindla

18,793 views • 1 year ago

That's my face - but I never said any of this. 🔊 Sound on. I made my avatar speak every language in this thread, powered by Sonic 3.5, the model that just went #1 in the world for text-to-speech.

Mira

33,874 views • 8 days ago

The majority of my ACTRA Toronto Award acceptance speech for my voice performance in Sonic Prime. Extended YouTube version linked below.

The majority of my ACTRA Toronto Award acceptance speech for my voice performance in Sonic Prime. Extended YouTube version linked below.

Deven Mack - Chaos/Sonic Prime 👨🏿‍🍳🦝🦔🤖🥷🥧

25,457 views • 1 year ago

The new ChatGPT voice mode is starting to roll out to some users in ChatGPT. Listen to the demo below, it's quite impressive. The AI can listen and speak at the same time (bidirectional), making the conversation much more natural!!

The new ChatGPT voice mode is starting to roll out to some users in ChatGPT. Listen to the demo below, it's quite impressive. The AI can listen and speak at the same time (bidirectional), making the conversation much more natural!!

Mark Kretschmann

105,029 views • 2 days ago

⚡ Join the PUBG MOBILE x Sonic the Hedgehog collab from Oct 3 – Oct 30 and have more fun with friends! Players can dash onto the battlegrounds with exclusive items such as - ⚔️ Sonic-themed character sets, including the Sonic Style Set and Tails Style Set and signature weapons like the Sonic Vector and Cube Wispon Machete 🪂 Team Sonic Parachute to ensure a speedy landing plus Stylish Vehicles, such as the Speedster Buggy and Team Sonic Speedboat 👟 Collectible items such as the Power Sneakers Ornament, Sonic Ornament, and Tails Ornament add a layer of style to gameplay Team up and show the world what it means to be Faster Together! 💙 #PUBGMOBILExSonic #Sonic #PUBGMOBILE

⚡ Join the PUBG MOBILE x Sonic the Hedgehog collab from Oct 3 – Oct 30 and have more fun with friends! Players can dash onto the battlegrounds with exclusive items such as - ⚔️ Sonic-themed character sets, including the Sonic Style Set and Tails Style Set and signature weapons like the Sonic Vector and Cube Wispon Machete 🪂 Team Sonic Parachute to ensure a speedy landing plus Stylish Vehicles, such as the Speedster Buggy and Team Sonic Speedboat 👟 Collectible items such as the Power Sneakers Ornament, Sonic Ornament, and Tails Ornament add a layer of style to gameplay Team up and show the world what it means to be Faster Together! 💙 #PUBGMOBILExSonic #Sonic #PUBGMOBILE

PUBG MOBILE

10,995 views • 8 months ago

This is the most realistic voice cloning I’ve ever heard. It captures voice, emotion, speaking style, and even your rhythm. Powered by EVI 3, Hume’s next-gen speech-to-speech model that: ➔ Streams your speech → replies in real-time ➔ Understands tone and context ➔ Adapts emotion on cue (“whisper fearfully,” “sound excited”) Try it now: 🔗 (live demo, no prompt edits) 🔗 (customize voices, integrate with LLMs) You can even integrate it with top AI models like Groq, Anthropic, and DeepSeek 👇 Talk to the voice I cloned here:

This is the most realistic voice cloning I’ve ever heard. It captures voice, emotion, speaking style, and even your rhythm. Powered by EVI 3, Hume’s next-gen speech-to-speech model that: ➔ Streams your speech → replies in real-time ➔ Understands tone and context ➔ Adapts emotion on cue (“whisper fearfully,” “sound excited”) Try it now: 🔗 (live demo, no prompt edits) 🔗 (customize voices, integrate with LLMs) You can even integrate it with top AI models like Groq, Anthropic, and DeepSeek 👇 Talk to the voice I cloned here:

Ali Sufian

15,063 views • 11 months ago

Today, we’re excited to introduce Miso One, the most emotive voice model in the world. Miso One is an 8-billion-parameter text-to-speech model for highly expressive speech generation. It emotes like a human and responds faster than a human, with just 110 milliseconds of latency. We’ve open-sourced the model weights, with API access coming soon. Hear how Miso One sounds in the thread below.

Today, we’re excited to introduce Miso One, the most emotive voice model in the world. Miso One is an 8-billion-parameter text-to-speech model for highly expressive speech generation. It emotes like a human and responds faster than a human, with just 110 milliseconds of latency. We’ve open-sourced the model weights, with API access coming soon. Hear how Miso One sounds in the thread below.

Aoden Teo

5,085,945 views • 21 days ago