Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

I taught a speech model to understand context in conversation. This is what happened It adjusts voice and tone to express urgency, comfort, understanding from the dialogue. Just like a real human being 520M model. Runs locally on consumer devices How this is achieved 🧵

Luozhu

8,039 subscribers

21,871 views • 5 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Excited about the launch of Amazon Nova Sonic, our new speech-to-speech model that helps make AI voice applications feel remarkably natural. It's designed to understand not just what people say, but how they say it – working with tone, style, and conversation flow including pauses and interruptions. Nova Sonic delivers speech understanding and generation through a single, unified model, making it easier for builders to develop voice applications that maintain important context and nuance for customer service, AI agents, and other use cases across industries. It’s available in Amazon Bedrock now. Look forward to seeing what teams build with Nova Sonic!

Excited about the launch of Amazon Nova Sonic, our new speech-to-speech model that helps make AI voice applications feel remarkably natural. It's designed to understand not just what people say, but how they say it – working with tone, style, and conversation flow including pauses and interruptions. Nova Sonic delivers speech understanding and generation through a single, unified model, making it easier for builders to develop voice applications that maintain important context and nuance for customer service, AI agents, and other use cases across industries. It’s available in Amazon Bedrock now. Look forward to seeing what teams build with Nova Sonic!

Andy Jassy

155,772 views • 1 year ago

This is insane. AI voice or real human? literally can’t tell the difference. OpenAudio S1 just dropped, this next-gen AI voice model, it nails emotions, accents, and dialogue like never before This is wild in audio, like Google Veo 3 in video. Donald J. Trump is in full fire mode on Elon

This is insane. AI voice or real human? literally can’t tell the difference. OpenAudio S1 just dropped, this next-gen AI voice model, it nails emotions, accents, and dialogue like never before This is wild in audio, like Google Veo 3 in video. Donald J. Trump is in full fire mode on Elon

Kaynat Kakar ✪

21,627 views • 1 year ago

This is the most realistic voice cloning I’ve seen. It doesn’t just copy the voice — it captures tone, rhythm, and emotion. Built with Hume’s EVI 3 speech-to-speech model and it even works with external LLMs like Groq, Anthropic, and DeepSeek. Just listen to this Ricky Gervais voice clone — same voice, same feeling 🎧 Try talking to the clone yourself →

This is the most realistic voice cloning I’ve seen. It doesn’t just copy the voice — it captures tone, rhythm, and emotion. Built with Hume’s EVI 3 speech-to-speech model and it even works with external LLMs like Groq, Anthropic, and DeepSeek. Just listen to this Ricky Gervais voice clone — same voice, same feeling 🎧 Try talking to the clone yourself →

Arsalan

26,923 views • 1 year ago

Today, we’re proud to unveil a pioneering partnership with @Groq. Our Dialog voice model now runs on GroqCloud. This isn't just an upgrade; this is a leap forward that redefines what voice technology can be—fast, powerful, and beautifully human.

Today, we’re proud to unveil a pioneering partnership with @Groq. Our Dialog voice model now runs on GroqCloud. This isn't just an upgrade; this is a leap forward that redefines what voice technology can be—fast, powerful, and beautifully human.

PlayAI

155,989 views • 1 year ago

Introducing Voxtral WebGPU: Real-time speech transcription entirely in your browser. This demo runs Voxtral-Mini-4B, a powerful streaming ASR model from Mistral AI, locally on WebGPU. The model supports 13 languages and is capable of <500 ms latency. Fully private. Zero cost.

Introducing Voxtral WebGPU: Real-time speech transcription entirely in your browser. This demo runs Voxtral-Mini-4B, a powerful streaming ASR model from Mistral AI, locally on WebGPU. The model supports 13 languages and is capable of <500 ms latency. Fully private. Zero cost.

Xenova

94,356 views • 4 months ago

Qoder just launched Qwen-Coder-Qoder a custom model fine-tuned specifically for its agent. This is what the "Model-Agent-Product" loop looks like in practice. I gave it a real coding task and walked away. Here's what happened: 👇

Qoder just launched Qwen-Coder-Qoder a custom model fine-tuned specifically for its agent. This is what the "Model-Agent-Product" loop looks like in practice. I gave it a real coding task and walked away. Here's what happened: 👇

Hasan Toor

83,848 views • 5 months ago

Today, we’re excited to introduce Miso One, the most emotive voice model in the world. Miso One is an 8-billion-parameter text-to-speech model for highly expressive speech generation. It emotes like a human and responds faster than a human, with just 110 milliseconds of latency. We’ve open-sourced the model weights, with API access coming soon. Hear how Miso One sounds in the thread below.

Today, we’re excited to introduce Miso One, the most emotive voice model in the world. Miso One is an 8-billion-parameter text-to-speech model for highly expressive speech generation. It emotes like a human and responds faster than a human, with just 110 milliseconds of latency. We’ve open-sourced the model weights, with API access coming soon. Hear how Miso One sounds in the thread below.

Aoden Teo

5,187,554 views • 2 months ago

Meet EVI 3, another step toward general voice intelligence. EVI 3 is a speech-language model that can understand and generate any human voice, not just a handful of speakers. With this broader voice intelligence comes greater expressiveness and a deeper understanding of tune, rhythm, timbre, and speaking style.

Meet EVI 3, another step toward general voice intelligence. EVI 3 is a speech-language model that can understand and generate any human voice, not just a handful of speakers. With this broader voice intelligence comes greater expressiveness and a deeper understanding of tune, rhythm, timbre, and speaking style.

Hume AI

832,639 views • 1 year ago

This is the most realistic voice cloning I’ve seen. It doesn’t just sound like your voice—It copies the way you speak: tone, emotion, pacing, and style. All from just 15–20 seconds of audio. Here’s what happened 🧵

This is the most realistic voice cloning I’ve seen. It doesn’t just sound like your voice—It copies the way you speak: tone, emotion, pacing, and style. All from just 15–20 seconds of audio. Here’s what happened 🧵

Chidanand Tripathi

94,742 views • 1 year ago

The AI crowd keeps worshipping giant models. Meanwhile, MiniCPM-5 1B is trying to make them look bloated. A 1B open-source model that runs locally, on CPUs, edge devices, and even browsers. Tiny model. Real deployment. No GPU cult required.

The AI crowd keeps worshipping giant models. Meanwhile, MiniCPM-5 1B is trying to make them look bloated. A 1B open-source model that runs locally, on CPUs, edge devices, and even browsers. Tiny model. Real deployment. No GPU cult required.

Alex Prompter

24,699 views • 2 months ago

This is the best way to understand how ML models actually work! Use Drawdata to draw a 2D dataset in Jupyter. Use it to actively pick data from the widget and update the model as the data is being drawn! Fully interactive, real-time, and open-source!

This is the best way to understand how ML models actually work! Use Drawdata to draw a 2D dataset in Jupyter. Use it to actively pick data from the widget and update the model as the data is being drawn! Fully interactive, real-time, and open-source!

Daily Dose of Data Science

52,103 views • 9 months ago

Today we’re launching our first homegrown AI model: an open source turn detection model for building voice agents. Instead of relying solely on voice activity detection (VAD), which only considers when a user is speaking, our model also considers what has and is being said in the context of a conversation and predicts when a user is finished expressing their thoughts before the agent responds. Conversations with AI voice agents using this new model flow much more naturally without constant interruptions from the AI— check it out (more videos, details, and code in the thread):

Today we’re launching our first homegrown AI model: an open source turn detection model for building voice agents. Instead of relying solely on voice activity detection (VAD), which only considers when a user is speaking, our model also considers what has and is being said in the context of a conversation and predicts when a user is finished expressing their thoughts before the agent responds. Conversations with AI voice agents using this new model flow much more naturally without constant interruptions from the AI— check it out (more videos, details, and code in the thread):

LiveKit

126,898 views • 1 year ago

This is the most realistic Voice CLONING I’ve ever heard⚠️ It is not just the sound — it mimics rhythm, tone, and even how someone speaks. And it’s speech-to-speech—no text in between.

This is the most realistic Voice CLONING I’ve ever heard⚠️ It is not just the sound — it mimics rhythm, tone, and even how someone speaks. And it’s speech-to-speech—no text in between.

Dipti Sharma

41,193 views • 1 year ago

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

kwindla

55,222 views • 2 months ago

ok this is insane.. i made an AI avatar SING a ballade with real emotion… and it actually looked like a scene from The Voice. this is the new AvatarX model and it’s scary good. tutorial + examples: ↓

The SamurAI

32,277 views • 11 months ago

This is the most realistic voice cloning I’ve ever heard. It captures voice, emotion, speaking style, and even your rhythm. Powered by EVI 3, Hume’s next-gen speech-to-speech model that: ➔ Streams your speech → replies in real-time ➔ Understands tone and context ➔ Adapts emotion on cue (“whisper fearfully,” “sound excited”) Try it now: 🔗 (live demo, no prompt edits) 🔗 (customize voices, integrate with LLMs) You can even integrate it with top AI models like Groq, Anthropic, and DeepSeek 👇 Talk to the voice I cloned here:

This is the most realistic voice cloning I’ve ever heard. It captures voice, emotion, speaking style, and even your rhythm. Powered by EVI 3, Hume’s next-gen speech-to-speech model that: ➔ Streams your speech → replies in real-time ➔ Understands tone and context ➔ Adapts emotion on cue (“whisper fearfully,” “sound excited”) Try it now: 🔗 (live demo, no prompt edits) 🔗 (customize voices, integrate with LLMs) You can even integrate it with top AI models like Groq, Anthropic, and DeepSeek 👇 Talk to the voice I cloned here:

Ali Sufian

15,063 views • 1 year ago

Sam Altman on GPT 5: "This morning I was testing our new model and I got a question. I got emailed a question that I didn't quite understand. And I put it in the model, this is GPT-5, and it answered it perfectly. And I really kind of sat back in my chair and I was just like, oh man, here it is moment... I felt like useless relative to the AI in this thing that I felt like I should have been able to do and I couldn't. It was really hard. But the AI just did it like that. It was a weird feeling."

Sam Altman on GPT 5: "This morning I was testing our new model and I got a question. I got emailed a question that I didn't quite understand. And I put it in the model, this is GPT-5, and it answered it perfectly. And I really kind of sat back in my chair and I was just like, oh man, here it is moment... I felt like useless relative to the AI in this thing that I felt like I should have been able to do and I couldn't. It was really hard. But the AI just did it like that. It was a weird feeling."

Chris

5,664,833 views • 1 year ago

Here you see the cloud + on-device split very cleanly. Doubao handles the semantics: from a single hotel entrance photo it figures out which hotel this is, that I want to book tonight, and that it will need to check the hotel’s pet policy. Then ZTE’s 7B Nebula-GUI model (a vision model trained to understand screens) running locally on the Snapdragon 8 Elite drives the UI like a human: it picks Ctrip app, opens it, fills in dates, finds cheapest rate, reads the hotel policy on pets, and informs me I can bring a dog.

Here you see the cloud + on-device split very cleanly. Doubao handles the semantics: from a single hotel entrance photo it figures out which hotel this is, that I want to book tonight, and that it will need to check the hotel’s pet policy. Then ZTE’s 7B Nebula-GUI model (a vision model trained to understand screens) running locally on the Snapdragon 8 Elite drives the UI like a human: it picks Ctrip app, opens it, fills in dates, finds cheapest rate, reads the hotel policy on pets, and informs me I can bring a dog.

Taylor Ogan

41,355 views • 8 months ago

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.

PlayAI

105,638 views • 2 years ago

The world's first audio-native AI model is now available as an API. Velma listens and understands like a human — emotions, tone, intent, rhythm, vocal stress. Already analyzed 550M+ hours of conversation for Fortune 500s. Now open to developers. 🧵

The world's first audio-native AI model is now available as an API. Velma listens and understands like a human — emotions, tone, intent, rhythm, vocal stress. Already analyzed 550M+ hours of conversation for Fortune 500s. Now open to developers. 🧵

Modulate

7,404,518 views • 2 months ago