Loading video...

Video Failed to Load

Go Home

.Vogent just released Vogent-Turn-80M: an open-source, state-of-the-art turn-detection model for voice AI. It improves any voice AI stack by detecting when to wait and when to speak, reducing interruptions and making conversations more humanlike.

ycombinator's profile picture

Y Combinator

1,600,701 subscribers

18,913 views • 9 months ago •via X (Twitter)

Health & WellnessScience & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Today we’re launching our first homegrown AI model: an open source turn detection model for building voice agents. Instead of relying solely on voice activity detection (VAD), which only considers when a user is speaking, our model also considers what has and is being said in the context of a conversation and predicts when a user is finished expressing their thoughts before the agent responds. Conversations with AI voice agents using this new model flow much more naturally without constant interruptions from the AI— check it out (more videos, details, and code in the thread):
2:36

Today we’re launching our first homegrown AI model: an open source turn detection model for building voice agents. Instead of relying solely on voice activity detection (VAD), which only considers when a user is speaking, our model also considers what has and is being said in the context of a conversation and predicts when a user is finished expressing their thoughts before the agent responds. Conversations with AI voice agents using this new model flow much more naturally without constant interruptions from the AI— check it out (more videos, details, and code in the thread):

LiveKit

126,860 views • 1 year ago

Vogent (Vogent) just launched extremely realistic voice agents. They rebuilt Sesame's CSM-1B model to produce ultra-humanlike voice in real time. Listen or call their AI Trump agent at 510-315-0014. Congrats on the launch, Jagath Vytheeswaran + Vignesh Varadarajan!
0:38

Vogent (Vogent) just launched extremely realistic voice agents. They rebuilt Sesame's CSM-1B model to produce ultra-humanlike voice in real time. Listen or call their AI Trump agent at 510-315-0014. Congrats on the launch, Jagath Vytheeswaran + Vignesh Varadarajan!

Y Combinator

45,803 views • 1 year ago

Smart Turn v2: open source, native audio turn detection in 14 languages. New checkpoint of the open source, open data, open training code, semantic VAD model on Hugging Face, fal, and Pipecat AI. - 3x faster inference (12ms on an L40) - 14 languages (13 more than v1, which was english-only) - New synthetic data set `chirp_3_all` with ~163k audio samples - 99% accuracy on held out `human_5_all` test data Good turn detection is critical for voice agents. This model "understands" both semantic and audio patterns, and mitigates the voice AI trade-off between unwanted turn latency vs the agent interrupting people before they are finished speaking. Training scripts for both Modal and local training are in the repo. We want to make it as easy as possible to contribute to or customize this model! Here's a demo running the smart-turn model with default settings, aimed at generally hitting 400ms total turn detection time. You can tune things to be faster, too. You can help by contributing data, doing architecture expermints, or cleaning open source data! Keep reading ...
2:12

Smart Turn v2: open source, native audio turn detection in 14 languages. New checkpoint of the open source, open data, open training code, semantic VAD model on Hugging Face, fal, and Pipecat AI. - 3x faster inference (12ms on an L40) - 14 languages (13 more than v1, which was english-only) - New synthetic data set `chirp_3_all` with ~163k audio samples - 99% accuracy on held out `human_5_all` test data Good turn detection is critical for voice agents. This model "understands" both semantic and audio patterns, and mitigates the voice AI trade-off between unwanted turn latency vs the agent interrupting people before they are finished speaking. Training scripts for both Modal and local training are in the repo. We want to make it as easy as possible to contribute to or customize this model! Here's a demo running the smart-turn model with default settings, aimed at generally hitting 400ms total turn detection time. You can tune things to be faster, too. You can help by contributing data, doing architecture expermints, or cleaning open source data! Keep reading ...

kwindla

42,246 views • 1 year ago

Voice AI without the wait! ⏱️ Thanks to Hugging Face and Cerebras, developers can now use the Gemma 4 31B model as the brain for voice AI at ultra-fast inference speeds. Add it to a fully open-source, cascaded speech-to-speech stack that can be used to power existing voice apps! 🗣️
1:46

Voice AI without the wait! ⏱️ Thanks to Hugging Face and Cerebras, developers can now use the Gemma 4 31B model as the brain for voice AI at ultra-fast inference speeds. Add it to a fully open-source, cascaded speech-to-speech stack that can be used to power existing voice apps! 🗣️

Google Gemma

156,539 views • 5 days ago

🚨 BREAKING: NVIDIA just removed the biggest friction point in Voice AI They open-sourced PersonaPlex 7B, a real-time conversational model. It listens and speaks simultaneously to handle natural interruptions and overlaps. 100% Open Source.
0:43

🚨 BREAKING: NVIDIA just removed the biggest friction point in Voice AI They open-sourced PersonaPlex 7B, a real-time conversational model. It listens and speaks simultaneously to handle natural interruptions and overlaps. 100% Open Source.

How To Prompt

702,251 views • 3 months ago

.Vogent Voicelab is a high-performance API to run top open-source voice models, like Sesame CSM-1B, Dia, and more. Voicelab optimizes inference for each model so you can run them quickly and scalably— and they post-train select models to improve performance and reliability.
1:45

.Vogent Voicelab is a high-performance API to run top open-source voice models, like Sesame CSM-1B, Dia, and more. Voicelab optimizes inference for each model so you can run them quickly and scalably— and they post-train select models to improve performance and reliability.

Y Combinator

55,257 views • 1 year ago

Today, we're introducing PlayHT2.0 - our new Conversational Text-to-Voice AI Model that's trained and built to generate humanlike conversations across languages with <1s latency. Sign up for beta access -
1:19

Today, we're introducing PlayHT2.0 - our new Conversational Text-to-Voice AI Model that's trained and built to generate humanlike conversations across languages with <1s latency. Sign up for beta access -

PlayAI

52,378 views • 3 years ago

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.
1:24

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.

Michael Yuan

14,983 views • 1 year ago

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.
2:02

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.

PlayAI

105,638 views • 2 years ago

Thrilled to see Amazon Web Services making a major contribution to the open source AI community with the launch of the Strands Agents, an open source AI agents SDK! The core of Strands is the simple agentic loop that connects the model and tools together, like the two strands of DNA. This model-driven approach to agent building eliminates the need for complex agent orchestration by embracing the capabilities of state-of-the-art models to plan, chain thoughts, call tools, and reflect. Providing open source tools and interoperability with open source protocols is an important part of our strategy to enable an agentic future. Can't wait to see what you build with Strands!
1:33

Thrilled to see Amazon Web Services making a major contribution to the open source AI community with the launch of the Strands Agents, an open source AI agents SDK! The core of Strands is the simple agentic loop that connects the model and tools together, like the two strands of DNA. This model-driven approach to agent building eliminates the need for complex agent orchestration by embracing the capabilities of state-of-the-art models to plan, chain thoughts, call tools, and reflect. Providing open source tools and interoperability with open source protocols is an important part of our strategy to enable an agentic future. Can't wait to see what you build with Strands!

Swami Sivasubramanian

32,185 views • 1 year ago

What will you build with Vision Agents? Out-of-the-box support for: - Turn detection - Speech-to-text + text-to-speech - Voice activity detection - MCP & function-calling support Open-source. Video-first. Ready to build.
0:30

What will you build with Vision Agents? Out-of-the-box support for: - Turn detection - Speech-to-text + text-to-speech - Voice activity detection - MCP & function-calling support Open-source. Video-first. Ready to build.

Stream

226,723 views • 6 months ago

Clone any voice. Keep it local. Voice Clone Lab turns 5–15 minutes of audio into a voice model on your own GPU, cleanup, transcription, fine-tuning, and generation included. Open source: github/tetsuo-ai/voice_clone_lab
0:48

Clone any voice. Keep it local. Voice Clone Lab turns 5–15 minutes of audio into a voice model on your own GPU, cleanup, transcription, fine-tuning, and generation included. Open source: github/tetsuo-ai/voice_clone_lab

tetsuo

63,241 views • 7 days ago

NVIDIA just removed the biggest friction point in Voice AI 🤯 They've open-sourced PersonaPlex-7B, a full-duplex conversational model that can listen and speak at the same time. Instead of waiting for you to finish talking, it uses a dual-stream architecture to process and respond in real-time. 100% Open-Source and Free.
0:42

NVIDIA just removed the biggest friction point in Voice AI 🤯 They've open-sourced PersonaPlex-7B, a full-duplex conversational model that can listen and speak at the same time. Instead of waiting for you to finish talking, it uses a dual-stream architecture to process and respond in real-time. 100% Open-Source and Free.

Simplifying AI

278,796 views • 6 months ago

Play AI by vibx (YC W23) is a new platform for creating human-like voice agents. It makes speech generation contextual and handles turn-taking, interruption, voice energy, and emotion modulation for natural, fluid, human conversations in real-time.
2:02

Play AI by vibx (YC W23) is a new platform for creating human-like voice agents. It makes speech generation contextual and handles turn-taking, interruption, voice energy, and emotion modulation for natural, fluid, human conversations in real-time.

Y Combinator

21,285 views • 2 years ago

ElevenLabs just lost the crown - to open source. Chatterbox by Resemble AI (I remember writing about this team back in 2022 as a pioneer of AI audio) just released as an open-source alternative for audio generation and voice cloning. - Zero-shot voice cloning from just 5 seconds of audio - Unique emotion intensity control—from subtle to dramatically expressive - Real-time voice synthesis faster than real-time inference - Built-in watermarking for secure, trusted audio - Consistently preferred over ElevenLabs in blind evaluations Fully open-source. No hidden restrictions. This is the way. Check out the demo:
0:26

ElevenLabs just lost the crown - to open source. Chatterbox by Resemble AI (I remember writing about this team back in 2022 as a pioneer of AI audio) just released as an open-source alternative for audio generation and voice cloning. - Zero-shot voice cloning from just 5 seconds of audio - Unique emotion intensity control—from subtle to dramatically expressive - Real-time voice synthesis faster than real-time inference - Built-in watermarking for secure, trusted audio - Consistently preferred over ElevenLabs in blind evaluations Fully open-source. No hidden restrictions. This is the way. Check out the demo:

AI Breakfast

454,132 views • 1 year ago

🚨 BREAKING: ElevenLabs just launched Conversational AI 2.0 AI voice agents can now understand when to pause, speak, and take turns just like a real person. Here’s what’s new (and why it matters):
1:37

🚨 BREAKING: ElevenLabs just launched Conversational AI 2.0 AI voice agents can now understand when to pause, speak, and take turns just like a real person. Here’s what’s new (and why it matters):

Brendan Jowett

290,969 views • 1 year ago

Ever suspected a paper you’re reading is AI slop? You can now turn on AI detection mode on alphaXiv to visualize what is written by an AI and what is not. Now available for every research paper indexed on arXiv. Integrated with the latest detection model from 🚀
0:20

Ever suspected a paper you’re reading is AI slop? You can now turn on AI detection mode on alphaXiv to visualize what is written by an AI and what is not. Now available for every research paper indexed on arXiv. Integrated with the latest detection model from 🚀

alphaXiv

97,632 views • 3 months ago

Imagine a world where your voice is the universal interface. No screens, no buttons, just seamless, human-like conversations. This is the future we're creating at PlayAI. Today, we are announcing our latest foundational voice model, Play Dialog, a multi-turn conversational voice model trained to converse like humans. And a $21m seed funding to fuel our research and product development efforts. Join us in building the future of conversational voice ai.
1:35

Imagine a world where your voice is the universal interface. No screens, no buttons, just seamless, human-like conversations. This is the future we're creating at PlayAI. Today, we are announcing our latest foundational voice model, Play Dialog, a multi-turn conversational voice model trained to converse like humans. And a $21m seed funding to fuel our research and product development efforts. Join us in building the future of conversational voice ai.

PlayAI

46,742 views • 1 year ago

Turn any world model from World Labs into a multi-user space for exploration and collaboration with FRAME. Voice chat, embodied AI agents, and tons more you can layer on top of the model foundation. This took all of 10 seconds to get going. The metaverse is so back. 😄
1:10

Turn any world model from World Labs into a multi-user space for exploration and collaboration with FRAME. Voice chat, embodied AI agents, and tons more you can layer on top of the model foundation. This took all of 10 seconds to get going. The metaverse is so back. 😄

Gabriel Baker

21,608 views • 10 months ago