Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

.Vogent just released Vogent-Turn-80M: an open-source, state-of-the-art turn-detection model for voice AI. It improves any voice AI stack by detecting when to wait and when to speak, reducing interruptions and making conversations more humanlike.

ycombinator's profile picture

Y Combinator

1,600,701 subscribers

18,913 Aufrufe • vor 8 Monaten •via X (Twitter)

Gesundheit & WellnessWissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Vogent (Vogent) just launched extremely realistic voice agents. They rebuilt Sesame's CSM-1B model to produce ultra-humanlike voice in real time. Listen or call their AI Trump agent at 510-315-0014. Congrats on the launch, Jagath Vytheeswaran + Vignesh Varadarajan!
0:38

Vogent (Vogent) just launched extremely realistic voice agents. They rebuilt Sesame's CSM-1B model to produce ultra-humanlike voice in real time. Listen or call their AI Trump agent at 510-315-0014. Congrats on the launch, Jagath Vytheeswaran + Vignesh Varadarajan!

Y Combinator

44,718 Aufrufe • vor 1 Jahr

Today we’re launching our first homegrown AI model: an open source turn detection model for building voice agents. Instead of relying solely on voice activity detection (VAD), which only considers when a user is speaking, our model also considers what has and is being said in the context of a conversation and predicts when a user is finished expressing their thoughts before the agent responds. Conversations with AI voice agents using this new model flow much more naturally without constant interruptions from the AI— check it out (more videos, details, and code in the thread):
2:36

Today we’re launching our first homegrown AI model: an open source turn detection model for building voice agents. Instead of relying solely on voice activity detection (VAD), which only considers when a user is speaking, our model also considers what has and is being said in the context of a conversation and predicts when a user is finished expressing their thoughts before the agent responds. Conversations with AI voice agents using this new model flow much more naturally without constant interruptions from the AI— check it out (more videos, details, and code in the thread):

LiveKit

126,817 Aufrufe • vor 1 Jahr

Vogent (Vogent) just launched voice AI agents that design and improve themselves, learning from real failure cases and requiring no prompt engineering. Congrats on the launch, Jagath Vytheeswaran and Vignesh Varadarajan!
3:20

Vogent (Vogent) just launched voice AI agents that design and improve themselves, learning from real failure cases and requiring no prompt engineering. Congrats on the launch, Jagath Vytheeswaran and Vignesh Varadarajan!

Y Combinator

106,181 Aufrufe • vor 1 Jahr

YC S21's Vogent is an all-in-one platform for building voice AI agents using intelligent building blocks, including drag-and-drop conversational flow builders, IVR detection models, spelling-optimized voices, custom phone-ready LLMs, and more.
0:49

YC S21's Vogent is an all-in-one platform for building voice AI agents using intelligent building blocks, including drag-and-drop conversational flow builders, IVR detection models, spelling-optimized voices, custom phone-ready LLMs, and more.

Y Combinator

23,713 Aufrufe • vor 1 Jahr

Smart Turn v2: open source, native audio turn detection in 14 languages. New checkpoint of the open source, open data, open training code, semantic VAD model on Hugging Face, fal, and Pipecat AI. - 3x faster inference (12ms on an L40) - 14 languages (13 more than v1, which was english-only) - New synthetic data set `chirp_3_all` with ~163k audio samples - 99% accuracy on held out `human_5_all` test data Good turn detection is critical for voice agents. This model "understands" both semantic and audio patterns, and mitigates the voice AI trade-off between unwanted turn latency vs the agent interrupting people before they are finished speaking. Training scripts for both Modal and local training are in the repo. We want to make it as easy as possible to contribute to or customize this model! Here's a demo running the smart-turn model with default settings, aimed at generally hitting 400ms total turn detection time. You can tune things to be faster, too. You can help by contributing data, doing architecture expermints, or cleaning open source data! Keep reading ...
2:12

Smart Turn v2: open source, native audio turn detection in 14 languages. New checkpoint of the open source, open data, open training code, semantic VAD model on Hugging Face, fal, and Pipecat AI. - 3x faster inference (12ms on an L40) - 14 languages (13 more than v1, which was english-only) - New synthetic data set `chirp_3_all` with ~163k audio samples - 99% accuracy on held out `human_5_all` test data Good turn detection is critical for voice agents. This model "understands" both semantic and audio patterns, and mitigates the voice AI trade-off between unwanted turn latency vs the agent interrupting people before they are finished speaking. Training scripts for both Modal and local training are in the repo. We want to make it as easy as possible to contribute to or customize this model! Here's a demo running the smart-turn model with default settings, aimed at generally hitting 400ms total turn detection time. You can tune things to be faster, too. You can help by contributing data, doing architecture expermints, or cleaning open source data! Keep reading ...

kwindla

42,202 Aufrufe • vor 11 Monaten

🚨 BREAKING: NVIDIA just removed the biggest friction point in Voice AI They open-sourced PersonaPlex 7B, a real-time conversational model. It listens and speaks simultaneously to handle natural interruptions and overlaps. 100% Open Source.
0:43

🚨 BREAKING: NVIDIA just removed the biggest friction point in Voice AI They open-sourced PersonaPlex 7B, a real-time conversational model. It listens and speaks simultaneously to handle natural interruptions and overlaps. 100% Open Source.

How To Prompt

700,008 Aufrufe • vor 2 Monaten

.Vogent Voicelab is a high-performance API to run top open-source voice models, like Sesame CSM-1B, Dia, and more. Voicelab optimizes inference for each model so you can run them quickly and scalably— and they post-train select models to improve performance and reliability.
1:45

.Vogent Voicelab is a high-performance API to run top open-source voice models, like Sesame CSM-1B, Dia, and more. Voicelab optimizes inference for each model so you can run them quickly and scalably— and they post-train select models to improve performance and reliability.

Y Combinator

54,718 Aufrufe • vor 11 Monaten

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.
1:24

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.

Michael Yuan

14,983 Aufrufe • vor 1 Jahr

Drive-thru voice AI that handles interruptions, noise, and natural conversations in Python. Ready? Let's build it ↓
0:59

Drive-thru voice AI that handles interruptions, noise, and natural conversations in Python. Ready? Let's build it ↓

Stream

614,953 Aufrufe • vor 5 Monaten

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.
2:02

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.

PlayAI

105,616 Aufrufe • vor 2 Jahren

Thrilled to see Amazon Web Services making a major contribution to the open source AI community with the launch of the Strands Agents, an open source AI agents SDK! The core of Strands is the simple agentic loop that connects the model and tools together, like the two strands of DNA. This model-driven approach to agent building eliminates the need for complex agent orchestration by embracing the capabilities of state-of-the-art models to plan, chain thoughts, call tools, and reflect. Providing open source tools and interoperability with open source protocols is an important part of our strategy to enable an agentic future. Can't wait to see what you build with Strands!
1:33

Thrilled to see Amazon Web Services making a major contribution to the open source AI community with the launch of the Strands Agents, an open source AI agents SDK! The core of Strands is the simple agentic loop that connects the model and tools together, like the two strands of DNA. This model-driven approach to agent building eliminates the need for complex agent orchestration by embracing the capabilities of state-of-the-art models to plan, chain thoughts, call tools, and reflect. Providing open source tools and interoperability with open source protocols is an important part of our strategy to enable an agentic future. Can't wait to see what you build with Strands!

Swami Sivasubramanian

32,185 Aufrufe • vor 1 Jahr

What will you build with Vision Agents? Out-of-the-box support for: - Turn detection - Speech-to-text + text-to-speech - Voice activity detection - MCP & function-calling support Open-source. Video-first. Ready to build.
0:30

What will you build with Vision Agents? Out-of-the-box support for: - Turn detection - Speech-to-text + text-to-speech - Voice activity detection - MCP & function-calling support Open-source. Video-first. Ready to build.

Stream

226,723 Aufrufe • vor 5 Monaten

Introducing Whisper – an open source voice note taking app! Record voice notes and transcribe them into lists, blogs, & more with AI. 100% free & open source.
0:59

Introducing Whisper – an open source voice note taking app! Record voice notes and transcribe them into lists, blogs, & more with AI. 100% free & open source.

Hassan

280,697 Aufrufe • vor 11 Monaten

NVIDIA just removed the biggest friction point in Voice AI 🤯 They've open-sourced PersonaPlex-7B, a full-duplex conversational model that can listen and speak at the same time. Instead of waiting for you to finish talking, it uses a dual-stream architecture to process and respond in real-time. 100% Open-Source and Free.
0:42

NVIDIA just removed the biggest friction point in Voice AI 🤯 They've open-sourced PersonaPlex-7B, a full-duplex conversational model that can listen and speak at the same time. Instead of waiting for you to finish talking, it uses a dual-stream architecture to process and respond in real-time. 100% Open-Source and Free.

Simplifying AI

278,796 Aufrufe • vor 5 Monaten

Play AI by vibx (YC W23) is a new platform for creating human-like voice agents. It makes speech generation contextual and handles turn-taking, interruption, voice energy, and emotion modulation for natural, fluid, human conversations in real-time.
2:02

Play AI by vibx (YC W23) is a new platform for creating human-like voice agents. It makes speech generation contextual and handles turn-taking, interruption, voice energy, and emotion modulation for natural, fluid, human conversations in real-time.

Y Combinator

21,285 Aufrufe • vor 2 Jahren

ElevenLabs just lost the crown - to open source. Chatterbox by Resemble AI (I remember writing about this team back in 2022 as a pioneer of AI audio) just released as an open-source alternative for audio generation and voice cloning. - Zero-shot voice cloning from just 5 seconds of audio - Unique emotion intensity control—from subtle to dramatically expressive - Real-time voice synthesis faster than real-time inference - Built-in watermarking for secure, trusted audio - Consistently preferred over ElevenLabs in blind evaluations Fully open-source. No hidden restrictions. This is the way. Check out the demo:
0:26

ElevenLabs just lost the crown - to open source. Chatterbox by Resemble AI (I remember writing about this team back in 2022 as a pioneer of AI audio) just released as an open-source alternative for audio generation and voice cloning. - Zero-shot voice cloning from just 5 seconds of audio - Unique emotion intensity control—from subtle to dramatically expressive - Real-time voice synthesis faster than real-time inference - Built-in watermarking for secure, trusted audio - Consistently preferred over ElevenLabs in blind evaluations Fully open-source. No hidden restrictions. This is the way. Check out the demo:

AI Breakfast

454,132 Aufrufe • vor 1 Jahr

🚨 BREAKING: ElevenLabs just launched Conversational AI 2.0 AI voice agents can now understand when to pause, speak, and take turns just like a real person. Here’s what’s new (and why it matters):
1:37

🚨 BREAKING: ElevenLabs just launched Conversational AI 2.0 AI voice agents can now understand when to pause, speak, and take turns just like a real person. Here’s what’s new (and why it matters):

Brendan Jowett

290,960 Aufrufe • vor 1 Jahr

Ever suspected a paper you’re reading is AI slop? You can now turn on AI detection mode on alphaXiv to visualize what is written by an AI and what is not. Now available for every research paper indexed on arXiv. Integrated with the latest detection model from 🚀
0:20

Ever suspected a paper you’re reading is AI slop? You can now turn on AI detection mode on alphaXiv to visualize what is written by an AI and what is not. Now available for every research paper indexed on arXiv. Integrated with the latest detection model from 🚀

alphaXiv

97,424 Aufrufe • vor 2 Monaten

Imagine a world where your voice is the universal interface. No screens, no buttons, just seamless, human-like conversations. This is the future we're creating at PlayAI. Today, we are announcing our latest foundational voice model, Play Dialog, a multi-turn conversational voice model trained to converse like humans. And a $21m seed funding to fuel our research and product development efforts. Join us in building the future of conversational voice ai.
1:35

Imagine a world where your voice is the universal interface. No screens, no buttons, just seamless, human-like conversations. This is the future we're creating at PlayAI. Today, we are announcing our latest foundational voice model, Play Dialog, a multi-turn conversational voice model trained to converse like humans. And a $21m seed funding to fuel our research and product development efforts. Join us in building the future of conversational voice ai.

PlayAI

46,742 Aufrufe • vor 1 Jahr

Turn any world model from World Labs into a multi-user space for exploration and collaboration with FRAME. Voice chat, embodied AI agents, and tons more you can layer on top of the model foundation. This took all of 10 seconds to get going. The metaverse is so back. 😄
1:10

Turn any world model from World Labs into a multi-user space for exploration and collaboration with FRAME. Voice chat, embodied AI agents, and tons more you can layer on top of the model foundation. This took all of 10 seconds to get going. The metaverse is so back. 😄

Gabriel Baker

21,505 Aufrufe • vor 9 Monaten