Загрузка видео...

Не удалось загрузить видео

На главную

.Vogent just released Vogent-Turn-80M: an open-source, state-of-the-art turn-detection model for voice AI. It improves any voice AI stack by detecting when to wait and when to speak, reducing interruptions and making conversations more humanlike.

ycombinator's profile picture

Y Combinator

1,600,701 subscribers

18,913 просмотров • 8 месяцев назад •via X (Twitter)

Здоровье и велнесНаука и технологииОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Today we’re launching our first homegrown AI model: an open source turn detection model for building voice agents. Instead of relying solely on voice activity detection (VAD), which only considers when a user is speaking, our model also considers what has and is being said in the context of a conversation and predicts when a user is finished expressing their thoughts before the agent responds. Conversations with AI voice agents using this new model flow much more naturally without constant interruptions from the AI— check it out (more videos, details, and code in the thread):
2:36

Today we’re launching our first homegrown AI model: an open source turn detection model for building voice agents. Instead of relying solely on voice activity detection (VAD), which only considers when a user is speaking, our model also considers what has and is being said in the context of a conversation and predicts when a user is finished expressing their thoughts before the agent responds. Conversations with AI voice agents using this new model flow much more naturally without constant interruptions from the AI— check it out (more videos, details, and code in the thread):

LiveKit

126,860 просмотров • 1 год назад

Vogent (Vogent) just launched extremely realistic voice agents. They rebuilt Sesame's CSM-1B model to produce ultra-humanlike voice in real time. Listen or call their AI Trump agent at 510-315-0014. Congrats on the launch, Jagath Vytheeswaran + Vignesh Varadarajan!
0:38

Vogent (Vogent) just launched extremely realistic voice agents. They rebuilt Sesame's CSM-1B model to produce ultra-humanlike voice in real time. Listen or call their AI Trump agent at 510-315-0014. Congrats on the launch, Jagath Vytheeswaran + Vignesh Varadarajan!

Y Combinator

44,718 просмотров • 1 год назад

Smart Turn v2: open source, native audio turn detection in 14 languages. New checkpoint of the open source, open data, open training code, semantic VAD model on Hugging Face, fal, and Pipecat AI. - 3x faster inference (12ms on an L40) - 14 languages (13 more than v1, which was english-only) - New synthetic data set `chirp_3_all` with ~163k audio samples - 99% accuracy on held out `human_5_all` test data Good turn detection is critical for voice agents. This model "understands" both semantic and audio patterns, and mitigates the voice AI trade-off between unwanted turn latency vs the agent interrupting people before they are finished speaking. Training scripts for both Modal and local training are in the repo. We want to make it as easy as possible to contribute to or customize this model! Here's a demo running the smart-turn model with default settings, aimed at generally hitting 400ms total turn detection time. You can tune things to be faster, too. You can help by contributing data, doing architecture expermints, or cleaning open source data! Keep reading ...
2:12

Smart Turn v2: open source, native audio turn detection in 14 languages. New checkpoint of the open source, open data, open training code, semantic VAD model on Hugging Face, fal, and Pipecat AI. - 3x faster inference (12ms on an L40) - 14 languages (13 more than v1, which was english-only) - New synthetic data set `chirp_3_all` with ~163k audio samples - 99% accuracy on held out `human_5_all` test data Good turn detection is critical for voice agents. This model "understands" both semantic and audio patterns, and mitigates the voice AI trade-off between unwanted turn latency vs the agent interrupting people before they are finished speaking. Training scripts for both Modal and local training are in the repo. We want to make it as easy as possible to contribute to or customize this model! Here's a demo running the smart-turn model with default settings, aimed at generally hitting 400ms total turn detection time. You can tune things to be faster, too. You can help by contributing data, doing architecture expermints, or cleaning open source data! Keep reading ...

kwindla

42,219 просмотров • 1 год назад

🚨 BREAKING: NVIDIA just removed the biggest friction point in Voice AI They open-sourced PersonaPlex 7B, a real-time conversational model. It listens and speaks simultaneously to handle natural interruptions and overlaps. 100% Open Source.
0:43

🚨 BREAKING: NVIDIA just removed the biggest friction point in Voice AI They open-sourced PersonaPlex 7B, a real-time conversational model. It listens and speaks simultaneously to handle natural interruptions and overlaps. 100% Open Source.

How To Prompt

701,651 просмотров • 3 месяцев назад

.Vogent Voicelab is a high-performance API to run top open-source voice models, like Sesame CSM-1B, Dia, and more. Voicelab optimizes inference for each model so you can run them quickly and scalably— and they post-train select models to improve performance and reliability.
1:45

.Vogent Voicelab is a high-performance API to run top open-source voice models, like Sesame CSM-1B, Dia, and more. Voicelab optimizes inference for each model so you can run them quickly and scalably— and they post-train select models to improve performance and reliability.

Y Combinator

55,257 просмотров • 1 год назад

Today, we're introducing PlayHT2.0 - our new Conversational Text-to-Voice AI Model that's trained and built to generate humanlike conversations across languages with <1s latency. Sign up for beta access -
1:19

Today, we're introducing PlayHT2.0 - our new Conversational Text-to-Voice AI Model that's trained and built to generate humanlike conversations across languages with <1s latency. Sign up for beta access -

PlayAI

52,378 просмотров • 2 лет назад

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.
1:24

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.

Michael Yuan

14,983 просмотров • 1 год назад

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.
2:02

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.

PlayAI

105,616 просмотров • 2 лет назад

Thrilled to see Amazon Web Services making a major contribution to the open source AI community with the launch of the Strands Agents, an open source AI agents SDK! The core of Strands is the simple agentic loop that connects the model and tools together, like the two strands of DNA. This model-driven approach to agent building eliminates the need for complex agent orchestration by embracing the capabilities of state-of-the-art models to plan, chain thoughts, call tools, and reflect. Providing open source tools and interoperability with open source protocols is an important part of our strategy to enable an agentic future. Can't wait to see what you build with Strands!
1:33

Thrilled to see Amazon Web Services making a major contribution to the open source AI community with the launch of the Strands Agents, an open source AI agents SDK! The core of Strands is the simple agentic loop that connects the model and tools together, like the two strands of DNA. This model-driven approach to agent building eliminates the need for complex agent orchestration by embracing the capabilities of state-of-the-art models to plan, chain thoughts, call tools, and reflect. Providing open source tools and interoperability with open source protocols is an important part of our strategy to enable an agentic future. Can't wait to see what you build with Strands!

Swami Sivasubramanian

32,185 просмотров • 1 год назад

What will you build with Vision Agents? Out-of-the-box support for: - Turn detection - Speech-to-text + text-to-speech - Voice activity detection - MCP & function-calling support Open-source. Video-first. Ready to build.
0:30

What will you build with Vision Agents? Out-of-the-box support for: - Turn detection - Speech-to-text + text-to-speech - Voice activity detection - MCP & function-calling support Open-source. Video-first. Ready to build.

Stream

226,723 просмотров • 6 месяцев назад

NVIDIA just removed the biggest friction point in Voice AI 🤯 They've open-sourced PersonaPlex-7B, a full-duplex conversational model that can listen and speak at the same time. Instead of waiting for you to finish talking, it uses a dual-stream architecture to process and respond in real-time. 100% Open-Source and Free.
0:42

NVIDIA just removed the biggest friction point in Voice AI 🤯 They've open-sourced PersonaPlex-7B, a full-duplex conversational model that can listen and speak at the same time. Instead of waiting for you to finish talking, it uses a dual-stream architecture to process and respond in real-time. 100% Open-Source and Free.

Simplifying AI

278,796 просмотров • 5 месяцев назад

Play AI by vibx (YC W23) is a new platform for creating human-like voice agents. It makes speech generation contextual and handles turn-taking, interruption, voice energy, and emotion modulation for natural, fluid, human conversations in real-time.
2:02

Play AI by vibx (YC W23) is a new platform for creating human-like voice agents. It makes speech generation contextual and handles turn-taking, interruption, voice energy, and emotion modulation for natural, fluid, human conversations in real-time.

Y Combinator

21,285 просмотров • 2 лет назад

ElevenLabs just lost the crown - to open source. Chatterbox by Resemble AI (I remember writing about this team back in 2022 as a pioneer of AI audio) just released as an open-source alternative for audio generation and voice cloning. - Zero-shot voice cloning from just 5 seconds of audio - Unique emotion intensity control—from subtle to dramatically expressive - Real-time voice synthesis faster than real-time inference - Built-in watermarking for secure, trusted audio - Consistently preferred over ElevenLabs in blind evaluations Fully open-source. No hidden restrictions. This is the way. Check out the demo:
0:26

ElevenLabs just lost the crown - to open source. Chatterbox by Resemble AI (I remember writing about this team back in 2022 as a pioneer of AI audio) just released as an open-source alternative for audio generation and voice cloning. - Zero-shot voice cloning from just 5 seconds of audio - Unique emotion intensity control—from subtle to dramatically expressive - Real-time voice synthesis faster than real-time inference - Built-in watermarking for secure, trusted audio - Consistently preferred over ElevenLabs in blind evaluations Fully open-source. No hidden restrictions. This is the way. Check out the demo:

AI Breakfast

454,132 просмотров • 1 год назад

🚨 BREAKING: ElevenLabs just launched Conversational AI 2.0 AI voice agents can now understand when to pause, speak, and take turns just like a real person. Here’s what’s new (and why it matters):
1:37

🚨 BREAKING: ElevenLabs just launched Conversational AI 2.0 AI voice agents can now understand when to pause, speak, and take turns just like a real person. Here’s what’s new (and why it matters):

Brendan Jowett

290,969 просмотров • 1 год назад

Ever suspected a paper you’re reading is AI slop? You can now turn on AI detection mode on alphaXiv to visualize what is written by an AI and what is not. Now available for every research paper indexed on arXiv. Integrated with the latest detection model from 🚀
0:20

Ever suspected a paper you’re reading is AI slop? You can now turn on AI detection mode on alphaXiv to visualize what is written by an AI and what is not. Now available for every research paper indexed on arXiv. Integrated with the latest detection model from 🚀

alphaXiv

97,632 просмотров • 3 месяцев назад

Imagine a world where your voice is the universal interface. No screens, no buttons, just seamless, human-like conversations. This is the future we're creating at PlayAI. Today, we are announcing our latest foundational voice model, Play Dialog, a multi-turn conversational voice model trained to converse like humans. And a $21m seed funding to fuel our research and product development efforts. Join us in building the future of conversational voice ai.
1:35

Imagine a world where your voice is the universal interface. No screens, no buttons, just seamless, human-like conversations. This is the future we're creating at PlayAI. Today, we are announcing our latest foundational voice model, Play Dialog, a multi-turn conversational voice model trained to converse like humans. And a $21m seed funding to fuel our research and product development efforts. Join us in building the future of conversational voice ai.

PlayAI

46,742 просмотров • 1 год назад

Turn any world model from World Labs into a multi-user space for exploration and collaboration with FRAME. Voice chat, embodied AI agents, and tons more you can layer on top of the model foundation. This took all of 10 seconds to get going. The metaverse is so back. 😄
1:10

Turn any world model from World Labs into a multi-user space for exploration and collaboration with FRAME. Voice chat, embodied AI agents, and tons more you can layer on top of the model foundation. This took all of 10 seconds to get going. The metaverse is so back. 😄

Gabriel Baker

21,608 просмотров • 9 месяцев назад

Introducing a Text-to-API AI ⚙️ Turn any website into an API with 's /extract. Just describe your API in plain text and get an endpoint you can hit. Another great open-source project by !
0:52

Introducing a Text-to-API AI ⚙️ Turn any website into an API with 's /extract. Just describe your API in plain text and get an endpoint you can hit. Another great open-source project by !

Caleb Peffer (Hiring!)

262,812 просмотров • 1 год назад

.@Samora_AI's voice agents speak local dialects, complete tasks, learn from calls, and escalate to Samora’s human teams when needed. No tech stack. No ops team. No call center. Just Samora AI. Congrats to the team on the launch!
1:37

.@Samora_AI's voice agents speak local dialects, complete tasks, learn from calls, and escalate to Samora’s human teams when needed. No tech stack. No ops team. No call center. Just Samora AI. Congrats to the team on the launch!

Y Combinator

14,973 просмотров • 4 месяцев назад