Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Whoever nails real-time voice stands to win the interface layer to AI. Not screens. Not chat bubbles. One of the startups doing great work in this area is Cartesia (disclosure: I'm an indie investor in the company). Their Sonic-3 low latency models are already laughing, emoting, and switching languages live.

dharmesh

433,287 subscribers

51,837 Aufrufe • vor 8 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

The voice AI company that raised $100M from companies like NVIDIA just dropped Sonic-3. • it has latency 190ms first byte (fastest in production) • can laugh, show sadness & happiness • has 42 languages in one voice • handles acronyms, dates, phone numbers correctly • can clone anyone’s voice • you can adjust the speed & volume in real time.

The voice AI company that raised $100M from companies like NVIDIA just dropped Sonic-3. • it has latency 190ms first byte (fastest in production) • can laugh, show sadness & happiness • has 42 languages in one voice • handles acronyms, dates, phone numbers correctly • can clone anyone’s voice • you can adjust the speed & volume in real time.

Alvaro Cintas

28,103 Aufrufe • vor 8 Monaten

In Signal Dialogues #04, we explore what it takes to build the foundational layer of voice AI from the ground up. Karan Goel, Co-founder and CEO of Cartesia, sits down with Aakrit Vaish to unpack the bet behind one of the most ambitious infrastructure plays in AI. Karan and his co-founders came out of Stanford's AI Lab, where Albert Gu (now Cartesia's Chief Scientist) co-authored Mamba and pioneered State Space Models, the architecture they believe will define the next generation of real-time, interactive AI. Backed by Kleiner Perkins, Index Ventures, Lightspeed and NVIDIA with over $120M raised, Cartesia is building voice models engineered for real-time latency and efficiency at scale. If you're a founder, researcher or builder thinking about voice, infrastructure or the next architectural shift in AI, this one's for you. Timestamps: 00:00 - Introduction 02:46 - What Cartesia Does: Interactive AI Models 03:24 - Founding Story: From Stanford PhDs to Cartesia 04:03 - The Unique Insight: Efficiency and Beyond Transformers 09:07 - Voice Company, Neolab, or Big Lab? 14:57 - State Space Models and Algorithmic Innovation 26:04 - The Four Big Bets in Interactive AI 30:24 - Products, Customers, and Going Full-Stack 41:44 - The BPO Disruption: India's Call Center Future 54:17 - Competition, Moats, and the Long Game Karan Goel Aakrit Vaish Cartesia

In Signal Dialogues #04, we explore what it takes to build the foundational layer of voice AI from the ground up. Karan Goel, Co-founder and CEO of Cartesia, sits down with Aakrit Vaish to unpack the bet behind one of the most ambitious infrastructure plays in AI. Karan and his co-founders came out of Stanford's AI Lab, where Albert Gu (now Cartesia's Chief Scientist) co-authored Mamba and pioneered State Space Models, the architecture they believe will define the next generation of real-time, interactive AI. Backed by Kleiner Perkins, Index Ventures, Lightspeed and NVIDIA with over $120M raised, Cartesia is building voice models engineered for real-time latency and efficiency at scale. If you're a founder, researcher or builder thinking about voice, infrastructure or the next architectural shift in AI, this one's for you. Timestamps: 00:00 - Introduction 02:46 - What Cartesia Does: Interactive AI Models 03:24 - Founding Story: From Stanford PhDs to Cartesia 04:03 - The Unique Insight: Efficiency and Beyond Transformers 09:07 - Voice Company, Neolab, or Big Lab? 14:57 - State Space Models and Algorithmic Innovation 26:04 - The Four Big Bets in Interactive AI 30:24 - Products, Customers, and Going Full-Stack 41:44 - The BPO Disruption: India's Call Center Future 54:17 - Competition, Moats, and the Long Game Karan Goel Aakrit Vaish Cartesia

Activate

12,489 Aufrufe • vor 1 Monat

From IIT Delhi to Stanford PhD to raising $27M before having a product. That's Karan Goel story. No revenue. No product. Just strong research, strong demos, and strong conviction. What does Cartesia do? In simple language: It helps businesses automate conversations. If you’re a small business owner and miss a customer’s call, you may lose revenue. Cartesia makes it possible for AI to answer that call, qualify the lead, and respond naturally — in real time, and in local languages. A few things that stood out to me from my conversation with Karan: → Cartesia is building some of the fastest voice AI models in the world → They’re obsessed with latency because even small delays break conversations → They’re betting big on India as a voice-first market → Karan believes India should aim to export AI to the world, not just consume it Karan Goel Cartesia 🎧 Link in comments.

From IIT Delhi to Stanford PhD to raising $27M before having a product. That's Karan Goel story. No revenue. No product. Just strong research, strong demos, and strong conviction. What does Cartesia do? In simple language: It helps businesses automate conversations. If you’re a small business owner and miss a customer’s call, you may lose revenue. Cartesia makes it possible for AI to answer that call, qualify the lead, and respond naturally — in real time, and in local languages. A few things that stood out to me from my conversation with Karan: → Cartesia is building some of the fastest voice AI models in the world → They’re obsessed with latency because even small delays break conversations → They’re betting big on India as a voice-first market → Karan believes India should aim to export AI to the world, not just consume it Karan Goel Cartesia 🎧 Link in comments.

Shiva Singh Sangwan

23,707 Aufrufe • vor 3 Monaten

This is the DeepSeek moment for Voice AI. Chatterbox Turbo is an MIT-licensed voice model that beats ElevenLabs Turbo & Cartesia Sonic 3! - <150ms time-to-first-sound - Voice cloning from just 5-second audio - Paralinguistic tags for real human expression 100% open-source.

This is the DeepSeek moment for Voice AI. Chatterbox Turbo is an MIT-licensed voice model that beats ElevenLabs Turbo & Cartesia Sonic 3! - <150ms time-to-first-sound - Voice cloning from just 5-second audio - Paralinguistic tags for real human expression 100% open-source.

Akshay 🚀

468,163 Aufrufe • vor 6 Monaten

At RAISE Summit in Paris, one theme stood out: every layer of the AI stack is up for grabs. Startups are challenging incumbents in chips, cloud infrastructure, data centers, and foundation models alike.

At RAISE Summit in Paris, one theme stood out: every layer of the AI stack is up for grabs. Startups are challenging incumbents in chips, cloud infrastructure, data centers, and foundation models alike.

TIME

26,266 Aufrufe • vor 4 Tagen

Did Google just mass-murdered every voice AI startup irrelevant? Google just shipped Gemini 3.1 Flash Live. Real-time voice AND vision. Sub-second latency. 90+ languages. And the one thing no voice AI has cracked until now: it filters background noise in real-world environments. Not demo environments. Real ones. Traffic outside. TV left on. Drill running next door. That's the wall every voice AI startup has been quietly hitting for three years. The demos worked. The deployments didn't. Because the real world is loud and messy and the models couldn't tell your voice from the noise around it. Google just called that problem solved. And it's not sitting in a research paper. It's already running in production apps. Stitch is using it to let designers talk to their canvas in real-time. Ato is using it to give elderly people a companion who actually listens. Wit's End built an RPG game master with it that delivers theatrical dialogue indistinguishable from a human voice actor. Three live products. Three different industries. All shipping now. Every voice AI startup just woke up to a new baseline. The question isn't whether to build with this. The question is how fast.

Did Google just mass-murdered every voice AI startup irrelevant? Google just shipped Gemini 3.1 Flash Live. Real-time voice AND vision. Sub-second latency. 90+ languages. And the one thing no voice AI has cracked until now: it filters background noise in real-world environments. Not demo environments. Real ones. Traffic outside. TV left on. Drill running next door. That's the wall every voice AI startup has been quietly hitting for three years. The demos worked. The deployments didn't. Because the real world is loud and messy and the models couldn't tell your voice from the noise around it. Google just called that problem solved. And it's not sitting in a research paper. It's already running in production apps. Stitch is using it to let designers talk to their canvas in real-time. Ato is using it to give elderly people a companion who actually listens. Wit's End built an RPG game master with it that delivers theatrical dialogue indistinguishable from a human voice actor. Three live products. Three different industries. All shipping now. Every voice AI startup just woke up to a new baseline. The question isn't whether to build with this. The question is how fast.

Vaibhav Sisinty

59,199 Aufrufe • vor 3 Monaten

As Larry Ellison explains, there are two types of AI models: real-time models, also called AI on the edge, where you need ultra-low latency decisions (think autonomous driving or robotics), and models that don’t need an immediate response, like ChatGPT, where the system has time to reason. Real-time models require local compute inside the device, and these chips have nothing to do with the GPUs running in data centers. The AI-on-the-edge market is still largely untapped — and it’s going to be a multi-trillion-dollar opportunity. I believe $AMD will be one of the biggest beneficiaries

As Larry Ellison explains, there are two types of AI models: real-time models, also called AI on the edge, where you need ultra-low latency decisions (think autonomous driving or robotics), and models that don’t need an immediate response, like ChatGPT, where the system has time to reason. Real-time models require local compute inside the device, and these chips have nothing to do with the GPUs running in data centers. The AI-on-the-edge market is still largely untapped — and it’s going to be a multi-trillion-dollar opportunity. I believe $AMD will be one of the biggest beneficiaries

Daniel

151,698 Aufrufe • vor 7 Monaten

We've raised a $64M Series A led by Kleiner Perkins to build the platform for real-time voice AI. We'll use this funding to expand our team, and to build the next generation of models, infrastructure, and products for voice, starting with Sonic 2.0, available today. Link below to try it free 👇

We've raised a $64M Series A led by Kleiner Perkins to build the platform for real-time voice AI. We'll use this funding to expand our team, and to build the next generation of models, infrastructure, and products for voice, starting with Sonic 2.0, available today. Link below to try it free 👇

Cartesia

327,874 Aufrufe • vor 1 Jahr

This is the DeepSeek moment for Voice AI. Today we’re releasing Chatterbox Turbo — our state-of-the-art MIT licensed voice model that beats ElevenLabs Turbo and Cartesia Sonic 3! We’re finally removing the trade-offs that have held voice AI back. Fast models sound robotic. Great models are slow. And none are built for trust. We fixed all three. Chatterbox Turbo is transparent, auditable, and built for a world that needs proof.

This is the DeepSeek moment for Voice AI. Today we’re releasing Chatterbox Turbo — our state-of-the-art MIT licensed voice model that beats ElevenLabs Turbo and Cartesia Sonic 3! We’re finally removing the trade-offs that have held voice AI back. Fast models sound robotic. Great models are slow. And none are built for trust. We fixed all three. Chatterbox Turbo is transparent, auditable, and built for a world that needs proof.

Dev Shah

468,857 Aufrufe • vor 7 Monaten

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.

Sudarshan Kamath

71,298 Aufrufe • vor 3 Monaten

To the haters: The one thing you're not going to succeed in is silencing my voice. 💅🏽 I'm grateful to represent great Americans who have faith in me to carry their voice, to fight, and to ensure that they can afford their lives.

To the haters: The one thing you're not going to succeed in is silencing my voice. 💅🏽 I'm grateful to represent great Americans who have faith in me to carry their voice, to fight, and to ensure that they can afford their lives.

Ilhan Omar

442,337 Aufrufe • vor 9 Monaten

THIS 18-YEAR-OLD BUILT AN AI OPERATING SYSTEM FOR HIS ENTIRE COMPANY - ONE BRAIN THAT REMEMBERS EVERYTHING every node on the graph is an agent - memory, workflows, live systems, clients, projects, decisions - all connected to one center at the center is Kronos - a brain that remembers years of projects, conversations, clients and decisions - not one chat, not one folder, one shared intelligence layer instead of opening terminal after terminal he opens one dashboard - and the entire company is already there 18 years old, his own company, AI operating system instead of managers and coordinators most companies pay $50,000-100,000/month for a team that coordinates work - his Kronos does it for free and forgets nothing

THIS 18-YEAR-OLD BUILT AN AI OPERATING SYSTEM FOR HIS ENTIRE COMPANY - ONE BRAIN THAT REMEMBERS EVERYTHING every node on the graph is an agent - memory, workflows, live systems, clients, projects, decisions - all connected to one center at the center is Kronos - a brain that remembers years of projects, conversations, clients and decisions - not one chat, not one folder, one shared intelligence layer instead of opening terminal after terminal he opens one dashboard - and the entire company is already there 18 years old, his own company, AI operating system instead of managers and coordinators most companies pay $50,000-100,000/month for a team that coordinates work - his Kronos does it for free and forgets nothing

Cortex

17,821 Aufrufe • vor 21 Tagen

we are live! you can now (for free!) check your brand's presence in the most popular AI models this is different from the promptwatch main platform, where you can monitor the real chatgpt user interface but this is great to see how well your brand is stored in the training data

Klaas

21,569 Aufrufe • vor 1 Jahr

Voice‑driven, real‑time arbitrary action generation😁 Using external voice commands, G1 is directly controlled to generate a wide range of actions in real time. This video was recorded in a single take, with on‑site audio recording. Because the actions are autonomously generated by AI in real time, there may be slight latency, and the smoothness of the movements may be somewhat reduced.

Voice‑driven, real‑time arbitrary action generation😁 Using external voice commands, G1 is directly controlled to generate a wide range of actions in real time. This video was recorded in a single take, with on‑site audio recording. Because the actions are autonomously generated by AI in real time, there may be slight latency, and the smoothness of the movements may be somewhat reduced.

Unitree

29,017,924 Aufrufe • vor 1 Monat

🚨 BREAKING: Big day for voice AI. Cartesia just dropped Sonic 3.5 and Sarvam announced their $300M Series B - so I decided to put both to the test myself. Same scripts, side by side. The results are kind of insane. Sonic came out a leap ahead on emotion, alphanumerics, and switching across Indian languages mid-sentence. Karan Goel grew up in Delhi, went to IIT Delhi, and constantly talks about how much he cares about building for India. Hard to argue he doesn't mean it 👇

🚨 BREAKING: Big day for voice AI. Cartesia just dropped Sonic 3.5 and Sarvam announced their $300M Series B - so I decided to put both to the test myself. Same scripts, side by side. The results are kind of insane. Sonic came out a leap ahead on emotion, alphanumerics, and switching across Indian languages mid-sentence. Karan Goel grew up in Delhi, went to IIT Delhi, and constantly talks about how much he cares about building for India. Hard to argue he doesn't mean it 👇

Aakash Kanojiya

189,108 Aufrufe • vor 29 Tagen

Chat: Who will win the LCK CUP? NS Lehends: I DONT CARE! I'm not in the tournament now so I simply don't care! Whoever wants to win can win! Might as well let an LPL team come and win the LCK CUP!

Chat: Who will win the LCK CUP? NS Lehends: I DONT CARE! I'm not in the tournament now so I simply don't care! Whoever wants to win can win! Might as well let an LPL team come and win the LCK CUP!

Yuuu

227,216 Aufrufe • vor 1 Jahr

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:

Andrew Ng

87,484 Aufrufe • vor 1 Jahr

The time is here that every believer should live in the consciousness of the fact that we are not oblivious of the life now and the one to come. That life ( HOLYSPIRIT) is already in us, so we can not fear tomorrow. Be conscious of the FATHER of SPIRITS. This Friday by 12am.

The time is here that every believer should live in the consciousness of the fact that we are not oblivious of the life now and the one to come. That life ( HOLYSPIRIT) is already in us, so we can not fear tomorrow. Be conscious of the FATHER of SPIRITS. This Friday by 12am.

Theophilus Sunday

89,445 Aufrufe • vor 2 Jahren