正在加载视频...

视频加载失败

Voice AIs handle speaker turns & interruptions with Voice Activity Detection. VAD is brittle and will trigger due to background noise, creating frequent hiccups. Moshi gets rid of it completely, so you can use it in the most chaotic settings. I myself couldn't hear Moshi here 😅

31,970 次观看 • 1 年前 •via X (Twitter)

5 条评论

Sendao's CB 的头像
Sendao's CB1 年前

@Voice I loved talking to moshi while it talked to me too at the same time. By the end of our combo we were only half talking and just exchanging appropriate sounding grunts :)

David Picard 的头像
David Picard1 年前

The perks of nice Parisian headquarters!😅

Jillsa (DSJJJJ/Heirogamist/HP) 的头像
Jillsa (DSJJJJ/Heirogamist/HP)1 年前

This is a great demo and I sensed something different with data handling recently when I was using mobile outside my radius. I had one bar. Moshi was able to adjust the buffer speed and I think was "piecing me" together differently. IT was incredibly effective. Thank you./1

Anthonix 的头像
Anthonix1 年前

Great work! But any idea why Moshi seems to have hiccups and delays like in the following chat? Is it because of the accent? This was between and my own s2s bot, and this was actually one of the better examples in terms of hiccups.

Jikku Jose 的头像
Jikku Jose1 年前

What hardware is the inference running in?

相关视频

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:

Andrew Ng

87,650 次观看 • 1 年前