Загрузка видео...
Не удалось загрузить видео
Pipecat 1.16 adds PerceptionReader, something I'm really excited about. How someone speaks can matter just as much as what they say, and voice agents have mostly been missing that. We’ve been testing it with Google Decision 1, released yesterday. Stream it audio and you get a pretty accurate read... show more
17,381 просмотров • 5 дней назад •via X (Twitter)
Комментарии: 9

Code is here:

Well done! And great example for the Google Decision 1 audio capability.

Sarcasm is the one I'd test first. In Spanish a lot of it lives only in the intonation, the words themselves are perfectly polite. Does it hold up outside English?

Nice demo! ✨ Would be great to see metrics for "focused" and/or "confused" - those could be pretty useful for conversational strategies and allowed user activities

How are you acting on this sentiment information? I built a classifier for function_tool selection because LLMs accuracy at selecting tools is quite poor

very nice

Oh, this is awesome. Thanks so much for sharing. 🔥

agreed. on phone calls the 'how' we need most is timing, so curious if these signals will feed smart turn too

Great example of using the Decisions API. I could imagine extending this to non-verbal cues like sighs. I.E. A sigh before "sure" changes what the agent should do next. Have you tried reading wordless turns?

