Loading video...

Video Failed to Load

Go Home

I think people are still sleeping on realtime voice driven consumer experiences.. Releasing my latest side project geared towards kids: Upon A Voice ✨ You can watch my daughter interact with it in the video below but the highlights are as follows: - generates a "live" storybook based on...

27,953 views • 3 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Tucker goes on epic rant about modern life and nature: "The ruling party is the party of the childless, the unmarried, the people working for low wages for large corporations and living in tiny apartments in overcrowded cities that are rife with crime." "Who votes for the people who run the United States right now? People who are working for big banks, living in crowded conditions, very often alone, in big soulless cities, having their food delivered by immigrants, and spending their time glued to a screen. What does that sound like to you? It sounds like prison, actually." "Who are the people who oppose this? Where do they live and how do they live? Well, they are poorer generally on paper. But are their lives worse if you live in a place where you can see the sky? Where you can make your own food? If you can go outside and identify three species of trees or hear birds, or experience silence, the rarest commodity in the modern world. Those are the people who are not with the program. People who have a daily experience of nature. And those people are much more likely to acknowledge a power beyond themselves and their government. And there's a reason for that because they can see it. When you're living crowded as you would on an industrial farm as a cow, you are not liberated. You are enslaved. Your reference points are gone. You can't see the stars. You cannot see God's creation. All around you you see drywall and screens. And your ability to think clearly goes away."

TheBlaze

3,543,218 views • 3 years ago

We blew past the Turing test for voice agents about a year ago. I don't think we talk about this enough. We have lots of data from real-world voice agent deployments. In contexts like customer support, people often forget they are talking to a voice agent. This is true even when the system tells people they are talking to an AI agent at the beginning of the session. (Which I think is a best practice that almost all AI agents should adhere to.) So ... when will this happen for realtime, conversational AI video? Well, we're getting very close. Tavus just released a new realtime video model that, at its best, passes the Turing test for conversational video. It's pretty amazing. The model is full-duplex (it can talk and listen at the same time), and does vision and audio input and audio+video output in realtime. Both on the nascent conversational video benchmarks, and in my testing, it's a pretty big step forward. Here's an unedited video of one of my conversations with the new model. I think you can see a few interesting things here. When the model responds as quickly as you expect a human to respond, the experience is magical. The responses are conversational and natural; there's no leaning on stock filler phrases to hit the response time goals. The integration between the video and audio feels natural, which has historically been an uncanny valley thing that most video avatar experiences didn't quite get past. The model can do hand gestures! If you're deep into this stuff, you'll find that a little bit mind-blowing. And, in keeping with all the stuff that Tavus has released, the fact that the model can "see" as well as hear and talk is integral to the experience and a big part of what makes the conversation feel useful and interesting. At the very beginning of the conversation, you can see that the model and I talk over each other. Which is something that happens a lot in human-to-human video call conversations. We both recover from this gracefully, which, again, has been something that rarely worked quite perfectly in previous generations of realtime video systems. Even more than the "when it works perfectly" capabilities, it's probably these recovery and robustness moments that get us all the way to experiences that feel completely natural.

kwindla

39,444 views • 13 days ago