Loading video...

Video Failed to Load

Go Home

New paper: Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models We use RL to post-train speech models (Moshi and PersonaPlex) to talk more like a human: to know when to respond, when to wait, and when to nod along with “yeah”s and “okay”s when listening.

kyutai_labs's profile picture

kyutai

26,610 subscribers

32,055 views • 1 month ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

We released Sonic-3.5 and Ink-2, the #1 streaming models for text to speech and speech to text you can use in your voice agents today. New architectures enable new frontiers for speed and quality. We're now the only provider to have #1 models for both speaking and listening.
2:47

We released Sonic-3.5 and Ink-2, the #1 streaming models for text to speech and speech to text you can use in your voice agents today. New architectures enable new frontiers for speed and quality. We're now the only provider to have #1 models for both speaking and listening.

Karan Goel

7,004,255 views • 26 days ago

When Bush came to NATO, he made a Speech and Left. When Obama came to NATO, he made a speech and left. When Trump came to NATO and he said “LET ME SEE YOUR BOOKS”
0:53

When Bush came to NATO, he made a Speech and Left. When Obama came to NATO, he made a speech and left. When Trump came to NATO and he said “LET ME SEE YOUR BOOKS”

MJTruthUltra

1,382,232 views • 1 year ago

jungkook’s little nod and smile when he was listening to jimin talk about how he wanted to be in 2025 because bts would be together :(
0:25

jungkook’s little nod and smile when he was listening to jimin talk about how he wanted to be in 2025 because bts would be together :(

lex⁷

113,665 views • 3 years ago

Speech to Speech is now available in 29 languages. In November, we launched Speech to Speech, enabling you to transform your voice into another character with full control over emotions, timing, and delivery. Today we're making Speech to Speech multilingual. Use Speech to Speech to get more control than with prompting alone. Simply say it how you want it, choose a target voice, and generate.
0:37

Speech to Speech is now available in 29 languages. In November, we launched Speech to Speech, enabling you to transform your voice into another character with full control over emotions, timing, and delivery. Today we're making Speech to Speech multilingual. Use Speech to Speech to get more control than with prompting alone. Simply say it how you want it, choose a target voice, and generate.

ElevenLabs

113,343 views • 2 years ago

It's going to be insane when we can prompt our own virtual worlds like this and explore them. Imagine adding other characters you can talk to with LLMs + voice models!
0:28

It's going to be insane when we can prompt our own virtual worlds like this and explore them. Imagine adding other characters you can talk to with LLMs + voice models!

Justine Moore

2,188,073 views • 1 year ago

Robert De Niro: I'm pretty close to being a free speech absolutist. Even speech I don't like. But when I hear something I don't like, I use my own free speech to respond. When I hear Trump say, "I don't think about Americans' financial situation." I say, "shut the fuck up."
0:42

Robert De Niro: I'm pretty close to being a free speech absolutist. Even speech I don't like. But when I hear something I don't like, I use my own free speech to respond. When I hear Trump say, "I don't think about Americans' financial situation." I say, "shut the fuck up."

Headquarters

797,149 views • 26 days ago

"We cannot remain silent. No-one can remain silent when there is an ongoing genocide and when people are denied the most basic human needs ... To stand with Palestine is to be human." Greta Thunberg calls out Israel's genocide during a speech in Leipzig, Germany.
0:55

"We cannot remain silent. No-one can remain silent when there is an ongoing genocide and when people are denied the most basic human needs ... To stand with Palestine is to be human." Greta Thunberg calls out Israel's genocide during a speech in Leipzig, Germany.

Quds News Network

728,916 views • 2 years ago

Throwback to when iLLeY gave Dashy and Cellium a motivational speech 😂
0:39

Throwback to when iLLeY gave Dashy and Cellium a motivational speech 😂

SpawnUp

61,704 views • 8 months ago

ELON: WHEN WE LOSE FREE SPEECH, WE LOSE DEMOCRACY "Free speech is the bedrock of democracy, and free speech is what allows atrocities to be called out and for people to be aware of them. That's why the Germans wanted to shut down the press immediately. So, I think we should do everything we can to preserve free speech. And when we lose free speech, I think we lose democracy." Source: Interview with Ben Shapiro / Daily Wire, January 2024
0:23

ELON: WHEN WE LOSE FREE SPEECH, WE LOSE DEMOCRACY "Free speech is the bedrock of democracy, and free speech is what allows atrocities to be called out and for people to be aware of them. That's why the Germans wanted to shut down the press immediately. So, I think we should do everything we can to preserve free speech. And when we lose free speech, I think we lose democracy." Source: Interview with Ben Shapiro / Daily Wire, January 2024

Mario Nawfal

14,271,694 views • 1 year ago

Speech-native models like Moshi sound great and answer fast, but aren’t as smart as text LLMs. In our new paper, MoshiRAG, we show how Moshi can ask for advice from a text LLM or a knowledge base. The tricky part is how to do this in real time without adding latency. 🧵
1:06

Speech-native models like Moshi sound great and answer fast, but aren’t as smart as text LLMs. In our new paper, MoshiRAG, we show how Moshi can ask for advice from a text LLM or a knowledge base. The tricky part is how to do this in real time without adding latency. 🧵

kyutai

52,598 views • 2 months ago

"Know when to walk away and know when to run"
0:23

"Know when to walk away and know when to run"

JScott Memes

57,182 views • 9 months ago

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations
2:50

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations

Google AI

1,092,358 views • 7 months ago

Our paper is out in Nature Human Behaviour🔥🔥 ‘Evidence of a predictive coding hierarchy in the human brain listening to speech’ 📄 💡Unlike language models, our brain makes distant & hierarchical predictions with Alexandre Gramfort and Jean-Rémi King Thread👇
0:43

Our paper is out in Nature Human Behaviour🔥🔥 ‘Evidence of a predictive coding hierarchy in the human brain listening to speech’ 📄 💡Unlike language models, our brain makes distant & hierarchical predictions with Alexandre Gramfort and Jean-Rémi King Thread👇

Charlotte Caucheteux @NeurIPS2025

145,098 views • 3 years ago

Hiring RL Engineer! Started off as a curious project at Lossfunk to push the boundaries of LLMs in social reasoning - we are now building RL environments, data, and benchmarks to simulate more real-world scenarios. If you want to train SoTA RL models over multi-GPUs (H200s/B200s) to unlock next AI frontier, this is for you.
1:21

Hiring RL Engineer! Started off as a curious project at Lossfunk to push the boundaries of LLMs in social reasoning - we are now building RL environments, data, and benchmarks to simulate more real-world scenarios. If you want to train SoTA RL models over multi-GPUs (H200s/B200s) to unlock next AI frontier, this is for you.

Satpal Singh Rathore

45,915 views • 11 months ago

"We know we're going to looks, know we're going to get chances. We just got to focus and bear down when they come." More post-game 🎥 »
0:29

"We know we're going to looks, know we're going to get chances. We just got to focus and bear down when they come." More post-game 🎥 »

Detroit Red Wings

19,832 views • 3 months ago

Know when to hold them and know when to fold them
0:56

Know when to hold them and know when to fold them

TaraBull

304,274 views • 6 months ago

Our latest speech-to-speech model is faster, more accurate, and excels at function calling. Watch @promptshant and Brian Fioca build a realtime voice agent that can search the web and hand off tasks to reasoning models with full context.
1:58

Our latest speech-to-speech model is faster, more accurate, and excels at function calling. Watch @promptshant and Brian Fioca build a realtime voice agent that can search the web and hand off tasks to reasoning models with full context.

OpenAI Developers

81,822 views • 1 year ago

Tavus just secured a $40M raise to bring a new kind of intelligence to life. When technology starts to understand us, respond to us, and feel present with us, the future suddenly feels real. PALs add emotion, perception, and genuine human presence to computing in a way we’ve never seen before. Not a chatbot. Not a wrapper. A true human level interface you can talk to through video, voice, or text. This is what it looks like when machines finally learn to connect with us. Comment “PALs” and I’ll DM you free early access.
0:22

Tavus just secured a $40M raise to bring a new kind of intelligence to life. When technology starts to understand us, respond to us, and feel present with us, the future suddenly feels real. PALs add emotion, perception, and genuine human presence to computing in a way we’ve never seen before. Not a chatbot. Not a wrapper. A true human level interface you can talk to through video, voice, or text. This is what it looks like when machines finally learn to connect with us. Comment “PALs” and I’ll DM you free early access.

Manish Kumar Shah

19,375 views • 7 months ago

* abt love scenes 🐻 I will always go to him and say like it's okay we can do it. Bcs when when we’re filming love scene, we have to talk to eo first just want to feel free when we’re playing this scene. I want to both of us feel free and be happy playin it #ปอนด์ภูวินทร์
1:58

* abt love scenes 🐻 I will always go to him and say like it's okay we can do it. Bcs when when we’re filming love scene, we have to talk to eo first just want to feel free when we’re playing this scene. I want to both of us feel free and be happy playin it #ปอนด์ภูวินทร์

𝙇𝙚𝙖 🧡🤍

29,849 views • 3 months ago