Загрузка видео...

Не удалось загрузить видео

На главную

New paper: Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models We use RL to post-train speech models (Moshi and PersonaPlex) to talk more like a human: to know when to respond, when to wait, and when to nod along with “yeah”s and “okay”s when listening.

kyutai_labs's profile picture

kyutai

26,610 subscribers

32,055 просмотров • 1 месяц назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

We released Sonic-3.5 and Ink-2, the #1 streaming models for text to speech and speech to text you can use in your voice agents today. New architectures enable new frontiers for speed and quality. We're now the only provider to have #1 models for both speaking and listening.
2:47

We released Sonic-3.5 and Ink-2, the #1 streaming models for text to speech and speech to text you can use in your voice agents today. New architectures enable new frontiers for speed and quality. We're now the only provider to have #1 models for both speaking and listening.

Karan Goel

7,004,255 просмотров • 25 дней назад

When Bush came to NATO, he made a Speech and Left. When Obama came to NATO, he made a speech and left. When Trump came to NATO and he said “LET ME SEE YOUR BOOKS”
0:53

When Bush came to NATO, he made a Speech and Left. When Obama came to NATO, he made a speech and left. When Trump came to NATO and he said “LET ME SEE YOUR BOOKS”

MJTruthUltra

1,382,232 просмотров • 1 год назад

jungkook’s little nod and smile when he was listening to jimin talk about how he wanted to be in 2025 because bts would be together :(
0:25

jungkook’s little nod and smile when he was listening to jimin talk about how he wanted to be in 2025 because bts would be together :(

lex⁷

113,665 просмотров • 3 лет назад

Speech to Speech is now available in 29 languages. In November, we launched Speech to Speech, enabling you to transform your voice into another character with full control over emotions, timing, and delivery. Today we're making Speech to Speech multilingual. Use Speech to Speech to get more control than with prompting alone. Simply say it how you want it, choose a target voice, and generate.
0:37

Speech to Speech is now available in 29 languages. In November, we launched Speech to Speech, enabling you to transform your voice into another character with full control over emotions, timing, and delivery. Today we're making Speech to Speech multilingual. Use Speech to Speech to get more control than with prompting alone. Simply say it how you want it, choose a target voice, and generate.

ElevenLabs

113,343 просмотров • 2 лет назад

It's going to be insane when we can prompt our own virtual worlds like this and explore them. Imagine adding other characters you can talk to with LLMs + voice models!
0:28

It's going to be insane when we can prompt our own virtual worlds like this and explore them. Imagine adding other characters you can talk to with LLMs + voice models!

Justine Moore

2,188,073 просмотров • 1 год назад

Robert De Niro: I'm pretty close to being a free speech absolutist. Even speech I don't like. But when I hear something I don't like, I use my own free speech to respond. When I hear Trump say, "I don't think about Americans' financial situation." I say, "shut the fuck up."
0:42

Robert De Niro: I'm pretty close to being a free speech absolutist. Even speech I don't like. But when I hear something I don't like, I use my own free speech to respond. When I hear Trump say, "I don't think about Americans' financial situation." I say, "shut the fuck up."

Headquarters

797,149 просмотров • 26 дней назад

"We cannot remain silent. No-one can remain silent when there is an ongoing genocide and when people are denied the most basic human needs ... To stand with Palestine is to be human." Greta Thunberg calls out Israel's genocide during a speech in Leipzig, Germany.
0:55

"We cannot remain silent. No-one can remain silent when there is an ongoing genocide and when people are denied the most basic human needs ... To stand with Palestine is to be human." Greta Thunberg calls out Israel's genocide during a speech in Leipzig, Germany.

Quds News Network

728,916 просмотров • 2 лет назад

Throwback to when iLLeY gave Dashy and Cellium a motivational speech 😂
0:39

Throwback to when iLLeY gave Dashy and Cellium a motivational speech 😂

SpawnUp

61,704 просмотров • 8 месяцев назад

Speech-native models like Moshi sound great and answer fast, but aren’t as smart as text LLMs. In our new paper, MoshiRAG, we show how Moshi can ask for advice from a text LLM or a knowledge base. The tricky part is how to do this in real time without adding latency. 🧵
1:06

Speech-native models like Moshi sound great and answer fast, but aren’t as smart as text LLMs. In our new paper, MoshiRAG, we show how Moshi can ask for advice from a text LLM or a knowledge base. The tricky part is how to do this in real time without adding latency. 🧵

kyutai

52,598 просмотров • 2 месяцев назад

ELON: WHEN WE LOSE FREE SPEECH, WE LOSE DEMOCRACY "Free speech is the bedrock of democracy, and free speech is what allows atrocities to be called out and for people to be aware of them. That's why the Germans wanted to shut down the press immediately. So, I think we should do everything we can to preserve free speech. And when we lose free speech, I think we lose democracy." Source: Interview with Ben Shapiro / Daily Wire, January 2024
0:23

ELON: WHEN WE LOSE FREE SPEECH, WE LOSE DEMOCRACY "Free speech is the bedrock of democracy, and free speech is what allows atrocities to be called out and for people to be aware of them. That's why the Germans wanted to shut down the press immediately. So, I think we should do everything we can to preserve free speech. And when we lose free speech, I think we lose democracy." Source: Interview with Ben Shapiro / Daily Wire, January 2024

Mario Nawfal

14,271,694 просмотров • 1 год назад

"Know when to walk away and know when to run"
0:23

"Know when to walk away and know when to run"

JScott Memes

57,182 просмотров • 9 месяцев назад

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations
2:50

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations

Google AI

1,092,358 просмотров • 7 месяцев назад

Hiring RL Engineer! Started off as a curious project at Lossfunk to push the boundaries of LLMs in social reasoning - we are now building RL environments, data, and benchmarks to simulate more real-world scenarios. If you want to train SoTA RL models over multi-GPUs (H200s/B200s) to unlock next AI frontier, this is for you.
1:21

Hiring RL Engineer! Started off as a curious project at Lossfunk to push the boundaries of LLMs in social reasoning - we are now building RL environments, data, and benchmarks to simulate more real-world scenarios. If you want to train SoTA RL models over multi-GPUs (H200s/B200s) to unlock next AI frontier, this is for you.

Satpal Singh Rathore

45,915 просмотров • 11 месяцев назад

Our paper is out in Nature Human Behaviour🔥🔥 ‘Evidence of a predictive coding hierarchy in the human brain listening to speech’ 📄 💡Unlike language models, our brain makes distant & hierarchical predictions with Alexandre Gramfort and Jean-Rémi King Thread👇
0:43

Our paper is out in Nature Human Behaviour🔥🔥 ‘Evidence of a predictive coding hierarchy in the human brain listening to speech’ 📄 💡Unlike language models, our brain makes distant & hierarchical predictions with Alexandre Gramfort and Jean-Rémi King Thread👇

Charlotte Caucheteux @NeurIPS2025

145,098 просмотров • 3 лет назад

"We know we're going to looks, know we're going to get chances. We just got to focus and bear down when they come." More post-game 🎥 »
0:29

"We know we're going to looks, know we're going to get chances. We just got to focus and bear down when they come." More post-game 🎥 »

Detroit Red Wings

19,832 просмотров • 3 месяцев назад

Know when to hold them and know when to fold them
0:56

Know when to hold them and know when to fold them

TaraBull

304,274 просмотров • 6 месяцев назад

Our latest speech-to-speech model is faster, more accurate, and excels at function calling. Watch @promptshant and Brian Fioca build a realtime voice agent that can search the web and hand off tasks to reasoning models with full context.
1:58

Our latest speech-to-speech model is faster, more accurate, and excels at function calling. Watch @promptshant and Brian Fioca build a realtime voice agent that can search the web and hand off tasks to reasoning models with full context.

OpenAI Developers

81,822 просмотров • 1 год назад

Tavus just secured a $40M raise to bring a new kind of intelligence to life. When technology starts to understand us, respond to us, and feel present with us, the future suddenly feels real. PALs add emotion, perception, and genuine human presence to computing in a way we’ve never seen before. Not a chatbot. Not a wrapper. A true human level interface you can talk to through video, voice, or text. This is what it looks like when machines finally learn to connect with us. Comment “PALs” and I’ll DM you free early access.
0:22

Tavus just secured a $40M raise to bring a new kind of intelligence to life. When technology starts to understand us, respond to us, and feel present with us, the future suddenly feels real. PALs add emotion, perception, and genuine human presence to computing in a way we’ve never seen before. Not a chatbot. Not a wrapper. A true human level interface you can talk to through video, voice, or text. This is what it looks like when machines finally learn to connect with us. Comment “PALs” and I’ll DM you free early access.

Manish Kumar Shah

19,375 просмотров • 7 месяцев назад

* abt love scenes 🐻 I will always go to him and say like it's okay we can do it. Bcs when when we’re filming love scene, we have to talk to eo first just want to feel free when we’re playing this scene. I want to both of us feel free and be happy playin it #ปอนด์ภูวินทร์
1:58

* abt love scenes 🐻 I will always go to him and say like it's okay we can do it. Bcs when when we’re filming love scene, we have to talk to eo first just want to feel free when we’re playing this scene. I want to both of us feel free and be happy playin it #ปอนด์ภูวินทร์

𝙇𝙚𝙖 🧡🤍

29,849 просмотров • 3 месяцев назад