Загрузка видео...

Не удалось загрузить видео

На главную

This new 2B open-source speech model transcribes in real time with 200ms latency 🤯 It’s called Confucius R2T2 by NetEase Youdao and commits each word the moment it's recognized and never rewrites it. 100% open source.

31,677 просмотров • 3 дней назад •via X (Twitter)

Комментарии: 18

Фото профиля Alvaro Cintas
Alvaro Cintas3 дней назад

Almost every streaming ASR system is built to emit something at every step. When the audio is ambiguous, it falls back on language priors and produces its best guess, because staying silent isn't really an option in the architecture. R2T2 introduces an explicit wait state instead. If there isn't enough acoustic evidence yet, it holds. When evidence arrives, it commits.

Фото профиля Alvaro Cintas
Alvaro Cintas3 дней назад

What I find interesting is how this reframes the latency conversation. The field keeps chasing "predict faster." This design argues the harder skill is knowing when a prediction is premature and would cost you more downstream than a short pause. Link: Open source, vLLM backend. Built for voice agents.

Фото профиля Alvaro Cintas
Alvaro Cintas3 дней назад

Here are the links to the repo: and Hugging Face:

Фото профиля FluidVoice
FluidVoice2 дней назад

Awesome find! Benchmarking it to see if it's a good fit for Fluidvoice and my users ;)

Фото профиля Swipecraft
Swipecraft3 дней назад

What is the inference cost ? we have already NLLB model there right ? so what is the special about this model ?

Фото профиля Qamar Rizwani
Qamar Rizwani3 дней назад

Nice real time transcription, @Build_Vertical.

Фото профиля triet.bui
triet.bui2 дней назад

Wow, thanks for the information 🤯

Фото профиля Gregor
Gregor3 дней назад

the 'never rewrites' claim is the real tradeoff here. most streaming models correct earlier words as context rolls in. genuinely asking how WER compares to Whisper on phonetically ambiguous audio

Фото профиля Ali Mirza | AI Agents & Automation
Ali Mirza | AI Agents & Automation3 дней назад

200ms immutable token emission cuts voice agent turn-taking latency in half.

Фото профиля Manu_TechAndGames
Manu_TechAndGames2 дней назад

Not completely open source. Companies with 1B revenues need a specific license.

Фото профиля Aaron
Aaron3 дней назад

damn that's awesome, trying it right away

Фото профиля Muhammad Ayan
Muhammad Ayan3 дней назад

the wait state is the clever bit guessing less can beat speaking sooner

Фото профиля 💧🌞John Troughton
💧🌞John Troughton3 дней назад

How can we get it?

Фото профиля Alvaro Cintas
Alvaro Cintas3 дней назад

Here:

Фото профиля Thach Nguyen
Thach Nguyen3 дней назад

big if true, esp for ai voice agents. how is it compared to deepgram in terms of accuracy?

Фото профиля James Camarota
James Camarota2 дней назад

Committing each word without rewriting is a bold design. How does it handle names or phrases that only become clear from later context?

Фото профиля Abat
Abat2 дней назад

That's great!

Фото профиля Max Bevza
Max Bevza3 дней назад

finally an open source model that actually stays bullish

Похожие видео