Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

This new 2B open-source speech model transcribes in real time with 200ms latency 🤯 It’s called Confucius R2T2 by NetEase Youdao and commits each word the moment it's recognized and never rewrites it. 100% open source.

31,677 görüntüleme • 3 gün önce •via X (Twitter)

18 Yorum

Alvaro Cintas profil fotoğrafı
Alvaro Cintas3 gün önce

Almost every streaming ASR system is built to emit something at every step. When the audio is ambiguous, it falls back on language priors and produces its best guess, because staying silent isn't really an option in the architecture. R2T2 introduces an explicit wait state instead. If there isn't enough acoustic evidence yet, it holds. When evidence arrives, it commits.

Alvaro Cintas profil fotoğrafı
Alvaro Cintas3 gün önce

What I find interesting is how this reframes the latency conversation. The field keeps chasing "predict faster." This design argues the harder skill is knowing when a prediction is premature and would cost you more downstream than a short pause. Link: Open source, vLLM backend. Built for voice agents.

Alvaro Cintas profil fotoğrafı
Alvaro Cintas2 gün önce

Here are the links to the repo: and Hugging Face:

FluidVoice profil fotoğrafı
FluidVoice2 gün önce

Awesome find! Benchmarking it to see if it's a good fit for Fluidvoice and my users ;)

Swipecraft profil fotoğrafı
Swipecraft3 gün önce

What is the inference cost ? we have already NLLB model there right ? so what is the special about this model ?

Qamar Rizwani profil fotoğrafı
Qamar Rizwani3 gün önce

Nice real time transcription, @Build_Vertical.

triet.bui profil fotoğrafı
triet.bui2 gün önce

Wow, thanks for the information 🤯

Gregor profil fotoğrafı
Gregor3 gün önce

the 'never rewrites' claim is the real tradeoff here. most streaming models correct earlier words as context rolls in. genuinely asking how WER compares to Whisper on phonetically ambiguous audio

Ali Mirza | AI Agents & Automation profil fotoğrafı
Ali Mirza | AI Agents & Automation3 gün önce

200ms immutable token emission cuts voice agent turn-taking latency in half.

Manu_TechAndGames profil fotoğrafı
Manu_TechAndGames2 gün önce

Not completely open source. Companies with 1B revenues need a specific license.

Aaron profil fotoğrafı
Aaron3 gün önce

damn that's awesome, trying it right away

Muhammad Ayan profil fotoğrafı
Muhammad Ayan3 gün önce

the wait state is the clever bit guessing less can beat speaking sooner

💧🌞John Troughton profil fotoğrafı
💧🌞John Troughton3 gün önce

How can we get it?

Alvaro Cintas profil fotoğrafı
Alvaro Cintas3 gün önce

Here:

Thach Nguyen profil fotoğrafı
Thach Nguyen3 gün önce

big if true, esp for ai voice agents. how is it compared to deepgram in terms of accuracy?

James Camarota profil fotoğrafı
James Camarota2 gün önce

Committing each word without rewriting is a bold design. How does it handle names or phrases that only become clear from later context?

Abat profil fotoğrafı
Abat2 gün önce

That's great!

Max Bevza profil fotoğrafı
Max Bevza3 gün önce

finally an open source model that actually stays bullish

Benzer Videolar