正在加载视频...

视频加载失败

This new 2B open-source speech model transcribes in real time with 200ms latency 🤯 It’s called Confucius R2T2 by NetEase Youdao and commits each word the moment it's recognized and never rewrites it. 100% open source.

31,677 次观看 • 3 天前 •via X (Twitter)

18 条评论

Alvaro Cintas 的头像
Alvaro Cintas3 天前

Almost every streaming ASR system is built to emit something at every step. When the audio is ambiguous, it falls back on language priors and produces its best guess, because staying silent isn't really an option in the architecture. R2T2 introduces an explicit wait state instead. If there isn't enough acoustic evidence yet, it holds. When evidence arrives, it commits.

Alvaro Cintas 的头像
Alvaro Cintas3 天前

What I find interesting is how this reframes the latency conversation. The field keeps chasing "predict faster." This design argues the harder skill is knowing when a prediction is premature and would cost you more downstream than a short pause. Link: Open source, vLLM backend. Built for voice agents.

Alvaro Cintas 的头像
Alvaro Cintas2 天前

Here are the links to the repo: and Hugging Face:

FluidVoice 的头像
FluidVoice2 天前

Awesome find! Benchmarking it to see if it's a good fit for Fluidvoice and my users ;)

Swipecraft 的头像
Swipecraft3 天前

What is the inference cost ? we have already NLLB model there right ? so what is the special about this model ?

Qamar Rizwani 的头像
Qamar Rizwani3 天前

Nice real time transcription, @Build_Vertical.

triet.bui 的头像
triet.bui2 天前

Wow, thanks for the information 🤯

Gregor 的头像
Gregor3 天前

the 'never rewrites' claim is the real tradeoff here. most streaming models correct earlier words as context rolls in. genuinely asking how WER compares to Whisper on phonetically ambiguous audio

Ali Mirza | AI Agents & Automation 的头像
Ali Mirza | AI Agents & Automation3 天前

200ms immutable token emission cuts voice agent turn-taking latency in half.

Manu_TechAndGames 的头像
Manu_TechAndGames2 天前

Not completely open source. Companies with 1B revenues need a specific license.

Aaron 的头像
Aaron3 天前

damn that's awesome, trying it right away

Muhammad Ayan 的头像
Muhammad Ayan3 天前

the wait state is the clever bit guessing less can beat speaking sooner

💧🌞John Troughton 的头像
💧🌞John Troughton3 天前

How can we get it?

Alvaro Cintas 的头像
Alvaro Cintas3 天前

Here:

Thach Nguyen 的头像
Thach Nguyen3 天前

big if true, esp for ai voice agents. how is it compared to deepgram in terms of accuracy?

James Camarota 的头像
James Camarota2 天前

Committing each word without rewriting is a bold design. How does it handle names or phrases that only become clear from later context?

Abat 的头像
Abat2 天前

That's great!

Max Bevza 的头像
Max Bevza3 天前

finally an open source model that actually stays bullish

相关视频