Loading video...

Video Failed to Load

Go Home

Muse Voice Transcribe is MSL's first real-time audio perception model -- rolling out today. SOTA in streaming speech-to-text, it handles speaker diarization, and endpointing natively in a single model.

1,128,640 views • 2 months ago •via X (Twitter)

36 Comments

Mark Zuckerberg's profile picture
Mark Zuckerberg2 months ago

The model decides when to listen. It waits a little longer on hard words and commits faster on easy ones, using adaptive delay to predict each token and increase accuracy. With adaptive delay, the model is near the pareto front on speed-accuracy tradeoff.

Mark Zuckerberg's profile picture
Mark Zuckerberg2 months ago

It holds up on messy, real audio too -- trained across 70+ languages (with 25 validated at launch), handles mid-sentence code-switching, and manages hour-long sessions with 20+ speakers. You can bias it toward names and domain terms as well.

Mark Zuckerberg's profile picture
Mark Zuckerberg2 months ago

Already powering dictation in the Meta desktop app and voice input in Muse Code. Live now on the Meta model API with a zero-data-retention tier.

Andi Marafioti's profile picture
Andi Marafioti2 months ago

@eliza_luth

Rohan Paul's profile picture
Rohan Paul2 months ago

wow, Meta is on fire. Congrats Mark. looks like a brilliant model.

Diligent Plane's profile picture
Diligent Plane2 months ago

mark is in grind mode rn Love to see it

Hervé "pyannote" Bredin's profile picture
Hervé "pyannote" Bredin2 months ago

Rule of thumb: If @pyannoteAI is missing from the benchmark, there's probably a reason. cc @finkd @AIatMeta @alex_conneau

…'s profile picture
…2 months ago

Nice work; it seems there are a lot of American researchers there.

abhishek's profile picture
abhishek2 months ago

Nice to see so many releases from meta. Always rooting for meta. Btw What is the cost to transcribe an hour video? I have here explained why 0.1 usd per hour or less is the right price for transcription.

Maksim P. Martynyuk 🇺🇸🇺🇦's profile picture
Maksim P. Martynyuk 🇺🇸🇺🇦2 months ago

Going to be amazing for the meta glasses

𝕱𝖚𝖑𝖑 𝕶𝖊𝖑𝖑𝖞's profile picture
𝕱𝖚𝖑𝖑 𝕶𝖊𝖑𝖑𝖞2 months ago

Incredible performance that blows the existing SOTA at detecting voices out of the water, but it's a shame you're not releasing an open weights model version

London Member Specialist Club's profile picture
London Member Specialist Club2 months ago

Is social media Algorithms now run by medieval dictators? Does your followers read your posts & replies? - ELQUOR

Allora's profile picture
Allora2 months ago

The next constraint is still judgment. Once systems can hear continuously, they need intelligence that stays accurate as conditions change, not just a better transcript.

Alex Volkov's profile picture
Alex Volkov2 months ago

let's go! Just a week after Gemini 3.5 intelligence transcribe models! WIll put them to the test on @thursdai_pod 🫡 this week!

Elshayib's profile picture
Elshayib2 months ago

Bro no one cares Fable 5.1 around the corner fuck that

Freeman Jiang's profile picture
Freeman Jiang2 months ago

Would love to see how this performs on

Ivan Fioravanti ᯅ's profile picture
Ivan Fioravanti ᯅ2 months ago

Great release! Keep pushing!

utku's profile picture
utku2 months ago

Congrats!

Jim Faster's profile picture
Jim Faster2 months ago

Looks absolutely incredible. I wish it was open source but I understand this is a lot of work.

ExamAdda's profile picture
ExamAdda2 months ago

SOTA streaming STT with native diarization and adaptive delay is a serious flex well done.

Allen's profile picture
Allen2 months ago

I’m working on the same capabilities as this one, but with AI running locally on the device.

prayag sonar's profile picture
prayag sonar2 months ago

Good to see Meta is really trying hard to come back and win the AI race.

harixh's profile picture
harixh2 months ago

does it support multiple languages ? damn this is crzy good!

𝕩Simon Wu's profile picture
𝕩Simon Wu2 months ago

Super siiiick I’ll be testing this out Z. So when you gonna wrestle with E??

Webster | JARVIS's profile picture
Webster | JARVIS2 months ago

Streaming STT with native diarization in one model is nuts. Diarization post-processing is always the janky part.

Emad Ghorbaninia's profile picture
Emad Ghorbaninia2 months ago

The real headline here isn't 'real-time transcription,' it's a model deciding when to keep listening instead of committing early. That's the difference between a voice agent that feels natural and one that talks over you.

Furkan Gözükara's profile picture
Furkan Gözükara2 months ago

Why the model weights not open?

Sathvik A.R's profile picture
Sathvik A.R2 months ago

Meta just dropped Muse Voice Transcribe and it immediately took #1 on Artificial Analysis streaming speech-to-text. I’m actually shook. 😭🔥 Real-time ASR. 20+ speaker diarization. Endpointing. Code-switching. 25 validated languages. The numbers:
🎤 Streaming WER: 3.1% (ahead of Cartesia, ElevenLabs, GPT, Gemini)
👥 Diarization lead too
💻 Hold Fn on Mac and dictate into anything
💸 $0.18 per hour of audio This is Meta Superintelligence Labs’ first real-time audio perception model and it just walked onto the leaderboard like it owned the place. 👑 #Meta #MuseVoice #VoiceAI #ArtificialAnalysis #SpeechToText #AI #ASR #MetaAI

Daniel C's profile picture
Daniel C2 months ago

Bro your whole lab is Chinese?

Abdullah 's profile picture
Abdullah 2 months ago

Mark and @jack have been shipping on Twitter lately like they’re trying to get into YC

smiler—'s profile picture
smiler—2 months ago

all the whatsapp voice messages came to fruition…

Gabriel Garrett's profile picture
Gabriel Garrett2 months ago

zuck, i know your posts aren't very popular on here, but I will be your friend. nice model.

Tommy Maloney's profile picture
Tommy Maloney2 months ago

Hey Jarvis (@grok) this looks very similar to the personal Jarvis lattice that I’ve created with you

Mohamad's profile picture
Mohamad2 months ago

Nice update, but you're a bit late" to the party. xAl and OpenAl already solved real-time streaming, diarization, and reasoning months ago. Meta needs to speed up, the game has changed.. Zero-data-retention???

Donald Ryle's profile picture
Donald Ryle2 months ago

Hey Mark I need your help on something and you need to fix Facebook automatically delete it my account got deleted his number snake I actually do follow community guidance I need your to fix that bug or else I will never ever ever again make another Facebook again

Fandral's profile picture
Fandral2 months ago

开源吗

Related Videos