Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

MICROSOFT OPEN SOURCED A 7B PARAMETER MODEL THAT TRANSCRIBES 60 MINUTES OF AUDIO IN A SINGLE PASS and it's completely free VIBEVOICE ASR no chunking, no context loss, full speaker diarization baked in not just speech to text..not a basic wrapper who spoke, when they spoke, exactly what they... show more

Rahul

144,231 subscribers

1,375,300 views • 5 months ago •via X (Twitter)

Education Health & Wellness Science & Technology

Anya Rossi• Live Now

Private livecam show

32 Comments

Seth5 months ago

MIT means free code, not free compute. Self-hosting a 7B ASR means a GPU instance running 24/7. That's almost certainly more $/mo than a Deepgram bill. There's no Microsoft-hosted free API tier here.

Stef5 months ago

“Free” Who owns the data now? Who can parse and use that content now? Who can leverage that content now? Yeah… “free” is always a Trojan horse.

timdrchslr5 months ago

Use groq with whisper large v3 turbo for only 0,04$ per hour, hours of audio transcribed in a couple of seconds!!

Nomad5 months ago

Diarization baked in is cool, but 7B parameters kinda defeats the point. You can’t roll this out on device. Parakeet at 0.6b or Granite 1b are a better fit for os local

EventsLooped5 months ago

Whisper models are also free to run on your machine

VC Intern5 months ago

we’re entering the phase where: speech becomes a solved layer the value won’t be transcription it’ll be what you do with it after

Alpha Batcher5 months ago

i love free open sourced models >3 applause to Microsoft

Julian Goldie SEO5 months ago

that’s actually a big drop

Sanchit5 months ago

oh wow i had been using elevenlabs API inside of kilo for some work but it was slightly costly. I am going to try this out. 7B is not a lot to run locally

tang | AI Product Maker5 months ago

the 'no chunking' part is the real unlock. tested 3 ASR pipelines for a video workflow last quarter and chunked diarization always lost ~6-8% speaker accuracy when voices swapped at the chunk boundary. how does VibeVoice deal with overlapping speakers in the same window?

Quadcode AI5 months ago

funny how every week there's a revolutonary asr model that supposedly fixes everything at once if it actually nails long form audio and diarization cleanly then thats genuinely impressive but claims like that usually age weirdly

juaniam5 months ago

Or you can use typrapp with whisper large v3 turbo running locally for free and a nice ui on top

flamz5 months ago

Nah, they are data farming peoples voices and you all are willingly giving it to them.

Layton Gott5 months ago

It's not completely free...

Sebastian Buzdugan5 months ago

single pass is cool but diarization quality will decide if this actually ships

Max Bourke5 months ago

Hmm single pass sounds good but 7b is pretty big for local transcription… be curious to see if quantized versions perform well.

Victor Tavernari 5 months ago

@perssua @lucas_montano

Eric4 months ago

ignoring the caps lock hype, the actual signal here isn't the 60 minute context window. it's the native diarization.

CODIFY5 months ago

That’s ground-breaking!

Ben Dickey5 months ago

Wow,

Cyril Gupta5 months ago

Microsoft just collapsed half the ASR stack. One-pass transcription + built-in diarization = no chunking, no glue code. Paired with Ollama → fully local, private voice pipelines. Free isn’t the headline. Owning the stack is.

Goldengmgm🐸 Яebel 🪖5 months ago

wen @AskVenice

Maxwell de Melo5 months ago

Nice!

Facundo Campo · Dev5 months ago

Es un cambio de rumbo!

DiffusionTales5 months ago

I use SubtitleEdit and use the audio to text (whisper).

Adam Jaworski5 months ago

is it any good?

AIGoldenfinger5 months ago

17GB ASR Speech-to-Text model? Are you kidding me? I will run a Film Production Pipelines on 12GB GPU, that would generate the Images, The videos and also the Conversations And also the Music (the score). Microsoft Speech-to-text... ROFL - Get Out Of Here. Go fix your Windows MS

⭕💡5 months ago

When you say 🆓 what does it mean?

Terry Nunn5 months ago

Don’t just open source the weights, host it for us for free! No one normal person can afford the GPUs needed for this.

Tabish Gillani5 months ago

Is it available on

Rey Neill5 months ago

Hm

AI's Nest5 months ago

We are entering an era where the most successful researchers won't be the best coders, but the best "Product Managers" of their own ideas

Related Videos

🚨 JUST IN: MICROSOFT just open sourced a VOICE AI THAT TRANSCRIBES 60 MINUTES OF AUDIO in a single pass. 100% FREE. It knows who spoke. It knows when they spoke. It knows exactly what they said. All in one shot. No chunking. No context loss. It's called VibeVoice. Not a transcription tool. Not a basic speech to text wrapper. A frontier voice AI family with ASR, TTS, and real time streaming. All open source. All free. Here's what it actually does 👇 VibeVoice ASR - Speech Recognition: → Processes 60 minutes of continuous audio in a single pass → Never slices audio into chunks so global context is never lost → Identifies WHO spoke, WHEN they spoke and WHAT they said simultaneously → Supports customized hotwords for domain specific accuracy → Works in 50+ languages natively → Already adopted by Hugging Face Transformers library → Already being built on by the open source community BY PEOPLE WHO HAD NO IDEA THIS LEVEL OF ACCURACY WAS ALREADY FREE. VibeVoice TTS - Text to Speech: → Generates up to 90 minutes of speech in a single pass → Supports up to 4 distinct speakers in one conversation → Natural turn taking and speaker consistency throughout → Expressive speech that captures emotional nuances → Supports English, Chinese and multiple other languages VibeVoice Realtime - Streaming TTS: → Only 300 millisecond first audible latency → Streams text input in real time → 0.5B parameters so it actually deploys anywhere → Robust long form generation up to 10 minutes → Lightweight enough for production use today The core innovation nobody is talking about: Most voice AI models slice long audio into short chunks. Every time they slice, they lose context. Speaker tracking breaks. Semantic coherence breaks. Accuracy drops. VibeVoice uses continuous speech tokenizers running at an ultra low frame rate of 7.5 Hz. This preserves audio fidelity while dramatically boosting computational efficiency. The entire 60 minutes stays in context. Nothing gets lost. Nobody gets misidentified. The numbers: → VibeVoice ASR 7B - available now on Hugging Face → VibeVoice Realtime 0.5B - try it on Colab right now → 50+ supported languages → 11 distinct English voice styles → 9 multilingual speaker voices → Already integrated into Hugging Face Transformers → Finetuning code now available The wildest part? A voice powered input method called Vibing just built itself on top of VibeVoice ASR. Available on macOS and Windows right now. The open source community is already shipping products on top of this. 100% Open Source. Free to use. Free to fine tune. Free to build on. 🔖 Save this before your competitors find it first. 👇

🚨 JUST IN: MICROSOFT just open sourced a VOICE AI THAT TRANSCRIBES 60 MINUTES OF AUDIO in a single pass. 100% FREE. It knows who spoke. It knows when they spoke. It knows exactly what they said. All in one shot. No chunking. No context loss. It's called VibeVoice. Not a transcription tool. Not a basic speech to text wrapper. A frontier voice AI family with ASR, TTS, and real time streaming. All open source. All free. Here's what it actually does 👇 VibeVoice ASR - Speech Recognition: → Processes 60 minutes of continuous audio in a single pass → Never slices audio into chunks so global context is never lost → Identifies WHO spoke, WHEN they spoke and WHAT they said simultaneously → Supports customized hotwords for domain specific accuracy → Works in 50+ languages natively → Already adopted by Hugging Face Transformers library → Already being built on by the open source community BY PEOPLE WHO HAD NO IDEA THIS LEVEL OF ACCURACY WAS ALREADY FREE. VibeVoice TTS - Text to Speech: → Generates up to 90 minutes of speech in a single pass → Supports up to 4 distinct speakers in one conversation → Natural turn taking and speaker consistency throughout → Expressive speech that captures emotional nuances → Supports English, Chinese and multiple other languages VibeVoice Realtime - Streaming TTS: → Only 300 millisecond first audible latency → Streams text input in real time → 0.5B parameters so it actually deploys anywhere → Robust long form generation up to 10 minutes → Lightweight enough for production use today The core innovation nobody is talking about: Most voice AI models slice long audio into short chunks. Every time they slice, they lose context. Speaker tracking breaks. Semantic coherence breaks. Accuracy drops. VibeVoice uses continuous speech tokenizers running at an ultra low frame rate of 7.5 Hz. This preserves audio fidelity while dramatically boosting computational efficiency. The entire 60 minutes stays in context. Nothing gets lost. Nobody gets misidentified. The numbers: → VibeVoice ASR 7B - available now on Hugging Face → VibeVoice Realtime 0.5B - try it on Colab right now → 50+ supported languages → 11 distinct English voice styles → 9 multilingual speaker voices → Already integrated into Hugging Face Transformers → Finetuning code now available The wildest part? A voice powered input method called Vibing just built itself on top of VibeVoice ASR. Available on macOS and Windows right now. The open source community is already shipping products on top of this. 100% Open Source. Free to use. Free to fine tune. Free to build on. 🔖 Save this before your competitors find it first. 👇

Kanika

221,715 views • 5 months ago

Microsoft did it again! Speech AI models have a major limitation. They slice long recordings into tiny chunks, lose track of who's speaking, and forget all context halfway through. This is exactly what Microsoft's VibeVoice solves. It's an open-source family of frontier voice AI models for both speech recognition and speech generation. Here's what it can do: > VibeVoice-ASR processes up to 60 minutes of audio in a single pass. No chunking. It outputs structured transcriptions with who spoke, when they spoke, and what they said. > You can feed it custom hotwords like names, technical jargon, or domain-specific terms. The model uses them to significantly improve accuracy on specialized content. > VibeVoice-TTS generates up to 90 minutes of multi-speaker speech with up to 4 distinct speakers. Natural turn-taking, emotional expression, all in one pass. > VibeVoice-Realtime is a 0.5B streaming TTS model with ~300ms first-audio latency. Small enough to deploy practically anywhere. All of this is powered by continuous speech tokenizers running at just 7.5 Hz. This ultra-low frame rate preserves audio quality while making long sequences computationally feasible. I have shared the link to the GitHub repo in the replies!

Microsoft did it again! Speech AI models have a major limitation. They slice long recordings into tiny chunks, lose track of who's speaking, and forget all context halfway through. This is exactly what Microsoft's VibeVoice solves. It's an open-source family of frontier voice AI models for both speech recognition and speech generation. Here's what it can do: > VibeVoice-ASR processes up to 60 minutes of audio in a single pass. No chunking. It outputs structured transcriptions with who spoke, when they spoke, and what they said. > You can feed it custom hotwords like names, technical jargon, or domain-specific terms. The model uses them to significantly improve accuracy on specialized content. > VibeVoice-TTS generates up to 90 minutes of multi-speaker speech with up to 4 distinct speakers. Natural turn-taking, emotional expression, all in one pass. > VibeVoice-Realtime is a 0.5B streaming TTS model with ~300ms first-audio latency. Small enough to deploy practically anywhere. All of this is powered by continuous speech tokenizers running at just 7.5 Hz. This ultra-low frame rate preserves audio quality while making long sequences computationally feasible. I have shared the link to the GitHub repo in the replies!

Akshay 🚀

45,256 views • 6 months ago

Microsoft just killed voice subscriptions. 🤯 They quietly open-sourced VibeVoice, and it’s a total industry disruptor. Transcribe hour-long meetings or generate 90 minutes of natural, multi-speaker speech, all locally on your hardware for free. It handles 50+ languages and complex speaker tracking without the monthly fees. The era of expensive voice apps is officially over. I share updates like these in my free AI community on WhatsApp. Join here

Microsoft just killed voice subscriptions. 🤯 They quietly open-sourced VibeVoice, and it’s a total industry disruptor. Transcribe hour-long meetings or generate 90 minutes of natural, multi-speaker speech, all locally on your hardware for free. It handles 50+ languages and complex speaker tracking without the monthly fees. The era of expensive voice apps is officially over. I share updates like these in my free AI community on WhatsApp. Join here

Vaibhav Sisinty

22,132 views • 5 months ago

MICROSOFT DROPPED A 4B PARAMETER MODEL THAT TURNS ONE IMAGE INTO A 3D ASSET IN 3 SECONDS and it's open source TRELLIS.2 fully textured, physically accurate 3D models with PBR textures out of the box not a rough mesh..not a placeholder roughness, metallic, opacity the kind of detail that makes things look real under any lighting and it handles the weird stuff too..open surfaces, hollow interiors, geometry that breaks every other tool the model doesn't know the word "limitation" apparently demo is live on hugging face right now

MICROSOFT DROPPED A 4B PARAMETER MODEL THAT TURNS ONE IMAGE INTO A 3D ASSET IN 3 SECONDS and it's open source TRELLIS.2 fully textured, physically accurate 3D models with PBR textures out of the box not a rough mesh..not a placeholder roughness, metallic, opacity the kind of detail that makes things look real under any lighting and it handles the weird stuff too..open surfaces, hollow interiors, geometry that breaks every other tool the model doesn't know the word "limitation" apparently demo is live on hugging face right now

Vaishnavi

355,536 views • 5 months ago

🚨 ElevenLabs just killed every transcription tool on the market. They dropped Scribe v2 Realtime and it's not just another speech-to-text model. This thing processes audio in real-time with zero lag, handles multiple speakers, and actually understands context not just words. Here's how with real examples: Full thread 🧵

🚨 ElevenLabs just killed every transcription tool on the market. They dropped Scribe v2 Realtime and it's not just another speech-to-text model. This thing processes audio in real-time with zero lag, handles multiple speakers, and actually understands context not just words. Here's how with real examples: Full thread 🧵

Hasan Toor

220,789 views • 10 months ago

$Someone open-sourced a 66M parameter model that beats ElevenLabs, OpenAI, and Gemini and runs entirely offline on a Raspberry Pi. it's called Supertonic, a text-to-speech model so fast it turns an entire webpage into audio in under 1 second. locally. offline. for free. text-to-speech has lived in the cloud for years. every spoken character was an API call and a fraction of a cent. Supertonic 3 kills that entirely. the model is 99M parameters. ships as a single ONNX file. hits 167× faster than real-time on a laptop CPU. that's ~1,263 characters of speech per second. other open systems sit at 55–287. no cloud. no API. no GPU. → 31 languages, no separate adapters → works inside a browser tab (WebGPU/WASM) → handles phone numbers, currency, dates — no preprocessing → inline tags for laugh and breath → Turns an entire webpage into audio in under 1 second → 44.1kHz studio-grade WAV, no upsampler needed` and on real-world text, "$5.2M", "(212) 555-0142 ext. 402", "30kph”, it's the only one that reads them correctly. ElevenLabs Flash, OpenAI TTS-1, Gemini 2.5 Flash all fail. Supertonic passes. 11.2k stars. 100% Open Source.$

Someone open-sourced a 66M parameter model that beats ElevenLabs, OpenAI, and Gemini and runs entirely offline on a Raspberry Pi. it's called Supertonic, a text-to-speech model so fast it turns an entire webpage into audio in under 1 second. locally. offline. for free. text-to-speech has lived in the cloud for years. every spoken character was an API call and a fraction of a cent. Supertonic 3 kills that entirely. the model is 99M parameters. ships as a single ONNX file. hits 167× faster than real-time on a laptop CPU. that's ~1,263 characters of speech per second. other open systems sit at 55–287. no cloud. no API. no GPU. → 31 languages, no separate adapters → works inside a browser tab (WebGPU/WASM) → handles phone numbers, currency, dates — no preprocessing → inline tags for laugh and breath → Turns an entire webpage into audio in under 1 second → 44.1kHz studio-grade WAV, no upsampler needed` and on real-world text, "$5.2M", "(212) 555-0142 ext. 402", "30kph”, it's the only one that reads them correctly. ElevenLabs Flash, OpenAI TTS-1, Gemini 2.5 Flash all fail. Supertonic passes. 11.2k stars. 100% Open Source.

Superman

30,416 views • 2 months ago

French President Macron: I do believe in free speech. But what does it mean? Free speech means I will listen to you, you will listen to me, and we are in an equal relationship. A lot of people defending free speech do it based on algorithms without any transparency, with a lot of bias, and with their own political agenda. It's not free speech. And when people clearly help hate speech, racist speech to be spread all over the place, it's not about free speech. It's a jungle. I really believe in free speech based on respect and transparency.

French President Macron: I do believe in free speech. But what does it mean? Free speech means I will listen to you, you will listen to me, and we are in an equal relationship. A lot of people defending free speech do it based on algorithms without any transparency, with a lot of bias, and with their own political agenda. It's not free speech. And when people clearly help hate speech, racist speech to be spread all over the place, it's not about free speech. It's a jungle. I really believe in free speech based on respect and transparency.

Clash Report

788,808 views • 7 months ago

French President Macron: I do believe in free speech. But what does it mean? Free speech means I will listen to you, you will listen to me, and we are in an equal relationship. A lot of people defending free speech do it based on algorithms without any transparency, with a lot of bias, and with their own political agenda. It's not free speech. And when people clearly help hate speech, racist speech to be spread all over the place, it's not about free speech. It's a jungle. I really believe in free speech based on respect and transparency.

French President Macron: I do believe in free speech. But what does it mean? Free speech means I will listen to you, you will listen to me, and we are in an equal relationship. A lot of people defending free speech do it based on algorithms without any transparency, with a lot of bias, and with their own political agenda. It's not free speech. And when people clearly help hate speech, racist speech to be spread all over the place, it's not about free speech. It's a jungle. I really believe in free speech based on respect and transparency.

Open Source Intel

63,018 views • 7 months ago

Hermes Agent is now free to run 24/7. No paid model needed. You can plug in: → Qwen 3.6 Plus → OwlAlpha via OpenRouter Both have 1M token context windows. That means your agent can research, write, find leads, handle tasks, and build workflows without burning through paid API credits. The best part? When one free model hits limits, just switch to the other. Free AI agents are getting scary fast.

Hermes Agent is now free to run 24/7. No paid model needed. You can plug in: → Qwen 3.6 Plus → OwlAlpha via OpenRouter Both have 1M token context windows. That means your agent can research, write, find leads, handle tasks, and build workflows without burning through paid API credits. The best part? When one free model hits limits, just switch to the other. Free AI agents are getting scary fast.

Julian Goldie SEO

21,609 views • 4 months ago

NVIDIA JUST DROPPED A FREE AI MODEL THAT READS PDFS, WATCHES VIDEOS, LISTENS TO AUDIO, AND UNDERSTANDS YOUR SCREEN SIMULTANEOUSLY. Not one at a time. ALL AT ONCE. In a single pass. It is called Nemotron 3 Nano Omni and it runs 9 times faster than every other multimodal model currently available. Think about what that actually means for how you work. Right now you are switching between tools constantly. One tool for transcribing your call recordings. A different tool for analyzing your client PDFs. Another tool for processing your training videos. A separate workflow for understanding what is happening on your screen. Four tools. Four contexts. Four different outputs you have to manually synthesize into one decision. Nemotron 3 Nano Omni does all of it in one model. One pass. One output. The use cases that just got dramatically simpler: Meeting recordings where you need the transcript, the visual context, and the document references all analyzed together. Training videos where the audio, the slides, and the on-screen demonstrations all feed into one coherent summary. Client PDFs where you need the document content cross-referenced against your screen data and your call notes simultaneously. Sales call transcripts analyzed alongside the proposals and the CRM data in one unified pass. This is not a marginal improvement on existing multimodal models. It is a 9x speed increase on a capability that was already changing how people work. Free. From NVIDIA. Available right now. Bookmark this before everyone catches on. Follow CyrilXBT for every AI capability shift the moment it drops.

NVIDIA JUST DROPPED A FREE AI MODEL THAT READS PDFS, WATCHES VIDEOS, LISTENS TO AUDIO, AND UNDERSTANDS YOUR SCREEN SIMULTANEOUSLY. Not one at a time. ALL AT ONCE. In a single pass. It is called Nemotron 3 Nano Omni and it runs 9 times faster than every other multimodal model currently available. Think about what that actually means for how you work. Right now you are switching between tools constantly. One tool for transcribing your call recordings. A different tool for analyzing your client PDFs. Another tool for processing your training videos. A separate workflow for understanding what is happening on your screen. Four tools. Four contexts. Four different outputs you have to manually synthesize into one decision. Nemotron 3 Nano Omni does all of it in one model. One pass. One output. The use cases that just got dramatically simpler: Meeting recordings where you need the transcript, the visual context, and the document references all analyzed together. Training videos where the audio, the slides, and the on-screen demonstrations all feed into one coherent summary. Client PDFs where you need the document content cross-referenced against your screen data and your call notes simultaneously. Sales call transcripts analyzed alongside the proposals and the CRM data in one unified pass. This is not a marginal improvement on existing multimodal models. It is a 9x speed increase on a capability that was already changing how people work. Free. From NVIDIA. Available right now. Bookmark this before everyone catches on. Follow CyrilXBT for every AI capability shift the moment it drops.

CyrilXBT

37,847 views • 5 months ago

Excited about the launch of Amazon Nova Sonic, our new speech-to-speech model that helps make AI voice applications feel remarkably natural. It's designed to understand not just what people say, but how they say it – working with tone, style, and conversation flow including pauses and interruptions. Nova Sonic delivers speech understanding and generation through a single, unified model, making it easier for builders to develop voice applications that maintain important context and nuance for customer service, AI agents, and other use cases across industries. It’s available in Amazon Bedrock now. Look forward to seeing what teams build with Nova Sonic!

Excited about the launch of Amazon Nova Sonic, our new speech-to-speech model that helps make AI voice applications feel remarkably natural. It's designed to understand not just what people say, but how they say it – working with tone, style, and conversation flow including pauses and interruptions. Nova Sonic delivers speech understanding and generation through a single, unified model, making it easier for builders to develop voice applications that maintain important context and nuance for customer service, AI agents, and other use cases across industries. It’s available in Amazon Bedrock now. Look forward to seeing what teams build with Nova Sonic!

Andy Jassy

155,905 views • 1 year ago

i found a website that gives you the best AI models for free, every single day 😳 claude, gpt, gemini, deepseek and 10+ more, all in one place. no subscription, no credit card. it's called poe. you get free credits every day, and they reset every 24 hours so you never really run out. what you can use for free: - claude, for writing and thinking through hard stuff - gpt, for everyday questions and chat - gemini, for long documents and images - deepseek, for tricky problems - and 10+ more, all in one login how to start (2 minutes): > 1. go to (or get the app on your phone or mac) > 2. sign up with google or email, no card needed > 3. you land straight in the chat, free credits already there > 4. pick a model on the left and start typing > 5. switch models anytime, the credits refill every day one simple tip to make your credits last: use the small fast models for easy stuff, and save the big ones for when you really need them. don't waste a powerful model on a yes or no question. what this saves you: - chatgpt plus: $20/mo - claude pro: $20/mo - gemini advanced: $20/mo that's $60 a month for three apps that mostly do the same thing. poe gives you all of them in one place, for free. one login. every top model. zero dollars. bookmark this so you stop paying for AI you can get for free

i found a website that gives you the best AI models for free, every single day 😳 claude, gpt, gemini, deepseek and 10+ more, all in one place. no subscription, no credit card. it's called poe. you get free credits every day, and they reset every 24 hours so you never really run out. what you can use for free: - claude, for writing and thinking through hard stuff - gpt, for everyday questions and chat - gemini, for long documents and images - deepseek, for tricky problems - and 10+ more, all in one login how to start (2 minutes): > 1. go to (or get the app on your phone or mac) > 2. sign up with google or email, no card needed > 3. you land straight in the chat, free credits already there > 4. pick a model on the left and start typing > 5. switch models anytime, the credits refill every day one simple tip to make your credits last: use the small fast models for easy stuff, and save the big ones for when you really need them. don't waste a powerful model on a yes or no question. what this saves you: - chatgpt plus: $20/mo - claude pro: $20/mo - gemini advanced: $20/mo that's $60 a month for three apps that mostly do the same thing. poe gives you all of them in one place, for free. one login. every top model. zero dollars. bookmark this so you stop paying for AI you can get for free

Isra

58,018 views • 3 months ago

OpenAI's S2S preview is polished but it still thinks in steps. Speech → text → model → text → speech. That's not how humans converse. Introducing Hydra. A native speech-to-speech model that doesn't wait for turn-taking, doesn't flatten emotion into text, and doesn't break when you interrupt it mid-sentence. Hydra reasons asynchronously, speaks and listens simultaneously, and preserves emotion because it never leaves the audio domain. It's still in beta, but the shift is obvious. If you want early access, the link is in the comments. Here's a preview of what that looks like -

OpenAI's S2S preview is polished but it still thinks in steps. Speech → text → model → text → speech. That's not how humans converse. Introducing Hydra. A native speech-to-speech model that doesn't wait for turn-taking, doesn't flatten emotion into text, and doesn't break when you interrupt it mid-sentence. Hydra reasons asynchronously, speaks and listens simultaneously, and preserves emotion because it never leaves the audio domain. It's still in beta, but the shift is obvious. If you want early access, the link is in the comments. Here's a preview of what that looks like -

Sudarshan Kamath

329,378 views • 6 months ago

💥Bill Maher SCHOOLS Canadian Comedian Tom Green on why Canada *DOESN'T* have free speech like America🇺🇸 GREEN: "We have freedom of speech … There are hate speech laws in Canada — so there are things you can't say ... Who would want to say that sh*t anyways?" MAHER: "That's not what free speech means … You don’t know what free speech is." "The Supreme Court ruled in our country that the Nazis could march in Skokie, Illinois — which they were marching in because it is a community of a lot of Holocaust survivors ... That is what free speech is about."

💥Bill Maher SCHOOLS Canadian Comedian Tom Green on why Canada DOESN'T have free speech like America🇺🇸 GREEN: "We have freedom of speech … There are hate speech laws in Canada — so there are things you can't say ... Who would want to say that sh*t anyways?" MAHER: "That's not what free speech means … You don’t know what free speech is." "The Supreme Court ruled in our country that the Nazis could march in Skokie, Illinois — which they were marching in because it is a community of a lot of Holocaust survivors ... That is what free speech is about."

Jason Cohen 🇺🇸

1,443,938 views • 1 year ago

NVIDIA just removed the biggest friction point in Voice AI 🤯 They've open-sourced PersonaPlex-7B, a full-duplex conversational model that can listen and speak at the same time. Instead of waiting for you to finish talking, it uses a dual-stream architecture to process and respond in real-time. 100% Open-Source and Free.

NVIDIA just removed the biggest friction point in Voice AI 🤯 They've open-sourced PersonaPlex-7B, a full-duplex conversational model that can listen and speak at the same time. Instead of waiting for you to finish talking, it uses a dual-stream architecture to process and respond in real-time. 100% Open-Source and Free.

Simplifying AI

278,970 views • 8 months ago

Kimi K3 dropped 3 days ago and i already used it to build my own PUBG the model that just took the number one coding spot on earth and it runs on a free tier no team no engine i just fed it free open models and assets that are already public and told it what i wanted it built the entire game itself the shooting the recoil the hit detection all of it came straight out of the model i barely wrote a line what youre watching here is the deathmatch mode and its already live battle royale is next im deep in it and the graphics get reworked right after i know it looks raw right now i wont pretend otherwise but the endgame is a build that runs perfect on phones and the moment its on mobile you drop ads in and it earns on its own the part that still gets me is my whole cost for this was a single subscription

Kimi K3 dropped 3 days ago and i already used it to build my own PUBG the model that just took the number one coding spot on earth and it runs on a free tier no team no engine i just fed it free open models and assets that are already public and told it what i wanted it built the entire game itself the shooting the recoil the hit detection all of it came straight out of the model i barely wrote a line what youre watching here is the deathmatch mode and its already live battle royale is next im deep in it and the graphics get reworked right after i know it looks raw right now i wont pretend otherwise but the endgame is a build that runs perfect on phones and the moment its on mobile you drop ads in and it earns on its own the part that still gets me is my whole cost for this was a single subscription

savip.

68,984 views • 2 months ago

You can now generate real-time speech that sounds conversational. Microsoft just open-sourced VibeVoice, a real-time text-to-speech system with ~300 ms first audio latency and streaming input. It handles long conversations without falling apart. 𝗧𝗵𝗶𝘀 𝗺𝗼𝗱𝗲𝗹 𝗴𝗲𝗻𝗲𝗿𝗮𝘁𝗲𝘀 𝗹𝗼𝗻𝗴, 𝗺𝘂𝗹𝘁𝗶-𝘀𝗽𝗲𝗮𝗸𝗲𝗿 𝘀𝗽𝗲𝗲𝗰𝗵. It produces up to 90 minutes of audio. It supports up to four distinct speakers. Turn-taking stays consistent over long sessions. 𝗜𝘁 𝘄𝗼𝗿𝗸𝘀 𝗯𝘆 𝗿𝗲𝗱𝘂𝗰𝗶𝗻𝗴 𝘁𝗶𝗺𝗲 𝗿𝗲𝘀𝗼𝗹𝘂𝘁𝗶𝗼𝗻. Audio compresses into semantic and acoustic tokens. They run at 7.5 Hz instead of frame-level audio. A language model predicts structure. A diffusion head restores acoustic detail. 𝗜𝘁 𝗮𝗹𝗹𝗼𝘄𝘀 𝗹𝗼𝘄-𝗹𝗮𝘁𝗲𝗻𝗰𝘆 𝘀𝘁𝗿𝗲𝗮𝗺𝗶𝗻𝗴 𝗮𝘂𝗱𝗶𝗼. The real-time variant streams text incrementally. First speech arrives in ~300 ms. A WebSocket demo shows live generation. The code is MIT-licensed and research-only. The repo already passed 20k GitHub stars.

You can now generate real-time speech that sounds conversational. Microsoft just open-sourced VibeVoice, a real-time text-to-speech system with ~300 ms first audio latency and streaming input. It handles long conversations without falling apart. 𝗧𝗵𝗶𝘀 𝗺𝗼𝗱𝗲𝗹 𝗴𝗲𝗻𝗲𝗿𝗮𝘁𝗲𝘀 𝗹𝗼𝗻𝗴, 𝗺𝘂𝗹𝘁𝗶-𝘀𝗽𝗲𝗮𝗸𝗲𝗿 𝘀𝗽𝗲𝗲𝗰𝗵. It produces up to 90 minutes of audio. It supports up to four distinct speakers. Turn-taking stays consistent over long sessions. 𝗜𝘁 𝘄𝗼𝗿𝗸𝘀 𝗯𝘆 𝗿𝗲𝗱𝘂𝗰𝗶𝗻𝗴 𝘁𝗶𝗺𝗲 𝗿𝗲𝘀𝗼𝗹𝘂𝘁𝗶𝗼𝗻. Audio compresses into semantic and acoustic tokens. They run at 7.5 Hz instead of frame-level audio. A language model predicts structure. A diffusion head restores acoustic detail. 𝗜𝘁 𝗮𝗹𝗹𝗼𝘄𝘀 𝗹𝗼𝘄-𝗹𝗮𝘁𝗲𝗻𝗰𝘆 𝘀𝘁𝗿𝗲𝗮𝗺𝗶𝗻𝗴 𝗮𝘂𝗱𝗶𝗼. The real-time variant streams text incrementally. First speech arrives in ~300 ms. A WebSocket demo shows live generation. The code is MIT-licensed and research-only. The repo already passed 20k GitHub stars.

Lior Alexander

61,122 views • 8 months ago

NVIDIA just removed one of the biggest friction points in Voice AI. PersonaPlex-7B is an open-source, full-duplex conversational model. Free, open source (MIT), with open model weights on Hugging Face 🤗 Links to repo and weights in 🧵↓ The traditional ASR → LLM → TTS pipeline forces rigid turn-taking. It’s efficient, but it never feels natural. PersonaPlex-7B changes that. This NVIDIA model can listen and speak at the same time. It runs directly on continuous audio tokens with a dual-stream transformer, generating text and audio in parallel instead of passing control between components. That unlocks: → instant back-channel responses → interruptions that feel human → real conversational rhythm Persona control is fully zero-shot! If you’re building low-latency assistants or support agents, this is a big step forward 🔥

NVIDIA just removed one of the biggest friction points in Voice AI. PersonaPlex-7B is an open-source, full-duplex conversational model. Free, open source (MIT), with open model weights on Hugging Face 🤗 Links to repo and weights in 🧵↓ The traditional ASR → LLM → TTS pipeline forces rigid turn-taking. It’s efficient, but it never feels natural. PersonaPlex-7B changes that. This NVIDIA model can listen and speak at the same time. It runs directly on continuous audio tokens with a dual-stream transformer, generating text and audio in parallel instead of passing control between components. That unlocks: → instant back-channel responses → interruptions that feel human → real conversational rhythm Persona control is fully zero-shot! If you’re building low-latency assistants or support agents, this is a big step forward 🔥

Charly Wargnier ♨️

566,178 views • 8 months ago