Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

BOOM! Microsoft just released an upgraded VibeVoice Large ~10B Text to Speech model - MIT licensed ๐Ÿ”ฅ > Generate multi-speaker podcasts in minutes โšก > Works blazingly fast on ZeroGPU with H200 (FREE) Try it out today!

89,549 Aufrufe โ€ข vor 10 Monaten โ€ขvia X (Twitter)

0 Kommentare

Keine Kommentare verfรผgbar

Kommentare vom Original-Post werden hier angezeigt

ร„hnliche Videos

๐Ÿšจ JUST IN: MICROSOFT just open sourced a VOICE AI THAT TRANSCRIBES 60 MINUTES OF AUDIO in a single pass. 100% FREE. It knows who spoke. It knows when they spoke. It knows exactly what they said. All in one shot. No chunking. No context loss. It's called VibeVoice. Not a transcription tool. Not a basic speech to text wrapper. A frontier voice AI family with ASR, TTS, and real time streaming. All open source. All free. Here's what it actually does ๐Ÿ‘‡ VibeVoice ASR - Speech Recognition: โ†’ Processes 60 minutes of continuous audio in a single pass โ†’ Never slices audio into chunks so global context is never lost โ†’ Identifies WHO spoke, WHEN they spoke and WHAT they said simultaneously โ†’ Supports customized hotwords for domain specific accuracy โ†’ Works in 50+ languages natively โ†’ Already adopted by Hugging Face Transformers library โ†’ Already being built on by the open source community BY PEOPLE WHO HAD NO IDEA THIS LEVEL OF ACCURACY WAS ALREADY FREE. VibeVoice TTS - Text to Speech: โ†’ Generates up to 90 minutes of speech in a single pass โ†’ Supports up to 4 distinct speakers in one conversation โ†’ Natural turn taking and speaker consistency throughout โ†’ Expressive speech that captures emotional nuances โ†’ Supports English, Chinese and multiple other languages VibeVoice Realtime - Streaming TTS: โ†’ Only 300 millisecond first audible latency โ†’ Streams text input in real time โ†’ 0.5B parameters so it actually deploys anywhere โ†’ Robust long form generation up to 10 minutes โ†’ Lightweight enough for production use today The core innovation nobody is talking about: Most voice AI models slice long audio into short chunks. Every time they slice, they lose context. Speaker tracking breaks. Semantic coherence breaks. Accuracy drops. VibeVoice uses continuous speech tokenizers running at an ultra low frame rate of 7.5 Hz. This preserves audio fidelity while dramatically boosting computational efficiency. The entire 60 minutes stays in context. Nothing gets lost. Nobody gets misidentified. The numbers: โ†’ VibeVoice ASR 7B - available now on Hugging Face โ†’ VibeVoice Realtime 0.5B - try it on Colab right now โ†’ 50+ supported languages โ†’ 11 distinct English voice styles โ†’ 9 multilingual speaker voices โ†’ Already integrated into Hugging Face Transformers โ†’ Finetuning code now available The wildest part? A voice powered input method called Vibing just built itself on top of VibeVoice ASR. Available on macOS and Windows right now. The open source community is already shipping products on top of this. 100% Open Source. Free to use. Free to fine tune. Free to build on. ๐Ÿ”– Save this before your competitors find it first. ๐Ÿ‘‡

Kanika

220,656 Aufrufe โ€ข vor 3 Monaten

You can now generate real-time speech that sounds conversational. Microsoft just open-sourced VibeVoice, a real-time text-to-speech system with ~300 ms first audio latency and streaming input. It handles long conversations without falling apart. ๐—ง๐—ต๐—ถ๐˜€ ๐—บ๐—ผ๐—ฑ๐—ฒ๐—น ๐—ด๐—ฒ๐—ป๐—ฒ๐—ฟ๐—ฎ๐˜๐—ฒ๐˜€ ๐—น๐—ผ๐—ป๐—ด, ๐—บ๐˜‚๐—น๐˜๐—ถ-๐˜€๐—ฝ๐—ฒ๐—ฎ๐—ธ๐—ฒ๐—ฟ ๐˜€๐—ฝ๐—ฒ๐—ฒ๐—ฐ๐—ต. It produces up to 90 minutes of audio. It supports up to four distinct speakers. Turn-taking stays consistent over long sessions. ๐—œ๐˜ ๐˜„๐—ผ๐—ฟ๐—ธ๐˜€ ๐—ฏ๐˜† ๐—ฟ๐—ฒ๐—ฑ๐˜‚๐—ฐ๐—ถ๐—ป๐—ด ๐˜๐—ถ๐—บ๐—ฒ ๐—ฟ๐—ฒ๐˜€๐—ผ๐—น๐˜‚๐˜๐—ถ๐—ผ๐—ป. Audio compresses into semantic and acoustic tokens. They run at 7.5 Hz instead of frame-level audio. A language model predicts structure. A diffusion head restores acoustic detail. ๐—œ๐˜ ๐—ฎ๐—น๐—น๐—ผ๐˜„๐˜€ ๐—น๐—ผ๐˜„-๐—น๐—ฎ๐˜๐—ฒ๐—ป๐—ฐ๐˜† ๐˜€๐˜๐—ฟ๐—ฒ๐—ฎ๐—บ๐—ถ๐—ป๐—ด ๐—ฎ๐˜‚๐—ฑ๐—ถ๐—ผ. The real-time variant streams text incrementally. First speech arrives in ~300 ms. A WebSocket demo shows live generation. The code is MIT-licensed and research-only. The repo already passed 20k GitHub stars.

Lior Alexander

60,568 Aufrufe โ€ข vor 5 Monaten