Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Speech-to-speech no longer needs speech-to-text! Until now, our stack was VAD -> STT -> LLM -> TTS. Now it can send audio directly to multimodal LLMs: VAD → MLLM → TTS No STT. The model understands your voice. Now go build better voice agents!

Andi Marafioti

8,003 subscribers

108,293 görüntüleme • 4 gün önce •via X (Twitter)

Bilim & Teknoloji Eğitim

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️

Prince Canuma

163,744 görüntüleme • 5 ay önce

SwiftUI: You can chain free and open-source STT, TTS, and LLMs to build voice/vision apps with Core AI. Here is a demo I was experimenting with: - Whisper: Speech-to-text - Kokoro-82M: Text-to-speech - Qwen3-VL 2B: Vision I converted Pocket TTS and VibeVoice to Core AI models and tried with Gemma 4. All is working great.

SwiftUI: You can chain free and open-source STT, TTS, and LLMs to build voice/vision apps with Core AI. Here is a demo I was experimenting with: - Whisper: Speech-to-text - Kokoro-82M: Text-to-speech - Qwen3-VL 2B: Vision I converted Pocket TTS and VibeVoice to Core AI models and tried with Gemma 4. All is working great.

Amos Gyamfi

79,756 görüntüleme • 1 ay önce

✨ bolt.new + BuildShip = Voice-to-Voice Translation App 🎙️ 🚀 Build your own AI-powered translator: - Convert speech → text (OpenAI Whisper) - Translate into any language - Generate lifelike speech (TTS) - Upload & retrieve translated audio files

✨ bolt.new + BuildShip = Voice-to-Voice Translation App 🎙️ 🚀 Build your own AI-powered translator: - Convert speech → text (OpenAI Whisper) - Translate into any language - Generate lifelike speech (TTS) - Upload & retrieve translated audio files

BuildShip

12,742 görüntüleme • 1 yıl önce

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

Melvin Vivas

27,722 görüntüleme • 1 yıl önce

How to build the world's fastest voice AI bot: - Self-host speech-to-text, LLM inference, and text-to-speech all together in the same container/cluster. - Route audio over the internet using WebRTC and edge networking. - Configure timings for voice activity detection, phrase endpointing, and other parts of the pipeline to optimize for latency. (There are trade-offs to doing this!) Here's a LLama 3 voice bot that has voice-to-voice response times of ~500ms. We used Deepgram's STT and TTS for this bot, and everything is hosted on cerebriumai's serverless GPU infrastructure.

How to build the world's fastest voice AI bot: - Self-host speech-to-text, LLM inference, and text-to-speech all together in the same container/cluster. - Route audio over the internet using WebRTC and edge networking. - Configure timings for voice activity detection, phrase endpointing, and other parts of the pipeline to optimize for latency. (There are trade-offs to doing this!) Here's a LLama 3 voice bot that has voice-to-voice response times of ~500ms. We used Deepgram's STT and TTS for this bot, and everything is hosted on cerebriumai's serverless GPU infrastructure.

kwindla

282,617 görüntüleme • 2 yıl önce

🎙️Do you know you now have all the building blocks for full speech-to-speech? - Voxtral Realtime: High-quality, real-time speech-to-text. - Mistral Small 4: Fast, efficient, general-purpose agentic model. - Voxtral TTS: Realistic customizable text-to-speech with streaming output.

🎙️Do you know you now have all the building blocks for full speech-to-speech? - Voxtral Realtime: High-quality, real-time speech-to-text. - Mistral Small 4: Fast, efficient, general-purpose agentic model. - Voxtral TTS: Realistic customizable text-to-speech with streaming output.

Mistral AI for Developers

27,858 görüntüleme • 4 ay önce

We added 600+ new voices on Together AI! Introducing MiniMax Speech 2.8 Turbo on Together AI, an enterprise TTS model for expressive real-time voice agents. AI natives can now deploy MiniMax (official) Speech 2.8 Turbo on Together AI dedicated infrastructure, and try the voices directly in voice finder.

We added 600+ new voices on Together AI! Introducing MiniMax Speech 2.8 Turbo on Together AI, an enterprise TTS model for expressive real-time voice agents. AI natives can now deploy MiniMax (official) Speech 2.8 Turbo on Together AI dedicated infrastructure, and try the voices directly in voice finder.

Together AI

21,814 görüntüleme • 2 ay önce

Build a real-time AI Voice Agent that can actually sell. In less than 30 minutes, you'll learn how to build a sophisticated real-time voice sales agent that can have natural conversations with potential customers. Includes a full code notebook, recorded tutorial, and docs The stack: ⚡ fast inference 🎙 LiveKit for real-time audio/video infrastructure 🗣 realistic speech synthesis (STT/TTS)

Build a real-time AI Voice Agent that can actually sell. In less than 30 minutes, you'll learn how to build a sophisticated real-time voice sales agent that can have natural conversations with potential customers. Includes a full code notebook, recorded tutorial, and docs The stack: ⚡ fast inference 🎙 LiveKit for real-time audio/video infrastructure 🗣 realistic speech synthesis (STT/TTS)

Sarah Chieng

452,438 görüntüleme • 10 ay önce

LLaMA voice chat + Siri TTS This example is now truly 100% offline since we are now using the built-in Siri text-to-speech available on MacOS through the "say" command

LLaMA voice chat + Siri TTS This example is now truly 100% offline since we are now using the built-in Siri text-to-speech available on MacOS through the "say" command

Georgi Gerganov

412,007 görüntüleme • 3 yıl önce

xAI just dropped 2 absolute monsters: Grok Speech-to-Text + Grok Text-to-Speech APIs Same battle-tested stack that runs Grok Voice, millions of Tesla cars, and Starlink support. - STT: Real-time WebSocket, speaker diarization, 25+ languages, word-level timestamps. - TTS: Super natural, expressive voices with tags for laugh, sigh, whisper, emphasis, pause; batch + streaming. Put voice AI on the list of things Grok already 100%'d xAI, Grok

xAI just dropped 2 absolute monsters: Grok Speech-to-Text + Grok Text-to-Speech APIs Same battle-tested stack that runs Grok Voice, millions of Tesla cars, and Starlink support. - STT: Real-time WebSocket, speaker diarization, 25+ languages, word-level timestamps. - TTS: Super natural, expressive voices with tags for laugh, sigh, whisper, emphasis, pause; batch + streaming. Put voice AI on the list of things Grok already 100%'d xAI, Grok

Mario Nawfal

164,897 görüntüleme • 3 ay önce

We’re excited to introduce Pocket TTS: a 100M-parameter text-to-speech model with high-quality voice cloning that runs on your laptop—no GPU required. Open-source, lightweight, and incredibly fast. 🧵👇

We’re excited to introduce Pocket TTS: a 100M-parameter text-to-speech model with high-quality voice cloning that runs on your laptop—no GPU required. Open-source, lightweight, and incredibly fast. 🧵👇

kyutai

238,021 görüntüleme • 7 ay önce

I've been building voice agents for the last 6mo and I think the chat-supervisor pattern is a game changer. Stitched model (STT-LLM-TTS) is slow, but realtime audio models aren't (yet) as smart as text. This has the best of both worlds. Here's how it works:

I've been building voice agents for the last 6mo and I think the chat-supervisor pattern is a game changer. Stitched model (STT-LLM-TTS) is slow, but realtime audio models aren't (yet) as smart as text. This has the best of both worlds. Here's how it works:

Noah MacCallum

73,462 görüntüleme • 1 yıl önce

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.

AI at Meta

351,764 görüntüleme • 1 yıl önce

We are thrilled to announce a massive update to our Text-To-Speech (TTS) model for Twi! We are confident it is the best Twi TTS there now! Give it a listen and see if you agree! Sign up for our API and incorporate it into your products today! 🙏🏾 (link in bio)

We are thrilled to announce a massive update to our Text-To-Speech (TTS) model for Twi! We are confident it is the best Twi TTS there now! Give it a listen and see if you agree! Sign up for our API and incorporate it into your products today! 🙏🏾 (link in bio)

Ghana Natural Language Processing (NLP)

94,209 görüntüleme • 2 yıl önce

Gemini 3.1 Flash TTS is our most controllable text-to-speech model yet. With new Audio Tags, you can easily direct vocal style, delivery, and pace through text commands. 🧵

Gemini 3.1 Flash TTS is our most controllable text-to-speech model yet. With new Audio Tags, you can easily direct vocal style, delivery, and pace through text commands. 🧵

Google DeepMind

470,406 görüntüleme • 4 ay önce

Voice AI without the wait! ⏱️ Thanks to Hugging Face and Cerebras, developers can now use the Gemma 4 31B model as the brain for voice AI at ultra-fast inference speeds. Add it to a fully open-source, cascaded speech-to-speech stack that can be used to power existing voice apps! 🗣️

Voice AI without the wait! ⏱️ Thanks to Hugging Face and Cerebras, developers can now use the Gemma 4 31B model as the brain for voice AI at ultra-fast inference speeds. Add it to a fully open-source, cascaded speech-to-speech stack that can be used to power existing voice apps! 🗣️

Google Gemma

160,424 görüntüleme • 26 gün önce

Your app talks back. Lovable now supports text-to-speech and-speech-to-text, so you can seamlessly add AI voice features to your projects. Make a voice assistant, a hands-free tool, or an app you can literally speak to. Sound on:

Your app talks back. Lovable now supports text-to-speech and-speech-to-text, so you can seamlessly add AI voice features to your projects. Make a voice assistant, a hands-free tool, or an app you can literally speak to. Sound on:

Lovable

22,100 görüntüleme • 1 ay önce

I've just tested the EVI 3 speech-to-speech model by Hume Hume AI, and this is the most realistic voice cloning I’ve heard. It doesn’t just clone the sound of your voice — it captures your tone, your speech patterns, your personality. Feels like your voice is thinking in real time. What’s wild is: — It’s not text-to-speech. It’s speech-to-speech. — You speak → it clones your voice + vibe — And it’s compatible with LLMs like Groq, Anthropic, Deepseek - Try talking to a voice clone: - Want more control? Customize it here: This changes how we’ll interact with AI voices. No more robotic replies — these sound human.

I've just tested the EVI 3 speech-to-speech model by Hume Hume AI, and this is the most realistic voice cloning I’ve heard. It doesn’t just clone the sound of your voice — it captures your tone, your speech patterns, your personality. Feels like your voice is thinking in real time. What’s wild is: — It’s not text-to-speech. It’s speech-to-speech. — You speak → it clones your voice + vibe — And it’s compatible with LLMs like Groq, Anthropic, Deepseek - Try talking to a voice clone: - Want more control? Customize it here: This changes how we’ll interact with AI voices. No more robotic replies — these sound human.

Aaliya

28,046 görüntüleme • 1 yıl önce

Today, we’re releasing Octave: the first LLM built for text-to-speech. 🎨Design any voice with a prompt 🎬 Give acting instructions to control emotion and delivery (sarcasm, whispering, etc.) 🛠️Produce long-form content on our Creator Studio Unlike traditional TTS that just “reads” words aloud, Octave understands how meaning affects delivery to generate emotional, human-like speech.

Today, we’re releasing Octave: the first LLM built for text-to-speech. 🎨Design any voice with a prompt 🎬 Give acting instructions to control emotion and delivery (sarcasm, whispering, etc.) 🛠️Produce long-form content on our Creator Studio Unlike traditional TTS that just “reads” words aloud, Octave understands how meaning affects delivery to generate emotional, human-like speech.

Hume AI

394,020 görüntüleme • 1 yıl önce

This is the most realistic voice cloning I’ve ever heard. It captures voice, emotion, speaking style, and even your rhythm. Powered by EVI 3, Hume’s next-gen speech-to-speech model that: ➔ Streams your speech → replies in real-time ➔ Understands tone and context ➔ Adapts emotion on cue (“whisper fearfully,” “sound excited”) Try it now: 🔗 (live demo, no prompt edits) 🔗 (customize voices, integrate with LLMs) You can even integrate it with top AI models like Groq, Anthropic, and DeepSeek 👇 Talk to the voice I cloned here:

This is the most realistic voice cloning I’ve ever heard. It captures voice, emotion, speaking style, and even your rhythm. Powered by EVI 3, Hume’s next-gen speech-to-speech model that: ➔ Streams your speech → replies in real-time ➔ Understands tone and context ➔ Adapts emotion on cue (“whisper fearfully,” “sound excited”) Try it now: 🔗 (live demo, no prompt edits) 🔗 (customize voices, integrate with LLMs) You can even integrate it with top AI models like Groq, Anthropic, and DeepSeek 👇 Talk to the voice I cloned here:

Ali Sufian

15,063 görüntüleme • 1 yıl önce