Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

people always ask me how they can create long, consistent AI videos with audio. well creatify aurora solves a big part of that and there are some new models coming soon too for more action + audio. I created his voice with dia tts which i think great at... show more

gokaygokay

5,427 subscribers

38,341 görüntüleme • 8 ay önce •via X (Twitter)

Eğitim Bilim & Teknoloji

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

Melvin Vivas

27,722 görüntüleme • 1 yıl önce

SwiftUI: You can chain free and open-source STT, TTS, and LLMs to build voice/vision apps with Core AI. Here is a demo I was experimenting with: - Whisper: Speech-to-text - Kokoro-82M: Text-to-speech - Qwen3-VL 2B: Vision I converted Pocket TTS and VibeVoice to Core AI models and tried with Gemma 4. All is working great.

SwiftUI: You can chain free and open-source STT, TTS, and LLMs to build voice/vision apps with Core AI. Here is a demo I was experimenting with: - Whisper: Speech-to-text - Kokoro-82M: Text-to-speech - Qwen3-VL 2B: Vision I converted Pocket TTS and VibeVoice to Core AI models and tried with Gemma 4. All is working great.

Amos Gyamfi

79,756 görüntüleme • 1 ay önce

I’ve been testing MiniMax H3 on Magnific, and this one feels built for serious AI video work. It can combine text, images, video, and audio in the same prompt, then generate up to 15s video in 2K with native synced sound. Not a silent video with audio added later. Voice, music, effects, motion, and visuals are created together.

I’ve been testing MiniMax H3 on Magnific, and this one feels built for serious AI video work. It can combine text, images, video, and audio in the same prompt, then generate up to 15s video in 2K with native synced sound. Not a silent video with audio added later. Voice, music, effects, motion, and visuals are created together.

Dhaval Makwana

49,009 görüntüleme • 8 gün önce

Day 1 of 3 MLX Releases: Introducing MLX-Audio 🚀🔥 A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon. Features ⚡️Fast inference on Apple Silicon (M series chips) 🤖Multiple language support 🗣️Voice customization options 🚀Quantization support for optimized performance Supported models: 🪶Kokoro - A multilingual TTS model with 82M params that supports various languages and voice styles. With more models coming soon. Get started: > pip install mlx-audio Please leave us a star and send a PR :)

Day 1 of 3 MLX Releases: Introducing MLX-Audio 🚀🔥 A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon. Features ⚡️Fast inference on Apple Silicon (M series chips) 🤖Multiple language support 🗣️Voice customization options 🚀Quantization support for optimized performance Supported models: 🪶Kokoro - A multilingual TTS model with 82M params that supports various languages and voice styles. With more models coming soon. Get started: > pip install mlx-audio Please leave us a star and send a PR :)

Prince Canuma

123,553 görüntüleme • 1 yıl önce

How to build the world's fastest voice AI bot: - Self-host speech-to-text, LLM inference, and text-to-speech all together in the same container/cluster. - Route audio over the internet using WebRTC and edge networking. - Configure timings for voice activity detection, phrase endpointing, and other parts of the pipeline to optimize for latency. (There are trade-offs to doing this!) Here's a LLama 3 voice bot that has voice-to-voice response times of ~500ms. We used Deepgram's STT and TTS for this bot, and everything is hosted on cerebriumai's serverless GPU infrastructure.

How to build the world's fastest voice AI bot: - Self-host speech-to-text, LLM inference, and text-to-speech all together in the same container/cluster. - Route audio over the internet using WebRTC and edge networking. - Configure timings for voice activity detection, phrase endpointing, and other parts of the pipeline to optimize for latency. (There are trade-offs to doing this!) Here's a LLama 3 voice bot that has voice-to-voice response times of ~500ms. We used Deepgram's STT and TTS for this bot, and everything is hosted on cerebriumai's serverless GPU infrastructure.

kwindla

282,617 görüntüleme • 2 yıl önce

Text-to-speech is moving way too fast. Just a few days ago, I tweeted about PersonaPlex-7B, NVIDIA's new open source TTS ( And today, Qwen just open-sourced Qwen3-TTS 🤯 It’s a revolutionary text-to-speech model built for control. Not just about generating speech, but about shaping how it sounds directly from language. You can guide the pace, the tone, and the expressiveness straight from text, without touching audio graphs or hand-tuning parameters. That’s the real shift! What makes Qwen3-TTS stand out is how practical it already is: → voice cloning from just a few seconds of audio → voice creation without any reference sample → support for 10 languages out of the box → end-to-end latency down to ~97ms → works in both streaming and non-streaming setups The models come in two sizes (0.6B and 1.7B), so you can trade off quality and hardware cost depending on your setup. You can work with curated voices, designed voices, or cloned ones, and it integrates cleanly with vLLM for production use. It also ships as a simple Python package you can pip install. If you’re building real-time voice systems, this removes a lot of friction! 100% free and open source. I put the repo in the 🧵↓

Text-to-speech is moving way too fast. Just a few days ago, I tweeted about PersonaPlex-7B, NVIDIA's new open source TTS ( And today, Qwen just open-sourced Qwen3-TTS 🤯 It’s a revolutionary text-to-speech model built for control. Not just about generating speech, but about shaping how it sounds directly from language. You can guide the pace, the tone, and the expressiveness straight from text, without touching audio graphs or hand-tuning parameters. That’s the real shift! What makes Qwen3-TTS stand out is how practical it already is: → voice cloning from just a few seconds of audio → voice creation without any reference sample → support for 10 languages out of the box → end-to-end latency down to ~97ms → works in both streaming and non-streaming setups The models come in two sizes (0.6B and 1.7B), so you can trade off quality and hardware cost depending on your setup. You can work with curated voices, designed voices, or cloned ones, and it integrates cleanly with vLLM for production use. It also ships as a simple Python package you can pip install. If you’re building real-time voice systems, this removes a lot of friction! 100% free and open source. I put the repo in the 🧵↓

Charly Wargnier

59,144 görüntüleme • 7 ay önce

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.

Sudarshan Kamath

71,298 görüntüleme • 5 ay önce

Most voice models are great at cloning voices, but they still manage to erase the person. I have an accent. Voice models don't know how to preserve it. Whenever I clone my voice, models get the words right, but mess up the rhythm badly. They flatten my vowels, and everything drifts toward a generic American accent. I'm attaching one example from Mirage. This is the first model I have heard of that can reproduce access as-is. • My accent stays intact, even when speaking English and Spanish • My pacing and cadence feel intentional, not averaged • The expressivity of my voice comes through Best part: Mirage only needs a short sample of your voice to clone it. I think this solves the hard part of voice cloning: intelligibility is easy, but identity is what makes a huge difference. Listen to the attached sample, and you'll notice the difference if you compare it with any other model out there. If you want to try this out, check out this link: Thanks to the Mirage team for collaborating with me on this post.

Most voice models are great at cloning voices, but they still manage to erase the person. I have an accent. Voice models don't know how to preserve it. Whenever I clone my voice, models get the words right, but mess up the rhythm badly. They flatten my vowels, and everything drifts toward a generic American accent. I'm attaching one example from Mirage. This is the first model I have heard of that can reproduce access as-is. • My accent stays intact, even when speaking English and Spanish • My pacing and cadence feel intentional, not averaged • The expressivity of my voice comes through Best part: Mirage only needs a short sample of your voice to clone it. I think this solves the hard part of voice cloning: intelligibility is easy, but identity is what makes a huge difference. Listen to the attached sample, and you'll notice the difference if you compare it with any other model out there. If you want to try this out, check out this link: Thanks to the Mirage team for collaborating with me on this post.

Santiago

31,245 görüntüleme • 8 ay önce

The Ultimate Tutorial for Mastering Voice Cloning with Fish Audio and E2-F5-TTS I can't believe this is just 8 minutes long but teaches everything you need to know about Fish and F5. Even for me, 90% of the content was new and I learned A LOT. A STRONG recommend!

The Ultimate Tutorial for Mastering Voice Cloning with Fish Audio and E2-F5-TTS I can't believe this is just 8 minutes long but teaches everything you need to know about Fish and F5. Even for me, 90% of the content was new and I learned A LOT. A STRONG recommend!

cocktail peanut

21,699 görüntüleme • 1 yıl önce

🎧 Audio book is now live on the site for MAKE book I ended up using the 30-second Instant Voice Clone by and just talked into my laptop a bit Instead of the Professional Voice Clone with the 30-minute cut from me on the Lex Fridman podcast, because it had way too many problems, it stumbled over words, made random weird sounds, it just didn't work well The 30-second Instant Voice Clone does have much lower resemblance to my voice, it sounds more like an American voice, but at least it speaks properly 99% of the time I'll keep improving the resemblance by training with more data though over the next few weeks (I'm trying to unlock the 5-minute Instant Voice Clone beta on ElevenLabs) But at least this is good enough as a first version and easily listenable It's about 4.5 hours long! They're MP3s for each chapter of the book and tagged with category Audio Book so any good audio player like iTunes willt ry remember your last listening position (thx Marc Köhlbrugge for that tip) I will add a purchase option for current customers too, soon!

🎧 Audio book is now live on the site for MAKE book I ended up using the 30-second Instant Voice Clone by and just talked into my laptop a bit Instead of the Professional Voice Clone with the 30-minute cut from me on the Lex Fridman podcast, because it had way too many problems, it stumbled over words, made random weird sounds, it just didn't work well The 30-second Instant Voice Clone does have much lower resemblance to my voice, it sounds more like an American voice, but at least it speaks properly 99% of the time I'll keep improving the resemblance by training with more data though over the next few weeks (I'm trying to unlock the 5-minute Instant Voice Clone beta on ElevenLabs) But at least this is good enough as a first version and easily listenable It's about 4.5 hours long! They're MP3s for each chapter of the book and tagged with category Audio Book so any good audio player like iTunes willt ry remember your last listening position (thx Marc Köhlbrugge for that tip) I will add a purchase option for current customers too, soon!

@levelsio

173,286 görüntüleme • 1 yıl önce

Speech-02 from MiniMax Design (H3) is now live—and it’s a great tool to use alongside Hedra for high-quality voice-driven content. Create voiceovers in 30+ languages with natural tone and expressive delivery, then upload them into Hedra to turn your audio into rich, visual content for characters, scenes, and stories. Try it out and see what you can create.

Speech-02 from MiniMax Design (H3) is now live—and it’s a great tool to use alongside Hedra for high-quality voice-driven content. Create voiceovers in 30+ languages with natural tone and expressive delivery, then upload them into Hedra to turn your audio into rich, visual content for characters, scenes, and stories. Try it out and see what you can create.

Hedra

399,697 görüntüleme • 1 yıl önce

ElevenLabs has officially LOST to Open-Source ResembleAI allows you to clone ANY voice without verification using on 5-10 seconds of audio, and dominates on paralinguistic tags for human-like expressions. Most "fast" text-to-speech models sound robotic. Most "quality" TTS models are slow. None incorporate authentication at a foundational level. Resemble AI solved all three. Chatterbox Turbo delivers: 🟢<150ms time-to-first-sound 🟢State-of-the-art quality that beats larger proprietary models 🟢Natural, programmable expressions 🟢Zero-shot voice cloning with just 5 seconds of audio 🟢PerTh watermarking for authenticated and verifiable audio 🟢Open source – full transparency, no black boxes Try it on HuggingFace:

ElevenLabs has officially LOST to Open-Source ResembleAI allows you to clone ANY voice without verification using on 5-10 seconds of audio, and dominates on paralinguistic tags for human-like expressions. Most "fast" text-to-speech models sound robotic. Most "quality" TTS models are slow. None incorporate authentication at a foundational level. Resemble AI solved all three. Chatterbox Turbo delivers: 🟢<150ms time-to-first-sound 🟢State-of-the-art quality that beats larger proprietary models 🟢Natural, programmable expressions 🟢Zero-shot voice cloning with just 5 seconds of audio 🟢PerTh watermarking for authenticated and verifiable audio 🟢Open source – full transparency, no black boxes Try it on HuggingFace:

AI Breakfast

208,735 görüntüleme • 8 ay önce

Real-time AI voice agents for businesses are here. I created this AI assistant in minutes with no code and used my cloned voice to help handle customers at a fictitious store. Plus, there’s now a marketplace with ready-made templates where you can sell yours.

Real-time AI voice agents for businesses are here. I created this AI assistant in minutes with no code and used my cloned voice to help handle customers at a fictitious store. Plus, there’s now a marketplace with ready-made templates where you can sell yours.

Alvaro Cintas

60,780 görüntüleme • 1 yıl önce

Introducing Marvis-TTS 🔥🚀 A new local-first TTS model Lucas Newman and I built for efficiency, accessibility, and real-time performance right on consumer devices like Apple Silicon, iPhones, iPads, and more. Traditional TTS models often demand full text inputs or sacrifice real-time capabilities, Marvis flips the script. It streams audio chunks as text is processed, creating a truly conversational experience. No more awkward pauses or unnatural breaks—Marvis handles the entire text context intelligently to deliver coherent, expressive speech. Get started today: > pip install -U mlx-audio

Introducing Marvis-TTS 🔥🚀 A new local-first TTS model Lucas Newman and I built for efficiency, accessibility, and real-time performance right on consumer devices like Apple Silicon, iPhones, iPads, and more. Traditional TTS models often demand full text inputs or sacrifice real-time capabilities, Marvis flips the script. It streams audio chunks as text is processed, creating a truly conversational experience. No more awkward pauses or unnatural breaks—Marvis handles the entire text context intelligently to deliver coherent, expressive speech. Get started today: > pip install -U mlx-audio

Prince Canuma

81,404 görüntüleme • 1 yıl önce

I've been building voice agents for the last 6mo and I think the chat-supervisor pattern is a game changer. Stitched model (STT-LLM-TTS) is slow, but realtime audio models aren't (yet) as smart as text. This has the best of both worlds. Here's how it works:

I've been building voice agents for the last 6mo and I think the chat-supervisor pattern is a game changer. Stitched model (STT-LLM-TTS) is slow, but realtime audio models aren't (yet) as smart as text. This has the best of both worlds. Here's how it works:

Noah MacCallum

73,462 görüntüleme • 1 yıl önce

We are getting closer to “Her” where conversation is the new interface. Siri couldn’t do it, so I built an e-mail summarizing feature using #GPT3 and life-like #AI generated voice on iOS. (🔈Audio on to be 🤯with voice realism!) How did I do this? 👇

We are getting closer to “Her” where conversation is the new interface. Siri couldn’t do it, so I built an e-mail summarizing feature using #GPT3 and life-like #AI generated voice on iOS. (🔈Audio on to be 🤯with voice realism!) How did I do this? 👇

Justin Alvey

204,236 görüntüleme • 3 yıl önce

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️

Prince Canuma

163,831 görüntüleme • 6 ay önce