Big moment for text-to-speech. Qwen just open-sourced a text-to-speech... model that lets you clone voices, design new ones, and control speech using natural language. Let me explain what I mean: You can literally tell it "speak in a cheerful tone with slight nervousness," and it actually does that. No complex audio engineering needed. What makes this special: - 3-second voice cloning - Covers 10 languages: English, German, French, and more - Latency as low as 97ms for real-time applications - Supports both streaming and non-streaming generation The model comes in two sizes (0.6B and 1.7B parameters), so you can pick based on your hardware and quality needs. Three modes to work with: 1. Custom Voice: Use pre-built premium voices with instruction-based style control 2. Voice Design: Describe the voice you want in plain English (or Chinese), and the model creates it 3. Voice Clone: Provide a 3-second reference audio and clone that voice The best part? It integrates with vLLM for production deployment and has a simple Python package you can pip install. I've shared a link to the GitHub repo in the next tweet.show more

This week, we're excited to announce our partnership with... ElevenLabs — making it easier than ever to create videos with studio-grade voices, in any language, directly in Captions. With this partnership, you can dub your videos into different languages, select a professional-quality voice to narrate your content, or clone your voice so you can create polished videos any time, anywhere. Try it out and stay tuned for a third partnership announcement next week!show more

MiniMax H3 is now on Magnific and honestly, there’s... a lot you can do with it. You can mix text, images, videos and audio in a single prompt up to 9 images, 3 videos and 3 audio references. Start creating now: It can generate up to 15s of 2K video with synced sound, including voice, music and effects. And you can go beyond generation too: edit clips, remove objects, transfer motion, and control the camera, character and voice. But the multi-reference workflow is probably my favorite. Give it your product, character, environment and motion references, and H3 pulls everything together. It feels like a much easier way to go from an idea to an actual finished video.show more

MiniMax H3 is now 50% OFF on Magnific for... 2K video, only until September 1. 🔥 I’ve been trying MiniMax H3 on Magnific, and it feels like a big upgrade for AI video creation. It’s not just about turning text into videos. You can use text, images, videos, and audio together in one prompt, giving you more control over the final video. Here’s what makes it stand out: - Multimodal: Use text, images, video, and audio in one prompt. - Multiple references: Add up to 9 images, 3 videos, and 3 audio files. - 2K video: Create videos up to 15 seconds long. - Built-in sound: Generate voice, music, and sound effects with the video. - Easy editing: Remove objects or transfer motion easily. - More control: Control the camera, characters, and voice. You can use it to turn posters into videos, moodboards into short films, and product images into ads. It also helps bring your ideas to life with realistic movement, lighting, reflections, and sound. The workflow is simple: give it your references → generate → edit → refine. Try MiniMax H3 on Magnific:show more

MiniMax H3 is a serious upgrade for AI video... creation. Instead of relying on just text prompts, you can combine images, videos, and audio references to control the character, motion, camera, and sound. What stands out: → Up to 9 image + 3 video + 3 audio references → Native synced voice, music & sound effects → 2K video generation up to 15 seconds → Instruction-based video editing → Motion transfer → Better character, camera & voice control The interesting part is that you can build a full scene from references instead of endlessly regenerating until the result feels right. 🔗 Now is a great time to try MiniMax H3 on Magnific, especially with the current 2K offer.show more

llama.cpp isn't just for text LLMs anymore. Pure C++... zero shot voice cloning just officially landed in mainline. Text generation was only step one. If you’re building autonomous local AI agents, real time voice assistants, or edge workflows, instant low latency audio is the missing piece. Thanks to PR #26254, Alibaba’s state of the art Qwen3 TTS model family is now natively supported directly inside the llama.cpp repository under the multimodal (mtmd) framework. No Python bloat. No massive PyTorch CUDA overhead. Just raw, hyper optimized C++ running GGUF voice weights. Here is why this native update is a massive deal for the open source local AI stack: # Multimodal Architecture (.gguf + mmproj) Qwen3-TTS splits the workload between the base language model backbone and a multimodal projection adapter. llama.cpp handles this using the llama-tts binary, mapping the text model alongside its --mmproj projector to process audio tokens seamlessly. # Zero Shot Voice Cloning in Seconds You don't need fine tuning or massive dataset training. Feed the C++ engine a single 5 to 10 second .wav audio sample using the --tts-speaker-file flag, and it accurately clones the exact timbre, tone, and accent on the fly. # Real World T4 GPU Benchmark & Resource FootprintRunning the 1.7B Base model in 8-bit quantization (Q8_0): - VRAM Footprint: ~7 GB peak VRAM during active zero-shot cloning. - Audio Quality: Studio grade, natural-sounding voice output in seconds. • - Execution: Direct execution via native compiled binaries or sub process calls. # Coming Next to llama-server (PR #26603) Beyond CLI execution, a native POST /tts HTTP endpoint is currently being added to llama-server, which will soon allow you to trigger voice generation directly via standard REST API requests! # quick note on Colab compilation: Because this code was merged into mainline very recently, pre-built third-party binaries haven't fully caught up yet. Compiling llama-tts directly from source on Google Colab's free CPU instance can take about 1 hour (or ~1-2 minutes if targeting single GPU arch like -DCMAKE_CUDA_ARCHITECTURES=75). Be patient during the build step, or compile it locally on your own rig for instant execution! To test this out yourself, I built a zero config Google Colab notebook that compiles llama.cpp, downloads the Q8_0 GGUF files from HuggingFace, and spins up an interactive Gradio Studio UI so you can record/upload 3 second clips and clone voices in real time. Stop sleeping on native C++ audio. The era of bulky Python audio pipelines is officially over. Links to the free Google Colab notebook and the official ggml org GGUF HuggingFace model repository are in the replies below! available in q4 and q8 both variants, 1 GB and 1.85 GBs respectively (requires additional ~500MB mmproj gguf) Are you building local voice agents yet? What does your current audio stack look like? Drop your setups below!show more

⚠️ NSFW ⚠️ Looks like Hume made a virtually... uncensored voice-native LLM called Octave—the first language model built specifically for TTS. You can generate any type of voice you want with a prompt, and their WebUI tool can auto-generate corresponding example dialogue! The model grasps user intent from text quite well, but as you’ll hear in the second example there can be (somewhat unsettling) glitches inb4 glitch orgasms become a new fetish category 🙃show more

Claude Code can now go find the right skill... itself, instead of you searching for one. it's called find-skills. a small package that plugs into Claude Code, and instead of you hunting for rest, you just describe the task and it searches the whole open skills ecosystem, finds the ones that fit, and installs them for you. > tell it what you're trying to do, in plain english > it scans the skills registry and maps your task to real skills > it pulls the right ones in and sets them up half the time you don't even know a skill exists for what you're doing. now you don't have to.show more

Editors are becoming optional for ad creative. I built... a workflow that takes any viral video ad and rebuilds it with your product in it — in a couple of minutes. What it does: - Analyzes the reference ad's style — backgrounds, typography, zooms, pacing - Rebuilds it with your product, your face, your voice - No timeline, no manual cutting, no editor needed Input: raw clip + reference video Output: finished ad Comment "CLONE" and I'll DM you the workflow (must be following) 👇show more

We’re having much more natural conversations with Gemini directly... inside many of our products, so we’re bringing this to two more: Ask YouTube is a new experience for searching for content on YouTube. It gives you information in an easy to navigate layout, with videos best matched to what you’re looking for, and jumps right to the part most relevant to your query. With voice-powered Docs Live you can brain dump whatever is on your mind, and let Gemini do the rest. Rolling out this summer, and the same voice capability is coming to Gmail and Keep then too.show more

OpenClaw, but built for normal people. Sim is an... open-source platform that lets you build AI agent workflows on a drag-and-drop canvas. Connect them to channels like Telegram and WhatsApp and deploy without writing a single line of code. They also have a built-in Copilot that generates entire workflows from plain English, which you can then tweak and customize in the UI. Key features: - Free and open-source (Apache 2.0) - Vector store integration for RAG-grounded agents - Self-host with one command (`npx simstudio`) - Run fully local with Ollama, no API keys needed - Supports vLLM for production-grade self-hosted inference The thing I really like about Sim is the level of control you get. You can add conditional branching, parallel execution, human-in-the-loop approval gates, and even nest workflows inside other workflows. Everything is visible on the canvas, so you know exactly what your agent is doing at every step. And you can build a workflow in Sim, deploy it as an MCP server, and plug it into any agent, including OpenClaw. I've shared the link to Sim's GitHub repo in the next tweet.show more

We’ve seen incredible traction this year, with enterprises transforming... every part of their operations with Voice AI. We’re sharing what we’ve learned and are giving away a guide to the top 10 enterprise use cases for Voice AI. Retweet and comment "CARTESIA" on the main video and we'll send you the guide and $100 in credits so you can get started today.show more

You don't need a GPU for fast studio grade... voice cloning anymore. Qwen3 TTS (1.7B Q4_K_M) + mainline llama.cpp is officially the fastest way to generate zero shot voice clones using 100% pure CPU execution. Following up on my last post where we ran the Q8 model on a GPU, we just took local C++ voice synthesis a massive step further. The open source community quantized Alibaba's SOTA Qwen3 TTS model down to Q4_K_M GGUF, completely freeing local audio pipelines from dedicated graphics hardware. Here is the real world benchmark and hardware breakdown of running SOTA voice cloning on CPU: # Architecture & Model Setup Using Qwen3-TTS-12Hz-1.7B-Base-Q4_K_M.gguf paired with the 8 bit multimodal projector (mmproj-Q8_0.gguf), llama.cpp executes the entire pipeline in pure C++. No PyTorch, no CUDA dependencies, and no VRAM bottlenecks. # Real-World Memory Footprint - Baseline RAM: 1.6 GB system idle. - Peak Generation RAM: 8 GB RAM during active voice synthesis. - Requirement: Any basic machine with at least 8 GB of system RAM can run this easily. # Real World CPU Benchmarks - Google Colab Free Tier (Throttled 2 Core CPU): Synthesizes a 5 sec studio quality audio clip (~8 words) in 45 seconds. - Modern Consumer CPU (Intel i5/i7 13th/14th Gen or AMD Ryzen 7000/9000): generation should drop to 5 to 20 seconds (nearly 1:1 real-time generation speed!). # Zero Shot Voice Cloning Quality Pass any 5 to 20 second .wav audio sample to the C++ engine using the --tts-speaker-file flag. It yields clean, natural sounding cloned speech with virtually zero quality loss compared to unquantized FP16 weights. To make testing seamless, I built an updated zero config Google Colab notebook. It pulls the official pre built llama.cpp CPU binaries (zero compilation time!) launches a live Gradio web app right in your browser. Record a 5 second clip from your mic (or drop a .mp3, .wav file), type text, and generate cloned audio on CPU. Native C++ audio models are making edge based, offline AI voice agents a reality. Links to the free Q4 CPU Colab notebook and the Q4_K_M GGUF HuggingFace repository are in the replies below! Which models have you been running on your CPUs? What CPU hardware are you using for local inference?show more

Stop stitching together five different tools for one video.... MiniMax H3 understands text, image, video, and audio as one creative language, so it generates with the precision and cinematic quality your project actually needs. What you get: → Native multimodal understanding & generation → Precision editing & control → Commercial-grade output: film, ads, MVs, UI, game CG → 2K/24FPS with native stereo audio Multi-asset reference + voice cloning = concept to finished content, in one flow. Hailuo AI (MiniMax) | #MiniMaxH3show more

Introducing Novo Launching today a new project I coded... for myself in 1 weekend in May and decided to finish this week. Novo is a dead simple to-do app that lets you "Speech-To-Tasks", or paste a huge text and organize for you. You can customize the AI and make it organize in any criteria: - Auto-tag by category - Schedule some types of tasks to certain days - Prioritize based on your own rules Try it:show more

I've just launched a new app called Tekst! 🎉... It solves a simple problem: avoiding annoying voice messages. With Tekst, you can read transcriptions of voice messages and memos, making it that simple. To celebrate the release, I'm hosting a giveaway! 🎁 Repost and follow me for a chance to win one of 10 Lifetime Premium memberships. Winners will be announced Monday, September 23.show more

As always everyone is blind staring at the progress... of LLMs for coding and chat But meanwhile the new SOTA video model Seedance 2.5 has been slowly rolling out and it's really quite exceptional It's made by ByteDance (TikTok) who of course have lots of training data With just a few reference pics, it can get quite close to how you look IRL and you can do quite professional video shots with just a prompt I'd say it's the first video model that's now at the level of image models with the level of character likeness, cracking that in image models also took about 3 years (2022-2025) Generating 15 seconds takes about 4 minutes I put it live now on Photo AI, you can use it under [ Make video ] from the sidebar with just a prompt and your model selected! So you don't need to take an AI photo first and then turn that into a video! Saves lots of time :D It's more expensive than but I kept the credits the same (30 for 1 video) It also works inside the new video editor and you can make changes in your video with [ Magic edit ] in both the main app and the video editor Also a message for my server guy Daniel Lockyer (it can do voice too and you can even submit a voice sample of yourself, but I didn't here)show more

MiniMax H3 Instead of sharing the prompts for each... of these videos, I thought it would be more useful to share how I created that prompts. All of the videos were generated with text-to-video. First, find an image with the kind of scene, composition and mood you want to recreate. I used a few YouTube playlist thumbnails as references but Pinterest is also a great place to find inspiration. You can even use your own old or nostalgic photographs. Then upload the image to ChatGPT and ask it to describe the scene. The description it gives you can essentially become your text-to-video prompt. From there, you can generate completely new scenes with a similar composition, atmosphere and cinematic language. You can of course use the reference image directly with image-to-video or as a first frame. But if the original image isn't yours, I prefer using it only as visual inspiration and recreating the scene through text-to-video. This is the prompt I use with ChatGPT: "Describe the scene in this image in English, focusing primarily on what is happening, the characters, their actions and body language, the setting and the overall atmosphere. Also briefly describe the composition, framing, camera angle, approximate lens choice, lighting, color palette and cinematic aesthetic. Keep it concise and scene-focused rather than overly technical."show more

I'm joining to build and grow ElevenCreative. I've spent... most of my career building for creators. ElevenLabs is one of the fastest-growing AI companies, and it's clear they've been principled about how they build for creators every step of the way: → $11M+ paid back to creators through a voice marketplace that lets you control how your voice is used and earn from it → A music product setting the ethical standard with 50/50 royalty splits, trained only on licensed data → Leading voice and audio models that support 70+ languages so creators anywhere in the world can reach a global audience and earn on equal footing → Partnerships with 450+ nonprofits and people with ALS, cancer, and stroke reclaim their voice for them and their loved ones → An all-in-one creative workspace that supports everyone from millions of creators to brands like Disney, Duolingo, and Epic Games → Tooling that unlocks new workflows, like enabling indie authors to publish audiobooks where the economics aren't cost-prohibitive, and so much more Excited to work with @matiii, Luke Harries, and an incredible team that does not stop shipping. If you have feedback on the product, or are excited to join, reach out. Will be hiring for several roles.show more