We are open-sourcing TTSKit! Run state-of-the-art text-to-speech models on... your Mac and iPhone. The launch version supports Qwen Qwen3-TTS and generates audio faster than real-time playback with sub-200 ms time-to-first-byte. Voice cloning and advanced speed optimizations will be in the next version. Link to the GitHub repo and models on Hugging Face in comments.show more

Playing with Qwen3-TTS is and MLX-Audio locally on Mac... Studio M3 Ultra 🔥 Amazing model by Qwen and great work by Prince Canuma bringing this magic to MLX! Tuning the voice with instructions feels like magic! Command and prompts to run it are in the video.show more

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉... You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽show more

Big moment for text-to-speech. Qwen just open-sourced a text-to-speech... model that lets you clone voices, design new ones, and control speech using natural language. Let me explain what I mean: You can literally tell it "speak in a cheerful tone with slight nervousness," and it actually does that. No complex audio engineering needed. What makes this special: - 3-second voice cloning - Covers 10 languages: English, German, French, and more - Latency as low as 97ms for real-time applications - Supports both streaming and non-streaming generation The model comes in two sizes (0.6B and 1.7B parameters), so you can pick based on your hardware and quality needs. Three modes to work with: 1. Custom Voice: Use pre-built premium voices with instruction-based style control 2. Voice Design: Describe the voice you want in plain English (or Chinese), and the model creates it 3. Voice Clone: Provide a 3-second reference audio and clone that voice The best part? It integrates with vLLM for production deployment and has a simple Python package you can pip install. I've shared a link to the GitHub repo in the next tweet.show more

Also, you can now add the ability to talk... to your agents. Cloudflare /voice adds real-time voice to the Agents SDK. ~30 lines of server code to get started, with built-in speech to text and text to speech on Workers AI.show more

Qwen 3.6 models are now 2.5x times faster on... Atomic Chat with new MTP speedups. > MTP drafts several tokens ahead and verifies them in one pass. The speedup depends on the memory moved per pass. Users can run Qwen 3.6 models locally via the open-source Atomic Chat to test them!show more

On this auspicious day of Hayagreeva Jayanti, I am... open-sourcing the data and models for Samskrutam-Chant Speech-to-Text (ASR), named सुश्रोता. ~ 18 h of utterance-level annotated Shastric text, 1,500 contributors. Powers वाग्बोधिनी. Links in the first reply.show more

“Bro spent all his XP points on strength and... 0 on speed.” I’m releasing my next book $100M Money Models. The launch is going to be something not soon forgotten. Link in comments + hilarious replies.show more

parakeet.cpp: native C++/ggml (ggml) inference for NVIDIA AI Developer's... Parakeet, one of the best speech-to-text models out there, from the LocalAI team. Every Parakeet model (TDT/CTC/RNNT/hybrid + cache-aware streaming), byte-for-byte identical output to NeMo, now running anywhere with no Python and even a bit faster, on CPU and GPU. Quantized GGUF on Hugging Face 🤗 Huge thanks to Georgi Gerganov for ggml and to NVIDIA AI Developer for releasing Parakeet! 🧵show more

Inspired by Andrej Karpathy and the idea of using... games to compare LLMs, I've built a version of the game Codenames where different models are paired in teams to play the game with each other. Fun to see o3-mini team with R1 against Grok and Gemini! Link and repo below.show more

UNCENSOR ANY AI MODEL ON YOUR OWN GAMING PC... heretic 2.0 just dropped and it strips the censorship out of open models with no retraining how to set it up: 1. install python 3.10 or newer 2. install pytorch 2.6+ for your gpu 3. open terminal and install heretic pip install -U heretic-llm 4. run it on any hugging face model heretic Qwen/Qwen3-4B-Instruct-2507 5. save it, upload to hugging face, chat with it, or run benchmarks if you have low vram then turn on 4-bit modeshow more

Just dropped on HF — NeuTTS Air Next-gen on-device... TTS that matches cloud-level quality while staying fully open source. > Real-time speech synthesis on CPU/GPU > 3-second voice cloning, no cloud or data upload > Compact: under 200 MB, runs on mobile and edge devices > Multilingual and expressive > Developed by Neuphonic , optimized for speed and fidelityshow more

You don't need a GPU for fast studio grade... voice cloning anymore. Qwen3 TTS (1.7B Q4_K_M) + mainline llama.cpp is officially the fastest way to generate zero shot voice clones using 100% pure CPU execution. Following up on my last post where we ran the Q8 model on a GPU, we just took local C++ voice synthesis a massive step further. The open source community quantized Alibaba's SOTA Qwen3 TTS model down to Q4_K_M GGUF, completely freeing local audio pipelines from dedicated graphics hardware. Here is the real world benchmark and hardware breakdown of running SOTA voice cloning on CPU: # Architecture & Model Setup Using Qwen3-TTS-12Hz-1.7B-Base-Q4_K_M.gguf paired with the 8 bit multimodal projector (mmproj-Q8_0.gguf), llama.cpp executes the entire pipeline in pure C++. No PyTorch, no CUDA dependencies, and no VRAM bottlenecks. # Real-World Memory Footprint - Baseline RAM: 1.6 GB system idle. - Peak Generation RAM: 8 GB RAM during active voice synthesis. - Requirement: Any basic machine with at least 8 GB of system RAM can run this easily. # Real World CPU Benchmarks - Google Colab Free Tier (Throttled 2 Core CPU): Synthesizes a 5 sec studio quality audio clip (~8 words) in 45 seconds. - Modern Consumer CPU (Intel i5/i7 13th/14th Gen or AMD Ryzen 7000/9000): generation should drop to 5 to 20 seconds (nearly 1:1 real-time generation speed!). # Zero Shot Voice Cloning Quality Pass any 5 to 20 second .wav audio sample to the C++ engine using the --tts-speaker-file flag. It yields clean, natural sounding cloned speech with virtually zero quality loss compared to unquantized FP16 weights. To make testing seamless, I built an updated zero config Google Colab notebook. It pulls the official pre built llama.cpp CPU binaries (zero compilation time!) launches a live Gradio web app right in your browser. Record a 5 second clip from your mic (or drop a .mp3, .wav file), type text, and generate cloned audio on CPU. Native C++ audio models are making edge based, offline AI voice agents a reality. Links to the free Q4 CPU Colab notebook and the Q4_K_M GGUF HuggingFace repository are in the replies below! Which models have you been running on your CPUs? What CPU hardware are you using for local inference?show more

Local models on the left. Cloud models on the... right. I asked Qwen-flash-next, DeepSeek-v4.1, Fable-5.1 and Astra-6 to build an interactive volcanic island with flowing lava and boats that flee. In my opinion deepseek was the winner, and fable the disappointment Try each island yourself: Qwen · Mac Studio DeepSeek · 4× DGX Spark Fable · Cloud Astra · Cloudshow more

Fish Audio Drama 3 is the #1 open weights... model on both Artificial Analysis Speech Arenas, and #1 of all models on Pronunciation Robustness Fish Audio has released Drama 3. We evaluated it across both Speech Arenas and our Pronunciation Robustness benchmark. Key takeaways: ➤ Text to Speech, Provider Voice: Drama 3 scores an Elo of 1,278 across 1,512 arena appearances, ranking #6 overall and #1 among open weights models, 38 points clear of its own Drama 3 Preview at 1,240 and 50 ahead of BreezeBlue's Breeze TTS 2 at 1,228 ➤ Text to Speech, Controlled Voice: Drama 3 scores 1,085 across 1,958 appearances, ranking #12 overall and #1 among open weights models, ahead of Ant Group's Ming-3.0-tts at 1,068 and its own Preview at 1,063 ➤ Pronunciation Robustness: Drama 3 scores 94.6% across 2,157 rated spans, ranking #1, ahead of Ming-3.0-tts and Drama 3 Preview, both at 93.2% ➤ Speed: Drama 3 generates 66.6 characters per second, ahead of its own Drama 3 Preview at 60.7 and Murf's Speech Gen 2 at 63.0, and behind ElevenLabs' Eleven v4 at 70.0 and v3 Conversational at 66.8 ➤ Pricing: Drama 3 is priced at $15/1M characters. Every model ranked above it on Provider Voice costs more: Gemini 3.8 Flash TTS at $16.5/1M, Qwen-Audio-3.1-TTS-Plus at $19.3/1M, Eleven v4 Turbo at $40/1M, Sonic 3.6 at $49/1M and Eleven v4 at $80/1M ➤ Open weights: released under the Fish Audio Community License. See more details and listen to samples below ⬇️show more

We are building “Open Source Nano Banana for Video”... - here is open source demo v0.1 We are open sourcing Lucy Edit, the first foundation model for text-guided video editing! Get the model on Hugging Face 🤗, API on @FAL, and nodes on ComfyUI 🧵show more

Open-source TradingView Premium GitHub repo just went private The... repo gained more than 2k stars in a single day, bringing the total to 43.7k in just a couple of months The devs announced on Discord that they’re going private because of the insane amount of traffic You can still access it through the standalone Windows and Mac apps, with the GitHub and Discord links available in the Community sectionshow more

Biologists use specialized open-source models for tasks like modeling... the structure of molecular systems, designing drug-like molecules, and predicting the effects of genetic mutations. But these models are often expensive to run, potentially limiting their impact. In our latest Science Blog, we share how Claude was able to optimize inference for more than 30 open-source models, making them 4x faster on average, partly by writing custom software for GPUs. We’re open sourcing all of the optimization code. Read more:show more

I wanted voice dictation on macOS to feel instant... and native, and I built Talkify an 8.2 MB macOS dictation app with 123 ms median release-to-text latency. It was the fastest of five apps tested ahead of superwhisper, voiceink, wispr flow and macwhisper. It lives in your notch and have beautiful shader animations and different kind of customizations. Talkify is built on top of Apple’s SpeechAnalyzer using system-managed speech models to transcribe audio entirely on-device, its free and open source.show more