Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Introducing Kitten TTS, a SOTA tiny text-to-speech model - Just 15M parameters - Runs without a GPU - Model size less than 25 MB - Multiple high-quality voices - Ultra-fast - even runs on low-end edge devices Github and HF links below

Divam Gupta

9,776 subscribers

349,016 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & Technologie Bildung

Anya Rossi• Live Now

Private livecam show

47 Kommentare

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

Github: Huggingface:

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

Someone deployed it on a browser within few hrs!

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

Also, we would love to collaborate with y’all. If you want to potentially use this model somewhere, shoot me a DM

Profilbild von Paul Bohm

Paul Bohmvor 1 Jahr

But does it meow?

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

Added it to our todo!

Profilbild von Hamzé 🦀

Hamzé 🦀vor 1 Jahr

@joshmo_dev We could use on Raspberry pi so?

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

@joshmo_dev Ofc

Profilbild von Hamzé 🦀

Hamzé 🦀vor 1 Jahr

@joshmo_dev 🤩 wow

Profilbild von Hamzé 🦀

Hamzé 🦀vor 1 Jahr

@joshmo_dev I would say this is more game changer that gpt-oss

Profilbild von Paweł Bauer

Paweł Bauervor 1 Jahr

What languages does it support?

Profilbild von 𝑫𝒂𝒏𝒊𝒆𝒍 𝑺𝒄𝒐𝒕𝒕 𝑴𝒂𝒕𝒕𝒉𝒆𝒘𝒔 🇦🇺

𝑫𝒂𝒏𝒊𝒆𝒍 𝑺𝒄𝒐𝒕𝒕 𝑴𝒂𝒕𝒕𝒉𝒆𝒘𝒔 🇦🇺vor 1 Jahr

I genuinely appreciate your efforts and generosity but is this a case of a 25 MB model that requires gigabytes of python library downloads to run? Any chance in the future this can be ported to something written in C while being as lean and mean as the FFMpeg guys would write?

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

Yes we will do that

Profilbild von 𝑫𝒂𝒏𝒊𝒆𝒍 𝑺𝒄𝒐𝒕𝒕 𝑴𝒂𝒕𝒕𝒉𝒆𝒘𝒔 🇦🇺

𝑫𝒂𝒏𝒊𝒆𝒍 𝑺𝒄𝒐𝒕𝒕 𝑴𝒂𝒕𝒕𝒉𝒆𝒘𝒔 🇦🇺vor 1 Jahr

Awsome! 🙏

Profilbild von Josh Whiton

Josh Whitonvor 1 Jahr

Wow... so good, so smol. Very nice work!

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

This is an early checkpoint. The model is expected to get better!

Profilbild von Karim C

Karim Cvor 1 Jahr

15M parameters for quality TTS? this is exactly what edge deployment needed been looking for something like this for mario's voice responses in offline scenarios 25MB means it fits on basically any device, no cloud dependency the small model revolution is real

Profilbild von Vishnu Saran

Vishnu Saranvor 1 Jahr

Great work! Can we also do a custom clone?

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

We will release finetuning for custom voices in the future

Profilbild von Patryk Zoltowski

Patryk Zoltowskivor 1 Jahr

@ycombinator Couldn't find what languages it supports. Is it only English?

Profilbild von Erik Kaiser

Erik Kaiservor 1 Jahr

Dude. I am all over this. This is awesome. Do you have a mobile SDK yet? I have an ESP32 application for this right now today.

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

No sdk yet. But it’s just onnx. Maybe we can work together to get it on ESP32

Profilbild von Nasim Uddin

Nasim Uddinvor 1 Jahr

Wow. Nice. Will there be other SDK for running in mobile?

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

Definitely! Coming soon

Profilbild von Andromedus

Andromedusvor 1 Jahr

Are you guys by any chance working on a tiny speech-to-text model?

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

We are!

Profilbild von Pendar

Pendarvor 1 Jahr

This is awesome, I can now add offline voice capability to my app

Profilbild von Divam Gupta

Divam Guptavor 1 Jahr

Would love for you to add it! Dm me

Profilbild von Ari Kouts

Ari Koutsvor 1 Jahr

So it's raspberry friendly?

Profilbild von Gordon Shumway

Gordon Shumwayvor 1 Jahr

Holy moly. This is the most important announcement today if voice output is generally this good for everything and it wasn’t cherry picked! And yes, I’m aware of GPT OSS and Opus 4.1 releases, but they will be replaced with something better in a week or so and this tiny tts model with audio output this good, is way more important if you ask me!

Profilbild von ElonBald

ElonBaldvor 1 Jahr

Release the training code!!

Profilbild von Venkata Pingali

Venkata Pingalivor 1 Jahr

@divamgupta Great work. Was trying it to make it work on larger segments of text. It is failing even at 1000 characters. Shorter ones work. Same issue as

Profilbild von Satish G

Satish Gvor 1 Jahr

Wow! Gonna try it out today and let you know my feedback.

Profilbild von mt_shammah

mt_shammahvor 1 Jahr

@Hamzeml Awesome work 25mb is crazy. Needed something this small a few months ago. Will try this out soon

Profilbild von Privacy AI - on-device AI agent & chatbot

Privacy AI - on-device AI agent & chatbotvor 1 Jahr

It’s incredible to achieve this with only 15M parameters! We’re integrating Kokoros’ 82M model into our application now, and your model is on par with it. Congratulations! 🎉

Profilbild von David Alejandro

David Alejandrovor 1 Jahr

Awesome! What’s the difference between this and just using a plain ol’ TTS system? Voices seem similar. Genuinely asking.

Profilbild von Nikita 🤙

Nikita 🤙vor 1 Jahr

Great work! Will try in my TTS engine with livekit

Profilbild von Stefano Rivera

Stefano Riveravor 1 Jahr

@NeoFablesVR check this out.

Profilbild von Yeab - engg / core was in Palo Alto🌴

Yeab - engg / core was in Palo Alto🌴vor 1 Jahr

smaller

Profilbild von Prashant

Prashantvor 1 Jahr

Looking so good.. 👏

Profilbild von Chris Matthieu

Chris Matthieuvor 1 Jahr

Sounds great!

Profilbild von Devin AI

Devin AIvor 1 Jahr

Innovative work! Edge AI models like Kitten TTS make tech accessible. Exciting to see AI running without heavy hardware requirements.

Profilbild von Somesh

Someshvor 1 Jahr

great stuff!

Profilbild von Nathaniel™

Nathaniel™vor 1 Jahr

I need an Android PDF reader to have this as an add-on

Profilbild von Dimitri Gilbert

Dimitri Gilbertvor 1 Jahr

you sir, got my interest ! :) been a long day but it is bm for tomorrow !

Profilbild von @StoryOfAIGuess

@StoryOfAIGuessvor 1 Jahr

Very cool man great success

Profilbild von Fareesh Vijayarangam

Fareesh Vijayarangamvor 1 Jahr

any plans for cloning? accents?

Profilbild von inlanger 🍻 🇺🇦

inlanger 🍻 🇺🇦vor 1 Jahr

Should it work in a browser?

Ähnliche Videos

We just released a new version of Kitten TTS - 15M param SOTA tiny text-to-speech model It has a significant quality improvement over the previous version. Still less than 25MB in size! Open-source, extremely tiny, expressive. Apache 2.0

We just released a new version of Kitten TTS - 15M param SOTA tiny text-to-speech model It has a significant quality improvement over the previous version. Still less than 25MB in size! Open-source, extremely tiny, expressive. Apache 2.0

Divam Gupta

92,671 Aufrufe • vor 7 Monaten

We’re excited to introduce Pocket TTS: a 100M-parameter text-to-speech model with high-quality voice cloning that runs on your laptop—no GPU required. Open-source, lightweight, and incredibly fast. 🧵👇

We’re excited to introduce Pocket TTS: a 100M-parameter text-to-speech model with high-quality voice cloning that runs on your laptop—no GPU required. Open-source, lightweight, and incredibly fast. 🧵👇

kyutai

238,392 Aufrufe • vor 8 Monaten

Just dropped on HF: Supertonic TTS, a blazing fast speech model. 🤯 > RTF as low as 0.001 on RTX4090 > Runs on-device (no latency, full privacy) > 66M params + 8+ language SDKs > Browser, mobile, edge — it just works. > You can adjust inference steps, batch processing, and other parameters to match your specific needs! > Open-source. Ready to build with!

Just dropped on HF: Supertonic TTS, a blazing fast speech model. 🤯 > RTF as low as 0.001 on RTX4090 > Runs on-device (no latency, full privacy) > 66M params + 8+ language SDKs > Browser, mobile, edge — it just works. > You can adjust inference steps, batch processing, and other parameters to match your specific needs! > Open-source. Ready to build with!

steven

17,784 Aufrufe • vor 10 Monaten

🚨 New model alert! Dialog by vibx — a leading text-to-speech model — now runs on GroqCloud™. That means natural-sounding speech with ultra-low latency, making real-time voice applications smoother and more responsive. Learn more & build fast — links in the comments!

🚨 New model alert! Dialog by vibx — a leading text-to-speech model — now runs on GroqCloud™. That means natural-sounding speech with ultra-low latency, making real-time voice applications smoother and more responsive. Learn more & build fast — links in the comments!

Groq Inc

47,474 Aufrufe • vor 1 Jahr

You don't need a GPU to run text-to-speech anymore. Kyutai released Pocket TTS, a 100 million parameter speech model that runs entirely on CPU. How it performs: > Nearly 6x faster than real time on a MacBook CPU > First audio chunk arrives in about 200 milliseconds > Runs on just 2 CPU cores > Supports voice cloning and 6 languages Setup takes one command: pip install pocket-tts Text-to-speech that used to need a GPU or a paid API now runs locally, on a laptop, in near real time.

You don't need a GPU to run text-to-speech anymore. Kyutai released Pocket TTS, a 100 million parameter speech model that runs entirely on CPU. How it performs: > Nearly 6x faster than real time on a MacBook CPU > First audio chunk arrives in about 200 milliseconds > Runs on just 2 CPU cores > Supports voice cloning and 6 languages Setup takes one command: pip install pocket-tts Text-to-speech that used to need a GPU or a paid API now runs locally, on a laptop, in near real time.

Simplifying AI

14,391 Aufrufe • vor 1 Monat

The AI crowd keeps worshipping giant models. Meanwhile, MiniCPM-5 1B is trying to make them look bloated. A 1B open-source model that runs locally, on CPUs, edge devices, and even browsers. Tiny model. Real deployment. No GPU cult required.

The AI crowd keeps worshipping giant models. Meanwhile, MiniCPM-5 1B is trying to make them look bloated. A 1B open-source model that runs locally, on CPUs, edge devices, and even browsers. Tiny model. Real deployment. No GPU cult required.

Alex Prompter

24,699 Aufrufe • vor 3 Monaten

🔊Introducing Voxtral TTS: our new frontier open-weight model for natural, expressive, and ultra-fast text-to-speech 🎭Realistic, emotionally expressive speech. 🌍Supports 9 languages and accurately captures diverse dialects. ⚡Very low latency for time-to-first-audio. 🔄Easily adaptable to new voices

🔊Introducing Voxtral TTS: our new frontier open-weight model for natural, expressive, and ultra-fast text-to-speech 🎭Realistic, emotionally expressive speech. 🌍Supports 9 languages and accurately captures diverse dialects. ⚡Very low latency for time-to-first-audio. 🔄Easily adaptable to new voices

Mistral AI

949,040 Aufrufe • vor 5 Monaten

Really proud to share something we’ve been working on for a while: Magenta RealTime 2 (MTR2), a live music model that is highly interactive (MIDI, audio, text, lots of parameters) and low-latency (~200ms end-to-end), and runs locally on a MacBook!

Really proud to share something we’ve been working on for a while: Magenta RealTime 2 (MTR2), a live music model that is highly interactive (MIDI, audio, text, lots of parameters) and low-latency (~200ms end-to-end), and runs locally on a MacBook!

Ilaria Manco

45,328 Aufrufe • vor 3 Monaten

Introducing Soniox TTS v2, our most powerful text-to-speech model yet. Soniox TTS v2 brings extraordinary voice quality, expressive control through audio tags, exceptional precision, high-fidelity voice cloning, more than 60 languages, natural language mixing, and low-latency streaming together in one model. Built from the ground up with a new model architecture, audio codec, and highly optimized inference engine, Soniox TTS v2 delivers frontier TTS at just $0.70 per generated hour. Available globally today as tts-rt-v2. Try it out: Turn the sound on and hear what’s possible. 🔊

Introducing Soniox TTS v2, our most powerful text-to-speech model yet. Soniox TTS v2 brings extraordinary voice quality, expressive control through audio tags, exceptional precision, high-fidelity voice cloning, more than 60 languages, natural language mixing, and low-latency streaming together in one model. Built from the ground up with a new model architecture, audio codec, and highly optimized inference engine, Soniox TTS v2 delivers frontier TTS at just $0.70 per generated hour. Available globally today as tts-rt-v2. Try it out: Turn the sound on and hear what’s possible. 🔊

Soniox

663,421 Aufrufe • vor 1 Monat

Pocket TTS goes multilingual! Now you can use our 100M-parameter models to generate speech in six languages, fast enough to run real-time without a GPU. We also improved the quality of the English model while keeping the same size. And all of this is open-source.

Pocket TTS goes multilingual! Now you can use our 100M-parameter models to generate speech in six languages, fast enough to run real-time without a GPU. We also improved the quality of the English model while keeping the same size. And all of this is open-source.

kyutai

29,983 Aufrufe • vor 4 Monaten

Introducing Dialog 1.0 - Ultra-emotional AI Text-To-Speech model Outperforms Elevenlabs on expressiveness and quality 3 to 1 <1% error rate Supports 30+ languages Best in class voice cloning Low latency: 303ms TTFA (Time to First Audio) Experience it for yourself on Read more below⬇️

Introducing Dialog 1.0 - Ultra-emotional AI Text-To-Speech model Outperforms Elevenlabs on expressiveness and quality 3 to 1 <1% error rate Supports 30+ languages Best in class voice cloning Low latency: 303ms TTFA (Time to First Audio) Experience it for yourself on Read more below⬇️

PlayAI

196,182 Aufrufe • vor 1 Jahr

MiniMax H3 is the SOTA open weight model... but the large model comes with slow gens (depending on your hardware). You can be waiting for minutes just for the generation to miss the mark Here's a ComfyUI workflow to get the most out of H3 without the wait. → H3 Turbo LoRA (4–8 steps) → Model Preview Override + Tiny AutoEncoder H3 for a fast composition preview → Bad preview? stop it, tweak the prompt or seed → Save your precious gpu time Workflow and model links below 👇

MiniMax H3 is the SOTA open weight model... but the large model comes with slow gens (depending on your hardware). You can be waiting for minutes just for the generation to miss the mark Here's a ComfyUI workflow to get the most out of H3 without the wait. → H3 Turbo LoRA (4–8 steps) → Model Preview Override + Tiny AutoEncoder H3 for a fast composition preview → Bad preview? stop it, tweak the prompt or seed → Save your precious gpu time Workflow and model links below 👇

rob - comfyui

26,990 Aufrufe • vor 1 Monat

💥 Introducing MiniCPM-o 2.6: An 8B size, GPT-4o level Omni Model runs on device ✨ Highlights: ~Match GPT-4o-202405 in vision, audio and multimodal live streaming ~End-to-end real-time bilingual audio conversation ~Voice cloning & emotion control ~Advanced OCR & video understanding ~Offline iPad-compatible multimodal live streaming 🔗 Try it out: GitHub: HF: Demo:

💥 Introducing MiniCPM-o 2.6: An 8B size, GPT-4o level Omni Model runs on device ✨ Highlights: ~Match GPT-4o-202405 in vision, audio and multimodal live streaming ~End-to-end real-time bilingual audio conversation ~Voice cloning & emotion control ~Advanced OCR & video understanding ~Offline iPad-compatible multimodal live streaming 🔗 Try it out: GitHub: HF: Demo:

OpenBMB

97,844 Aufrufe • vor 1 Jahr

HOLY FUCK! Zyphra just dropped Zonos - Apache 2.0 licensed, Multilingual, Text to Speech model with INSTANT voice cloning! 🔥 > Zero-shot TTS with Voice Cloning: Input text and a 10-30 second speaker sample to generate high-quality text-to-speech output > Audio Prefix Inputs: Enhance speaker matching by adding an audio prefix to the text, enabling behaviors like whispering that are hard to achieve with voice cloning alone > Multilingual Support: Supports English, Japanese, Chinese, French, and German > Audio Quality & Emotion Control: Fine-tune speaking rate, pitch, frequency, audio quality, and emotions (e.g., happiness, anger, sadness, fear) > Fast Performance: Runs at ~2x real-time speed on an RTX 4090 > Available on the Hugging Face Hub 🤗

HOLY FUCK! Zyphra just dropped Zonos - Apache 2.0 licensed, Multilingual, Text to Speech model with INSTANT voice cloning! 🔥 > Zero-shot TTS with Voice Cloning: Input text and a 10-30 second speaker sample to generate high-quality text-to-speech output > Audio Prefix Inputs: Enhance speaker matching by adding an audio prefix to the text, enabling behaviors like whispering that are hard to achieve with voice cloning alone > Multilingual Support: Supports English, Japanese, Chinese, French, and German > Audio Quality & Emotion Control: Fine-tune speaking rate, pitch, frequency, audio quality, and emotions (e.g., happiness, anger, sadness, fear) > Fast Performance: Runs at ~2x real-time speed on an RTX 4090 > Available on the Hugging Face Hub 🤗

Vaibhav (VB) Srivastav

299,066 Aufrufe • vor 1 Jahr

I taught a speech model to understand context in conversation. This is what happened It adjusts voice and tone to express urgency, comfort, understanding from the dialogue. Just like a real human being 520M model. Runs locally on consumer devices How this is achieved 🧵

I taught a speech model to understand context in conversation. This is what happened It adjusts voice and tone to express urgency, comfort, understanding from the dialogue. Just like a real human being 520M model. Runs locally on consumer devices How this is achieved 🧵

Luozhu

22,028 Aufrufe • vor 6 Monaten

🚨 ANTHROPIC TRIED TO BAN HIS GITHUB Chinese guy published 70B parameter LLM, 20,000 starts on Github + a lawsuit from big AI companies Here's what it does: > runs on Python > even shitty mac or pc is enough > flat memory > loads a model layer by layer > 100% local This model can close 100% needs of most businesses, which would pay $3,000/a month for a trained version. It needs just 4 gb of GPU, so using this technology my gaming pc with 12 gb GPU will run 200B parameter model with ease Github link is below. Why you should go local too.

🚨 ANTHROPIC TRIED TO BAN HIS GITHUB Chinese guy published 70B parameter LLM, 20,000 starts on Github + a lawsuit from big AI companies Here's what it does: > runs on Python > even shitty mac or pc is enough > flat memory > loads a model layer by layer > 100% local This model can close 100% needs of most businesses, which would pay $3,000/a month for a trained version. It needs just 4 gb of GPU, so using this technology my gaming pc with 12 gb GPU will run 200B parameter model with ease Github link is below. Why you should go local too.

Milady

491,062 Aufrufe • vor 3 Monaten

Introducing our new Turbo 2.5 model - Hindi, French, Spanish, Mandarin and 27 other languages just got 3x faster. This unlocks high-quality low-latency conversational AI for nearly 80% of the world. For the first time, we support Vietnamese, Hungarian and Norwegian text to speech. And English is now 25% faster compared to Turbo v2.

Introducing our new Turbo 2.5 model - Hindi, French, Spanish, Mandarin and 27 other languages just got 3x faster. This unlocks high-quality low-latency conversational AI for nearly 80% of the world. For the first time, we support Vietnamese, Hungarian and Norwegian text to speech. And English is now 25% faster compared to Turbo v2.

ElevenLabs

50,875 Aufrufe • vor 2 Jahren

Kyutai released their Streaming Text to Speech model, ~2B param model, ultra low latency (220ms), CC-BY-4.0 license 🔥 Trained on 2.5 Million Hours of audio, it can serve up to 32 users w/ less than 350ms latency on a SINGLE L40 🤯 Incredible release by kyutai folks, go check out their hugging face page now!

Kyutai released their Streaming Text to Speech model, ~2B param model, ultra low latency (220ms), CC-BY-4.0 license 🔥 Trained on 2.5 Million Hours of audio, it can serve up to 32 users w/ less than 350ms latency on a SINGLE L40 🤯 Incredible release by kyutai folks, go check out their hugging face page now!

Vaibhav (VB) Srivastav

93,586 Aufrufe • vor 1 Jahr

i was playing around the newest TTS (text to speech) model 'kokoro' which has just 82M parameters! by adding only 1 line of code you can create a custom voice that mixes any two (out of ten voices) in any ratio example: mixing one male and one female voice in the 60-40 ratio

i was playing around the newest TTS (text to speech) model 'kokoro' which has just 82M parameters! by adding only 1 line of code you can create a custom voice that mixes any two (out of ten voices) in any ratio example: mixing one male and one female voice in the 60-40 ratio

maharshi

88,765 Aufrufe • vor 1 Jahr

Day 1 of 3 MLX Releases: Introducing MLX-Audio 🚀🔥 A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon. Features ⚡️Fast inference on Apple Silicon (M series chips) 🤖Multiple language support 🗣️Voice customization options 🚀Quantization support for optimized performance Supported models: 🪶Kokoro - A multilingual TTS model with 82M params that supports various languages and voice styles. With more models coming soon. Get started: > pip install mlx-audio Please leave us a star and send a PR :)

Day 1 of 3 MLX Releases: Introducing MLX-Audio 🚀🔥 A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon. Features ⚡️Fast inference on Apple Silicon (M series chips) 🤖Multiple language support 🗣️Voice customization options 🚀Quantization support for optimized performance Supported models: 🪶Kokoro - A multilingual TTS model with 82M params that supports various languages and voice styles. With more models coming soon. Get started: > pip install mlx-audio Please leave us a star and send a PR :)

Prince Canuma

123,553 Aufrufe • vor 1 Jahr