Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Introducing Kitten TTS, a SOTA tiny text-to-speech model - Just 15M parameters - Runs without a GPU - Model size less than 25 MB - Multiple high-quality voices - Ultra-fast - even runs on low-end edge devices Github and HF links below

Divam Gupta

9,776 subscribers

349,016 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & Teknoloji Eğitim

Anya Rossi• Live Now

Private livecam show

47 Yorum

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

Github: Huggingface:

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

Someone deployed it on a browser within few hrs!

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

Also, we would love to collaborate with y’all. If you want to potentially use this model somewhere, shoot me a DM

Paul Bohm profil fotoğrafı

Paul Bohm1 yıl önce

But does it meow?

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

Added it to our todo!

Hamzé 🦀 profil fotoğrafı

Hamzé 🦀1 yıl önce

@joshmo_dev We could use on Raspberry pi so?

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

@joshmo_dev Ofc

Hamzé 🦀 profil fotoğrafı

Hamzé 🦀1 yıl önce

@joshmo_dev 🤩 wow

Hamzé 🦀 profil fotoğrafı

Hamzé 🦀1 yıl önce

@joshmo_dev I would say this is more game changer that gpt-oss

Paweł Bauer profil fotoğrafı

Paweł Bauer1 yıl önce

What languages does it support?

𝑫𝒂𝒏𝒊𝒆𝒍 𝑺𝒄𝒐𝒕𝒕 𝑴𝒂𝒕𝒕𝒉𝒆𝒘𝒔 🇦🇺 profil fotoğrafı

𝑫𝒂𝒏𝒊𝒆𝒍 𝑺𝒄𝒐𝒕𝒕 𝑴𝒂𝒕𝒕𝒉𝒆𝒘𝒔 🇦🇺1 yıl önce

I genuinely appreciate your efforts and generosity but is this a case of a 25 MB model that requires gigabytes of python library downloads to run? Any chance in the future this can be ported to something written in C while being as lean and mean as the FFMpeg guys would write?

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

Yes we will do that

𝑫𝒂𝒏𝒊𝒆𝒍 𝑺𝒄𝒐𝒕𝒕 𝑴𝒂𝒕𝒕𝒉𝒆𝒘𝒔 🇦🇺 profil fotoğrafı

𝑫𝒂𝒏𝒊𝒆𝒍 𝑺𝒄𝒐𝒕𝒕 𝑴𝒂𝒕𝒕𝒉𝒆𝒘𝒔 🇦🇺1 yıl önce

Awsome! 🙏

Josh Whiton profil fotoğrafı

Josh Whiton1 yıl önce

Wow... so good, so smol. Very nice work!

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

This is an early checkpoint. The model is expected to get better!

Karim C profil fotoğrafı

Karim C1 yıl önce

15M parameters for quality TTS? this is exactly what edge deployment needed been looking for something like this for mario's voice responses in offline scenarios 25MB means it fits on basically any device, no cloud dependency the small model revolution is real

Vishnu Saran profil fotoğrafı

Vishnu Saran1 yıl önce

Great work! Can we also do a custom clone?

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

We will release finetuning for custom voices in the future

Patryk Zoltowski profil fotoğrafı

Patryk Zoltowski1 yıl önce

@ycombinator Couldn't find what languages it supports. Is it only English?

Erik Kaiser profil fotoğrafı

Erik Kaiser1 yıl önce

Dude. I am all over this. This is awesome. Do you have a mobile SDK yet? I have an ESP32 application for this right now today.

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

No sdk yet. But it’s just onnx. Maybe we can work together to get it on ESP32

Nasim Uddin profil fotoğrafı

Nasim Uddin1 yıl önce

Wow. Nice. Will there be other SDK for running in mobile?

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

Definitely! Coming soon

Andromedus profil fotoğrafı

Andromedus1 yıl önce

Are you guys by any chance working on a tiny speech-to-text model?

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

We are!

Pendar profil fotoğrafı

Pendar1 yıl önce

This is awesome, I can now add offline voice capability to my app

Divam Gupta profil fotoğrafı

Divam Gupta1 yıl önce

Would love for you to add it! Dm me

Ari Kouts profil fotoğrafı

Ari Kouts1 yıl önce

So it's raspberry friendly?

Gordon Shumway profil fotoğrafı

Gordon Shumway1 yıl önce

Holy moly. This is the most important announcement today if voice output is generally this good for everything and it wasn’t cherry picked! And yes, I’m aware of GPT OSS and Opus 4.1 releases, but they will be replaced with something better in a week or so and this tiny tts model with audio output this good, is way more important if you ask me!

ElonBald profil fotoğrafı

ElonBald1 yıl önce

Release the training code!!

Venkata Pingali profil fotoğrafı

Venkata Pingali1 yıl önce

@divamgupta Great work. Was trying it to make it work on larger segments of text. It is failing even at 1000 characters. Shorter ones work. Same issue as

Satish G profil fotoğrafı

Satish G1 yıl önce

Wow! Gonna try it out today and let you know my feedback.

mt_shammah profil fotoğrafı

mt_shammah1 yıl önce

@Hamzeml Awesome work 25mb is crazy. Needed something this small a few months ago. Will try this out soon

Privacy AI - on-device AI agent & chatbot profil fotoğrafı

Privacy AI - on-device AI agent & chatbot1 yıl önce

It’s incredible to achieve this with only 15M parameters! We’re integrating Kokoros’ 82M model into our application now, and your model is on par with it. Congratulations! 🎉

David Alejandro profil fotoğrafı

David Alejandro1 yıl önce

Awesome! What’s the difference between this and just using a plain ol’ TTS system? Voices seem similar. Genuinely asking.

Nikita 🤙 profil fotoğrafı

Nikita 🤙1 yıl önce

Great work! Will try in my TTS engine with livekit

Stefano Rivera profil fotoğrafı

Stefano Rivera1 yıl önce

@NeoFablesVR check this out.

Yeab - engg / core was in Palo Alto🌴 profil fotoğrafı

Yeab - engg / core was in Palo Alto🌴1 yıl önce

smaller

Prashant profil fotoğrafı

Prashant1 yıl önce

Looking so good.. 👏

Chris Matthieu profil fotoğrafı

Chris Matthieu1 yıl önce

Sounds great!

Devin AI profil fotoğrafı

Devin AI1 yıl önce

Innovative work! Edge AI models like Kitten TTS make tech accessible. Exciting to see AI running without heavy hardware requirements.

Somesh profil fotoğrafı

Somesh1 yıl önce

great stuff!

Nathaniel™ profil fotoğrafı

Nathaniel™1 yıl önce

I need an Android PDF reader to have this as an add-on

Dimitri Gilbert profil fotoğrafı

Dimitri Gilbert1 yıl önce

you sir, got my interest ! :) been a long day but it is bm for tomorrow !

@StoryOfAIGuess profil fotoğrafı

@StoryOfAIGuess1 yıl önce

Very cool man great success

Fareesh Vijayarangam profil fotoğrafı

Fareesh Vijayarangam1 yıl önce

any plans for cloning? accents?

inlanger 🍻 🇺🇦 profil fotoğrafı

inlanger 🍻 🇺🇦1 yıl önce

Should it work in a browser?

Benzer Videolar

We just released a new version of Kitten TTS - 15M param SOTA tiny text-to-speech model It has a significant quality improvement over the previous version. Still less than 25MB in size! Open-source, extremely tiny, expressive. Apache 2.0

We just released a new version of Kitten TTS - 15M param SOTA tiny text-to-speech model It has a significant quality improvement over the previous version. Still less than 25MB in size! Open-source, extremely tiny, expressive. Apache 2.0

Divam Gupta

92,671 görüntüleme • 7 ay önce

We’re excited to introduce Pocket TTS: a 100M-parameter text-to-speech model with high-quality voice cloning that runs on your laptop—no GPU required. Open-source, lightweight, and incredibly fast. 🧵👇

We’re excited to introduce Pocket TTS: a 100M-parameter text-to-speech model with high-quality voice cloning that runs on your laptop—no GPU required. Open-source, lightweight, and incredibly fast. 🧵👇

kyutai

238,392 görüntüleme • 8 ay önce

Just dropped on HF: Supertonic TTS, a blazing fast speech model. 🤯 > RTF as low as 0.001 on RTX4090 > Runs on-device (no latency, full privacy) > 66M params + 8+ language SDKs > Browser, mobile, edge — it just works. > You can adjust inference steps, batch processing, and other parameters to match your specific needs! > Open-source. Ready to build with!

Just dropped on HF: Supertonic TTS, a blazing fast speech model. 🤯 > RTF as low as 0.001 on RTX4090 > Runs on-device (no latency, full privacy) > 66M params + 8+ language SDKs > Browser, mobile, edge — it just works. > You can adjust inference steps, batch processing, and other parameters to match your specific needs! > Open-source. Ready to build with!

steven

17,784 görüntüleme • 10 ay önce

🚨 New model alert! Dialog by vibx — a leading text-to-speech model — now runs on GroqCloud™. That means natural-sounding speech with ultra-low latency, making real-time voice applications smoother and more responsive. Learn more & build fast — links in the comments!

🚨 New model alert! Dialog by vibx — a leading text-to-speech model — now runs on GroqCloud™. That means natural-sounding speech with ultra-low latency, making real-time voice applications smoother and more responsive. Learn more & build fast — links in the comments!

Groq Inc

47,474 görüntüleme • 1 yıl önce

You don't need a GPU to run text-to-speech anymore. Kyutai released Pocket TTS, a 100 million parameter speech model that runs entirely on CPU. How it performs: > Nearly 6x faster than real time on a MacBook CPU > First audio chunk arrives in about 200 milliseconds > Runs on just 2 CPU cores > Supports voice cloning and 6 languages Setup takes one command: pip install pocket-tts Text-to-speech that used to need a GPU or a paid API now runs locally, on a laptop, in near real time.

You don't need a GPU to run text-to-speech anymore. Kyutai released Pocket TTS, a 100 million parameter speech model that runs entirely on CPU. How it performs: > Nearly 6x faster than real time on a MacBook CPU > First audio chunk arrives in about 200 milliseconds > Runs on just 2 CPU cores > Supports voice cloning and 6 languages Setup takes one command: pip install pocket-tts Text-to-speech that used to need a GPU or a paid API now runs locally, on a laptop, in near real time.

Simplifying AI

14,391 görüntüleme • 1 ay önce

The AI crowd keeps worshipping giant models. Meanwhile, MiniCPM-5 1B is trying to make them look bloated. A 1B open-source model that runs locally, on CPUs, edge devices, and even browsers. Tiny model. Real deployment. No GPU cult required.

The AI crowd keeps worshipping giant models. Meanwhile, MiniCPM-5 1B is trying to make them look bloated. A 1B open-source model that runs locally, on CPUs, edge devices, and even browsers. Tiny model. Real deployment. No GPU cult required.

Alex Prompter

24,699 görüntüleme • 3 ay önce

🔊Introducing Voxtral TTS: our new frontier open-weight model for natural, expressive, and ultra-fast text-to-speech 🎭Realistic, emotionally expressive speech. 🌍Supports 9 languages and accurately captures diverse dialects. ⚡Very low latency for time-to-first-audio. 🔄Easily adaptable to new voices

🔊Introducing Voxtral TTS: our new frontier open-weight model for natural, expressive, and ultra-fast text-to-speech 🎭Realistic, emotionally expressive speech. 🌍Supports 9 languages and accurately captures diverse dialects. ⚡Very low latency for time-to-first-audio. 🔄Easily adaptable to new voices

Mistral AI

949,040 görüntüleme • 5 ay önce

Really proud to share something we’ve been working on for a while: Magenta RealTime 2 (MTR2), a live music model that is highly interactive (MIDI, audio, text, lots of parameters) and low-latency (~200ms end-to-end), and runs locally on a MacBook!

Really proud to share something we’ve been working on for a while: Magenta RealTime 2 (MTR2), a live music model that is highly interactive (MIDI, audio, text, lots of parameters) and low-latency (~200ms end-to-end), and runs locally on a MacBook!

Ilaria Manco

45,328 görüntüleme • 3 ay önce

Introducing Soniox TTS v2, our most powerful text-to-speech model yet. Soniox TTS v2 brings extraordinary voice quality, expressive control through audio tags, exceptional precision, high-fidelity voice cloning, more than 60 languages, natural language mixing, and low-latency streaming together in one model. Built from the ground up with a new model architecture, audio codec, and highly optimized inference engine, Soniox TTS v2 delivers frontier TTS at just $0.70 per generated hour. Available globally today as tts-rt-v2. Try it out: Turn the sound on and hear what’s possible. 🔊

Introducing Soniox TTS v2, our most powerful text-to-speech model yet. Soniox TTS v2 brings extraordinary voice quality, expressive control through audio tags, exceptional precision, high-fidelity voice cloning, more than 60 languages, natural language mixing, and low-latency streaming together in one model. Built from the ground up with a new model architecture, audio codec, and highly optimized inference engine, Soniox TTS v2 delivers frontier TTS at just $0.70 per generated hour. Available globally today as tts-rt-v2. Try it out: Turn the sound on and hear what’s possible. 🔊

Soniox

663,421 görüntüleme • 1 ay önce

Pocket TTS goes multilingual! Now you can use our 100M-parameter models to generate speech in six languages, fast enough to run real-time without a GPU. We also improved the quality of the English model while keeping the same size. And all of this is open-source.

Pocket TTS goes multilingual! Now you can use our 100M-parameter models to generate speech in six languages, fast enough to run real-time without a GPU. We also improved the quality of the English model while keeping the same size. And all of this is open-source.

kyutai

29,983 görüntüleme • 4 ay önce

Introducing Dialog 1.0 - Ultra-emotional AI Text-To-Speech model Outperforms Elevenlabs on expressiveness and quality 3 to 1 <1% error rate Supports 30+ languages Best in class voice cloning Low latency: 303ms TTFA (Time to First Audio) Experience it for yourself on Read more below⬇️

Introducing Dialog 1.0 - Ultra-emotional AI Text-To-Speech model Outperforms Elevenlabs on expressiveness and quality 3 to 1 <1% error rate Supports 30+ languages Best in class voice cloning Low latency: 303ms TTFA (Time to First Audio) Experience it for yourself on Read more below⬇️

PlayAI

196,182 görüntüleme • 1 yıl önce

MiniMax H3 is the SOTA open weight model... but the large model comes with slow gens (depending on your hardware). You can be waiting for minutes just for the generation to miss the mark Here's a ComfyUI workflow to get the most out of H3 without the wait. → H3 Turbo LoRA (4–8 steps) → Model Preview Override + Tiny AutoEncoder H3 for a fast composition preview → Bad preview? stop it, tweak the prompt or seed → Save your precious gpu time Workflow and model links below 👇

MiniMax H3 is the SOTA open weight model... but the large model comes with slow gens (depending on your hardware). You can be waiting for minutes just for the generation to miss the mark Here's a ComfyUI workflow to get the most out of H3 without the wait. → H3 Turbo LoRA (4–8 steps) → Model Preview Override + Tiny AutoEncoder H3 for a fast composition preview → Bad preview? stop it, tweak the prompt or seed → Save your precious gpu time Workflow and model links below 👇

rob - comfyui

26,990 görüntüleme • 1 ay önce

💥 Introducing MiniCPM-o 2.6: An 8B size, GPT-4o level Omni Model runs on device ✨ Highlights: ~Match GPT-4o-202405 in vision, audio and multimodal live streaming ~End-to-end real-time bilingual audio conversation ~Voice cloning & emotion control ~Advanced OCR & video understanding ~Offline iPad-compatible multimodal live streaming 🔗 Try it out: GitHub: HF: Demo:

💥 Introducing MiniCPM-o 2.6: An 8B size, GPT-4o level Omni Model runs on device ✨ Highlights: ~Match GPT-4o-202405 in vision, audio and multimodal live streaming ~End-to-end real-time bilingual audio conversation ~Voice cloning & emotion control ~Advanced OCR & video understanding ~Offline iPad-compatible multimodal live streaming 🔗 Try it out: GitHub: HF: Demo:

OpenBMB

97,844 görüntüleme • 1 yıl önce

HOLY FUCK! Zyphra just dropped Zonos - Apache 2.0 licensed, Multilingual, Text to Speech model with INSTANT voice cloning! 🔥 > Zero-shot TTS with Voice Cloning: Input text and a 10-30 second speaker sample to generate high-quality text-to-speech output > Audio Prefix Inputs: Enhance speaker matching by adding an audio prefix to the text, enabling behaviors like whispering that are hard to achieve with voice cloning alone > Multilingual Support: Supports English, Japanese, Chinese, French, and German > Audio Quality & Emotion Control: Fine-tune speaking rate, pitch, frequency, audio quality, and emotions (e.g., happiness, anger, sadness, fear) > Fast Performance: Runs at ~2x real-time speed on an RTX 4090 > Available on the Hugging Face Hub 🤗

HOLY FUCK! Zyphra just dropped Zonos - Apache 2.0 licensed, Multilingual, Text to Speech model with INSTANT voice cloning! 🔥 > Zero-shot TTS with Voice Cloning: Input text and a 10-30 second speaker sample to generate high-quality text-to-speech output > Audio Prefix Inputs: Enhance speaker matching by adding an audio prefix to the text, enabling behaviors like whispering that are hard to achieve with voice cloning alone > Multilingual Support: Supports English, Japanese, Chinese, French, and German > Audio Quality & Emotion Control: Fine-tune speaking rate, pitch, frequency, audio quality, and emotions (e.g., happiness, anger, sadness, fear) > Fast Performance: Runs at ~2x real-time speed on an RTX 4090 > Available on the Hugging Face Hub 🤗

Vaibhav (VB) Srivastav

299,066 görüntüleme • 1 yıl önce

I taught a speech model to understand context in conversation. This is what happened It adjusts voice and tone to express urgency, comfort, understanding from the dialogue. Just like a real human being 520M model. Runs locally on consumer devices How this is achieved 🧵

I taught a speech model to understand context in conversation. This is what happened It adjusts voice and tone to express urgency, comfort, understanding from the dialogue. Just like a real human being 520M model. Runs locally on consumer devices How this is achieved 🧵

Luozhu

22,028 görüntüleme • 6 ay önce

🚨 ANTHROPIC TRIED TO BAN HIS GITHUB Chinese guy published 70B parameter LLM, 20,000 starts on Github + a lawsuit from big AI companies Here's what it does: > runs on Python > even shitty mac or pc is enough > flat memory > loads a model layer by layer > 100% local This model can close 100% needs of most businesses, which would pay $3,000/a month for a trained version. It needs just 4 gb of GPU, so using this technology my gaming pc with 12 gb GPU will run 200B parameter model with ease Github link is below. Why you should go local too.

🚨 ANTHROPIC TRIED TO BAN HIS GITHUB Chinese guy published 70B parameter LLM, 20,000 starts on Github + a lawsuit from big AI companies Here's what it does: > runs on Python > even shitty mac or pc is enough > flat memory > loads a model layer by layer > 100% local This model can close 100% needs of most businesses, which would pay $3,000/a month for a trained version. It needs just 4 gb of GPU, so using this technology my gaming pc with 12 gb GPU will run 200B parameter model with ease Github link is below. Why you should go local too.

Milady

491,062 görüntüleme • 3 ay önce

Introducing our new Turbo 2.5 model - Hindi, French, Spanish, Mandarin and 27 other languages just got 3x faster. This unlocks high-quality low-latency conversational AI for nearly 80% of the world. For the first time, we support Vietnamese, Hungarian and Norwegian text to speech. And English is now 25% faster compared to Turbo v2.

Introducing our new Turbo 2.5 model - Hindi, French, Spanish, Mandarin and 27 other languages just got 3x faster. This unlocks high-quality low-latency conversational AI for nearly 80% of the world. For the first time, we support Vietnamese, Hungarian and Norwegian text to speech. And English is now 25% faster compared to Turbo v2.

ElevenLabs

50,875 görüntüleme • 2 yıl önce

Kyutai released their Streaming Text to Speech model, ~2B param model, ultra low latency (220ms), CC-BY-4.0 license 🔥 Trained on 2.5 Million Hours of audio, it can serve up to 32 users w/ less than 350ms latency on a SINGLE L40 🤯 Incredible release by kyutai folks, go check out their hugging face page now!

Kyutai released their Streaming Text to Speech model, ~2B param model, ultra low latency (220ms), CC-BY-4.0 license 🔥 Trained on 2.5 Million Hours of audio, it can serve up to 32 users w/ less than 350ms latency on a SINGLE L40 🤯 Incredible release by kyutai folks, go check out their hugging face page now!

Vaibhav (VB) Srivastav

93,586 görüntüleme • 1 yıl önce

i was playing around the newest TTS (text to speech) model 'kokoro' which has just 82M parameters! by adding only 1 line of code you can create a custom voice that mixes any two (out of ten voices) in any ratio example: mixing one male and one female voice in the 60-40 ratio

i was playing around the newest TTS (text to speech) model 'kokoro' which has just 82M parameters! by adding only 1 line of code you can create a custom voice that mixes any two (out of ten voices) in any ratio example: mixing one male and one female voice in the 60-40 ratio

maharshi

88,765 görüntüleme • 1 yıl önce

Day 1 of 3 MLX Releases: Introducing MLX-Audio 🚀🔥 A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon. Features ⚡️Fast inference on Apple Silicon (M series chips) 🤖Multiple language support 🗣️Voice customization options 🚀Quantization support for optimized performance Supported models: 🪶Kokoro - A multilingual TTS model with 82M params that supports various languages and voice styles. With more models coming soon. Get started: > pip install mlx-audio Please leave us a star and send a PR :)

Day 1 of 3 MLX Releases: Introducing MLX-Audio 🚀🔥 A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon. Features ⚡️Fast inference on Apple Silicon (M series chips) 🤖Multiple language support 🗣️Voice customization options 🚀Quantization support for optimized performance Supported models: 🪶Kokoro - A multilingual TTS model with 82M params that supports various languages and voice styles. With more models coming soon. Get started: > pip install mlx-audio Please leave us a star and send a PR :)

Prince Canuma

123,553 görüntüleme • 1 yıl önce