Loading video...

Video Failed to Load

Go Home

🚀Introducing Aero-1-Audio lmms-lab ⚡️Lightweight 1.5B model 💡Outperforms SOTA models like Whisper, Qwen-2-Audio & commercial services from ElevenLabs - Blog: - Code: - Demo Gradio: . Thanks to AK!

liuziwei7's profile picture

Ziwei Liu

13,112 subscribers

17,973 views • 1 year ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

try out the Gradio Demo for AudioLDM: Text-to-Audio Generation with Latent Diffusion Models on Hugging Face demo:
1:36

try out the Gradio Demo for AudioLDM: Text-to-Audio Generation with Latent Diffusion Models on Hugging Face demo:

AK

82,138 views • 3 years ago

This is big. SOTA audio reasoning. SOTA video reasoning. SOTA audio captioning. SOTA sound event detection. Better than Gemini. Better than Qwen. TAC: Timestamped Audio Captioning 📑 paper: 🌐 website with more demos:
0:22

This is big. SOTA audio reasoning. SOTA video reasoning. SOTA audio captioning. SOTA sound event detection. Better than Gemini. Better than Qwen. TAC: Timestamped Audio Captioning 📑 paper: 🌐 website with more demos:

Justin Salamon

19,296 views • 4 months ago

Today we are announcing Avalon – the best transcription model in the world for prompting AIs. It outperforms the previous state-of-the-art models like ElevenLabs' Scribe and OpenAI's Whisper.
1:38

Today we are announcing Avalon – the best transcription model in the world for prompting AIs. It outperforms the previous state-of-the-art models like ElevenLabs' Scribe and OpenAI's Whisper.

Aqua Voice

472,244 views • 10 months ago

Introducing ElevenLabs Image & Video - the best audio, image and video models now in one platform. Generate with leading models like Veo, Sora, Kling, Wan and Seedance, then enhance with the highest quality voices, music, and sound effects.
0:48

Introducing ElevenLabs Image & Video - the best audio, image and video models now in one platform. Generate with leading models like Veo, Sora, Kling, Wan and Seedance, then enhance with the highest quality voices, music, and sound effects.

ElevenLabs

149,194 views • 7 months ago

Introducing Universal-1: Our most powerful and accurate Speech AI model yet. ✅ Trained on 12.5M hours of multilingual speech data ✅ 13.5% more accurate than models like Whisper ✅ Up to 30% fewer hallucinations than seq2seq models ✅ Just 38 seconds to process 1 hour of audio
1:01

Introducing Universal-1: Our most powerful and accurate Speech AI model yet. ✅ Trained on 12.5M hours of multilingual speech data ✅ 13.5% more accurate than models like Whisper ✅ Up to 30% fewer hallucinations than seq2seq models ✅ Just 38 seconds to process 1 hour of audio

AssemblyAI

23,511,269 views • 2 years ago

Open-source audio scene is quite on 🔥 lately! - kyutai STT, TTS modules and Unmute fully open-sourced - NVIDIA drops 3 models: Parakeet (beats Whisper), Audio Flamingo 3 and Canary-Qwen-2.5B (new SOTA on Hugging Face leaderboard) - Mistral AI released 3B and 24B Voxtral
1:12

Open-source audio scene is quite on 🔥 lately! - kyutai STT, TTS modules and Unmute fully open-sourced - NVIDIA drops 3 models: Parakeet (beats Whisper), Audio Flamingo 3 and Canary-Qwen-2.5B (new SOTA on Hugging Face leaderboard) - Mistral AI released 3B and 24B Voxtral

Niels Rogge

27,234 views • 11 months ago

Introducing Dialog 1.0 - Ultra-emotional AI Text-To-Speech model Outperforms Elevenlabs on expressiveness and quality 3 to 1 <1% error rate Supports 30+ languages Best in class voice cloning Low latency: 303ms TTFA (Time to First Audio) Experience it for yourself on Read more below⬇️
0:51

Introducing Dialog 1.0 - Ultra-emotional AI Text-To-Speech model Outperforms Elevenlabs on expressiveness and quality 3 to 1 <1% error rate Supports 30+ languages Best in class voice cloning Low latency: 303ms TTFA (Time to First Audio) Experience it for yourself on Read more below⬇️

PlayAI

196,152 views • 1 year ago

Wow! New Speech to Speech model - Fish Agent v0.1 3B by Fish Audio 🔥 > Trained on 700K hours of multilingual audio > Continue-pretrained version of Qwen-2.5-3B-Instruct for 200B audio & text tokens > Zero-shot voice cloning > Text + audio input/ Audio output > Ultra-fast inference w/ 200ms TTFA > Models on the Hub & Finetuning code on its way! 🚀 What an amazing time to be alive 🤗
1:08

Wow! New Speech to Speech model - Fish Agent v0.1 3B by Fish Audio 🔥 > Trained on 700K hours of multilingual audio > Continue-pretrained version of Qwen-2.5-3B-Instruct for 200B audio & text tokens > Zero-shot voice cloning > Text + audio input/ Audio output > Ultra-fast inference w/ 200ms TTFA > Models on the Hub & Finetuning code on its way! 🚀 What an amazing time to be alive 🤗

Vaibhav (VB) Srivastav

66,963 views • 1 year ago

Introducing Talk Arena🔊: the platform for interactively evaluating Large Audio Models! With the release of speech AI models like GPT4o, Gemini, Qwen-Audio, etc. which is the best? Cast your votes and help us decide🔥
0:52

Introducing Talk Arena🔊: the platform for interactively evaluating Large Audio Models! With the release of speech AI models like GPT4o, Gemini, Qwen-Audio, etc. which is the best? Cast your votes and help us decide🔥

Michael Ryan

17,417 views • 1 year ago

Introducing ElevenLabs Skills. With skills, AI coding assistants like Claude Code, Cursor, and OpenCode are better at using our APIs to handle AI audio and agent workflows. Get started: npx skills add elevenlabs/skills
1:13

Introducing ElevenLabs Skills. With skills, AI coding assistants like Claude Code, Cursor, and OpenCode are better at using our APIs to handle AI audio and agent workflows. Get started: npx skills add elevenlabs/skills

ElevenLabs Developers

163,453 views • 5 months ago

We’ve partnered with @LTXStudio to bring their new Audio-to-Video model exclusively to ElevenLabs. For the next 7 days, generate audio-first videos exclusively on the ElevenLabs Creative Platform.
0:20

We’ve partnered with @LTXStudio to bring their new Audio-to-Video model exclusively to ElevenLabs. For the next 7 days, generate audio-first videos exclusively on the ElevenLabs Creative Platform.

ElevenLabs

45,227 views • 5 months ago

Introducing Audio Native. Our embeddable audio player that automatically narrates your blog or news site. Head to to customize your player. Check out for CMS platform integration guides. Your readers (and soon to be listeners) will thank you.
0:43

Introducing Audio Native. Our embeddable audio player that automatically narrates your blog or news site. Head to to customize your player. Check out for CMS platform integration guides. Your readers (and soon to be listeners) will thank you.

ElevenLabs

164,720 views • 2 years ago

Not a Qwen-TTS, but the small and fast LuxTTS delivers SOTA voice cloning from just 1GB VRAM; - &gt;150x realtime speed, - outputs crisp 48kHz audio, and matches models 10x its size.
0:27

Not a Qwen-TTS, but the small and fast LuxTTS delivers SOTA voice cloning from just 1GB VRAM; - &gt;150x realtime speed, - outputs crisp 48kHz audio, and matches models 10x its size.

Wildminder

25,238 views • 5 months ago

I just came across the most realistic text-to-audio model I've ever seen. You can even clone your voice. The audiobook industry is about to change forever. Demo: from ElevenLabs
0:32

I just came across the most realistic text-to-audio model I've ever seen. You can even clone your voice. The audiobook industry is about to change forever. Demo: from ElevenLabs

Lior Alexander

749,777 views • 3 years ago

Kokoro is insane. 🤯 This AI is a groundbreaking TTS model with just 82M parameters. It outperforms larger models and generates minutes of speech in seconds. APACHE 2.0 licensed, trained on < 100 hours of audio is now available in ai-gradio pip install --upgrade "ai-gradio[kokoro]" import gradio as gr import ai_gradio gr.load(name='kokoro:kokoro-v0_19', src=ai_gradio.registry,).launch()
0:33

Kokoro is insane. 🤯 This AI is a groundbreaking TTS model with just 82M parameters. It outperforms larger models and generates minutes of speech in seconds. APACHE 2.0 licensed, trained on < 100 hours of audio is now available in ai-gradio pip install --upgrade "ai-gradio[kokoro]" import gradio as gr import ai_gradio gr.load(name='kokoro:kokoro-v0_19', src=ai_gradio.registry,).launch()

AK

114,000 views • 1 year ago

Introducing ElevenLabs UI - open-source components for AI audio &amp; voice agents. • 22 components &amp; examples for chat interfaces, transcription, music, and more • Fully customizable • MIT licensed
0:21

Introducing ElevenLabs UI - open-source components for AI audio &amp; voice agents. • 22 components &amp; examples for chat interfaces, transcription, music, and more • Fully customizable • MIT licensed

ElevenLabs

241,824 views • 9 months ago

AudioLDM 2: text to audio/music/speech generation Code/models/paper coming soon
3:37

AudioLDM 2: text to audio/music/speech generation Code/models/paper coming soon

AK

202,456 views • 2 years ago