Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

We released Sonic-3.5 and Ink-2, the #1 streaming models for text to speech and speech to text you can use in your voice agents today. New architectures enable new frontiers for speed and quality. We're now the only provider to have #1 models for both speaking and listening.

krandiash's profile picture

Karan Goel

20,400 subscribers

7,018,227 Aufrufe • vor 1 Monat •via X (Twitter)

ComedyBildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.
0:36

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.

AI at Meta

351,764 Aufrufe • vor 1 Jahr

A startup with under 100 people just passed ElevenLabs, Gemini, and OpenAI on the voice leaderboards Cartesia took #1 on both speaking and listening in the same week. Sonic 3.5 for voice, Ink 2 for transcription👇
1:20

A startup with under 100 people just passed ElevenLabs, Gemini, and OpenAI on the voice leaderboards Cartesia took #1 on both speaking and listening in the same week. Sonic 3.5 for voice, Ink 2 for transcription👇

Nelly;

22,875 Aufrufe • vor 1 Monat

MyRobot Dev Blog 1/14/26 - Quality of Life I added offline text to speech support (Chatterbox) so you can host your own offline text to speech models.
0:45

MyRobot Dev Blog 1/14/26 - Quality of Life I added offline text to speech support (Chatterbox) so you can host your own offline text to speech models.

sgthale | MyRobot Dev

42,817 Aufrufe • vor 5 Monaten

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.
4:10

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.

AK

290,517 Aufrufe • vor 3 Jahren

New text to speech models, they have range, pacing, accent, emotional expression. I gave Gemini 3 the launch blog post and asked it to make a short ad for these new models, but in an ASMR whisper:
1:26

New text to speech models, they have range, pacing, accent, emotional expression. I gave Gemini 3 the launch blog post and asked it to make a short ad for these new models, but in an ASMR whisper:

fofr

109,025 Aufrufe • vor 8 Monaten

We pioneered the first ultra-realistic Text to Speech model, and recently launched the world's most accurate Speech to Text model, Scribe. But we're not stopping there. Today, we're taking one small step for man, and one giant leap for man's best friend... with Text to Bark.
1:00

We pioneered the first ultra-realistic Text to Speech model, and recently launched the world's most accurate Speech to Text model, Scribe. But we're not stopping there. Today, we're taking one small step for man, and one giant leap for man's best friend... with Text to Bark.

ElevenLabs

291,655 Aufrufe • vor 1 Jahr

Realtime speech-to-text for developers building conversational apps, AI agents, and voice workflows.
0:30

Realtime speech-to-text for developers building conversational apps, AI agents, and voice workflows.

ElevenLabs Developers

5,813,645 Aufrufe • vor 3 Monaten

is the best free speech to text tool and it just got better handy now supports streaming, and transcriptions are even faster now thanks to transcribe.cpp give v0.9.0 a spin and try the new models out
2:04

is the best free speech to text tool and it just got better handy now supports streaming, and transcriptions are even faster now thanks to transcribe.cpp give v0.9.0 a spin and try the new models out

cj

24,073 Aufrufe • vor 1 Monat

BUILD 🔥: Microsoft is preparing new image and voice models for the announcement on June 2. > MAI Voice 2, a multilingual model supporting 15 news languages and a wider range of emotional spectrum (check voice samples in the article) > MAI Transcribe 1.5, a new model for speech-to-text use cases. > MAI Image 2.5, already announced last week, is now available on LM Arena in preview. Compared to MAI Image 2, it supports file uploads and can be used for image editing.
0:40

BUILD 🔥: Microsoft is preparing new image and voice models for the announcement on June 2. > MAI Voice 2, a multilingual model supporting 15 news languages and a wider range of emotional spectrum (check voice samples in the article) > MAI Transcribe 1.5, a new model for speech-to-text use cases. > MAI Image 2.5, already announced last week, is now available on LM Arena in preview. Compared to MAI Image 2, it supports file uploads and can be used for image editing.

🚨 AI News | TestingCatalog

46,535 Aufrufe • vor 2 Monaten

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?
3:29

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

Melvin Vivas

27,722 Aufrufe • vor 1 Jahr

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️
4:29

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️

Prince Canuma

163,744 Aufrufe • vor 5 Monaten

🎙️Do you know you now have all the building blocks for full speech-to-speech? - Voxtral Realtime: High-quality, real-time speech-to-text. - Mistral Small 4: Fast, efficient, general-purpose agentic model. - Voxtral TTS: Realistic customizable text-to-speech with streaming output.
0:50

🎙️Do you know you now have all the building blocks for full speech-to-speech? - Voxtral Realtime: High-quality, real-time speech-to-text. - Mistral Small 4: Fast, efficient, general-purpose agentic model. - Voxtral TTS: Realistic customizable text-to-speech with streaming output.

Mistral AI for Developers

27,858 Aufrufe • vor 4 Monaten

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.
1:41

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.

Rowan Cheung

55,777 Aufrufe • vor 2 Jahren

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison Mati Staniszewski ElevenLabs
1:09

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison Mati Staniszewski ElevenLabs

Stripe

17,118 Aufrufe • vor 3 Monaten

How to have your Openclaw install the new Qwen 3.5-9b Local LLM in 1 minute This came out TODAY and is one of the only local models you can run on a 16GB Mac Mini Will be testing and making some videos this week, look out for that (check below for some tests for now)
1:04

How to have your Openclaw install the new Qwen 3.5-9b Local LLM in 1 minute This came out TODAY and is one of the only local models you can run on a 16GB Mac Mini Will be testing and making some videos this week, look out for that (check below for some tests for now)

ashen

63,977 Aufrufe • vor 5 Monaten

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊
0:23

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊

calle 🟥

29,005 Aufrufe • vor 2 Tagen

From text to reality: MIT researchers find new ways to use LLMs to help in design & manufacturing. These models can convert text prompts to CAD, generate manufacturing instructions, and search for optimal designs:
1:25

From text to reality: MIT researchers find new ways to use LLMs to help in design & manufacturing. These models can convert text prompts to CAD, generate manufacturing instructions, and search for optimal designs:

MIT CSAIL

59,161 Aufrufe • vor 3 Jahren

Your app talks back. Lovable now supports text-to-speech and-speech-to-text, so you can seamlessly add AI voice features to your projects. Make a voice assistant, a hands-free tool, or an app you can literally speak to. Sound on:
0:31

Your app talks back. Lovable now supports text-to-speech and-speech-to-text, so you can seamlessly add AI voice features to your projects. Make a voice assistant, a hands-free tool, or an app you can literally speak to. Sound on:

Lovable

22,100 Aufrufe • vor 1 Monat

for celebrating Sonic Frontiers 3RD anniversary I tried learning blender just couple weeks and did edits to the frontiers models to make them look more fresh and appealing! "Sonic Characters - Ace Models" MOD IS NOW AVAILABLE!
1:42

for celebrating Sonic Frontiers 3RD anniversary I tried learning blender just couple weeks and did edits to the frontiers models to make them look more fresh and appealing! "Sonic Characters - Ace Models" MOD IS NOW AVAILABLE!

Ace super💥

12,680 Aufrufe • vor 9 Monaten

New paper: Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models We use RL to post-train speech models (Moshi and PersonaPlex) to talk more like a human: to know when to respond, when to wait, and when to nod along with “yeah”s and “okay”s when listening.
0:40

New paper: Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models We use RL to post-train speech models (Moshi and PersonaPlex) to talk more like a human: to know when to respond, when to wait, and when to nod along with “yeah”s and “okay”s when listening.

kyutai

33,056 Aufrufe • vor 2 Monaten