Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Two Realtime API updates: - You can now build speech-to-speech experiences with five new voices—which are much more expressive and steerable. 🤣🤫🤪 - We're lowering the price by using prompt caching. Cached text inputs are discounted 50% and cached audio inputs are discounted 80%. 📉

OpenAIDevs's profile picture

OpenAI Developers

371,134 subscribers

243,280 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieBildungNachrichten & Politik
LIVE

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von Vaibhav (VB) Srivastav
Vaibhav (VB) Srivastavvor 1 Jahr

Congratulations - our cascaded approach has had that for quite a long while 🤗

Profilbild von Degen Wave 🌊
Degen Wave 🌊vor 1 Jahr

Can we get a voice that is at least close to being as good as Sky was plz?

Profilbild von Mckay Wrigley
Mckay Wrigleyvor 1 Jahr

This one is super appreciated!

Profilbild von Alex Volkov (Thursd/AI)
Alex Volkov (Thursd/AI)vor 1 Jahr

Can we get some clarification / confirmation of the following? - are output tokens are turned into input tokens on next turn? - Is the caching automatic or do we need to do anything? - can we get an example calculation of a 3 turn conversation and transparent pricing? 🙏

Profilbild von Daniel Nguyen ⚡
Daniel Nguyen ⚡vor 1 Jahr

Thank you. Can you add sample audio so we can add voice preview in our app? Similar to mp3 files on this page

Profilbild von •
•vor 1 Jahr

“Sorry, that’s against my guidelines” is what needs to be fixed most

Profilbild von Haider.
Haider.vor 1 Jahr

ok, but what's so funny?

Profilbild von Everett World
Everett Worldvor 1 Jahr

Nice, but Sol is still the best voice!

Profilbild von Jan
Janvor 1 Jahr

we need an updated text to speech api : (

Profilbild von Kol Tregaskes
Kol Tregaskesvor 1 Jahr

Liking the new voices.

Ähnliche Videos

New native audio capabilities in Gemini 2.5 enable text-to-speech in over 24 languages. 🔊Voices are more natural and expressive, and you can seamlessly switch between languages.
0:39

New native audio capabilities in Gemini 2.5 enable text-to-speech in over 24 languages. 🔊Voices are more natural and expressive, and you can seamlessly switch between languages.

Google

155,360 Aufrufe • vor 1 Jahr

🎥 Sora 2 and Sora 2 Pro are now in the API. And new image and speech-to-speech models that are cheaper than their full-sized counterparts, but with similar quality: 📸 gpt-image-1-mini (80% cheaper) 🗣️ gpt-realtime-mini (70% cheaper)
1:30

🎥 Sora 2 and Sora 2 Pro are now in the API. And new image and speech-to-speech models that are cheaper than their full-sized counterparts, but with similar quality: 📸 gpt-image-1-mini (80% cheaper) 🗣️ gpt-realtime-mini (70% cheaper)

OpenAI Developers

192,185 Aufrufe • vor 9 Monaten

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.
0:36

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.

AI at Meta

351,698 Aufrufe • vor 1 Jahr

Introducing Gemini 3.1 Flash TTS 🗣️, our latest text to speech model with scene direction, speaker level specificity, audio tags, more natural + expressive voices, and support for 70 different languages. Available via our new audio playground in AI Studio and in the Gemini API!
0:33

Introducing Gemini 3.1 Flash TTS 🗣️, our latest text to speech model with scene direction, speaker level specificity, audio tags, more natural + expressive voices, and support for 70 different languages. Available via our new audio playground in AI Studio and in the Gemini API!

Logan Kilpatrick

801,785 Aufrufe • vor 2 Monaten

PSA: Our intern Dylan Mitic (the people's prince) screwed up again and reduced prices for GPT OSS models on Groq Inc, but we're rolling with it. 20-40% price reductions + 50% off cached tokens with prompt caching for 20B (120B coming soon). Fast and even more affordable. 🫡
1:05

PSA: Our intern Dylan Mitic (the people's prince) screwed up again and reduced prices for GPT OSS models on Groq Inc, but we're rolling with it. 20-40% price reductions + 50% off cached tokens with prompt caching for 20B (120B coming soon). Fast and even more affordable. 🫡

Hatice Ozen

84,974 Aufrufe • vor 8 Monaten

🚨Today we’re rolling out Prompt Caching on GroqCloud. Keep hot prompts in memory, cut cached token costs by 50% and slash latency. Faster response, smarter inference. Learn more 👇
0:44

🚨Today we’re rolling out Prompt Caching on GroqCloud. Keep hot prompts in memory, cut cached token costs by 50% and slash latency. Faster response, smarter inference. Learn more 👇

Groq Inc

20,383 Aufrufe • vor 10 Monaten

Here are the best practices for using Eleven v3 (alpha) - the most expressive Text to Speech model.
3:55

Here are the best practices for using Eleven v3 (alpha) - the most expressive Text to Speech model.

ElevenLabs

43,692 Aufrufe • vor 1 Jahr

people always ask me how they can create long, consistent AI videos with audio. well creatify aurora solves a big part of that and there are some new models coming soon too for more action + audio. I created his voice with dia tts which i think great at capturing emotional speeches. then I cloned his voice using minimax voice clone and use it on minimax tts 2.6. here is the my full conversation with claude for images and text to speech inputs:
0:27

people always ask me how they can create long, consistent AI videos with audio. well creatify aurora solves a big part of that and there are some new models coming soon too for more action + audio. I created his voice with dia tts which i think great at capturing emotional speeches. then I cloned his voice using minimax voice clone and use it on minimax tts 2.6. here is the my full conversation with claude for images and text to speech inputs:

gokaygokay

38,341 Aufrufe • vor 7 Monaten

🎵 ✨The world’s most flexible sound machine? With text and audio inputs, this new #generativeAI model, named Fugatto, can create any combination of music, voices, and sounds.🎹 Read more in our blog by richardkerris ➡️ #NVIDIAResearch Note: Some music, sounds, and the voice of NVIDIA CEO Jensen Huang used in this video are AI generated.
3:03

🎵 ✨The world’s most flexible sound machine? With text and audio inputs, this new #generativeAI model, named Fugatto, can create any combination of music, voices, and sounds.🎹 Read more in our blog by richardkerris ➡️ #NVIDIAResearch Note: Some music, sounds, and the voice of NVIDIA CEO Jensen Huang used in this video are AI generated.

NVIDIA AI Developer

90,328 Aufrufe • vor 1 Jahr

Here are the experiences developers are building with the Realtime API:
2:31

Here are the experiences developers are building with the Realtime API:

OpenAI Developers

36,351 Aufrufe • vor 1 Monat

We are launching the Eleven v3 (alpha) API. Built for async use cases, Eleven v3 (alpha) delivers the most expressive Text to Speech model: - Dialogue mode, unlimited amount of speakers - 70+ languages - Enhanced voice and emotional control with [audio tags]
0:31

We are launching the Eleven v3 (alpha) API. Built for async use cases, Eleven v3 (alpha) delivers the most expressive Text to Speech model: - Dialogue mode, unlimited amount of speakers - 70+ languages - Enhanced voice and emotional control with [audio tags]

ElevenLabs

8,188,671 Aufrufe • vor 10 Monaten

Mini-Omni 2 understands image, audio and text inputs all via end-to-end voice conversations with users 🔥 > Understands and processes images, speech, and text > Generates real-time speech responses > Supports interruptions during speech Technical Overview: > Concatenates image, audio, and text features for input. > Uses text-guided delayed parallel output for real-time speech > Involves encoder adaptation, modal alignment, and multimodal fine-tuning Best part: MIT licensed ⚡
0:54

Mini-Omni 2 understands image, audio and text inputs all via end-to-end voice conversations with users 🔥 > Understands and processes images, speech, and text > Generates real-time speech responses > Supports interruptions during speech Technical Overview: > Concatenates image, audio, and text features for input. > Uses text-guided delayed parallel output for real-time speech > Involves encoder adaptation, modal alignment, and multimodal fine-tuning Best part: MIT licensed ⚡

Vaibhav (VB) Srivastav

45,409 Aufrufe • vor 1 Jahr

POV: You gave every accent a World Cup mic 🌍 Pollo AI Audio is now live! Text-to-Speech + expressive voices. Try it:
0:26

POV: You gave every accent a World Cup mic 🌍 Pollo AI Audio is now live! Text-to-Speech + expressive voices. Try it:

Pollo AI

1,370,304 Aufrufe • vor 1 Monat

🔊Introducing Voxtral TTS: our new frontier open-weight model for natural, expressive, and ultra-fast text-to-speech 🎭Realistic, emotionally expressive speech. 🌍Supports 9 languages and accurately captures diverse dialects. ⚡Very low latency for time-to-first-audio. 🔄Easily adaptable to new voices
1:21

🔊Introducing Voxtral TTS: our new frontier open-weight model for natural, expressive, and ultra-fast text-to-speech 🎭Realistic, emotionally expressive speech. 🌍Supports 9 languages and accurately captures diverse dialects. ⚡Very low latency for time-to-first-audio. 🔄Easily adaptable to new voices

Mistral AI

939,580 Aufrufe • vor 3 Monaten

Today we launched Gemini 3.1 Flash TTS, our most expressive and controllable text-to-speech model yet. This launch [excitement] includes audio tags! 🗣🏷 Audio tags [explanatory] are a seamless way to guide vocal style, pace, and delivery using natural language commands embedded directly in your text. Want a different tempo or tone? [amazement] Just tag the audio to steer the AI-speech output! The model supports 70+ languages (24 of which are high-quality evaluated languages, including: Japanese, Hindi, and Arabic). Watch the audio tags in action in the demo below ↓
1:14

Today we launched Gemini 3.1 Flash TTS, our most expressive and controllable text-to-speech model yet. This launch [excitement] includes audio tags! 🗣🏷 Audio tags [explanatory] are a seamless way to guide vocal style, pace, and delivery using natural language commands embedded directly in your text. Want a different tempo or tone? [amazement] Just tag the audio to steer the AI-speech output! The model supports 70+ languages (24 of which are high-quality evaluated languages, including: Japanese, Hindi, and Arabic). Watch the audio tags in action in the demo below ↓

Google AI

202,556 Aufrufe • vor 2 Monaten

That’s it. That’s the tweet. The Realtime API now supports WebRTC—you can add Realtime capabilities with just a handful of lines of code. We’ve also cut prices by 60%, added GPT-4o mini (10x cheaper than previous prices), improved voice quality, and made inputs more reliable.
5:36

That’s it. That’s the tweet. The Realtime API now supports WebRTC—you can add Realtime capabilities with just a handful of lines of code. We’ve also cut prices by 60%, added GPT-4o mini (10x cheaper than previous prices), improved voice quality, and made inputs more reliable.

OpenAI Developers

523,494 Aufrufe • vor 1 Jahr

Voice agents, now on Vercel. Realtime, speech and transcription are now live on AI Gateway. Build with 𝚞𝚜𝚎𝚁𝚎𝚊𝚕𝚝𝚒𝚖𝚎, 𝚐𝚎𝚗𝚎𝚛𝚊𝚝𝚎𝚂𝚙𝚎𝚎𝚌𝚑 & 𝚝𝚛𝚊𝚗𝚜𝚌𝚛𝚒𝚋𝚎 on AI SDK 7.
0:57

Voice agents, now on Vercel. Realtime, speech and transcription are now live on AI Gateway. Build with 𝚞𝚜𝚎𝚁𝚎𝚊𝚕𝚝𝚒𝚖𝚎, 𝚐𝚎𝚗𝚎𝚛𝚊𝚝𝚎𝚂𝚙𝚎𝚎𝚌𝚑 & 𝚝𝚛𝚊𝚗𝚜𝚌𝚛𝚒𝚋𝚎 on AI SDK 7.

Vercel

645,100 Aufrufe • vor 11 Tagen

PSA: Prompt caching is now live for moonshotai/kimi-k2-instruct on Groq Inc: → 50% discount for cached tokens → Lower latency → Automatic prefix matching Excited to roll this out starting with Kimi K2 and even more excited for inexpensive, fast vibe coding for all. ⚡️
6:41

PSA: Prompt caching is now live for moonshotai/kimi-k2-instruct on Groq Inc: → 50% discount for cached tokens → Lower latency → Automatic prefix matching Excited to roll this out starting with Kimi K2 and even more excited for inexpensive, fast vibe coding for all. ⚡️

Hatice Ozen

67,965 Aufrufe • vor 10 Monaten

I made a few updates to the MLX port of F5 TTS over the holiday: - Longform generation is now supported, and text will be split automatically on sentence boundaries for natural-sounding speech. - You can now pipe in text from another process (e.g. a language model) and listen to the speech as each segment is generated. - I implemented RK4 sampling for the ODE, which achieves much better quality with fewer steps — it's now possible to generate speech at 1.6x realtime on my M3 Max. See the video of an example of generating speech in realtime from a language model entirely on-device! 🚀
0:54

I made a few updates to the MLX port of F5 TTS over the holiday: - Longform generation is now supported, and text will be split automatically on sentence boundaries for natural-sounding speech. - You can now pipe in text from another process (e.g. a language model) and listen to the speech as each segment is generated. - I implemented RK4 sampling for the ODE, which achieves much better quality with fewer steps — it's now possible to generate speech at 1.6x realtime on my M3 Max. See the video of an example of generating speech in realtime from a language model entirely on-device! 🚀

Lucas Newman

22,962 Aufrufe • vor 1 Jahr