Загрузка видео...

Не удалось загрузить видео

На главную

Two Realtime API updates: - You can now build speech-to-speech experiences with five new voices—which are much more expressive and steerable. 🤣🤫🤪 - We're lowering the price by using prompt caching. Cached text inputs are discounted 50% and cached audio inputs are discounted 80%. 📉

OpenAIDevs's profile picture

OpenAI Developers

396,261 subscribers

243,432 просмотров • 2 лет назад •via X (Twitter)

Наука и технологииОбразованиеНовости и политика
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 10

Фото профиля Vaibhav (VB) Srivastav
Vaibhav (VB) Srivastav2 лет назад

Congratulations - our cascaded approach has had that for quite a long while 🤗

Фото профиля Degen Wave 🌊
Degen Wave 🌊2 лет назад

Can we get a voice that is at least close to being as good as Sky was plz?

Фото профиля Mckay Wrigley
Mckay Wrigley2 лет назад

This one is super appreciated!

Фото профиля Alex Volkov (Thursd/AI)
Alex Volkov (Thursd/AI)2 лет назад

Can we get some clarification / confirmation of the following? - are output tokens are turned into input tokens on next turn? - Is the caching automatic or do we need to do anything? - can we get an example calculation of a 3 turn conversation and transparent pricing? 🙏

Фото профиля Daniel Nguyen ⚡
Daniel Nguyen ⚡2 лет назад

Thank you. Can you add sample audio so we can add voice preview in our app? Similar to mp3 files on this page

Фото профиля •
•2 лет назад

“Sorry, that’s against my guidelines” is what needs to be fixed most

Фото профиля Haider.
Haider.2 лет назад

ok, but what's so funny?

Фото профиля Everett World
Everett World2 лет назад

Nice, but Sol is still the best voice!

Фото профиля Jan
Jan2 лет назад

we need an updated text to speech api : (

Фото профиля Kol Tregaskes
Kol Tregaskes2 лет назад

Liking the new voices.

Похожие видео

New native audio capabilities in Gemini 2.5 enable text-to-speech in over 24 languages. 🔊Voices are more natural and expressive, and you can seamlessly switch between languages.
0:39

New native audio capabilities in Gemini 2.5 enable text-to-speech in over 24 languages. 🔊Voices are more natural and expressive, and you can seamlessly switch between languages.

Google

155,535 просмотров • 1 год назад

🎥 Sora 2 and Sora 2 Pro are now in the API. And new image and speech-to-speech models that are cheaper than their full-sized counterparts, but with similar quality: 📸 gpt-image-1-mini (80% cheaper) 🗣️ gpt-realtime-mini (70% cheaper)
1:30

🎥 Sora 2 and Sora 2 Pro are now in the API. And new image and speech-to-speech models that are cheaper than their full-sized counterparts, but with similar quality: 📸 gpt-image-1-mini (80% cheaper) 🗣️ gpt-realtime-mini (70% cheaper)

OpenAI Developers

192,329 просмотров • 1 год назад

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.
0:36

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.

AI at Meta

351,956 просмотров • 2 лет назад

Kotoba’s speech APIs are now live on fal. - Translates speech in real time with text and audio output - Transcribes live audio as it streams - Generates speech with preset voices - Transcribes recordings with optional word timestamps
0:25

Kotoba’s speech APIs are now live on fal. - Translates speech in real time with text and audio output - Transcribes live audio as it streams - Generates speech with preset voices - Transcribes recordings with optional word timestamps

fal

11,621 просмотров • 19 дней назад

Introducing Gemini 3.1 Flash TTS 🗣️, our latest text to speech model with scene direction, speaker level specificity, audio tags, more natural + expressive voices, and support for 70 different languages. Available via our new audio playground in AI Studio and in the Gemini API!
0:33

Introducing Gemini 3.1 Flash TTS 🗣️, our latest text to speech model with scene direction, speaker level specificity, audio tags, more natural + expressive voices, and support for 70 different languages. Available via our new audio playground in AI Studio and in the Gemini API!

Logan Kilpatrick

807,320 просмотров • 6 месяцев назад

Here are the best practices for using Eleven v3 (alpha) - the most expressive Text to Speech model.
3:55

Here are the best practices for using Eleven v3 (alpha) - the most expressive Text to Speech model.

ElevenLabs

43,851 просмотров • 1 год назад

🚨Today we’re rolling out Prompt Caching on GroqCloud. Keep hot prompts in memory, cut cached token costs by 50% and slash latency. Faster response, smarter inference. Learn more 👇
0:44

🚨Today we’re rolling out Prompt Caching on GroqCloud. Keep hot prompts in memory, cut cached token costs by 50% and slash latency. Faster response, smarter inference. Learn more 👇

Groq Inc

20,383 просмотров • 1 год назад

people always ask me how they can create long, consistent AI videos with audio. well creatify aurora solves a big part of that and there are some new models coming soon too for more action + audio. I created his voice with dia tts which i think great at capturing emotional speeches. then I cloned his voice using minimax voice clone and use it on minimax tts 2.6. here is the my full conversation with claude for images and text to speech inputs:
0:27

people always ask me how they can create long, consistent AI videos with audio. well creatify aurora solves a big part of that and there are some new models coming soon too for more action + audio. I created his voice with dia tts which i think great at capturing emotional speeches. then I cloned his voice using minimax voice clone and use it on minimax tts 2.6. here is the my full conversation with claude for images and text to speech inputs:

gokaygokay

38,341 просмотров • 11 месяцев назад

🎵 ✨The world’s most flexible sound machine? With text and audio inputs, this new #generativeAI model, named Fugatto, can create any combination of music, voices, and sounds.🎹 Read more in our blog by richardkerris ➡️ #NVIDIAResearch Note: Some music, sounds, and the voice of NVIDIA CEO Jensen Huang used in this video are AI generated.
3:03

🎵 ✨The world’s most flexible sound machine? With text and audio inputs, this new #generativeAI model, named Fugatto, can create any combination of music, voices, and sounds.🎹 Read more in our blog by richardkerris ➡️ #NVIDIAResearch Note: Some music, sounds, and the voice of NVIDIA CEO Jensen Huang used in this video are AI generated.

NVIDIA AI Developer

90,418 просмотров • 1 год назад

Introducing Cekura Bench: the world’s leading Voice AI Benchmarks We benchmarked 50+ models from openAi, Google, Nvidia, xAI, Inworld, Gradium, Assembly, Fish audio and more Now you can: → Compare naturalness, performance and cost → See how the best voice agents are being built. → Find the best fit for what you are building. Our tests cover Speech-to-Speech models, Speech-to-Text models, Text-to-Speech Models, and Voice Agent platforms. We recorded real humans doing tasks in different domains and created the most representative voice benchmark out there! Explore the benchmarks: We would love to collaborate with more teams on these benchmarks. Reach out if you are interested.
1:23

Introducing Cekura Bench: the world’s leading Voice AI Benchmarks We benchmarked 50+ models from openAi, Google, Nvidia, xAI, Inworld, Gradium, Assembly, Fish audio and more Now you can: → Compare naturalness, performance and cost → See how the best voice agents are being built. → Find the best fit for what you are building. Our tests cover Speech-to-Speech models, Speech-to-Text models, Text-to-Speech Models, and Voice Agent platforms. We recorded real humans doing tasks in different domains and created the most representative voice benchmark out there! Explore the benchmarks: We would love to collaborate with more teams on these benchmarks. Reach out if you are interested.

Tarush Agarwal

796,437 просмотров • 1 день назад

We are launching the Eleven v3 (alpha) API. Built for async use cases, Eleven v3 (alpha) delivers the most expressive Text to Speech model: - Dialogue mode, unlimited amount of speakers - 70+ languages - Enhanced voice and emotional control with [audio tags]
0:31

We are launching the Eleven v3 (alpha) API. Built for async use cases, Eleven v3 (alpha) delivers the most expressive Text to Speech model: - Dialogue mode, unlimited amount of speakers - 70+ languages - Enhanced voice and emotional control with [audio tags]

ElevenLabs

8,189,110 просмотров • 1 год назад

Here are the experiences developers are building with the Realtime API:
2:31

Here are the experiences developers are building with the Realtime API:

OpenAI Developers

36,603 просмотров • 5 месяцев назад

Mini-Omni 2 understands image, audio and text inputs all via end-to-end voice conversations with users 🔥 > Understands and processes images, speech, and text > Generates real-time speech responses > Supports interruptions during speech Technical Overview: > Concatenates image, audio, and text features for input. > Uses text-guided delayed parallel output for real-time speech > Involves encoder adaptation, modal alignment, and multimodal fine-tuning Best part: MIT licensed ⚡
0:54

Mini-Omni 2 understands image, audio and text inputs all via end-to-end voice conversations with users 🔥 > Understands and processes images, speech, and text > Generates real-time speech responses > Supports interruptions during speech Technical Overview: > Concatenates image, audio, and text features for input. > Uses text-guided delayed parallel output for real-time speech > Involves encoder adaptation, modal alignment, and multimodal fine-tuning Best part: MIT licensed ⚡

Vaibhav (VB) Srivastav

45,453 просмотров • 2 лет назад

POV: You gave every accent a World Cup mic 🌍 Pollo AI Audio is now live! Text-to-Speech + expressive voices. Try it:
0:26

POV: You gave every accent a World Cup mic 🌍 Pollo AI Audio is now live! Text-to-Speech + expressive voices. Try it:

Pollo AI

1,370,304 просмотров • 5 месяцев назад

🔊Introducing Voxtral TTS: our new frontier open-weight model for natural, expressive, and ultra-fast text-to-speech 🎭Realistic, emotionally expressive speech. 🌍Supports 9 languages and accurately captures diverse dialects. ⚡Very low latency for time-to-first-audio. 🔄Easily adaptable to new voices
1:21

🔊Introducing Voxtral TTS: our new frontier open-weight model for natural, expressive, and ultra-fast text-to-speech 🎭Realistic, emotionally expressive speech. 🌍Supports 9 languages and accurately captures diverse dialects. ⚡Very low latency for time-to-first-audio. 🔄Easily adaptable to new voices

Mistral AI

953,789 просмотров • 7 месяцев назад

ElevenLabs is officially on OpenRouter. You can now call 9 Text to Speech models, with up to 90+ languages, and 2 Speech to Text models with speaker labels and word-level timestamps. All ElevenLabs models are 50% off, only on OpenRouter, through October 19, 8am PT.
1:29

ElevenLabs is officially on OpenRouter. You can now call 9 Text to Speech models, with up to 90+ languages, and 2 Speech to Text models with speaker labels and word-level timestamps. All ElevenLabs models are 50% off, only on OpenRouter, through October 19, 8am PT.

OpenRouter

46,903 просмотров • 1 месяц назад

Today we launched Gemini 3.1 Flash TTS, our most expressive and controllable text-to-speech model yet. This launch [excitement] includes audio tags! 🗣🏷 Audio tags [explanatory] are a seamless way to guide vocal style, pace, and delivery using natural language commands embedded directly in your text. Want a different tempo or tone? [amazement] Just tag the audio to steer the AI-speech output! The model supports 70+ languages (24 of which are high-quality evaluated languages, including: Japanese, Hindi, and Arabic). Watch the audio tags in action in the demo below ↓
1:14

Today we launched Gemini 3.1 Flash TTS, our most expressive and controllable text-to-speech model yet. This launch [excitement] includes audio tags! 🗣🏷 Audio tags [explanatory] are a seamless way to guide vocal style, pace, and delivery using natural language commands embedded directly in your text. Want a different tempo or tone? [amazement] Just tag the audio to steer the AI-speech output! The model supports 70+ languages (24 of which are high-quality evaluated languages, including: Japanese, Hindi, and Arabic). Watch the audio tags in action in the demo below ↓

Google AI

203,820 просмотров • 6 месяцев назад

The new Speech Recognition API enables real-time and batch transcription without sending audio to the cloud. Build live captions, dictation, accessibility experiences, voice commands, and more. Available on Windows 11, version 24H2 and later:
0:55

The new Speech Recognition API enables real-time and batch transcription without sending audio to the cloud. Build live captions, dictation, accessibility experiences, voice commands, and more. Available on Windows 11, version 24H2 and later:

Windows Developer

14,778 просмотров • 3 месяцев назад

That’s it. That’s the tweet. The Realtime API now supports WebRTC—you can add Realtime capabilities with just a handful of lines of code. We’ve also cut prices by 60%, added GPT-4o mini (10x cheaper than previous prices), improved voice quality, and made inputs more reliable.
5:36

That’s it. That’s the tweet. The Realtime API now supports WebRTC—you can add Realtime capabilities with just a handful of lines of code. We’ve also cut prices by 60%, added GPT-4o mini (10x cheaper than previous prices), improved voice quality, and made inputs more reliable.

OpenAI Developers

523,588 просмотров • 1 год назад