Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Two Realtime API updates: - You can now build speech-to-speech experiences with five new voices—which are much more expressive and steerable. 🤣🤫🤪 - We're lowering the price by using prompt caching. Cached text inputs are discounted 50% and cached audio inputs are discounted 80%. 📉

OpenAIDevs's profile picture

OpenAI Developers

396,261 subscribers

243,432 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & TeknolojiEğitimHaberler & Politika
LIVE

Anya Rossi• Live Now

Private livecam show

10 Yorum

Vaibhav (VB) Srivastav profil fotoğrafı
Vaibhav (VB) Srivastav1 yıl önce

Congratulations - our cascaded approach has had that for quite a long while 🤗

Degen Wave 🌊 profil fotoğrafı
Degen Wave 🌊1 yıl önce

Can we get a voice that is at least close to being as good as Sky was plz?

Mckay Wrigley profil fotoğrafı
Mckay Wrigley1 yıl önce

This one is super appreciated!

Alex Volkov (Thursd/AI) profil fotoğrafı
Alex Volkov (Thursd/AI)1 yıl önce

Can we get some clarification / confirmation of the following? - are output tokens are turned into input tokens on next turn? - Is the caching automatic or do we need to do anything? - can we get an example calculation of a 3 turn conversation and transparent pricing? 🙏

Daniel Nguyen ⚡ profil fotoğrafı
Daniel Nguyen ⚡1 yıl önce

Thank you. Can you add sample audio so we can add voice preview in our app? Similar to mp3 files on this page

• profil fotoğrafı
•1 yıl önce

“Sorry, that’s against my guidelines” is what needs to be fixed most

Haider. profil fotoğrafı
Haider.1 yıl önce

ok, but what's so funny?

Everett World profil fotoğrafı
Everett World1 yıl önce

Nice, but Sol is still the best voice!

Jan profil fotoğrafı
Jan1 yıl önce

we need an updated text to speech api : (

Kol Tregaskes profil fotoğrafı
Kol Tregaskes1 yıl önce

Liking the new voices.

Benzer Videolar

New native audio capabilities in Gemini 2.5 enable text-to-speech in over 24 languages. 🔊Voices are more natural and expressive, and you can seamlessly switch between languages.
0:39

New native audio capabilities in Gemini 2.5 enable text-to-speech in over 24 languages. 🔊Voices are more natural and expressive, and you can seamlessly switch between languages.

Google

155,500 görüntüleme • 1 yıl önce

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.
0:36

Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech. Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification. We hope that sharing this work will enable the research community to further new approaches for text and speech integration.

AI at Meta

351,764 görüntüleme • 1 yıl önce

🎥 Sora 2 and Sora 2 Pro are now in the API. And new image and speech-to-speech models that are cheaper than their full-sized counterparts, but with similar quality: 📸 gpt-image-1-mini (80% cheaper) 🗣️ gpt-realtime-mini (70% cheaper)
1:30

🎥 Sora 2 and Sora 2 Pro are now in the API. And new image and speech-to-speech models that are cheaper than their full-sized counterparts, but with similar quality: 📸 gpt-image-1-mini (80% cheaper) 🗣️ gpt-realtime-mini (70% cheaper)

OpenAI Developers

192,261 görüntüleme • 11 ay önce

Introducing Gemini 3.1 Flash TTS 🗣️, our latest text to speech model with scene direction, speaker level specificity, audio tags, more natural + expressive voices, and support for 70 different languages. Available via our new audio playground in AI Studio and in the Gemini API!
0:33

Introducing Gemini 3.1 Flash TTS 🗣️, our latest text to speech model with scene direction, speaker level specificity, audio tags, more natural + expressive voices, and support for 70 different languages. Available via our new audio playground in AI Studio and in the Gemini API!

Logan Kilpatrick

805,885 görüntüleme • 5 ay önce

people always ask me how they can create long, consistent AI videos with audio. well creatify aurora solves a big part of that and there are some new models coming soon too for more action + audio. I created his voice with dia tts which i think great at capturing emotional speeches. then I cloned his voice using minimax voice clone and use it on minimax tts 2.6. here is the my full conversation with claude for images and text to speech inputs:
0:27

people always ask me how they can create long, consistent AI videos with audio. well creatify aurora solves a big part of that and there are some new models coming soon too for more action + audio. I created his voice with dia tts which i think great at capturing emotional speeches. then I cloned his voice using minimax voice clone and use it on minimax tts 2.6. here is the my full conversation with claude for images and text to speech inputs:

gokaygokay

38,341 görüntüleme • 9 ay önce

🎵 ✨The world’s most flexible sound machine? With text and audio inputs, this new #generativeAI model, named Fugatto, can create any combination of music, voices, and sounds.🎹 Read more in our blog by richardkerris ➡️ #NVIDIAResearch Note: Some music, sounds, and the voice of NVIDIA CEO Jensen Huang used in this video are AI generated.
3:03

🎵 ✨The world’s most flexible sound machine? With text and audio inputs, this new #generativeAI model, named Fugatto, can create any combination of music, voices, and sounds.🎹 Read more in our blog by richardkerris ➡️ #NVIDIAResearch Note: Some music, sounds, and the voice of NVIDIA CEO Jensen Huang used in this video are AI generated.

NVIDIA AI Developer

90,418 görüntüleme • 1 yıl önce

We are launching the Eleven v3 (alpha) API. Built for async use cases, Eleven v3 (alpha) delivers the most expressive Text to Speech model: - Dialogue mode, unlimited amount of speakers - 70+ languages - Enhanced voice and emotional control with [audio tags]
0:31

We are launching the Eleven v3 (alpha) API. Built for async use cases, Eleven v3 (alpha) delivers the most expressive Text to Speech model: - Dialogue mode, unlimited amount of speakers - 70+ languages - Enhanced voice and emotional control with [audio tags]

ElevenLabs

8,188,968 görüntüleme • 1 yıl önce

Today we launched Gemini 3.1 Flash TTS, our most expressive and controllable text-to-speech model yet. This launch [excitement] includes audio tags! 🗣🏷 Audio tags [explanatory] are a seamless way to guide vocal style, pace, and delivery using natural language commands embedded directly in your text. Want a different tempo or tone? [amazement] Just tag the audio to steer the AI-speech output! The model supports 70+ languages (24 of which are high-quality evaluated languages, including: Japanese, Hindi, and Arabic). Watch the audio tags in action in the demo below ↓
1:14

Today we launched Gemini 3.1 Flash TTS, our most expressive and controllable text-to-speech model yet. This launch [excitement] includes audio tags! 🗣🏷 Audio tags [explanatory] are a seamless way to guide vocal style, pace, and delivery using natural language commands embedded directly in your text. Want a different tempo or tone? [amazement] Just tag the audio to steer the AI-speech output! The model supports 70+ languages (24 of which are high-quality evaluated languages, including: Japanese, Hindi, and Arabic). Watch the audio tags in action in the demo below ↓

Google AI

203,435 görüntüleme • 5 ay önce

I made a few updates to the MLX port of F5 TTS over the holiday: - Longform generation is now supported, and text will be split automatically on sentence boundaries for natural-sounding speech. - You can now pipe in text from another process (e.g. a language model) and listen to the speech as each segment is generated. - I implemented RK4 sampling for the ODE, which achieves much better quality with fewer steps — it's now possible to generate speech at 1.6x realtime on my M3 Max. See the video of an example of generating speech in realtime from a language model entirely on-device! 🚀
0:54

I made a few updates to the MLX port of F5 TTS over the holiday: - Longform generation is now supported, and text will be split automatically on sentence boundaries for natural-sounding speech. - You can now pipe in text from another process (e.g. a language model) and listen to the speech as each segment is generated. - I implemented RK4 sampling for the ODE, which achieves much better quality with fewer steps — it's now possible to generate speech at 1.6x realtime on my M3 Max. See the video of an example of generating speech in realtime from a language model entirely on-device! 🚀

Lucas Newman

22,998 görüntüleme • 1 yıl önce

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️
4:29

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️

Prince Canuma

164,026 görüntüleme • 7 ay önce

HOLY FUCK! Zyphra just dropped Zonos - Apache 2.0 licensed, Multilingual, Text to Speech model with INSTANT voice cloning! 🔥 > Zero-shot TTS with Voice Cloning: Input text and a 10-30 second speaker sample to generate high-quality text-to-speech output > Audio Prefix Inputs: Enhance speaker matching by adding an audio prefix to the text, enabling behaviors like whispering that are hard to achieve with voice cloning alone > Multilingual Support: Supports English, Japanese, Chinese, French, and German > Audio Quality & Emotion Control: Fine-tune speaking rate, pitch, frequency, audio quality, and emotions (e.g., happiness, anger, sadness, fear) > Fast Performance: Runs at ~2x real-time speed on an RTX 4090 > Available on the Hugging Face Hub 🤗
1:21

HOLY FUCK! Zyphra just dropped Zonos - Apache 2.0 licensed, Multilingual, Text to Speech model with INSTANT voice cloning! 🔥 > Zero-shot TTS with Voice Cloning: Input text and a 10-30 second speaker sample to generate high-quality text-to-speech output > Audio Prefix Inputs: Enhance speaker matching by adding an audio prefix to the text, enabling behaviors like whispering that are hard to achieve with voice cloning alone > Multilingual Support: Supports English, Japanese, Chinese, French, and German > Audio Quality & Emotion Control: Fine-tune speaking rate, pitch, frequency, audio quality, and emotions (e.g., happiness, anger, sadness, fear) > Fast Performance: Runs at ~2x real-time speed on an RTX 4090 > Available on the Hugging Face Hub 🤗

Vaibhav (VB) Srivastav

299,066 görüntüleme • 1 yıl önce

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.
1:41

Speak with ChatGPT: You can now use voice to engage in a back-and-forth conversation with your assistant. The hyper-realistic text-to-speech model allows you to choose from five different voices. On mobile, opt-in to voice in Settings → New Features on the mobile app.

Rowan Cheung

55,915 görüntüleme • 3 yıl önce

NVIDIA Releases Audex (Nemotron-Labs-Audex-30B-A3B): A Unified Audio-Text LLM That Preserves the Text Intelligence of Its Backbone Most unified audio models pay a text tax. Add audio output, and reasoning benchmarks drop — even when the only new output is speech. NVIDIA just released one that doesn't. Audex (Nemotron-Labs-Audex-30B-A3B) is a 30B MoE with 3B active parameters, built on the text-only Nemotron-Cascade-2-30B-A3B backbone. Audio inputs are projected into the text embedding space. Text tokens and quantized audio tokens are then generated the same way, inside one MoE decoder — no thinker–talker split, no stacked cascade. Here's what's actually interesting: → One model, audio in and out: understanding, ASR, translation, TTS, text-to-audio, speech-to-speech → Text holds vs its own backbone: IMO AnswerBench 81.1 vs 79.3, MMLU-Redux 86.4 vs 86.3 → Beats text-only Qwen3.5-35B-A3B on several tasks: LiveCodeBench v6 85.3 vs 74.6, IFBench 77.8 vs 70.2 → The usual tax, for contrast: Qwen3-Omni-30B-A3B-Thinking drops to 60.4 on HMMT vs 71.4 for its text backbone → 6.82 WER on OpenASR, ahead of Step-Audio-R1.1-33B (7.91) and Qwen3-Omni-Thinking (8.00) → Two codecs: X-Codec2 for speech (50 tok/s, FSQ, 65,536 codebook), X-Codec for general audio (200 tok/s, 4 flattened RVQ layers) — the only strong open model generating general audio beyond speech Full analysis: Paper: Model weights: NVIDIA AI NVIDIA Wei Ping
0:27

NVIDIA Releases Audex (Nemotron-Labs-Audex-30B-A3B): A Unified Audio-Text LLM That Preserves the Text Intelligence of Its Backbone Most unified audio models pay a text tax. Add audio output, and reasoning benchmarks drop — even when the only new output is speech. NVIDIA just released one that doesn't. Audex (Nemotron-Labs-Audex-30B-A3B) is a 30B MoE with 3B active parameters, built on the text-only Nemotron-Cascade-2-30B-A3B backbone. Audio inputs are projected into the text embedding space. Text tokens and quantized audio tokens are then generated the same way, inside one MoE decoder — no thinker–talker split, no stacked cascade. Here's what's actually interesting: → One model, audio in and out: understanding, ASR, translation, TTS, text-to-audio, speech-to-speech → Text holds vs its own backbone: IMO AnswerBench 81.1 vs 79.3, MMLU-Redux 86.4 vs 86.3 → Beats text-only Qwen3.5-35B-A3B on several tasks: LiveCodeBench v6 85.3 vs 74.6, IFBench 77.8 vs 70.2 → The usual tax, for contrast: Qwen3-Omni-30B-A3B-Thinking drops to 60.4 on HMMT vs 71.4 for its text backbone → 6.82 WER on OpenASR, ahead of Step-Audio-R1.1-33B (7.91) and Qwen3-Omni-Thinking (8.00) → Two codecs: X-Codec2 for speech (50 tok/s, FSQ, 65,536 codebook), X-Codec for general audio (200 tok/s, 4 flattened RVQ layers) — the only strong open model generating general audio beyond speech Full analysis: Paper: Model weights: NVIDIA AI NVIDIA Wei Ping

Marktechpost AI

28,301 görüntüleme • 2 ay önce

Finally here! Dreamina Seedance 2.0 and Seedream 5.0 Lite are Now Available on Dreamina AI We're excited to introduce our latest models, which are built for deeper control and broader creative possibilities. What Makes Dreamina Seedance 2.0 Exceptional? → Multimodal video model → Reference with image, video, and text inputs → Ultimate consistency across multiple scenes → More expressive, more controllable Create images with Seedream 5.0 Lite → Real-time world knowledge → Follows your prompts, delivers precise results → Upgraded visual expression We are gradually rolling out Dreamina Seedance 2.0 and Seedream 5.0 Lite to our community over the coming days. Hang tight if you don't see it yet and check back soon. Try it now: #DreaminaSeedance2 #DreaminaAI #Seedream5Lite #Seedance2
1:59

Finally here! Dreamina Seedance 2.0 and Seedream 5.0 Lite are Now Available on Dreamina AI We're excited to introduce our latest models, which are built for deeper control and broader creative possibilities. What Makes Dreamina Seedance 2.0 Exceptional? → Multimodal video model → Reference with image, video, and text inputs → Ultimate consistency across multiple scenes → More expressive, more controllable Create images with Seedream 5.0 Lite → Real-time world knowledge → Follows your prompts, delivers precise results → Upgraded visual expression We are gradually rolling out Dreamina Seedance 2.0 and Seedream 5.0 Lite to our community over the coming days. Hang tight if you don't see it yet and check back soon. Try it now: #DreaminaSeedance2 #DreaminaAI #Seedream5Lite #Seedance2

Dreamina AI

396,608 görüntüleme • 6 ay önce

Our inspect services are now integrated with the CS2 Trader extension! Made by fellow trader Gergely Szabo This means ST and Agent codes are now supported and you can connect to servers with ease 🥳 More to come 🤫
0:23

Our inspect services are now integrated with the CS2 Trader extension! Made by fellow trader Gergely Szabo This means ST and Agent codes are now supported and you can connect to servers with ease 🥳 More to come 🤫

Epidemic

10,346 görüntüleme • 2 yıl önce

World Labs and VIVE Mars are making it easier to turn ideas into shoot-ready 3D scenes, fast. World Labs new AI world-builder lets you create detailed virtual environments from a simple text or image prompt, then composite them live. Once the scene is ready, you can step straight into production using VIVE Mars CamTrack. Sign up at a discounted rate to start building worlds, and see how the full workflow comes together with VIVE Mars CamTrack and Marble. 👉 👉
2:24

World Labs and VIVE Mars are making it easier to turn ideas into shoot-ready 3D scenes, fast. World Labs new AI world-builder lets you create detailed virtual environments from a simple text or image prompt, then composite them live. Once the scene is ready, you can step straight into production using VIVE Mars CamTrack. Sign up at a discounted rate to start building worlds, and see how the full workflow comes together with VIVE Mars CamTrack and Marble. 👉 👉

HTC VIVE

41,235 görüntüleme • 10 ay önce

We asked Dylan Field about organizational design in the age of AI, the importance of design. "As the inputs to software change, as more people are creating software, design becomes the differentiator." "Two decades ago, design was lipstick on a pig." "Design now is how you win or lose. We're going to start seeing so many more designer CEOs and design-oriented folks who are leading and shaping the future of software and companies." "Incredible designers are more in demand than ever. Good luck recruiting them because they have 50 other offers and infinite optionality."
3:34

We asked Dylan Field about organizational design in the age of AI, the importance of design. "As the inputs to software change, as more people are creating software, design becomes the differentiator." "Two decades ago, design was lipstick on a pig." "Design now is how you win or lose. We're going to start seeing so many more designer CEOs and design-oriented folks who are leading and shaping the future of software and companies." "Incredible designers are more in demand than ever. Good luck recruiting them because they have 50 other offers and infinite optionality."

TBPN

27,940 görüntüleme • 1 yıl önce