Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing Speech Engine. Developers can now turn their existing chat agent into a full voice agent with one prompt. Speech Engine combines our leading speech, transcription, and voice orchestration models into a single pipeline - all custom built to work best together.

ElevenLabs's profile picture

ElevenLabs

183,723 subscribers

133,678 Aufrufe • vor 1 Monat •via X (Twitter)

BildungNachrichten & PolitikWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Your AI agent just got a voice. And yeah, it might be yours Goose + ElevenLabs = - Voice cloning - Audio editing - Speech transcription All from one single prompt.
0:44

Your AI agent just got a voice. And yeah, it might be yours Goose + ElevenLabs = - Voice cloning - Audio editing - Speech transcription All from one single prompt.

goose

93,245 Aufrufe • vor 1 Jahr

Speech to Speech is now available in 29 languages. In November, we launched Speech to Speech, enabling you to transform your voice into another character with full control over emotions, timing, and delivery. Today we're making Speech to Speech multilingual. Use Speech to Speech to get more control than with prompting alone. Simply say it how you want it, choose a target voice, and generate.
0:37

Speech to Speech is now available in 29 languages. In November, we launched Speech to Speech, enabling you to transform your voice into another character with full control over emotions, timing, and delivery. Today we're making Speech to Speech multilingual. Use Speech to Speech to get more control than with prompting alone. Simply say it how you want it, choose a target voice, and generate.

ElevenLabs

113,317 Aufrufe • vor 2 Jahren

Our latest speech-to-speech model is faster, more accurate, and excels at function calling. Watch @promptshant and Brian Fioca build a realtime voice agent that can search the web and hand off tasks to reasoning models with full context.
1:58

Our latest speech-to-speech model is faster, more accurate, and excels at function calling. Watch @promptshant and Brian Fioca build a realtime voice agent that can search the web and hand off tasks to reasoning models with full context.

OpenAI Developers

81,822 Aufrufe • vor 11 Monaten

What if voice AI could understand context, intent, and emotion — not just words? 🎙️ Meet Seed Speech 2.0. A new speech AI stack designed for natural, expressive conversations — with major upgrades in both text-to-speech (TTS) and speech recognition (ASR). Built for developers and creators who want natural conversational speech. What’s inside: - Natural and expressive speech generation - Prompt-controlled emotion and tone - High-accuracy multilingual recognition - Strong contextual reasoning Built for: 🎧 Voice content creation 🤖 AI assistants ☎️ Customer service 🎬 Dubbing & subtitling 📊 Audio-video analysis Voice AI built for expression, accuracy, and understanding. Try it now → Read more about Seed Speech here → #SeedSpeech #VoiceAI #SpeechAI #AI
0:30

What if voice AI could understand context, intent, and emotion — not just words? 🎙️ Meet Seed Speech 2.0. A new speech AI stack designed for natural, expressive conversations — with major upgrades in both text-to-speech (TTS) and speech recognition (ASR). Built for developers and creators who want natural conversational speech. What’s inside: - Natural and expressive speech generation - Prompt-controlled emotion and tone - High-accuracy multilingual recognition - Strong contextual reasoning Built for: 🎧 Voice content creation 🤖 AI assistants ☎️ Customer service 🎬 Dubbing & subtitling 📊 Audio-video analysis Voice AI built for expression, accuracy, and understanding. Try it now → Read more about Seed Speech here → #SeedSpeech #VoiceAI #SpeechAI #AI

BytePlus

19,717 Aufrufe • vor 3 Monaten

EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine github: EmotiVoice is a powerful and modern open-source text-to-speech engine. EmotiVoice speaks both English and Chinese, and with over 2000 different voices. The most prominent feature is emotional synthesis, allowing you to create speech with a wide range of emotions, including happy, excited, sad, angry and others.
0:25

EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine github: EmotiVoice is a powerful and modern open-source text-to-speech engine. EmotiVoice speaks both English and Chinese, and with over 2000 different voices. The most prominent feature is emotional synthesis, allowing you to create speech with a wide range of emotions, including happy, excited, sad, angry and others.

AK

312,299 Aufrufe • vor 2 Jahren

I built a simple voice assistant in 70 lines of Python code. It uses: • LiveKit - The voice agent • AssemblyAI - To turn your voice into text • OpenAI - The brain of the agent, and to turn text into audio There's something really cool about this:
6:55

I built a simple voice assistant in 70 lines of Python code. It uses: • LiveKit - The voice agent • AssemblyAI - To turn your voice into text • OpenAI - The brain of the agent, and to turn text into audio There's something really cool about this:

Santiago

34,632 Aufrufe • vor 10 Monaten

🌟Introducing🎻Violin — an Open-source Video Translation Skill. 📹Video is the dominant medium on the internet, yet most high-quality content (lecture, talk, podcast) is locked behind a single language, leaving global audiences behind. So we built Violin: a video skill that combines speech recognition, LLM translation, and speech synthesis into one seamless pipeline. 🌐 Demo: 📝 Blog: 🔗 GitHub: ✨Key Features: 🎙️High-quality multilingual ASR & Translation & TTS. 🗣️Personalize translation & voice (turn an academic talk into something children can follow). 💬Chat with the video — ask any questions grounded in the video. 🧩Support Web app, CLI, and Agent skill 🍃Fully open-source under MIT. ❤️Built with the wonderful Shang Zhu and advised by James Zou ! All features powered by Together AI . Try it and let us know what you think! 🎻
0:41

🌟Introducing🎻Violin — an Open-source Video Translation Skill. 📹Video is the dominant medium on the internet, yet most high-quality content (lecture, talk, podcast) is locked behind a single language, leaving global audiences behind. So we built Violin: a video skill that combines speech recognition, LLM translation, and speech synthesis into one seamless pipeline. 🌐 Demo: 📝 Blog: 🔗 GitHub: ✨Key Features: 🎙️High-quality multilingual ASR & Translation & TTS. 🗣️Personalize translation & voice (turn an academic talk into something children can follow). 💬Chat with the video — ask any questions grounded in the video. 🧩Support Web app, CLI, and Agent skill 🍃Fully open-source under MIT. ❤️Built with the wonderful Shang Zhu and advised by James Zou ! All features powered by Together AI . Try it and let us know what you think! 🎻

Kevin Lin

137,357 Aufrufe • vor 1 Monat

NVIDIA just released a new open source transcription model, Nemotron Speech ASR, designed from the ground up for low-latency use cases like voice agents. Here's a voice agent built with this new model. 24ms transcription finalization and total voice-to-voice inference time under 500ms. This agent actually uses *three* NVIDIA open source models: - Nemotron Speech ASR - Nemotron 3 Nano 30GB in a 4-bit quant (released in December) - A preview checkpoint of the upcoming Magpie text-to-speech model These models are all truly open source: weights, training data, training code, and inference code. This is a big deal! Jensen said in the CES keynote yesterday that he expects open source models to catch up to proprietary models this year in a number of categories. NVIDIA is putting their weight behind making this happen. (As Alan Kay said, the best way to predict the future is to invent it.) The code for this agent is open source too, of course. You can deploy it to production with Modal and Pipecat AI cloud, or run locally on an NVIDIA DGX Spark or RTX 5090.
1:24

NVIDIA just released a new open source transcription model, Nemotron Speech ASR, designed from the ground up for low-latency use cases like voice agents. Here's a voice agent built with this new model. 24ms transcription finalization and total voice-to-voice inference time under 500ms. This agent actually uses *three* NVIDIA open source models: - Nemotron Speech ASR - Nemotron 3 Nano 30GB in a 4-bit quant (released in December) - A preview checkpoint of the upcoming Magpie text-to-speech model These models are all truly open source: weights, training data, training code, and inference code. This is a big deal! Jensen said in the CES keynote yesterday that he expects open source models to catch up to proprietary models this year in a number of categories. NVIDIA is putting their weight behind making this happen. (As Alan Kay said, the best way to predict the future is to invent it.) The code for this agent is open source too, of course. You can deploy it to production with Modal and Pipecat AI cloud, or run locally on an NVIDIA DGX Spark or RTX 5090.

kwindla

274,254 Aufrufe • vor 5 Monaten

With Invincible Voice, we help people living with ALS communicate more easily. Encountering Olivier Goy, an entrepreneur who lives with ALS and relentlessly fights to help all patients, made it obvious that our cutting-edge voice AI should help. We turned our Unmute voice-wrapper into a new system that 1/ transcribes interlocutor’s speech in real time, 2/ suggests various relevant responses via a personalised language model, 3/ utters patient's chosen response with their voice (using 10s pre-disease speech recordings). True to our philosophy, we open-source Invincible Voice, so that developers can refine the prototype, port it from French to other languages, adapt it to other conditions (aphasia, neurodegenerative diseases) and turn it into a deployable product. Its modularity also allows it to leverage technologies developed by Gradium that supports Invincible Voice by granting it free access to its multilingual speech models.
2:40

With Invincible Voice, we help people living with ALS communicate more easily. Encountering Olivier Goy, an entrepreneur who lives with ALS and relentlessly fights to help all patients, made it obvious that our cutting-edge voice AI should help. We turned our Unmute voice-wrapper into a new system that 1/ transcribes interlocutor’s speech in real time, 2/ suggests various relevant responses via a personalised language model, 3/ utters patient's chosen response with their voice (using 10s pre-disease speech recordings). True to our philosophy, we open-source Invincible Voice, so that developers can refine the prototype, port it from French to other languages, adapt it to other conditions (aphasia, neurodegenerative diseases) and turn it into a deployable product. Its modularity also allows it to leverage technologies developed by Gradium that supports Invincible Voice by granting it free access to its multilingual speech models.

kyutai

11,028 Aufrufe • vor 4 Monaten

Can your voice agent pronounce "hydroxychloroquine?" If you're using our latest Text to Speech model, Aura-2, it can. Aura-2 sounds natural, but also delivers ultralow latency and leading accuracy and pronunciation so your customers hang up with a smile.
0:56

Can your voice agent pronounce "hydroxychloroquine?" If you're using our latest Text to Speech model, Aura-2, it can. Aura-2 sounds natural, but also delivers ultralow latency and leading accuracy and pronunciation so your customers hang up with a smile.

Deepgram

92,259 Aufrufe • vor 1 Jahr

⚕️ Multi-Agent Medical AI Assistant A full-stack system that combines agents, computer vision, hybrid RAG, and voice I/O into a unified pipeline for diagnosis, research, and patient interaction. The architecture includes: • LangGraph by LangChain for agent orchestration • PyTorch vision models • Hybrid RAG on Qdrant + Hugging Face re-ranking • Unstructured for parsing medical PDFs • tavily for real-time search • ElevenLabs voice interface • FastAPI + Docker backend • Human-in-the-loop validation Built by Souvik Majumder 🚀 Code:
1:17

⚕️ Multi-Agent Medical AI Assistant A full-stack system that combines agents, computer vision, hybrid RAG, and voice I/O into a unified pipeline for diagnosis, research, and patient interaction. The architecture includes: • LangGraph by LangChain for agent orchestration • PyTorch vision models • Hybrid RAG on Qdrant + Hugging Face re-ranking • Unstructured for parsing medical PDFs • tavily for real-time search • ElevenLabs voice interface • FastAPI + Docker backend • Human-in-the-loop validation Built by Souvik Majumder 🚀 Code:

Qdrant

34,045 Aufrufe • vor 1 Jahr

Introducing Voice Design. Generate a unique voice from a text prompt alone. Is our library missing a voice you need? Prompt your own.
0:49

Introducing Voice Design. Generate a unique voice from a text prompt alone. Is our library missing a voice you need? Prompt your own.

ElevenLabs

417,577 Aufrufe • vor 1 Jahr

Introducing @Chatbase Voice. The same AI agent that handles your emails and website chat, can now pick up the phone. One agent, deployed on every channel. Comment "voice" to get a personalized demo & 1 month free.
2:24

Introducing @Chatbase Voice. The same AI agent that handles your emails and website chat, can now pick up the phone. One agent, deployed on every channel. Comment "voice" to get a personalized demo & 1 month free.

Yasser

32,318 Aufrufe • vor 2 Monaten

Introducing Mainframe: turn agent work into videos your team can keep up with.
0:59

Introducing Mainframe: turn agent work into videos your team can keep up with.

Mainframe

130,720 Aufrufe • vor 24 Tagen

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️
4:29

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️

Prince Canuma

160,131 Aufrufe • vor 3 Monaten

Introducing Parrot 🦜 Our first speech-to-text model built for production-grade voice agents with an industry leading accuracy, built for noisy calls, regional dialects and compressed audio. Trained on thousands of hours of real-world audio to make sure when you say Udaipur, the agent doesn't hear 'you-die-poor'.
0:45

Introducing Parrot 🦜 Our first speech-to-text model built for production-grade voice agents with an industry leading accuracy, built for noisy calls, regional dialects and compressed audio. Trained on thousands of hours of real-world audio to make sure when you say Udaipur, the agent doesn't hear 'you-die-poor'.

Vedant

15,595 Aufrufe • vor 25 Tagen

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison Mati Staniszewski ElevenLabs
1:09

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison Mati Staniszewski ElevenLabs

Stripe

17,118 Aufrufe • vor 2 Monaten

Some examples: - Text to Speech: Read aloud content or create audiobooks. - Speech to Text: Transcribe audio and video into text. - Voice Designer: Create custom AI voices. - Conversational AI: Build dynamic voice agents and make outbound calls.
3:29

Some examples: - Text to Speech: Read aloud content or create audiobooks. - Speech to Text: Transcribe audio and video into text. - Voice Designer: Create custom AI voices. - Conversational AI: Build dynamic voice agents and make outbound calls.

ElevenLabs

19,318 Aufrufe • vor 1 Jahr

Nvidia CEO Jensen Huang just announced Avatar Cloud Engine (ACE), a glimpse into what happens when gaming and AI collide. ACE is a custom Generative AI model brings intelligence to NPCs through AI-powered natural language interactions. Developers can use ACE for Games to build and deploy customized speech, conversation and animation AI models in their software and games.
0:41

Nvidia CEO Jensen Huang just announced Avatar Cloud Engine (ACE), a glimpse into what happens when gaming and AI collide. ACE is a custom Generative AI model brings intelligence to NPCs through AI-powered natural language interactions. Developers can use ACE for Games to build and deploy customized speech, conversation and animation AI models in their software and games.

Lior Alexander

183,737 Aufrufe • vor 3 Jahren

3. Speech to Speech Record your own voice or upload a voice file and this tool will mirror voice with same accent and emotions.
0:31

3. Speech to Speech Record your own voice or upload a voice file and this tool will mirror voice with same accent and emotions.

Sehaj Singh

23,353 Aufrufe • vor 9 Monaten