Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

I've built an async Voice Agent for WhatsApp 💬 It's simple, yet makes for a powerful experience! → Scribe transcribes voice message → AI SDK generates text response → ElevenLabs generates speech in Opus format → Hono & Cloudflare write file to R2 → twilio serves files to WhatsApp... show more

Thor 雷神 ⚡️

12,153 subscribers

26,288 Aufrufe • vor 1 Jahr •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von Thor 雷神 ⚡️

Thor 雷神 ⚡️vor 1 Jahr

You can find the code here:

Profilbild von Alex ZAP

Alex ZAPvor 1 Jahr

🚀 Revolutionize your QA testing with ZAPTEST AI! ZAPTEST automates testing, slashes costs & boosts ROI up to 10X. No coding needed—just faster, smarter automation. 📅 Book your live demo now:

Profilbild von angelo

angelovor 1 Jahr

@elevenlabsio @aisdk @honojs @Cloudflare now i can answer my mum's voice notes

Profilbild von Luke Harries

Luke Harriesvor 1 Jahr

@elevenlabsio @aisdk @honojs @Cloudflare Love this! Native feature for Conversational AI soon too?!

Profilbild von Thor 雷神 ⚡️

Thor 雷神 ⚡️vor 1 Jahr

@elevenlabsio @aisdk @honojs @Cloudflare Sounds about right 🫡

Profilbild von Ray Fernando

Ray Fernandovor 1 Jahr

@elevenlabsio @aisdk @honojs @Cloudflare Yooooooo 👀👀👀 cooking up a code with AirPods workflow. Exactly what I needed RN.

Profilbild von Thor 雷神 ⚡️

Thor 雷神 ⚡️vor 1 Jahr

@elevenlabsio @aisdk @honojs @Cloudflare Yay, awesome, please help yourself to the code 🙌

Profilbild von Rexan Wong

Rexan Wongvor 1 Jahr

@elevenlabsio @aisdk @honojs @Cloudflare bro is boom boom bang different sexy tech tgt and boom he has a crazy product

Profilbild von Thor 雷神 ⚡️

Thor 雷神 ⚡️vor 1 Jahr

@elevenlabsio @aisdk @honojs @Cloudflare That's why they call me boomer! 💥

Profilbild von Ash

Ashvor 1 Jahr

@elevenlabsio @aisdk @honojs @Cloudflare Waiting till you eventually build out your own version of Jarvis now 😂

Profilbild von Thor 雷神 ⚡️

Thor 雷神 ⚡️vor 1 Jahr

@elevenlabsio @aisdk @honojs @Cloudflare Imagine simply ordering a pizza from a voice note! 🤯

Ähnliche Videos

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

Melvin Vivas

27,722 Aufrufe • vor 1 Jahr

Most AI products added voice by wrapping a chatbot in speech-to-text. Vellum built a real-time voice loop on top of a full agent. It browses the web, reads your files, runs code, and sends messages while you’re still talking. This is voice as a real surface for an agent. Not a voice chatbot.

Most AI products added voice by wrapping a chatbot in speech-to-text. Vellum built a real-time voice loop on top of a full agent. It browses the web, reads your files, runs code, and sends messages while you’re still talking. This is voice as a real surface for an agent. Not a voice chatbot.

Kyronis

112,849 Aufrufe • vor 1 Monat

My mom sent me a voice-note in between a class. Couldn't listen, so I just… don't know what she said. Built a concept: #WhatsApp voice notes to readable text, inline. WhatsApp is the only one that can ship this properly. Made an extension & it's open-source.

My mom sent me a voice-note in between a class. Couldn't listen, so I just… don't know what she said. Built a concept: #WhatsApp voice notes to readable text, inline. WhatsApp is the only one that can ship this properly. Made an extension & it's open-source.

Gracey Dugar

27,148 Aufrufe • vor 11 Tagen

Introducing Expressive TTS Arena 🥊🤖🥊 ⚡️ 🥊🤖🥊 Starting with Hume AI vs ElevenLabs, it's a new way to evaluate voice AI systems with natural language instructions + richer text As voice generation systems evolve, we wanted to show an example of an eval system better suited toward cutting edge models👇

Introducing Expressive TTS Arena 🥊🤖🥊 ⚡️ 🥊🤖🥊 Starting with Hume AI vs ElevenLabs, it's a new way to evaluate voice AI systems with natural language instructions + richer text As voice generation systems evolve, we wanted to show an example of an eval system better suited toward cutting edge models👇

Hume AI

52,628 Aufrufe • vor 1 Jahr

THIS IS CRAZY. I connected ElevenLabs to Lovable and built an AI storytelling app in UNDER 20 minutes. Enter a kid's name, pick a theme. The app writes a personalized bedtime story, narrates it with ElevenLabs, and plays ambient sounds that match the story world. → Text to Speech narration with emotion → Sound effects generated on the fly → Download the full story as audio Comment "VOICE" and I'll send you the full workflow + prompts. 👇

THIS IS CRAZY. I connected ElevenLabs to Lovable and built an AI storytelling app in UNDER 20 minutes. Enter a kid's name, pick a theme. The app writes a personalized bedtime story, narrates it with ElevenLabs, and plays ambient sounds that match the story world. → Text to Speech narration with emotion → Sound effects generated on the fly → Download the full story as audio Comment "VOICE" and I'll send you the full workflow + prompts. 👇

Prajwal Tomar

40,610 Aufrufe • vor 3 Monaten

How to build the world's fastest voice AI bot: - Self-host speech-to-text, LLM inference, and text-to-speech all together in the same container/cluster. - Route audio over the internet using WebRTC and edge networking. - Configure timings for voice activity detection, phrase endpointing, and other parts of the pipeline to optimize for latency. (There are trade-offs to doing this!) Here's a LLama 3 voice bot that has voice-to-voice response times of ~500ms. We used Deepgram's STT and TTS for this bot, and everything is hosted on cerebriumai's serverless GPU infrastructure.

How to build the world's fastest voice AI bot: - Self-host speech-to-text, LLM inference, and text-to-speech all together in the same container/cluster. - Route audio over the internet using WebRTC and edge networking. - Configure timings for voice activity detection, phrase endpointing, and other parts of the pipeline to optimize for latency. (There are trade-offs to doing this!) Here's a LLama 3 voice bot that has voice-to-voice response times of ~500ms. We used Deepgram's STT and TTS for this bot, and everything is hosted on cerebriumai's serverless GPU infrastructure.

kwindla

282,617 Aufrufe • vor 2 Jahren

ElevenLabs just lost the crown - to open source. Chatterbox by Resemble AI (I remember writing about this team back in 2022 as a pioneer of AI audio) just released as an open-source alternative for audio generation and voice cloning. - Zero-shot voice cloning from just 5 seconds of audio - Unique emotion intensity control—from subtle to dramatically expressive - Real-time voice synthesis faster than real-time inference - Built-in watermarking for secure, trusted audio - Consistently preferred over ElevenLabs in blind evaluations Fully open-source. No hidden restrictions. This is the way. Check out the demo:

ElevenLabs just lost the crown - to open source. Chatterbox by Resemble AI (I remember writing about this team back in 2022 as a pioneer of AI audio) just released as an open-source alternative for audio generation and voice cloning. - Zero-shot voice cloning from just 5 seconds of audio - Unique emotion intensity control—from subtle to dramatically expressive - Real-time voice synthesis faster than real-time inference - Built-in watermarking for secure, trusted audio - Consistently preferred over ElevenLabs in blind evaluations Fully open-source. No hidden restrictions. This is the way. Check out the demo:

AI Breakfast

454,451 Aufrufe • vor 1 Jahr

You can now create a REAL-TIME chatbot with any voice and customize its personality. Steps: 1. Go to ElevenLabs 2. Click on voices 3. you can type in a name for the voice 4. then you can drag in an audio file to use for your voice 5. then go to the agents tab in side panel 6. and create a new agent 7. the voice 8. Create system instructions 9. Optional (Upload knowledge docs) 10. Test This can be easily implemented into your applications. I'll make a tutorial on that soon.

You can now create a REAL-TIME chatbot with any voice and customize its personality. Steps: 1. Go to ElevenLabs 2. Click on voices 3. you can type in a name for the voice 4. then you can drag in an audio file to use for your voice 5. then go to the agents tab in side panel 6. and create a new agent 7. the voice 8. Create system instructions 9. Optional (Upload knowledge docs) 10. Test This can be easily implemented into your applications. I'll make a tutorial on that soon.

Riley Brown

40,108 Aufrufe • vor 1 Jahr

We opened a store where everything runs on voice. Two weeks ago in NYC, we launched an ElevenLabs pop-up where you could order coffee, listen to books with iconic voices, order items by talking to AI agents or even haggle for a better price :) Where should we pop up next?

We opened a store where everything runs on voice. Two weeks ago in NYC, we launched an ElevenLabs pop-up where you could order coffee, listen to books with iconic voices, order items by talking to AI agents or even haggle for a better price :) Where should we pop up next?

Mati Staniszewski

14,365 Aufrufe • vor 2 Monaten

This morning we received a disturbing voice note from a member of our Ward 91 WhatsApp group about an alleged plan by Somali shop owners against South Africans. We call on @SAPS Intelligence Services to urgently investigate these threats as the safety of our People is a Priority.

This morning we received a disturbing voice note from a member of our Ward 91 WhatsApp group about an alleged plan by Somali shop owners against South Africans. We call on @SAPS Intelligence Services to urgently investigate these threats as the safety of our People is a Priority.

Herman Mashaba

98,738 Aufrufe • vor 2 Monaten

Text to Sound Effects is here. Our newest AI Audio model generates sound effects, short instrumental tracks, soundscapes, and a wide variety of character voices, all from a text prompt. Available now for all users. Everyone from content creators, video game developers, to film and television studios, uses sound effects to create rich and immersive content. Now, in addition to AI voiceovers, you can generate all of the sounds you need with just a prompt. Everything you hear in this video was generated by ElevenLabs sound and voice models. In this thread, we shared some additional clips that help show off the range of this new model.

Text to Sound Effects is here. Our newest AI Audio model generates sound effects, short instrumental tracks, soundscapes, and a wide variety of character voices, all from a text prompt. Available now for all users. Everyone from content creators, video game developers, to film and television studios, uses sound effects to create rich and immersive content. Now, in addition to AI voiceovers, you can generate all of the sounds you need with just a prompt. Everything you hear in this video was generated by ElevenLabs sound and voice models. In this thread, we shared some additional clips that help show off the range of this new model.

ElevenLabs

450,763 Aufrufe • vor 2 Jahren

How can LLMs help improve local government services? This is the end of “Please listen closely as our menu options may have changed”: Lizzie Siegle’s team built a superset of San Francisco’s 311 service - which routes all residents through a massive, confusing and slow phone tree - all replaced by a simple natural language phone call with an AI agent as first line of response. voice to text, text to voice, all in a one day hackathon. Para Español, no necesita oprima numero dos.

How can LLMs help improve local government services? This is the end of “Please listen closely as our menu options may have changed”: Lizzie Siegle’s team built a superset of San Francisco’s 311 service - which routes all residents through a massive, confusing and slow phone tree - all replaced by a simple natural language phone call with an AI agent as first line of response. voice to text, text to voice, all in a one day hackathon. Para Español, no necesita oprima numero dos.

swyx

134,498 Aufrufe • vor 2 Jahren

This is the fastest text-to-speech and speech-to-text API out there. It's under 250 ms to first-byte latency. That's what we need to deploy conversational AI applications everywhere! (I can't wait for the death of automated voice machines.) Look at the attached video. For the first time, I could have a conversation with an AI agent in real time without awkward pauses. This technology is Aura from Deepgram. It's the fastest text-to-speech option I've seen. Here is a GitHub repository with the demo in the video: You can use it to build a conversational AI application using natural voice. You'll need a Deepgram API Key and an OpenAI API Key. Thanks to Deepgram for giving me access to Aura and collaborating with me on this post. If you want to learn more about Aura, here is the announcement post:

This is the fastest text-to-speech and speech-to-text API out there. It's under 250 ms to first-byte latency. That's what we need to deploy conversational AI applications everywhere! (I can't wait for the death of automated voice machines.) Look at the attached video. For the first time, I could have a conversation with an AI agent in real time without awkward pauses. This technology is Aura from Deepgram. It's the fastest text-to-speech option I've seen. Here is a GitHub repository with the demo in the video: You can use it to build a conversational AI application using natural voice. You'll need a Deepgram API Key and an OpenAI API Key. Thanks to Deepgram for giving me access to Aura and collaborating with me on this post. If you want to learn more about Aura, here is the announcement post:

Santiago

185,640 Aufrufe • vor 2 Jahren

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison @matiii ElevenLabs

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison @matiii ElevenLabs

Stripe

18,535 Aufrufe • vor 4 Monaten

A 49 year old father suffered a stroke last November and lost his voice. His kids missed his laugh. His wife missed hearing him say her name. An AI company called Bland built a speech engine trained on over 100 million real human conversations. To showcase what it can do, they took 5 seconds of old footage of James speaking. And gave him his voice back. Not a robotic version. Not a flat text-to-speech read. His actual voice. His tone. His emotion. His laugh. The first thing he said was "I got my voice back." Then he told his wife she was the best wife and mom in the world. The model is called Speech v3. Ranked number one on Audio Realism benchmarks above ElevenLabs, OpenAI, Grok, and Cartesia. It's already powering thousands of phone calls a day. But none of that matters as much as watching a father talk to his family again. This is what AI is actually for.

A 49 year old father suffered a stroke last November and lost his voice. His kids missed his laugh. His wife missed hearing him say her name. An AI company called Bland built a speech engine trained on over 100 million real human conversations. To showcase what it can do, they took 5 seconds of old footage of James speaking. And gave him his voice back. Not a robotic version. Not a flat text-to-speech read. His actual voice. His tone. His emotion. His laugh. The first thing he said was "I got my voice back." Then he told his wife she was the best wife and mom in the world. The model is called Speech v3. Ranked number one on Audio Realism benchmarks above ElevenLabs, OpenAI, Grok, and Cartesia. It's already powering thousands of phone calls a day. But none of that matters as much as watching a father talk to his family again. This is what AI is actually for.

Vaibhav Sisinty

12,180 Aufrufe • vor 23 Tagen

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:

Andrew Ng

87,711 Aufrufe • vor 1 Jahr

I built an AI WhatsApp agent that turns any business website into a 24/7 support & sales machine. With 200M+ businesses around the world relying on WhatsApp for customer communication, the TAM for this type of simple automation is significant. Here's the n8n workflow that's handling customer support and closing leads while business owners sleep: → Drop in any business URL → AI scrapes the entire site and builds a knowledge base → WhatsApp bot answers customer questions instantly → Converts inquiries into booked calls without human intervention Most businesses still have customers sitting in unread WhatsApp messages for hours. This workflow responds in seconds. The best part: It's simple. This took me 10 minutes to set up once the automation was built. If you want the n8n workflow, all the prompts, and a full setup video: Comment "WHATSAPP" Like + RT Follow me (so I can DM you) I'll send everything over.

I built an AI WhatsApp agent that turns any business website into a 24/7 support & sales machine. With 200M+ businesses around the world relying on WhatsApp for customer communication, the TAM for this type of simple automation is significant. Here's the n8n workflow that's handling customer support and closing leads while business owners sleep: → Drop in any business URL → AI scrapes the entire site and builds a knowledge base → WhatsApp bot answers customer questions instantly → Converts inquiries into booked calls without human intervention Most businesses still have customers sitting in unread WhatsApp messages for hours. This workflow responds in seconds. The best part: It's simple. This took me 10 minutes to set up once the automation was built. If you want the n8n workflow, all the prompts, and a full setup video: Comment "WHATSAPP" Like + RT Follow me (so I can DM you) I'll send everything over.

David Roberts

61,441 Aufrufe • vor 7 Monaten

An 8-year-old turned an $8 microcontroller into a fully offline, voice-controlled AI storyteller. No Wi-Fi. No cloud. No API. Using an ESP32-S3, INMP 441 mic, i2s speaker and Max 98357A amplifier, Laksh built a bot that generates stories, creates animations, reads them aloud and responds to voice commands: play, pause, resume and next story. He built it by forking the brilliant open-source TinyStories LLM for ESP32 created by Slava S.. It had text. Laksh added voice, interaction, controls and animation. Git repo: Current drawback: bad English TTS on the ESP32. So that is what we are building next.

An 8-year-old turned an $8 microcontroller into a fully offline, voice-controlled AI storyteller. No Wi-Fi. No cloud. No API. Using an ESP32-S3, INMP 441 mic, i2s speaker and Max 98357A amplifier, Laksh built a bot that generates stories, creates animations, reads them aloud and responds to voice commands: play, pause, resume and next story. He built it by forking the brilliant open-source TinyStories LLM for ESP32 created by Slava S.. It had text. Laksh added voice, interaction, controls and animation. Git repo: Current drawback: bad English TTS on the ESP32. So that is what we are building next.

Capt Venkat 🇮🇳

165,651 Aufrufe • vor 1 Monat

🔥 The reviews are in on An Inconvenient Study "This film is a masterpiece." "It's a bombshell of a study, and it's a bombshell of a movie." "This film will go down in the history of this movement." "These children did not have an informed choice, and so they lost their voice, and we have to stand for them. It's as simple as that." - Dr. Andrew Wakefield Have you watched yet?

🔥 The reviews are in on An Inconvenient Study "This film is a masterpiece." "It's a bombshell of a study, and it's a bombshell of a movie." "This film will go down in the history of this movement." "These children did not have an informed choice, and so they lost their voice, and we have to stand for them. It's as simple as that." - Dr. Andrew Wakefield Have you watched yet?

An Inconvenient Study

42,420 Aufrufe • vor 9 Monaten

AI agents are becoming increasingly capable of taking actions beyond the chat window and interacting with tools in the real world, such as web browsers. We explored this capability by having an AI agent present one of our interactive web-based demos. In this video, it's presenting our election interference demo. This agent is a Cursor coding agent and is equipped with tools to read and interact with the browser (using Playwright) and perform text-to-speech (with ElevenLabs), in addition to the standard Cursor tools.

AI agents are becoming increasingly capable of taking actions beyond the chat window and interacting with tools in the real world, such as web browsers. We explored this capability by having an AI agent present one of our interactive web-based demos. In this video, it's presenting our election interference demo. This agent is a Cursor coding agent and is equipped with tools to read and interact with the browser (using Playwright) and perform text-to-speech (with ElevenLabs), in addition to the standard Cursor tools.

CivAI

18,428 Aufrufe • vor 8 Monaten