Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Describing a specific sound can be a daunting task. For creators producing video, podcasts and other multimedia projects, it’s also a necessary one. By using AI audio models, it’s now possible to describe a sound – like police sirens, paired with the sound of a burning building, for example... – and almost instantly produce it. But the innovation won’t stop there, says Ammaar Reshi Reshi, the head of design at . We’re getting to the point where the interactions between LLMs, using voice interfaces, “is becoming incredibly natural and feels like talking to a person,” Ammaar says. Eventually, ElevenLabs believes that will result in a general AI audio model, unlocking even more possibilities.👇show more

a16z

1,078,924 subscribers

80,459 views • 2 years ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

5 Comments

a16z2 years ago

For more with @ammaar Reshi on bringing voice to life, watch the full video on YouTube:

a16z2 years ago

🎧 And listen to the a16z podcast episode, "When AI Meets Art":

Good Point2 years ago

if anyone looked 18 and 48 at the same time

chocoscoding2 years ago

Get custom built web3 sites now

…2 years ago

Are you guys really invested in smoke ?

Related Videos

Text to Sound Effects is here. Our newest AI Audio model generates sound effects, short instrumental tracks, soundscapes, and a wide variety of character voices, all from a text prompt. Available now for all users. Everyone from content creators, video game developers, to film and television studios, uses sound effects to create rich and immersive content. Now, in addition to AI voiceovers, you can generate all of the sounds you need with just a prompt. Everything you hear in this video was generated by ElevenLabs sound and voice models. In this thread, we shared some additional clips that help show off the range of this new model.

Text to Sound Effects is here. Our newest AI Audio model generates sound effects, short instrumental tracks, soundscapes, and a wide variety of character voices, all from a text prompt. Available now for all users. Everyone from content creators, video game developers, to film and television studios, uses sound effects to create rich and immersive content. Now, in addition to AI voiceovers, you can generate all of the sounds you need with just a prompt. Everything you hear in this video was generated by ElevenLabs sound and voice models. In this thread, we shared some additional clips that help show off the range of this new model.

ElevenLabs

451,122 views • 2 years ago

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

AI at Meta

2,266,896 views • 2 years ago

Fiverr just launched a platform for freelancers to train a custom AI model, and "sell" the ability to generate work with it. They're pitching it as a way for creators to scale the number of projects they can handle at once. Models are trainable on text, image, and sound.

Fiverr just launched a platform for freelancers to train a custom AI model, and "sell" the ability to generate work with it. They're pitching it as a way for creators to scale the number of projects they can handle at once. Models are trainable on text, image, and sound.

Olivia Moore

117,880 views • 1 year ago

.Decagon co-founder and CTO Ashwin Sreenivas says the choice between expensive frontier models and cheaper, less capable ones is a false trade-off: "Even if you have a 'dumber model,' you can get it to higher performance on that specific task." "When we fine-tune smaller, dumber models, it's that they're just not as general purpose, but on the specific task we want them to do, they actually outperform the large, smart, state-of-the-art models." "So we end up getting all three things. It is better at the task, it is cheaper, and it is faster." Ashwin Sreenivas

.Decagon co-founder and CTO Ashwin Sreenivas says the choice between expensive frontier models and cheaper, less capable ones is a false trade-off: "Even if you have a 'dumber model,' you can get it to higher performance on that specific task." "When we fine-tune smaller, dumber models, it's that they're just not as general purpose, but on the specific task we want them to do, they actually outperform the large, smart, state-of-the-art models." "So we end up getting all three things. It is better at the task, it is cheaper, and it is faster." Ashwin Sreenivas

a16z

36,067 views • 1 month ago

I’ve been a Dead Internet Theory truther for years. What used to sound like a conspiracy is now just…the feed. At this point, it’s not *if* most of what we see online will be AI-generated. It’s that it already is.

I’ve been a Dead Internet Theory truther for years. What used to sound like a conspiracy is now just…the feed. At this point, it’s not if most of what we see online will be AI-generated. It’s that it already is.

Alexis Ohanian 🗽

38,806 views • 1 year ago

When I was 8 years old, my favorite thing in the world was making mixtapes for my Walkman from my big sister’s CDs. That evolved into Lego stop-motion videos, and later, I fell down the rabbit hole of editing Naruto anime clips to Evanescence & Linkin Park beats. Looking back, it’s obvious: Sound and Video were always the main drivers in my life. I think that obsession also led me to my true love: Motion Design. A huge shoutout to Kevin who showed me +10 years ago the world of Motion Design. And honestly, look at where we are now. Who would have thought that there would be such a massive hype around Motion Design and UI promo videos? From giants like Airbnb to the new generation of creators like sutoxoriginals. The visual standard in 2026 is insane. But there was always one part of the process that felt like a grind to me: Sound Design. I love the result, but I hated the process. I was spending 4-5 hours per project just searching for the right sound effects. "Key typing effect" "Mouse click" "Subtle Whoosh" and so on.. So, I decided to fix it. I sat down with a Dev friend and we spent the last few weekends building a native AI tool right inside After Effects. The concept is simple: SoundDesigner AI watches your video. It understands the vibe and exactly what’s happening and when its happening. It sees a clock ticking or a text appearing, and it generates the perfect sound for it in seconds, synced to the action in your timeline. I’ve been using it on my own projects for a few days now, and it’s wild. My sound design workflow went actually from 5 hours to 20 minutes. We are launching this in February (fingers crossed for the approval at aescripts+aeplugins) If you want to see where this goes and try it out yourself, drop me a DM

When I was 8 years old, my favorite thing in the world was making mixtapes for my Walkman from my big sister’s CDs. That evolved into Lego stop-motion videos, and later, I fell down the rabbit hole of editing Naruto anime clips to Evanescence & Linkin Park beats. Looking back, it’s obvious: Sound and Video were always the main drivers in my life. I think that obsession also led me to my true love: Motion Design. A huge shoutout to Kevin who showed me +10 years ago the world of Motion Design. And honestly, look at where we are now. Who would have thought that there would be such a massive hype around Motion Design and UI promo videos? From giants like Airbnb to the new generation of creators like sutoxoriginals. The visual standard in 2026 is insane. But there was always one part of the process that felt like a grind to me: Sound Design. I love the result, but I hated the process. I was spending 4-5 hours per project just searching for the right sound effects. "Key typing effect" "Mouse click" "Subtle Whoosh" and so on.. So, I decided to fix it. I sat down with a Dev friend and we spent the last few weekends building a native AI tool right inside After Effects. The concept is simple: SoundDesigner AI watches your video. It understands the vibe and exactly what’s happening and when its happening. It sees a clock ticking or a text appearing, and it generates the perfect sound for it in seconds, synced to the action in your timeline. I’ve been using it on my own projects for a few days now, and it’s wild. My sound design workflow went actually from 5 hours to 20 minutes. We are launching this in February (fingers crossed for the approval at aescripts+aeplugins) If you want to see where this goes and try it out yourself, drop me a DM

Markus Gavrilov

20,299 views • 8 months ago

I've just tested the EVI 3 speech-to-speech model by Hume Hume AI, and this is the most realistic voice cloning I’ve heard. It doesn’t just clone the sound of your voice — it captures your tone, your speech patterns, your personality. Feels like your voice is thinking in real time. What’s wild is: — It’s not text-to-speech. It’s speech-to-speech. — You speak → it clones your voice + vibe — And it’s compatible with LLMs like Groq, Anthropic, Deepseek - Try talking to a voice clone: - Want more control? Customize it here: This changes how we’ll interact with AI voices. No more robotic replies — these sound human.

I've just tested the EVI 3 speech-to-speech model by Hume Hume AI, and this is the most realistic voice cloning I’ve heard. It doesn’t just clone the sound of your voice — it captures your tone, your speech patterns, your personality. Feels like your voice is thinking in real time. What’s wild is: — It’s not text-to-speech. It’s speech-to-speech. — You speak → it clones your voice + vibe — And it’s compatible with LLMs like Groq, Anthropic, Deepseek - Try talking to a voice clone: - Want more control? Customize it here: This changes how we’ll interact with AI voices. No more robotic replies — these sound human.

Aaliya

28,046 views • 1 year ago

i found a way to make AI videos that don't sound like AI... example below.... sora 2, veo 3.1, kling 2.6 are decent but they all have that robotic AI accent that everyone can detect immediately and when people try replacing the voices with elevenlabs, it always sounds way too professional like it's recorded on a professional mic in a studio but if i'm making a UGC video of someone in their room, i don't want studio quality it should sound like it's actually in that room the workflow i use completely removes that fake AI voice sound why this matters: when your AI voices sound too polished or robotic, people notice. their guard goes up. they disengage. but when your voices sound like they're coming from a real person in a real room, that's when they work the best i created a guide breaking down exactly how: > to create voiceovers that sound completely real > to replace fake-sounding voices in AI videos (not elevenlabs) > to make voices sound like they're in the actual environment, not a studio RT + reply "VOICE" and i'll send you the FULL guide (must follow so i can DM)

i found a way to make AI videos that don't sound like AI... example below.... sora 2, veo 3.1, kling 2.6 are decent but they all have that robotic AI accent that everyone can detect immediately and when people try replacing the voices with elevenlabs, it always sounds way too professional like it's recorded on a professional mic in a studio but if i'm making a UGC video of someone in their room, i don't want studio quality it should sound like it's actually in that room the workflow i use completely removes that fake AI voice sound why this matters: when your AI voices sound too polished or robotic, people notice. their guard goes up. they disengage. but when your voices sound like they're coming from a real person in a real room, that's when they work the best i created a guide breaking down exactly how: > to create voiceovers that sound completely real > to replace fake-sounding voices in AI videos (not elevenlabs) > to make voices sound like they're in the actual environment, not a studio RT + reply "VOICE" and i'll send you the FULL guide (must follow so i can DM)

Miko

248,753 views • 8 months ago

How did a tiny, scrappy team build one of the most powerful AI voice models? In a deep dive with Sesame CTO Ankit Kumar and a16z's Anjney Midha, we explore how Sesame is pushing the boundaries of AI conversation, why it open-sourced its speech generation model, and the power of small teams to outdo much larger AI labs on product focus. A part of their secret: a relentless focus on real-time, natural conversations over raw intelligence, and a deep commitment to voice, personality, and user experience. By opening up its speech generation model, Sesame is paving the way for even more breakthroughs in AI-native conversation 👇

How did a tiny, scrappy team build one of the most powerful AI voice models? In a deep dive with Sesame CTO Ankit Kumar and a16z's Anjney Midha, we explore how Sesame is pushing the boundaries of AI conversation, why it open-sourced its speech generation model, and the power of small teams to outdo much larger AI labs on product focus. A part of their secret: a relentless focus on real-time, natural conversations over raw intelligence, and a deep commitment to voice, personality, and user experience. By opening up its speech generation model, Sesame is paving the way for even more breakthroughs in AI-native conversation 👇

a16z

29,930 views • 1 year ago

David Sacks says the biggest risk of AI was described not by James Cameron in The Terminator but by George Orwell in 1984. “I almost feel like the term ‘woke AI’ is insufficient to explain what’s going on because it somehow trivializes it.” “What we’re really talking about is 'Orwellian AI.' We’re talking about AI that lies to you, that distorts an answer, that rewrites history in real time to serve a current political agenda of the people who are in power.” “To me, this is the biggest risk of AI... It’s not The Terminator, it’s 1984.” David Sacks

David Sacks says the biggest risk of AI was described not by James Cameron in The Terminator but by George Orwell in 1984. “I almost feel like the term ‘woke AI’ is insufficient to explain what’s going on because it somehow trivializes it.” “What we’re really talking about is 'Orwellian AI.' We’re talking about AI that lies to you, that distorts an answer, that rewrites history in real time to serve a current political agenda of the people who are in power.” “To me, this is the biggest risk of AI... It’s not The Terminator, it’s 1984.” David Sacks

a16z

16,354,757 views • 10 months ago

AI voice clones are here. But even the outputs from industry leaders sound like a TED Talk given by a cucumber. Recently I tested Mirage (fka Captions)’s new audio model, and I think it is the closest thing I've seen to getting this problem right. Follow the 🧵

AI voice clones are here. But even the outputs from industry leaders sound like a TED Talk given by a cucumber. Recently I tested Mirage (fka Captions)’s new audio model, and I think it is the closest thing I've seen to getting this problem right. Follow the 🧵

Edward Frank Morris 🦇

90,577 views • 9 months ago

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

Lior Alexander

231,723 views • 3 years ago

this video is 100% AI it was created by one of my community members using our new system there are literally no limits to the ideas you can bring to life with AI now it’s becoming almost impossible to tell the difference between AI-generated videos and real footage, and these ads convert incredibly well surprisingly, the simpler the ad is, the more likely it is to become a winner click below and do not miss on this AI gold rush and if your brand needs AI ads on scale - we can provide best creators out there

MAX

39,697 views • 3 months ago

We're changing our name. Captions is now Mirage. Today's most popular medium is short-form video. It's the fastest-growing format, it’s what people want, and it’s what brands need to grow. But unlike other forms of AI content like text or image, which can be generated and ready-to-use with a single prompt, generated video still requires a lot of manual work and editing to be ready to share. This is where the real opportunity lies. The way we see it, the real race for AI video hasn’t even begun. The world is waiting for a foundation model for video that can take an idea and produce a fully usable, cohesive output from scratch. So that’s what we’re building. We’re rebranding to Mirage to reflect our expanded vision for video, starting with the short-form format, through frontier AI research and models. Check it out at mirage dot app

We're changing our name. Captions is now Mirage. Today's most popular medium is short-form video. It's the fastest-growing format, it’s what people want, and it’s what brands need to grow. But unlike other forms of AI content like text or image, which can be generated and ready-to-use with a single prompt, generated video still requires a lot of manual work and editing to be ready to share. This is where the real opportunity lies. The way we see it, the real race for AI video hasn’t even begun. The world is waiting for a foundation model for video that can take an idea and produce a fully usable, cohesive output from scratch. So that’s what we’re building. We’re rebranding to Mirage to reflect our expanded vision for video, starting with the short-form format, through frontier AI research and models. Check it out at mirage dot app

Gaurav Misra

137,604 views • 1 year ago

I decided to remix a song with AI, remixed diamonds by Rihanna with AI using @musicfy to change the voice and Fadr to alter the beat. Genuinely speaking, AI will help individuals with zero knowledge in a particular area, like music production, to become pros. AI can act as the great equalizer and enabler. The tech is not perfect yet, but it will be eventually.

I decided to remix a song with AI, remixed diamonds by Rihanna with AI using @musicfy to change the voice and Fadr to alter the beat. Genuinely speaking, AI will help individuals with zero knowledge in a particular area, like music production, to become pros. AI can act as the great equalizer and enabler. The tech is not perfect yet, but it will be eventually.

Rufus

16,047 views • 2 years ago

Hedra’s Character-3 is a game-changer for AI storytelling! 🔥✨ Upload an image, add speech and movement prompts, or even drop in an audio file, and it generates the full video for you. The Process is super easy: Image: Freepik Audio: elevenlabs (you can record yourself) Video: Hedra Video prompt: female reporter excitedly reporting the news, holds a microphone, wearing a professional suit, delivering a live broadcast., natural movements You can also use Hedra to generate audio and images! All in one 🚀🔥 What do you think of the result!?

Hedra’s Character-3 is a game-changer for AI storytelling! 🔥✨ Upload an image, add speech and movement prompts, or even drop in an audio file, and it generates the full video for you. The Process is super easy: Image: Freepik Audio: elevenlabs (you can record yourself) Video: Hedra Video prompt: female reporter excitedly reporting the news, holds a microphone, wearing a professional suit, delivering a live broadcast., natural movements You can also use Hedra to generate audio and images! All in one 🚀🔥 What do you think of the result!?

Amira Zairi

76,782 views • 1 year ago

AI can translate any video into another language AND MAKE IT LOOK LIKE YOU ARE SAYING IT?!? 🤯🤯 How does it look and sound to you? For context, the translated portion of the video is a tiny portion of a tutorial I am making where I am using Appwrite to add authentication.

AI can translate any video into another language AND MAKE IT LOOK LIKE YOU ARE SAYING IT?!? 🤯🤯 How does it look and sound to you? For context, the translated portion of the video is a tiny portion of a tutorial I am making where I am using Appwrite to add authentication.

Danny Thompson

70,182 views • 3 years ago

fal's Gorkem Yurtseven on the Blender, Astra, and H3 Max workflow professionals are using to get exactly the shot they wanted: "Using Blender with one of these AI models together is an extremely popular workflow for professional work." "You render a low resolution of your scene, what you want to do, using Blender, previous non-AI technology. And once you add that video as a reference to an AI model, you basically get close to 100% controllability." "This is an incredibly popular workflow for VFX artists, people who are doing this professionally, because they want to get exactly what they put into the model." "A week after we launched H3 Max, people started generating these beautiful scenes using an LLM, Astra, in Blender, and all of a sudden it unlocked a whole new pipeline. Using an LLM to create a Blender scene and then passing that to the H3 Max model." "It works very well with H3 Max because it's extremely fast and you can try many things all at once in parallel." Gorkem Yurtseven batuhan the fal guy fal Jennifer Li

fal's Gorkem Yurtseven on the Blender, Astra, and H3 Max workflow professionals are using to get exactly the shot they wanted: "Using Blender with one of these AI models together is an extremely popular workflow for professional work." "You render a low resolution of your scene, what you want to do, using Blender, previous non-AI technology. And once you add that video as a reference to an AI model, you basically get close to 100% controllability." "This is an incredibly popular workflow for VFX artists, people who are doing this professionally, because they want to get exactly what they put into the model." "A week after we launched H3 Max, people started generating these beautiful scenes using an LLM, Astra, in Blender, and all of a sudden it unlocked a whole new pipeline. Using an LLM to create a Blender scene and then passing that to the H3 Max model." "It works very well with H3 Max because it's extremely fast and you can try many things all at once in parallel." Gorkem Yurtseven batuhan the fal guy fal Jennifer Li

a16z

34,883 views • 8 days ago

There’s a big difference between AI generating a video and AI helping you make a film. The first one ends when the generation finishes. The second one keeps going. GPT Image 2.5 is coming to CapCut, where it will be available through Design Studio and AI Image. Start with the story. Build the storyboard. Bring it into CapCut PC’s multi-track timeline and use AI Video with Seedance 2.5 to generate the film. Then use AI Edit to keep directing the result. Adjust the scene. Change the rhythm. Improve the sound. Polish the visual details. The interesting part isn’t just getting a video out of AI. It’s being able to keep working on it after the AI gives you the first version. #GPTImage25 #CapCutPC #AIVideo #Seedance25

There’s a big difference between AI generating a video and AI helping you make a film. The first one ends when the generation finishes. The second one keeps going. GPT Image 2.5 is coming to CapCut, where it will be available through Design Studio and AI Image. Start with the story. Build the storyboard. Bring it into CapCut PC’s multi-track timeline and use AI Video with Seedance 2.5 to generate the film. Then use AI Edit to keep directing the result. Adjust the scene. Change the rhythm. Improve the sound. Polish the visual details. The interesting part isn’t just getting a video out of AI. It’s being able to keep working on it after the AI gives you the first version. #GPTImage25 #CapCutPC #AIVideo #Seedance25

Vipin Gautam (Viipin I Gautam)

47,810 views • 14 days ago