Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Describing a specific sound can be a daunting task. For creators producing video, podcasts and other multimedia projects, it’s also a necessary one. By using AI audio models, it’s now possible to describe a sound – like police sirens, paired with the sound of a burning building, for example...

a16z's profile picture

a16z

1,078,924 subscribers

80,459 Aufrufe • vor 2 Jahren •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

5 Kommentare

Profilbild von a16z
a16zvor 2 Jahren

For more with @ammaar Reshi on bringing voice to life, watch the full video on YouTube:

Profilbild von a16z
a16zvor 2 Jahren

🎧 And listen to the a16z podcast episode, "When AI Meets Art":

Profilbild von Good Point
Good Pointvor 2 Jahren

if anyone looked 18 and 48 at the same time

Profilbild von chocoscoding
chocoscodingvor 2 Jahren

Get custom built web3 sites now

Profilbild von …
…vor 2 Jahren

Are you guys really invested in smoke ?

Ähnliche Videos

Text to Sound Effects is here. Our newest AI Audio model generates sound effects, short instrumental tracks, soundscapes, and a wide variety of character voices, all from a text prompt. Available now for all users. Everyone from content creators, video game developers, to film and television studios, uses sound effects to create rich and immersive content. Now, in addition to AI voiceovers, you can generate all of the sounds you need with just a prompt. Everything you hear in this video was generated by ElevenLabs sound and voice models. In this thread, we shared some additional clips that help show off the range of this new model.
1:08

Text to Sound Effects is here. Our newest AI Audio model generates sound effects, short instrumental tracks, soundscapes, and a wide variety of character voices, all from a text prompt. Available now for all users. Everyone from content creators, video game developers, to film and television studios, uses sound effects to create rich and immersive content. Now, in addition to AI voiceovers, you can generate all of the sounds you need with just a prompt. Everything you hear in this video was generated by ElevenLabs sound and voice models. In this thread, we shared some additional clips that help show off the range of this new model.

ElevenLabs

451,122 Aufrufe • vor 2 Jahren

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.
0:30

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

AI at Meta

2,266,896 Aufrufe • vor 2 Jahren

Fiverr just launched a platform for freelancers to train a custom AI model, and "sell" the ability to generate work with it. They're pitching it as a way for creators to scale the number of projects they can handle at once. Models are trainable on text, image, and sound.
0:24

Fiverr just launched a platform for freelancers to train a custom AI model, and "sell" the ability to generate work with it. They're pitching it as a way for creators to scale the number of projects they can handle at once. Models are trainable on text, image, and sound.

Olivia Moore

117,880 Aufrufe • vor 1 Jahr

.Decagon co-founder and CTO Ashwin Sreenivas says the choice between expensive frontier models and cheaper, less capable ones is a false trade-off: "Even if you have a 'dumber model,' you can get it to higher performance on that specific task." "When we fine-tune smaller, dumber models, it's that they're just not as general purpose, but on the specific task we want them to do, they actually outperform the large, smart, state-of-the-art models." "So we end up getting all three things. It is better at the task, it is cheaper, and it is faster." Ashwin Sreenivas
0:47

.Decagon co-founder and CTO Ashwin Sreenivas says the choice between expensive frontier models and cheaper, less capable ones is a false trade-off: "Even if you have a 'dumber model,' you can get it to higher performance on that specific task." "When we fine-tune smaller, dumber models, it's that they're just not as general purpose, but on the specific task we want them to do, they actually outperform the large, smart, state-of-the-art models." "So we end up getting all three things. It is better at the task, it is cheaper, and it is faster." Ashwin Sreenivas

a16z

36,067 Aufrufe • vor 1 Monat

I’ve been a Dead Internet Theory truther for years. What used to sound like a conspiracy is now just…the feed. At this point, it’s not *if* most of what we see online will be AI-generated. It’s that it already is.
0:38

I’ve been a Dead Internet Theory truther for years. What used to sound like a conspiracy is now just…the feed. At this point, it’s not *if* most of what we see online will be AI-generated. It’s that it already is.

Alexis Ohanian 🗽

38,806 Aufrufe • vor 1 Jahr

When I was 8 years old, my favorite thing in the world was making mixtapes for my Walkman from my big sister’s CDs. That evolved into Lego stop-motion videos, and later, I fell down the rabbit hole of editing Naruto anime clips to Evanescence & Linkin Park beats. Looking back, it’s obvious: Sound and Video were always the main drivers in my life. I think that obsession also led me to my true love: Motion Design. A huge shoutout to Kevin who showed me +10 years ago the world of Motion Design. And honestly, look at where we are now. Who would have thought that there would be such a massive hype around Motion Design and UI promo videos? From giants like Airbnb to the new generation of creators like sutoxoriginals. The visual standard in 2026 is insane. But there was always one part of the process that felt like a grind to me: Sound Design. I love the result, but I hated the process. I was spending 4-5 hours per project just searching for the right sound effects. "Key typing effect" "Mouse click" "Subtle Whoosh" and so on.. So, I decided to fix it. I sat down with a Dev friend and we spent the last few weekends building a native AI tool right inside After Effects. The concept is simple: SoundDesigner AI watches your video. It understands the vibe and exactly what’s happening and when its happening. It sees a clock ticking or a text appearing, and it generates the perfect sound for it in seconds, synced to the action in your timeline. I’ve been using it on my own projects for a few days now, and it’s wild. My sound design workflow went actually from 5 hours to 20 minutes. We are launching this in February (fingers crossed for the approval at aescripts+aeplugins) If you want to see where this goes and try it out yourself, drop me a DM
0:30

When I was 8 years old, my favorite thing in the world was making mixtapes for my Walkman from my big sister’s CDs. That evolved into Lego stop-motion videos, and later, I fell down the rabbit hole of editing Naruto anime clips to Evanescence & Linkin Park beats. Looking back, it’s obvious: Sound and Video were always the main drivers in my life. I think that obsession also led me to my true love: Motion Design. A huge shoutout to Kevin who showed me +10 years ago the world of Motion Design. And honestly, look at where we are now. Who would have thought that there would be such a massive hype around Motion Design and UI promo videos? From giants like Airbnb to the new generation of creators like sutoxoriginals. The visual standard in 2026 is insane. But there was always one part of the process that felt like a grind to me: Sound Design. I love the result, but I hated the process. I was spending 4-5 hours per project just searching for the right sound effects. "Key typing effect" "Mouse click" "Subtle Whoosh" and so on.. So, I decided to fix it. I sat down with a Dev friend and we spent the last few weekends building a native AI tool right inside After Effects. The concept is simple: SoundDesigner AI watches your video. It understands the vibe and exactly what’s happening and when its happening. It sees a clock ticking or a text appearing, and it generates the perfect sound for it in seconds, synced to the action in your timeline. I’ve been using it on my own projects for a few days now, and it’s wild. My sound design workflow went actually from 5 hours to 20 minutes. We are launching this in February (fingers crossed for the approval at aescripts+aeplugins) If you want to see where this goes and try it out yourself, drop me a DM

Markus Gavrilov

20,299 Aufrufe • vor 8 Monaten

I've just tested the EVI 3 speech-to-speech model by Hume Hume AI, and this is the most realistic voice cloning I’ve heard. It doesn’t just clone the sound of your voice — it captures your tone, your speech patterns, your personality. Feels like your voice is thinking in real time. What’s wild is: — It’s not text-to-speech. It’s speech-to-speech. — You speak → it clones your voice + vibe — And it’s compatible with LLMs like Groq, Anthropic, Deepseek - Try talking to a voice clone: - Want more control? Customize it here: This changes how we’ll interact with AI voices. No more robotic replies — these sound human.
1:09

I've just tested the EVI 3 speech-to-speech model by Hume Hume AI, and this is the most realistic voice cloning I’ve heard. It doesn’t just clone the sound of your voice — it captures your tone, your speech patterns, your personality. Feels like your voice is thinking in real time. What’s wild is: — It’s not text-to-speech. It’s speech-to-speech. — You speak → it clones your voice + vibe — And it’s compatible with LLMs like Groq, Anthropic, Deepseek - Try talking to a voice clone: - Want more control? Customize it here: This changes how we’ll interact with AI voices. No more robotic replies — these sound human.

Aaliya

28,046 Aufrufe • vor 1 Jahr

i found a way to make AI videos that don't sound like AI... example below.... sora 2, veo 3.1, kling 2.6 are decent but they all have that robotic AI accent that everyone can detect immediately and when people try replacing the voices with elevenlabs, it always sounds way too professional like it's recorded on a professional mic in a studio but if i'm making a UGC video of someone in their room, i don't want studio quality it should sound like it's actually in that room the workflow i use completely removes that fake AI voice sound why this matters: when your AI voices sound too polished or robotic, people notice. their guard goes up. they disengage. but when your voices sound like they're coming from a real person in a real room, that's when they work the best i created a guide breaking down exactly how: > to create voiceovers that sound completely real > to replace fake-sounding voices in AI videos (not elevenlabs) > to make voices sound like they're in the actual environment, not a studio RT + reply "VOICE" and i'll send you the FULL guide (must follow so i can DM)
0:27

i found a way to make AI videos that don't sound like AI... example below.... sora 2, veo 3.1, kling 2.6 are decent but they all have that robotic AI accent that everyone can detect immediately and when people try replacing the voices with elevenlabs, it always sounds way too professional like it's recorded on a professional mic in a studio but if i'm making a UGC video of someone in their room, i don't want studio quality it should sound like it's actually in that room the workflow i use completely removes that fake AI voice sound why this matters: when your AI voices sound too polished or robotic, people notice. their guard goes up. they disengage. but when your voices sound like they're coming from a real person in a real room, that's when they work the best i created a guide breaking down exactly how: > to create voiceovers that sound completely real > to replace fake-sounding voices in AI videos (not elevenlabs) > to make voices sound like they're in the actual environment, not a studio RT + reply "VOICE" and i'll send you the FULL guide (must follow so i can DM)

Miko

248,753 Aufrufe • vor 8 Monaten

How did a tiny, scrappy team build one of the most powerful AI voice models? In a deep dive with Sesame CTO Ankit Kumar and a16z's Anjney Midha, we explore how Sesame is pushing the boundaries of AI conversation, why it open-sourced its speech generation model, and the power of small teams to outdo much larger AI labs on product focus. A part of their secret: a relentless focus on real-time, natural conversations over raw intelligence, and a deep commitment to voice, personality, and user experience. By opening up its speech generation model, Sesame is paving the way for even more breakthroughs in AI-native conversation 👇
1:04

How did a tiny, scrappy team build one of the most powerful AI voice models? In a deep dive with Sesame CTO Ankit Kumar and a16z's Anjney Midha, we explore how Sesame is pushing the boundaries of AI conversation, why it open-sourced its speech generation model, and the power of small teams to outdo much larger AI labs on product focus. A part of their secret: a relentless focus on real-time, natural conversations over raw intelligence, and a deep commitment to voice, personality, and user experience. By opening up its speech generation model, Sesame is paving the way for even more breakthroughs in AI-native conversation 👇

a16z

29,930 Aufrufe • vor 1 Jahr

David Sacks says the biggest risk of AI was described not by James Cameron in The Terminator but by George Orwell in 1984. “I almost feel like the term ‘woke AI’ is insufficient to explain what’s going on because it somehow trivializes it.” “What we’re really talking about is 'Orwellian AI.' We’re talking about AI that lies to you, that distorts an answer, that rewrites history in real time to serve a current political agenda of the people who are in power.” “To me, this is the biggest risk of AI... It’s not The Terminator, it’s 1984.” David Sacks
2:02

David Sacks says the biggest risk of AI was described not by James Cameron in The Terminator but by George Orwell in 1984. “I almost feel like the term ‘woke AI’ is insufficient to explain what’s going on because it somehow trivializes it.” “What we’re really talking about is 'Orwellian AI.' We’re talking about AI that lies to you, that distorts an answer, that rewrites history in real time to serve a current political agenda of the people who are in power.” “To me, this is the biggest risk of AI... It’s not The Terminator, it’s 1984.” David Sacks

a16z

16,354,721 Aufrufe • vor 10 Monaten

AI voice clones are here. But even the outputs from industry leaders sound like a TED Talk given by a cucumber. Recently I tested Mirage (fka Captions)’s new audio model, and I think it is the closest thing I've seen to getting this problem right. Follow the 🧵
0:25

AI voice clones are here. But even the outputs from industry leaders sound like a TED Talk given by a cucumber. Recently I tested Mirage (fka Captions)’s new audio model, and I think it is the closest thing I've seen to getting this problem right. Follow the 🧵

Edward Frank Morris 🦇

90,577 Aufrufe • vor 9 Monaten

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏
0:28

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

Lior Alexander

231,723 Aufrufe • vor 3 Jahren

this video is 100% AI it was created by one of my community members using our new system there are literally no limits to the ideas you can bring to life with AI now it’s becoming almost impossible to tell the difference between AI-generated videos and real footage, and these ads convert incredibly well surprisingly, the simpler the ad is, the more likely it is to become a winner click below and do not miss on this AI gold rush and if your brand needs AI ads on scale - we can provide best creators out there
0:27

this video is 100% AI it was created by one of my community members using our new system there are literally no limits to the ideas you can bring to life with AI now it’s becoming almost impossible to tell the difference between AI-generated videos and real footage, and these ads convert incredibly well surprisingly, the simpler the ad is, the more likely it is to become a winner click below and do not miss on this AI gold rush and if your brand needs AI ads on scale - we can provide best creators out there

MAX

39,697 Aufrufe • vor 3 Monaten

We're changing our name. Captions is now Mirage. Today's most popular medium is short-form video. It's the fastest-growing format, it’s what people want, and it’s what brands need to grow. But unlike other forms of AI content like text or image, which can be generated and ready-to-use with a single prompt, generated video still requires a lot of manual work and editing to be ready to share. This is where the real opportunity lies. The way we see it, the real race for AI video hasn’t even begun. The world is waiting for a foundation model for video that can take an idea and produce a fully usable, cohesive output from scratch. So that’s what we’re building. We’re rebranding to Mirage to reflect our expanded vision for video, starting with the short-form format, through frontier AI research and models. Check it out at mirage dot app
0:30

We're changing our name. Captions is now Mirage. Today's most popular medium is short-form video. It's the fastest-growing format, it’s what people want, and it’s what brands need to grow. But unlike other forms of AI content like text or image, which can be generated and ready-to-use with a single prompt, generated video still requires a lot of manual work and editing to be ready to share. This is where the real opportunity lies. The way we see it, the real race for AI video hasn’t even begun. The world is waiting for a foundation model for video that can take an idea and produce a fully usable, cohesive output from scratch. So that’s what we’re building. We’re rebranding to Mirage to reflect our expanded vision for video, starting with the short-form format, through frontier AI research and models. Check it out at mirage dot app

Gaurav Misra

137,604 Aufrufe • vor 1 Jahr

I decided to remix a song with AI, remixed diamonds by Rihanna with AI using @musicfy to change the voice and Fadr to alter the beat. Genuinely speaking, AI will help individuals with zero knowledge in a particular area, like music production, to become pros. AI can act as the great equalizer and enabler. The tech is not perfect yet, but it will be eventually.
3:51

I decided to remix a song with AI, remixed diamonds by Rihanna with AI using @musicfy to change the voice and Fadr to alter the beat. Genuinely speaking, AI will help individuals with zero knowledge in a particular area, like music production, to become pros. AI can act as the great equalizer and enabler. The tech is not perfect yet, but it will be eventually.

Rufus

16,047 Aufrufe • vor 2 Jahren

Hedra’s Character-3 is a game-changer for AI storytelling! 🔥✨ Upload an image, add speech and movement prompts, or even drop in an audio file, and it generates the full video for you. The Process is super easy: Image: Freepik Audio: elevenlabs (you can record yourself) Video: Hedra Video prompt: female reporter excitedly reporting the news, holds a microphone, wearing a professional suit, delivering a live broadcast., natural movements You can also use Hedra to generate audio and images! All in one 🚀🔥 What do you think of the result!?
0:27

Hedra’s Character-3 is a game-changer for AI storytelling! 🔥✨ Upload an image, add speech and movement prompts, or even drop in an audio file, and it generates the full video for you. The Process is super easy: Image: Freepik Audio: elevenlabs (you can record yourself) Video: Hedra Video prompt: female reporter excitedly reporting the news, holds a microphone, wearing a professional suit, delivering a live broadcast., natural movements You can also use Hedra to generate audio and images! All in one 🚀🔥 What do you think of the result!?

Amira Zairi

76,782 Aufrufe • vor 1 Jahr

fal's Gorkem Yurtseven on the Blender, Astra, and H3 Max workflow professionals are using to get exactly the shot they wanted: "Using Blender with one of these AI models together is an extremely popular workflow for professional work." "You render a low resolution of your scene, what you want to do, using Blender, previous non-AI technology. And once you add that video as a reference to an AI model, you basically get close to 100% controllability." "This is an incredibly popular workflow for VFX artists, people who are doing this professionally, because they want to get exactly what they put into the model." "A week after we launched H3 Max, people started generating these beautiful scenes using an LLM, Astra, in Blender, and all of a sudden it unlocked a whole new pipeline. Using an LLM to create a Blender scene and then passing that to the H3 Max model." "It works very well with H3 Max because it's extremely fast and you can try many things all at once in parallel." Gorkem Yurtseven batuhan the fal guy fal Jennifer Li
2:05

fal's Gorkem Yurtseven on the Blender, Astra, and H3 Max workflow professionals are using to get exactly the shot they wanted: "Using Blender with one of these AI models together is an extremely popular workflow for professional work." "You render a low resolution of your scene, what you want to do, using Blender, previous non-AI technology. And once you add that video as a reference to an AI model, you basically get close to 100% controllability." "This is an incredibly popular workflow for VFX artists, people who are doing this professionally, because they want to get exactly what they put into the model." "A week after we launched H3 Max, people started generating these beautiful scenes using an LLM, Astra, in Blender, and all of a sudden it unlocked a whole new pipeline. Using an LLM to create a Blender scene and then passing that to the H3 Max model." "It works very well with H3 Max because it's extremely fast and you can try many things all at once in parallel." Gorkem Yurtseven batuhan the fal guy fal Jennifer Li

a16z

34,883 Aufrufe • vor 8 Tagen

AI can translate any video into another language AND MAKE IT LOOK LIKE YOU ARE SAYING IT?!? 🤯🤯 How does it look and sound to you? For context, the translated portion of the video is a tiny portion of a tutorial I am making where I am using Appwrite to add authentication.
0:52

AI can translate any video into another language AND MAKE IT LOOK LIKE YOU ARE SAYING IT?!? 🤯🤯 How does it look and sound to you? For context, the translated portion of the video is a tiny portion of a tutorial I am making where I am using Appwrite to add authentication.

Danny Thompson

70,182 Aufrufe • vor 3 Jahren

Ben Horowitz on the infrastructure behind the AI economy: "Crypto is the natural money for AI because it’s internet-native money." "AI is global. Crypto is global." "There needs to be not just a ledger of money, but probably a ledger of truth for AI to really fulfill its potential." "I think people are probably underestimating how crypto and AI work together to form the AI economy." "Networks and computers tend to grow together, and I think that AI is obviously a new kind of computer and crypto is a new kind of network." benahorowitz.eth on Moonshots with Peter H. Diamandis, MD
2:16

Ben Horowitz on the infrastructure behind the AI economy: "Crypto is the natural money for AI because it’s internet-native money." "AI is global. Crypto is global." "There needs to be not just a ledger of money, but probably a ledger of truth for AI to really fulfill its potential." "I think people are probably underestimating how crypto and AI work together to form the AI economy." "Networks and computers tend to grow together, and I think that AI is obviously a new kind of computer and crypto is a new kind of network." benahorowitz.eth on Moonshots with Peter H. Diamandis, MD

a16z

237,742 Aufrufe • vor 7 Monaten