Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introducing SAM Audio: the first unified AI model that allows you to isolate and edit sound from complex audio mixtures. This could mean isolating the guitar in a video of your band, filtering out traffic noises, or removing the sound of a dog barking in your podcast, all with... show more

Meta Newsroom

262,667 subscribers

204,976 views • 10 months ago •via X (Twitter)

Arts Music Science & Technology

Anya Rossi• Live Now

Private livecam show

30 Comments

AstroFella10 months ago

Lowkey Meta is doing the Lord's work with open source tools. SAM 3 segmentation is great -- a lot of excellent use cases in being able to isolate data signals.

Sakib🏴󠁧󠁢󠁳󠁣󠁴󠁿10 months ago

Will it be released on huggingface?

This is why AI10 months ago

Game changer for creators. Being able to pull out a single sound with just text or a time range is wild perfect for cleaning podcasts and reels without complex DAW skills.

Jrift App10 months ago

This will save creators hours. Isolating problems instead of re-recording is a big shift.

Contextrix10 months ago

Being able to isolate stems or clean up tracks using text and visual prompts will be incredible for content creation workflows.

Mikey 🏳️‍🌈10 months ago

Meanwhile,@Meta ignores the banning of tons of legitimate accounts by @AIatMeta, sells “$meta verified” scam that offers no support. Meta also ignored 41AG demands to stop using small claims court as customer support-extorting tax money. Meta hates transparency&loves suppression.

KasiaGr (DJ-Flukes)10 months ago

So u gonna get my profiles back or u gonna be a shit meta who prefere fake profiels being on Facebook like u just did

M RK10 months ago

Can anyone please help me fix my Instagram but where I don’t See link in Bio and can’t edit???

Mesut De10 months ago

Game changer for creators.thanks

Mr_AADI10 months ago

Sam Altman, watching from the sidelines…

V James-Foster10 months ago

Reinstate my account you disabled without cause!

cashoutmike10 months ago

@MetaNewsroom We do not give a shit y'all making all of these pointless updates and breaking y'all apo by removing certain features within the app even though i don't have ig anymore because you clowns banned me instead of you dumb asses fixing the problem

Alli AI10 months ago

Text and time-conditioned audio isolation feels like a big step toward practical, non-destructive audio editing. This kind of control is exactly what’s been missing for real-world video and podcast workflows.

Suman shetty H10 months ago

@ylecun This is required for ar and vr.. nice

Reinaldo Sotillo10 months ago

please, make the audio longer

Anuj Patel10 months ago

Amazed how fast Meta is moving in content creation tools specially computer vision side!

Antoine Parrish10 months ago

Omg AI just everywhere now dang lol.

Eyob10 months ago

surprisingly something cool from meta

Penguin10 months ago

Gg

max johnson10 months ago

this is super good for noise

Zoom Trader10 months ago

@MetaNewsroom my Instagram account disabled I’m trying all the positive way still I’m not getting my account back please help insta @zoom_trader

Antony Ndiritu10 months ago

🔥🔥🔥

Ben the developer10 months ago

This is kind of new!!!

Головков Артем10 months ago

Meta.

Karthi10 months ago

First Solve your customer problem in your facebook account side.

Pankesh Jambucha10 months ago

My account is disable please check instgram .pankesh_jambucha please

Kabyik10 months ago

I thought Meta is owned by MARK not SAM

ToxiCadet./10 months ago

@ylecun Isolating sounds with just text prompts sounds like a game changer for content creators. I can imagine how useful this will be for cleaning up recordings. Curious to see how it handles more complex audio layers.

nyx10 months ago

finally, a solution for people who want their dog's barking in the podcast but not the actual dog

Rolan Albarico (Rolando)10 months ago

This is definitely good news for music producers.

Related Videos

🔉 Introducing SAM Audio, the first unified model that isolates any sound from complex audio mixtures using text, visual, or span prompts. We’re sharing SAM Audio with the community, along with a perception encoder model, benchmarks and research papers, to empower others to explore new forms of expression and build applications that were previously out of reach. 🔗 Learn more:

🔉 Introducing SAM Audio, the first unified model that isolates any sound from complex audio mixtures using text, visual, or span prompts. We’re sharing SAM Audio with the community, along with a perception encoder model, benchmarks and research papers, to empower others to explore new forms of expression and build applications that were previously out of reach. 🔗 Learn more:

AI at Meta

1,253,770 views • 10 months ago

I stopped writing giant video prompts. Now I build the audio first with Seed Audio 1.0. Dialogue, pauses, emotion, sound cues, all in one generation. Then I feed that audio into Seedance and the video follows the rhythm on its own. Timing, pacing, even camera feeling, all coming from the sound. Audio first. Video second. This is a different way to make AI films.

I stopped writing giant video prompts. Now I build the audio first with Seed Audio 1.0. Dialogue, pauses, emotion, sound cues, all in one generation. Then I feed that audio into Seedance and the video follows the rhythm on its own. Timing, pacing, even camera feeling, all coming from the sound. Audio first. Video second. This is a different way to make AI films.

Anabiya

56,516 views • 3 months ago

Text to Sound Effects is here. Our newest AI Audio model generates sound effects, short instrumental tracks, soundscapes, and a wide variety of character voices, all from a text prompt. Available now for all users. Everyone from content creators, video game developers, to film and television studios, uses sound effects to create rich and immersive content. Now, in addition to AI voiceovers, you can generate all of the sounds you need with just a prompt. Everything you hear in this video was generated by ElevenLabs sound and voice models. In this thread, we shared some additional clips that help show off the range of this new model.

Text to Sound Effects is here. Our newest AI Audio model generates sound effects, short instrumental tracks, soundscapes, and a wide variety of character voices, all from a text prompt. Available now for all users. Everyone from content creators, video game developers, to film and television studios, uses sound effects to create rich and immersive content. Now, in addition to AI voiceovers, you can generate all of the sounds you need with just a prompt. Everything you hear in this video was generated by ElevenLabs sound and voice models. In this thread, we shared some additional clips that help show off the range of this new model.

ElevenLabs

451,198 views • 2 years ago

🎯 Introducing AI Prompts If you find yourself rewriting the same requests to AI over and over, save them as AI Prompts instead. Start with Evernote's Prompt Library for inspiration, then create your own reusable prompts that understand your context. Find AI Prompts when starting a new note, in the toolbar when selecting text, or from an audio recording. What AI Prompt would save you the most time? We'd love to hear your ideas in the comments. 👇

🎯 Introducing AI Prompts If you find yourself rewriting the same requests to AI over and over, save them as AI Prompts instead. Start with Evernote's Prompt Library for inspiration, then create your own reusable prompts that understand your context. Find AI Prompts when starting a new note, in the toolbar when selecting text, or from an audio recording. What AI Prompt would save you the most time? We'd love to hear your ideas in the comments. 👇

Evernote

10,601 views • 4 months ago

Sound Effects 1.0 from Sonilo is now available on fal. Generate realistic sound effects from video or text. Upload a video to get a fully synced audio track, or describe the exact sound you need with a text prompt. Generated in seconds.

Sound Effects 1.0 from Sonilo is now available on fal. Generate realistic sound effects from video or text. Upload a video to get a fully synced audio track, or describe the exact sound you need with a text prompt. Generated in seconds.

fal

21,870 views • 3 months ago

As part of Meta Movie Gen, we trained a 13B parameter audio generation model that can take a video + optional text prompts to generate high quality audio — including ambient sound, foley & instrumental background music — all synced to the video. Details ➡️

As part of Meta Movie Gen, we trained a 13B parameter audio generation model that can take a video + optional text prompts to generate high quality audio — including ambient sound, foley & instrumental background music — all synced to the video. Details ➡️

AI at Meta

76,729 views • 2 years ago

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

Lior Alexander

231,729 views • 3 years ago

Video to Audio is now here in #DreamMachine. To generate sound for your video generations, just select the new "Audio" button. Create with a single click or describe with prompts for more customized direction. Audio is available now in beta for free to all users.

Video to Audio is now here in #DreamMachine. To generate sound for your video generations, just select the new "Audio" button. Create with a single click or describe with prompts for more customized direction. Audio is available now in beta for free to all users.

Luma

2,260,529 views • 1 year ago

Type a sentence, get any sound - from talking cats to singing saxophones. Brilliant release by NVIDIA ✨ NVIDIA just unveiled Fugatto, a groundbreaking 2.5B parameter audio AI model that can generate and transform any combination of music, voices, and sounds using text prompts and audio inputs Fugatto could ultimately allow developers and creators to bring sounds to life simply by inputting text prompts, → The model demonstrates unique capabilities like creating hybrid sounds (trumpet barking), changing accents/emotions in voices, and allowing fine-grained control over sound transitions - trained on millions of audio samples using 32 NVIDIA H100 GPUs 👨‍🔧 Architecture Built as a foundational generative transformer model leveraging NVIDIA's previous work in speech modeling and audio understanding. The training process involved creating a specialized blended dataset containing millions of audio samples → ComposableART's Innovation in Audio Control Introduces a novel technique allowing combination of instructions that were only seen separately during training. Users can blend different audio attributes and control their intensity → Temporal Interpolation Capabilities Enables generation of evolving soundscapes with precise control over transitions. Can create dynamic audio sequences like rainstorms fading into birdsong at dawn → Processes both text and audio inputs flexibly, enabling tasks like removing instruments from songs or modifying specific audio characteristics while preserving others → Shows capabilities beyond its training data, creating entirely new sound combinations through interaction between different trained abilities 🔍 Real-world Applications → Allows rapid prototyping of musical ideas, style experimentation, and real-time sound creation during studio sessions → Enables dynamic audio asset generation matching gameplay situations, reducing pre-recorded audio requirements → Can modify voice characteristics for language learning applications, allowing content delivery in familiar voices NVIDIA AI Developer

Type a sentence, get any sound - from talking cats to singing saxophones. Brilliant release by NVIDIA ✨ NVIDIA just unveiled Fugatto, a groundbreaking 2.5B parameter audio AI model that can generate and transform any combination of music, voices, and sounds using text prompts and audio inputs Fugatto could ultimately allow developers and creators to bring sounds to life simply by inputting text prompts, → The model demonstrates unique capabilities like creating hybrid sounds (trumpet barking), changing accents/emotions in voices, and allowing fine-grained control over sound transitions - trained on millions of audio samples using 32 NVIDIA H100 GPUs 👨‍🔧 Architecture Built as a foundational generative transformer model leveraging NVIDIA's previous work in speech modeling and audio understanding. The training process involved creating a specialized blended dataset containing millions of audio samples → ComposableART's Innovation in Audio Control Introduces a novel technique allowing combination of instructions that were only seen separately during training. Users can blend different audio attributes and control their intensity → Temporal Interpolation Capabilities Enables generation of evolving soundscapes with precise control over transitions. Can create dynamic audio sequences like rainstorms fading into birdsong at dawn → Processes both text and audio inputs flexibly, enabling tasks like removing instruments from songs or modifying specific audio characteristics while preserving others → Shows capabilities beyond its training data, creating entirely new sound combinations through interaction between different trained abilities 🔍 Real-world Applications → Allows rapid prototyping of musical ideas, style experimentation, and real-time sound creation during studio sessions → Enables dynamic audio asset generation matching gameplay situations, reducing pre-recorded audio requirements → Can modify voice characteristics for language learning applications, allowing content delivery in familiar voices NVIDIA AI Developer

Rohan Paul

96,354 views • 1 year ago

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

AI at Meta

2,267,616 views • 2 years ago

Wan2.5: Let Sound Take the Director’s Chair! 🎬 Today, we’re excited to unveil another major feature in our powerful Wan 2.5 Preview: Native Audio-Driven Video Generation. ✨ Now you can use audio input directly for both text-to-video and image-to-video generation. Combine audio with text prompts or a reference image to shape your video's narrative. ✨ With support for videos up to 10 seconds and enhanced video quality, unlock a richer visual space where more engaging stories come to life.

Wan2.5: Let Sound Take the Director’s Chair! 🎬 Today, we’re excited to unveil another major feature in our powerful Wan 2.5 Preview: Native Audio-Driven Video Generation. ✨ Now you can use audio input directly for both text-to-video and image-to-video generation. Combine audio with text prompts or a reference image to shape your video's narrative. ✨ With support for videos up to 10 seconds and enhanced video quality, unlock a richer visual space where more engaging stories come to life.

Wan

52,172 views • 1 year ago

Introducing the open-source Next.js Audio Starter Kit Add Text to Speech, Speech to Text, Sound Effects and Conversational AI to your product in minutes. Built with: • ElevenLabs SDK • Next.js + shadcn/ui • Tailwind CSS v4 Repo link in the comments below:

Introducing the open-source Next.js Audio Starter Kit Add Text to Speech, Speech to Text, Sound Effects and Conversational AI to your product in minutes. Built with: • ElevenLabs SDK • Next.js + shadcn/ui • Tailwind CSS v4 Repo link in the comments below:

ElevenLabs Developers

145,836 views • 1 year ago

Audio tools are ready on BudgetPixel AI。 Choose from 300+ preset tones, convert voice to text, or clone a voice for custom audio. From voiceovers and narration to ads, characters, and social videos, create the sound your content needs faster.

Audio tools are ready on BudgetPixel AI。 Choose from 300+ preset tones, convert voice to text, or clone a voice for custom audio. From voiceovers and narration to ads, characters, and social videos, create the sound your content needs faster.

BudgetPixel AI

139,352 views • 3 months ago

Kling VIDEO 2.6 — See the Sound, Hear the Visual "What is your most unforgettable moment from this year?" For us, it's definitely this Omni Launch Week with O1 and 2.6 now available! Share your most unforgettable moment using Kling 2.6, with natural voice, sound effects, and ambient sounds perfectly aligned with the visuals! All visuals and audio in this video were generated with the Kling 2.6 model.

Kling VIDEO 2.6 — See the Sound, Hear the Visual "What is your most unforgettable moment from this year?" For us, it's definitely this Omni Launch Week with O1 and 2.6 now available! Share your most unforgettable moment using Kling 2.6, with natural voice, sound effects, and ambient sounds perfectly aligned with the visuals! All visuals and audio in this video were generated with the Kling 2.6 model.

Kling AI

81,779 views • 10 months ago

Introducing Audio-to-Video in LTX. The third paradigm in AI video generation. Start from audio to get consistent voices, control over performance, and actions timed to the beat. We’re proud to partner with for this launch. Here’s how it works (sound on) 🧵

Introducing Audio-to-Video in LTX. The third paradigm in AI video generation. Start from audio to get consistent voices, control over performance, and actions timed to the beat. We’re proud to partner with for this launch. Here’s how it works (sound on) 🧵

LTX.io

307,154 views • 9 months ago

Check out the 4 new Google Photos features coming first to Pixel 8 and 8 Pro ↓ Whether it’s noise from wind, traffic, or barking dogs, Audio Magic Eraser in Google Photos reduces distracting sounds in your video in just a few taps! 🪄

Check out the 4 new Google Photos features coming first to Pixel 8 and 8 Pro ↓ Whether it’s noise from wind, traffic, or barking dogs, Audio Magic Eraser in Google Photos reduces distracting sounds in your video in just a few taps! 🪄

Google Photos

107,621 views • 3 years ago

You’ll want sound on for this. Announcing Lipdub Playground. With just a click, add a voice to your videos. Upload a video, type in a script (or drop in your own audio), and let your videos do the talking.

You’ll want sound on for this. Announcing Lipdub Playground. With just a click, add a voice to your videos. Upload a video, type in a script (or drop in your own audio), and let your videos do the talking.

Mirage

30,905 views • 2 years ago

Another Hailuo AI (MiniMax) H3 test, this time looking at audio reference and performance (A little NSFW language on end of this one!). I recorded the dialogue as an audio track and fed that in as a reference with a image reference of the man. In the text prompts I gave some direction to the actor (Like the look to camera at the end). I think the model did a brilliant job of matching the performance to the words and emotion that were in the audio ref. Unlike Seedance 2.0 I didn't have to feed in black video or write the words in the prompt to get the words correct. It seemed to use the exact audio from the reference I provided, which is what you want when using voice actors. Things are getting real... fast

Another Hailuo AI (MiniMax) H3 test, this time looking at audio reference and performance (A little NSFW language on end of this one!). I recorded the dialogue as an audio track and fed that in as a reference with a image reference of the man. In the text prompts I gave some direction to the actor (Like the look to camera at the end). I think the model did a brilliant job of matching the performance to the words and emotion that were in the audio ref. Unlike Seedance 2.0 I didn't have to feed in black video or write the words in the prompt to get the words correct. It seemed to use the exact audio from the reference I provided, which is what you want when using voice actors. Things are getting real... fast

Uncanny Harry AI

14,036 views • 2 months ago