Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

We're introducing new stereo models for MusicGen. By extending the delay codebook pattern to cover tokens from both left & right channels, these models can generate stereo output with no extra computational cost vs previous models. Try MusicGen on 🤗 ➡️

AI at Meta

806,638 subscribers

214,803 views • 2 years ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

8 Comments

AI at Meta2 years ago

With this new release, we're excited to share that MusicGen Stereo is now available in the @HuggingFace Transformers library and the paper has been accepted at #NeurIPS2023! MusicGen in Transformers ➡️ Paper ➡️

Mark Zuckerberg - CEO of Facebook - Parody2 years ago

Nice work. Keep it up

Taimur Shahzada2 years ago

Great non copyrighted music background for video content lol

Rufus2 years ago

Cool.

KManiL2 years ago

Absolutely brilliant and amazing!

Tonio2 years ago

Release the 3 sec input Ai voice cloners too please! Need to make a new Bing Crosby Christmas banger! 😃

Josh2 years ago

Incredible!

egino2 years ago

👏

Related Videos

Meta just released MusicGen, a simple and controllable model for music generation MusicGen is a single stage auto-regressive Transformer model trained over a 32kHz EnCodec tokenizer with 4 codebooks sampled at 50 Hz. Unlike existing methods like MusicLM, MusicGen doesn't not require a self-supervised semantic representation, and it generates all 4 codebooks in one pass. By introducing a small delay between the codebooks, can predict them in parallel, thus having only 50 auto-regressive steps per second of audio try out the Gradio demo: Models on Hugging Face: github:

Sensitive content

Meta just released MusicGen, a simple and controllable model for music generation MusicGen is a single stage auto-regressive Transformer model trained over a 32kHz EnCodec tokenizer with 4 codebooks sampled at 50 Hz. Unlike existing methods like MusicLM, MusicGen doesn't not require a self-supervised semantic representation, and it generates all 4 codebooks in one pass. By introducing a small delay between the codebooks, can predict them in parallel, thus having only 50 auto-regressive steps per second of audio try out the Gradio demo: Models on Hugging Face: github:

AK

627,591 views • 3 years ago

Rigs are what would need improving for animation to get better not the models Which can & has been done for these models via fans New models would definitely be better but making new models has no real effect on the actual quality of the animation. weve seen this w/ their tests

Rigs are what would need improving for animation to get better not the models Which can & has been done for these models via fans New models would definitely be better but making new models has no real effect on the actual quality of the animation. weve seen this w/ their tests

🦝MelohRush🦝 - ANIMATOR

123,046 views • 6 months ago

Introducing Smart Routing in Unity AI Gateway. Stop overpaying for AI. Smart Routing matches each coding task to the right model and harness based on what the task needs, so higher-cost models can differentiate on intelligence while lower-cost models differentiate on cost and performance. Match frontier quality and cut task costs by 30%+.

Introducing Smart Routing in Unity AI Gateway. Stop overpaying for AI. Smart Routing matches each coding task to the right model and harness based on what the task needs, so higher-cost models can differentiate on intelligence while lower-cost models differentiate on cost and performance. Match frontier quality and cut task costs by 30%+.

Databricks

126,388 views • 1 month ago

🔈 today we're introducing two new live dialogue models Gemini 3.8 Live: built for scale and cost efficiency, combining conversational intelligence with fluid dialogue and visual grounding. Gemini 3.8 Live Extended Thinking: built for high-complexity tasks, with increased intelligence and multi-step reasoning. these audio models are available to build with in AI Studio and via the Gemini API

🔈 today we're introducing two new live dialogue models Gemini 3.8 Live: built for scale and cost efficiency, combining conversational intelligence with fluid dialogue and visual grounding. Gemini 3.8 Live Extended Thinking: built for high-complexity tasks, with increased intelligence and multi-step reasoning. these audio models are available to build with in AI Studio and via the Gemini API

Google AI Studio

69,635 views • 12 days ago

Exa CEO Will Bryk explains why retrieval can help solve the tokenpocalypse: "We should not be using gigantic models for every task." "You should use a family of models of different sizes. The big model decides what to do, and it dishes out commands to the small models, and those small models can be way more accurate and reliable if they're using retrieval." "Retrieval helps small models act like big models... We do save our customers a huge amount of tokens because they can use smaller models and use retrieval." "We could save 20x on cost for customers compared to other providers by being very efficient in what information from the web the agent actually sees." Will Bryk with Sarah Wang

Exa CEO Will Bryk explains why retrieval can help solve the tokenpocalypse: "We should not be using gigantic models for every task." "You should use a family of models of different sizes. The big model decides what to do, and it dishes out commands to the small models, and those small models can be way more accurate and reliable if they're using retrieval." "Retrieval helps small models act like big models... We do save our customers a huge amount of tokens because they can use smaller models and use retrieval." "We could save 20x on cost for customers compared to other providers by being very efficient in what information from the web the agent actually sees." Will Bryk with Sarah Wang

a16z

25,144 views • 3 months ago

📈 Today, we're launching Agent Mode in Excel on Windows and Mac. An Excel Copilot that can work with you and make edits in your spreadsheet like an expert collaborator. We're also introducing a new, multi-model system that supports both GPT models from OpenAI and Claude models from Anthropic. Wanna try Claude Opus 4.5 natively in Microsoft Excel? We've got you. Give it a shot and let me know what you think.

📈 Today, we're launching Agent Mode in Excel on Windows and Mac. An Excel Copilot that can work with you and make edits in your spreadsheet like an expert collaborator. We're also introducing a new, multi-model system that supports both GPT models from OpenAI and Claude models from Anthropic. Wanna try Claude Opus 4.5 natively in Microsoft Excel? We've got you. Give it a shot and let me know what you think.

Trevor O'Brien

74,989 views • 8 months ago

BREAKING: Only ~1% of Bending Spoons’ AI requests & tokens goes to frontier models. 99% runs on self-hosted open-weight models. CEO Luca Ferrari on the shift to Sovereign AI: “We end up using open-weight models we self-host, so these are basically free. I mean, there is a little bit of cloud cost, but for 99% of the requests and tokens.” “And the frontier models, generally closed weight, through APIs for maybe 1% of the requests, only for the most complex tasks.” “Sometimes we use them automatically to check the work that got done by the slightly less intelligent models, as a more senior engineer would with a more junior engineer.”

BREAKING: Only ~1% of Bending Spoons’ AI requests & tokens goes to frontier models. 99% runs on self-hosted open-weight models. CEO Luca Ferrari on the shift to Sovereign AI: “We end up using open-weight models we self-host, so these are basically free. I mean, there is a little bit of cloud cost, but for 99% of the requests and tokens.” “And the frontier models, generally closed weight, through APIs for maybe 1% of the requests, only for the most complex tasks.” “Sometimes we use them automatically to check the work that got done by the slightly less intelligent models, as a more senior engineer would with a more junior engineer.”

Molly O’Shea

241,276 views • 9 days ago

Today, we're introducing not one but TWO new models, striking the balance between efficiency and quality to enable you to build production AI agents. — Gemini 3.6 Flash: Addresses efficiency feedback we received from Gemini 3.5 Flash with upgrades in coding, knowledge work, and multimodal tasks faster, more accurately, and with substantially fewer tokens per task — Gemini 3.5 Flash-Lite: Our fastest, most cost-effective 3.5-class model yet built for agentic workflows, hitting ~350 output tokens/sec with improved coding and overall quality Start building with these today via the Gemini API in Google AI Studio or try them out in the Google Gemini

Today, we're introducing not one but TWO new models, striking the balance between efficiency and quality to enable you to build production AI agents. — Gemini 3.6 Flash: Addresses efficiency feedback we received from Gemini 3.5 Flash with upgrades in coding, knowledge work, and multimodal tasks faster, more accurately, and with substantially fewer tokens per task — Gemini 3.5 Flash-Lite: Our fastest, most cost-effective 3.5-class model yet built for agentic workflows, hitting ~350 output tokens/sec with improved coding and overall quality Start building with these today via the Gemini API in Google AI Studio or try them out in the Google Gemini

Google AI

439,038 views • 2 months ago

Excited to introduce StereoPolicy, led by Evans Han. 📷📷🤖StereoPolicy is an effective way to add geometric cues to modern robot policy models while keeping the strengths of pretrained 2D encoders. ⁉️Why stereo for robot manipulation? Monocular RGB often lacks the depth cues needed for precise manipulation, while RGB-D and point clouds can be noisy or brittle, especially on reflective and transparent objects in real-world deployment. Instead of explicitly reconstructing disparity, depth, or point clouds, StereoPolicy directly fuses synchronized left/right RGB views to learn implicit stereo cues, avoiding extra reconstruction latency that can make real-time manipulation difficult. Project Page:

Excited to introduce StereoPolicy, led by Evans Han. 📷📷🤖StereoPolicy is an effective way to add geometric cues to modern robot policy models while keeping the strengths of pretrained 2D encoders. ⁉️Why stereo for robot manipulation? Monocular RGB often lacks the depth cues needed for precise manipulation, while RGB-D and point clouds can be noisy or brittle, especially on reflective and transparent objects in real-world deployment. Instead of explicitly reconstructing disparity, depth, or point clouds, StereoPolicy directly fuses synchronized left/right RGB views to learn implicit stereo cues, avoiding extra reconstruction latency that can make real-time manipulation difficult. Project Page:

Ruohan Zhang

851,478 views • 3 months ago

🤝 Arcee.ai, an American AI lab, built its frontier open model family on NVIDIA Blackwell Ultra. Its flagship MoE model, Trinity-Large-Thinking, was RL post-trained using NVIDIA NeMo open libraries. Arcee optimized agentic model inference with NVIDIA Dynamo and vLLM, along with NVIDIA accelerated networking, to deliver low token cost, achieving: ✅ 3T+ tokens served on OpenRouter in its first two months ✅ $0.90 per 1M output tokens ✅ 2nd on PinchBench for open agentic models Explore Arcee's open models, powered by NVIDIA ➡️

🤝 Arcee.ai, an American AI lab, built its frontier open model family on NVIDIA Blackwell Ultra. Its flagship MoE model, Trinity-Large-Thinking, was RL post-trained using NVIDIA NeMo open libraries. Arcee optimized agentic model inference with NVIDIA Dynamo and vLLM, along with NVIDIA accelerated networking, to deliver low token cost, achieving: ✅ 3T+ tokens served on OpenRouter in its first two months ✅ $0.90 per 1M output tokens ✅ 2nd on PinchBench for open agentic models Explore Arcee's open models, powered by NVIDIA ➡️

NVIDIA AI Infrastructure

27,377 views • 2 months ago

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.

Databricks

10,138 views • 1 year ago

Starting today, open source is leading the way. Introducing Llama 3.1: Our most capable models yet. Today we’re releasing a collection of new Llama 3.1 models including our long awaited 405B. These models deliver improved reasoning capabilities, a larger 128K token context window and improved support for 8 languages among other improvements. Llama 3.1 405B rivals leading closed source models on state-of-the-art capabilities across a range of tasks in general knowledge, steerability, math, tool use and multilingual translation. The models are available to download now directly from Meta or Hugging Face. With today’s release the ecosystem is also ready to go with 25+ partners rolling out our latest models — including Amazon Web Services, NVIDIA, Databricks, GroqInc, Dell Technologies, Microsoft Azure and Google Cloud ready on day one. More details in the full announcement ➡️ Download Llama 3.1 models ➡️ With these releases we’re setting the stage for unprecedented new opportunities and we can’t wait to see the innovation our newest models will unlock across all levels of the AI community.

Starting today, open source is leading the way. Introducing Llama 3.1: Our most capable models yet. Today we’re releasing a collection of new Llama 3.1 models including our long awaited 405B. These models deliver improved reasoning capabilities, a larger 128K token context window and improved support for 8 languages among other improvements. Llama 3.1 405B rivals leading closed source models on state-of-the-art capabilities across a range of tasks in general knowledge, steerability, math, tool use and multilingual translation. The models are available to download now directly from Meta or Hugging Face. With today’s release the ecosystem is also ready to go with 25+ partners rolling out our latest models — including Amazon Web Services, NVIDIA, Databricks, GroqInc, Dell Technologies, Microsoft Azure and Google Cloud ready on day one. More details in the full announcement ➡️ Download Llama 3.1 models ➡️ With these releases we’re setting the stage for unprecedented new opportunities and we can’t wait to see the innovation our newest models will unlock across all levels of the AI community.

AI at Meta

1,270,037 views • 2 years ago

The Kilo App is live on Google Play and the App Store. From your phone you can: - Spawn Cloud Agent sessions - Continue CLI and editor extension sessions remotely - Chat with your KiloClaw, update it, restart it, manage its secrets - Pick from 500+ models, or let Auto Models route for you - Track live token cost on every session Sign in with your existing Kilo account. No new signup. Manage Kilo Pass or pre-paid tokens from your admin panel at Download here:

The Kilo App is live on Google Play and the App Store. From your phone you can: - Spawn Cloud Agent sessions - Continue CLI and editor extension sessions remotely - Chat with your KiloClaw, update it, restart it, manage its secrets - Pick from 500+ models, or let Auto Models route for you - Track live token cost on every session Sign in with your existing Kilo account. No new signup. Manage Kilo Pass or pre-paid tokens from your admin panel at Download here:

Kilo (acq. by Anaconda)

11,527 views • 2 months ago

$Introducing Antares: Cisco's family of small language models for locating known vulnerabilities in code. Antares-350M and Antares-1B are live on Hugging Face now. They can outperform many larger closed- and open-weight models at a fraction of the cost. Small enough to run locally. No shipping sensitive codebases to the cloud. Why it matters: vulnerability triage is expensive and slow. Antares helps democratize AI-assisted security for all. Explore the models + read the new Vulnerability Localization Benchmark:$

Introducing Antares: Cisco's family of small language models for locating known vulnerabilities in code. Antares-350M and Antares-1B are live on Hugging Face now. They can outperform many larger closed- and open-weight models at a fraction of the cost. Small enough to run locally. No shipping sensitive codebases to the cloud. Why it matters: vulnerability triage is expensive and slow. Antares helps democratize AI-assisted security for all. Explore the models + read the new Vulnerability Localization Benchmark:

Cisco AI

522,884 views • 2 months ago

I cut my AI Assistant spend by 70% with no hit on quality 💰 Using a skill to select models for 40+ agent actions to get the right balance of quality, cost, latency. Becky now runs at $200/wk, down from $660/wk

I cut my AI Assistant spend by 70% with no hit on quality 💰 Using a skill to select models for 40+ agent actions to get the right balance of quality, cost, latency. Becky now runs at $200/wk, down from $660/wk

Marina

55,453 views • 4 months ago

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

Lior Alexander

231,723 views • 3 years ago

Love this example! Congrats to Google DeepMind! I successfully replicated the Boggle game on SWE Arena. TLDR: Gemini 2.0 Pro won! In the case of Claude 3.5 Sonnet vs Gemini 2.0 Pro, both are given the image and prompt to generate the algo to get the results. The image and prompt are exactly the same. Try it out on SWE Arena: BTW can we get a bigger streaming rate limit for our API, so that ppl can better compare the latest Gemini models with other frontier models? Jeff Dean Logan Kilpatrick 👀

Love this example! Congrats to Google DeepMind! I successfully replicated the Boggle game on SWE Arena. TLDR: Gemini 2.0 Pro won! In the case of Claude 3.5 Sonnet vs Gemini 2.0 Pro, both are given the image and prompt to generate the algo to get the results. The image and prompt are exactly the same. Try it out on SWE Arena: BTW can we get a bigger streaming rate limit for our API, so that ppl can better compare the latest Gemini models with other frontier models? Jeff Dean Logan Kilpatrick 👀

Terry Yue Zhuo

48,220 views • 1 year ago

Opus 5.5 actually shows the difference. I honestly expected less. One prompt: build the DeLorean and the clock tower square, rig the car, animate the lightning strike. Both models drove Blender through the Higgsfield Blender plugin and hooked with Higgsfield MCP, where it can use Nano Banana Pro for images, Tripo for 3D models and more. The exact same test went to GPT-6 Astra. Both ran on max effort. Opus 5.5: 73 min, 218k output tokens, $27.3in API terms. Working doors, spinning wheels, the strike lands. GPT-6 Astra: 88 min, 136k output tokens, $21.3 in API terms. Skipped the generators and built all 517 objects itself.

Opus 5.5 actually shows the difference. I honestly expected less. One prompt: build the DeLorean and the clock tower square, rig the car, animate the lightning strike. Both models drove Blender through the Higgsfield Blender plugin and hooked with Higgsfield MCP, where it can use Nano Banana Pro for images, Tripo for 3D models and more. The exact same test went to GPT-6 Astra. Both ran on max effort. Opus 5.5: 73 min, 218k output tokens, $27.3in API terms. Working doors, spinning wheels, the strike lands. GPT-6 Astra: 88 min, 136k output tokens, $21.3 in API terms. Skipped the generators and built all 517 objects itself.

Stefan 3D AI

23,129 views • 5 days ago

I gave my silent cinematic video to the new Pika Audio Models and let Pika Soundtrack build the entire audio layer 🎬🔊 Footsteps, rain, ambience, suspenseful music, and motion-aware SFX, all synced to the visuals. Pika just dropped four new Pika Audio Models for Soundtrack, SFX, Speech, and Music. They cover the full generative audio spectrum and are the least expensive audio models on the market, with pricing up to 20x cheaper. You can try it here 👇 Here’s the result :

I gave my silent cinematic video to the new Pika Audio Models and let Pika Soundtrack build the entire audio layer 🎬🔊 Footsteps, rain, ambience, suspenseful music, and motion-aware SFX, all synced to the visuals. Pika just dropped four new Pika Audio Models for Soundtrack, SFX, Speech, and Music. They cover the full generative audio spectrum and are the least expensive audio models on the market, with pricing up to 20x cheaper. You can try it here 👇 Here’s the result :

Ai Arainz

35,390 views • 1 month ago

We just cut AI spend by 75% across an entire workforce in one click. Introducing: Merge for Workforce. Without Merge, your employees are left choosing one of two options: 1. Spend 100x the cost they should be from using frontier models for everything 2. Deliver subpar work from overly restrictive model access Instead with Merge, IT can connect any identity provider and set model routing policies by team in one click. Merge pushes them to every machine through a desktop client, overriding the model configs across your team’s AI assistants and coding tools. Now every task gets the right model for the job. The result? 75x fewer tokens with faster and better output.

We just cut AI spend by 75% across an entire workforce in one click. Introducing: Merge for Workforce. Without Merge, your employees are left choosing one of two options: 1. Spend 100x the cost they should be from using frontier models for everything 2. Deliver subpar work from overly restrictive model access Instead with Merge, IT can connect any identity provider and set model routing policies by team in one click. Merge pushes them to every machine through a desktop client, overriding the model configs across your team’s AI assistants and coding tools. Now every task gets the right model for the job. The result? 75x fewer tokens with faster and better output.

Shensi Ding

523,902 views • 1 month ago