Loading video...

Video Failed to Load

Go Home

Researchers at Meta recently shared MAGNeT, a single non-autoregressive transformer model for text-to-music & text-to-sound generation capable of generating audio on-par with the quality of SOTA models — at 7x the speed. MAGNeT is open source as part of AudioCraft. Hear audio samples and get more details on this...

122,001 views • 2 years ago •via X (Twitter)

10 Comments

AI at Meta's profile picture
AI at Meta2 years ago

Unlike prior non-autoregressive modeling work, MAGNeT doesn't require semantic token conditioning, model cascading or audio prompting — it employs a full text-to-audio using a single non-autoregressive Transformer. Paper ➡️ Code ➡️

MindBranches's profile picture
MindBranches2 years ago

Really cool research by Meta on text-music models that are 7x as fast as current state of the art. Here’s a summary of the research paper they released:

Mark Zuckerberg - CEO of Facebook - Parody's profile picture
Mark Zuckerberg - CEO of Facebook - Parody2 years ago

Nice work team

Arihant Parsoya's profile picture
Arihant Parsoya2 years ago

Wow, this an amazing model for text-to-music and text-to-sound generation. Curious to see how MAGNet compares to other models.

A's profile picture
A2 years ago

AI music will make to our playlists soon

ZC's profile picture
ZC2 years ago

Niceee

All Lifetime Deals's profile picture
All Lifetime Deals2 years ago

This is amazing work, Meta! The speed and quality of MAGNeT's audio generation is truly impressive.

Naina Chaturvedi's profile picture
Naina Chaturvedi2 years ago

++ thanks for sharing. Will be covering it here -

Filippo Gonteri's profile picture
Filippo Gonteri2 years ago

Hope to see MAGNet soon on tour or in some festival #AI #music

ATou's profile picture
ATou2 years ago

@SaveToNotion

Related Videos

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

AI at Meta

2,264,759 views • 1 year ago

We've officially released and open-sourced HunyuanImage 2.1, our latest text-to-image model. The new model delivers on our commitment to balancing performance and quality. With native 2K image generation, HunyuanImage 2.1 is an advanced open-source text-to-image model.🎨 ✨ New in 2.1: 🔹Advanced Semantics: Supports ultra-long and complex prompts of up to 1000 tokens, and precisely controls the generation of multiple subjects in a single image. 🔹Precise Chinese and English Text Rendering with seamless image–text integration: The model naturally integrates text into images, making it suitable for a wide range of applications such as product covers, illustrations, and poster design to meet the needs of various fields. 🔹Rich Styles and High Aesthetic: Capable of generating images in various styles—including photorealistic portraits, comics, and vinyl figures—it delivers outstanding visual appeal and artistic quality. 🔹High-Quality Generation: Efficiently produces ultra-high-definition (2K) images in the same time other models take to generate a 1K image. HunyuanImage 2.1 uses two text encoders: a multimodal large language model (MLLM) to improve the model's image and text alignment capabilities, and a multi-language character-aware encoder to improve text rendering capabilities. The model is a single- and double-stream diffusion transformer with 17B parameters. We've also open-sourced the weights of the the accelerated version with meanflow which reduces inference steps from 100 to just 8, and PromptEnhancer, the first industrial-grade rewriting model that enhances your prompts for more nuanced and expressive image generation. Now, creators turn complex ideas—like posters with slogans or multi-panel comics—into visuals faster than ever. We’re just getting started. Stay tuned for our native multimodal image generation model coming soon. 🌐Website: 🔗Github: 🤗Hugging Face: ✨Hugging Face Demo:

Tencent Hy

89,257 views • 10 months ago