Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Researchers at Meta recently shared MAGNeT, a single non-autoregressive transformer model for text-to-music & text-to-sound generation capable of generating audio on-par with the quality of SOTA models — at 7x the speed. MAGNeT is open source as part of AudioCraft. Hear audio samples and get more details on this...

122,001 görüntüleme • 2 yıl önce •via X (Twitter)

10 Yorum

AI at Meta profil fotoğrafı
AI at Meta2 yıl önce

Unlike prior non-autoregressive modeling work, MAGNeT doesn't require semantic token conditioning, model cascading or audio prompting — it employs a full text-to-audio using a single non-autoregressive Transformer. Paper ➡️ Code ➡️

MindBranches profil fotoğrafı
MindBranches2 yıl önce

Really cool research by Meta on text-music models that are 7x as fast as current state of the art. Here’s a summary of the research paper they released:

Mark Zuckerberg - CEO of Facebook - Parody profil fotoğrafı
Mark Zuckerberg - CEO of Facebook - Parody2 yıl önce

Nice work team

Arihant Parsoya profil fotoğrafı
Arihant Parsoya2 yıl önce

Wow, this an amazing model for text-to-music and text-to-sound generation. Curious to see how MAGNet compares to other models.

A profil fotoğrafı
A2 yıl önce

AI music will make to our playlists soon

ZC profil fotoğrafı
ZC2 yıl önce

Niceee

All Lifetime Deals profil fotoğrafı
All Lifetime Deals2 yıl önce

This is amazing work, Meta! The speed and quality of MAGNeT's audio generation is truly impressive.

Naina Chaturvedi profil fotoğrafı
Naina Chaturvedi2 yıl önce

++ thanks for sharing. Will be covering it here -

Filippo Gonteri profil fotoğrafı
Filippo Gonteri2 yıl önce

Hope to see MAGNet soon on tour or in some festival #AI #music

ATou profil fotoğrafı
ATou2 yıl önce

@SaveToNotion

Benzer Videolar

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

AI at Meta

2,267,342 görüntüleme • 2 yıl önce

We've officially released and open-sourced HunyuanImage 2.1, our latest text-to-image model. The new model delivers on our commitment to balancing performance and quality. With native 2K image generation, HunyuanImage 2.1 is an advanced open-source text-to-image model.🎨 ✨ New in 2.1: 🔹Advanced Semantics: Supports ultra-long and complex prompts of up to 1000 tokens, and precisely controls the generation of multiple subjects in a single image. 🔹Precise Chinese and English Text Rendering with seamless image–text integration: The model naturally integrates text into images, making it suitable for a wide range of applications such as product covers, illustrations, and poster design to meet the needs of various fields. 🔹Rich Styles and High Aesthetic: Capable of generating images in various styles—including photorealistic portraits, comics, and vinyl figures—it delivers outstanding visual appeal and artistic quality. 🔹High-Quality Generation: Efficiently produces ultra-high-definition (2K) images in the same time other models take to generate a 1K image. HunyuanImage 2.1 uses two text encoders: a multimodal large language model (MLLM) to improve the model's image and text alignment capabilities, and a multi-language character-aware encoder to improve text rendering capabilities. The model is a single- and double-stream diffusion transformer with 17B parameters. We've also open-sourced the weights of the the accelerated version with meanflow which reduces inference steps from 100 to just 8, and PromptEnhancer, the first industrial-grade rewriting model that enhances your prompts for more nuanced and expressive image generation. Now, creators turn complex ideas—like posters with slogans or multi-panel comics—into visuals faster than ever. We’re just getting started. Stay tuned for our native multimodal image generation model coming soon. 🌐Website: 🔗Github: 🤗Hugging Face: ✨Hugging Face Demo:

Tencent Hy

89,430 görüntüleme • 1 yıl önce

Today is a good day for open science. As part of our continued commitment to the growth and development of an open ecosystem, today at Meta FAIR we’re announcing four new publicly available AI models and additional research artifacts to inspire innovation in the community and help advance AI in a responsible way. More in the video from Joelle Pineau. What we’re releasing: 🦎 Meta Chameleon 7B & 34B language models that support mixed-modal input and text-only outputs. 🪙 Meta Multi-Token Prediction Pretrained Language Models for code completion using Multi-Token Prediction. 🎼 Meta JASCO Generative text-to-music models capable of accepting various conditioning inputs for greater controllability. Paper available today with a pretrained model coming soon. 🗣️ Meta AudioSeal An audio watermarking model that we believe is the first designed specifically for the localized detection of AI-generated speech, available under a commercial license. 📝 Additional RAI artifacts Including research, data and code to measure and improve the representation of geographical and cultural preferences and diversity in AI systems. We believe that access to state-of-the-art AI creates opportunities for everyone – not just a small handful of Big Tech companies. We’re excited to share this work and to see how the community learns, iterates and builds using this technology. Details and access to everything released by FAIR today ➡️

AI at Meta

381,248 görüntüleme • 2 yıl önce