正在加载视频...

视频加载失败

Transformers can map one mp3 to another mp3. But why do we want to do audio-space translation? SingSong from Google Magenta Project is a super clever application: singing voice -> instrument accompaniments, i.e. “Reverse Karaoke”! Now everyone’s got their private, deluxe band 🎤 1/🧵

336,976 次观看 • 3 年前 •via X (Twitter)

10 条评论

Jim Fan 的头像
Jim Fan3 年前

Overall idea is simple. Use an off-the-shelf source separation algorithm to make a synthetic training dataset from a large corpus of music audio. Each data point is an aligned (vocal, instrument) pair. Then train a Transformer to predict instrumental sound from vocals. 2/

Jim Fan 的头像
Jim Fan3 年前

Inference time is even simpler: directly take input vocals from users and generate the conditional instrument accompaniment. Just naively mix with the input, and voila! It will sound coherent. 3/

Jim Fan 的头像
Jim Fan3 年前

Paper: Demos: Original tweet from @chrisdonahuey, congrats to the Magenta team! 4/

Jim Fan 的头像
Jim Fan3 年前

“Reverse Karaoke” is a really witty & accurate characterization, quoted from @jesseengel. Welcome to follow me for the latest AI 🙌 END/🧵

Arthur B. 🌮 的头像
Arthur B. 🌮3 年前

@GoogleMagenta The French singing at the end is hilarious.

Cyclopatroidant 的头像
Cyclopatroidant3 年前

@GoogleMagenta « Et ça fait Hé, allez les Bleus, on va gagner le foot, à l’aide des pieds, ça va être super bien. On va marquer plus de points que l’adversaireuuuu… Let’s go! » 🤣🤣🤣🤣🤣🤣

Shane Gu 的头像
Shane Gu3 年前

@GoogleMagenta It's a dream app for all Asian PhDs

Jim Fan 的头像
Jim Fan3 年前

@GoogleMagenta 😜

Cyclopatroidant 的头像
Cyclopatroidant3 年前

@GoogleMagenta Le français à la fin! 🤣🤣🤣🤣🤣

Mouais ◻️🟥🟦◻️ 的头像
Mouais ◻️🟥🟦◻️3 年前

@GoogleMagenta Impromptu @kronomuzik à 1:20

相关视频