Generate Songs with DiffRythm Locally [NVIDIA ONLY] I've ported apolinario 🌐's DiffRyhthm gradio app to run locally. And Wow. 1. Only need 8GB VRAM 2. Very fast: Generate a FULL song in just around 10~12 seconds And now you too can run it with 1-click.

get it on

Note that the first time you generate it will take longer, but from the second time it will take like 10 ~ 15 seconds depending on your system.

Note that you must follow the instructions with the lyrics, the timestamp and the lyrics format must match what's suggested.

Project page:

One more thing, when you first install, please don't forget to restart Pinokio, just to make sure all the installations are applied. And if you have any questions, please post on discord

@multimodalart Thank you I had tried to create the installation with Gepeto. I couldn't launch DiffRhytm 😭

@multimodalart This was a tricky one. I had to change a lot of things to make it work locally and on windows, so it's totally understandable why it didn't work. also required a lot of automated system integration such as espeak-ng, so yeah probably one of the most difficult scripts on pinokio

@multimodalart Any idea how to customize the genre or give it example audio? @cocktailpeanut @multimodalart

@multimodalart Yeah this was what i was wondering too. At the moment i think it's fully based on the reference audio clip. But maybe it's as easy as tweaking the prompt. Will have to check out the code, but until i get there, @multimodalart if you could share some insights would appreciate!

@multimodalart You're making me work harder to afford all the hard drives.....