Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

🎉 Announcing v1.0 🥳 - 95 second music generation - Latent diffusion model (like stable diffusion) - Can do genre fusions - Trained by Harmonai

dadabots

10,627 subscribers

58,813 views • 2 years ago •via X (Twitter)

Music Science & Technology

Anya Rossi• Live Now

Private livecam show

10 Comments

dadabots2 years ago

Shout out to @harmonai_org team: @zqevans the mastermind who put in an extraordinary amount of work!! Odds the finesser of beats! @jordiponsdotme who just joined us! @ednewtonrex who connected all the dots! And the design/front/backend team who built the Stable Audio web app!

Rish2 years ago

@harmonai_org Congratulations @dadabots @zqevans @ednewtonrex @EMostaque and the entire team @harmonai_org + @StabilityAI another WIN!!!

Tero Parviainen2 years ago

@harmonai_org 👀👀👀👀👀👀👀👀👀👀👀👀

Rudzinski Maciej2 years ago

@harmonai_org 🥲 Thank you my grindcore industrial Beethoven is superb I could do that all day or make a playlist from it if it would work (wouldn't be so busy) Great success!

dadabots2 years ago

@harmonai_org were you able to generate your own grindcore industrial Beethoveen? can you share?

Thomas Gouritin2 years ago

@harmonai_org 👀

h̼͈̮̰̖̠͍̞̞̔̽ͤͪͦŗ͕̳ͧeͩ̈̆̇͏͎̲͙f̘̞̺͎̲̬̲ͭ̏͢͝ͅ2 years ago

@harmonai_org "We will be open sourcing a music generation model soon, trained on different data" ? So a limped down model will be released ? Stability is abandoning opensource?

pastel ← DENVER ꓽꓽ)2 years ago

@harmonai_org huuuuuuuge 🦾

Emma Catnip2 years ago

@harmonai_org exciting!

Kat Five2 years ago

@harmonai_org Congrats, it’s very slick!

Related Videos

We introduce W.A.L.T, a diffusion model for photorealistic video generation. Our model is a transformer trained on image and video generation in a shared latent space. 🧵👇

We introduce W.A.L.T, a diffusion model for photorealistic video generation. Our model is a transformer trained on image and video generation in a shared latent space. 🧵👇

Agrim Gupta

431,142 views • 2 years ago

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space

AK

43,387 views • 1 year ago

Stable Diffusion Moment of Audio?? Ace-Step Audio Model just dropped and is now natively supported in ComfyUI. ACE-Step is an open-source music generation model jointly developed by ACE Studio and StepFun.

Stable Diffusion Moment of Audio?? Ace-Step Audio Model just dropped and is now natively supported in ComfyUI. ACE-Step is an open-source music generation model jointly developed by ACE Studio and StepFun.

ComfyUI

23,495 views • 1 year ago

Stable Diffusion generates beautiful images, but can it be used for open-world recognition? Try Demo! Our #CVPR2023 paper shows that the pre-trained diffusion model indeed is a good image parser, allows for open-vocabulary segmentation and detection.

Stable Diffusion generates beautiful images, but can it be used for open-world recognition? Try Demo! Our #CVPR2023 paper shows that the pre-trained diffusion model indeed is a good image parser, allows for open-vocabulary segmentation and detection.

Xiaolong Wang

241,225 views • 3 years ago

Speed and quality can finally coexist in diffusion-based language generation. Introducing DiDi-Instruct, a Discrete Diffusion Divergence Instruct method that distills a pre-trained discrete diffusion language model (dLLM) into a few-step student for ultra-fast generation. Built on integral KL-divergence minimization, DiDi-Instruct achieves up to 64× faster decoding, surpasses both its teacher and GPT-2, and cuts training time by 20×. Ultra-Fast Language Generation via Discrete Diffusion Divergence Instruct Paper: Code: Project: Our report: 📬 #PapersAccepted by Jiqizhixin

Speed and quality can finally coexist in diffusion-based language generation. Introducing DiDi-Instruct, a Discrete Diffusion Divergence Instruct method that distills a pre-trained discrete diffusion language model (dLLM) into a few-step student for ultra-fast generation. Built on integral KL-divergence minimization, DiDi-Instruct achieves up to 64× faster decoding, surpasses both its teacher and GPT-2, and cuts training time by 20×. Ultra-Fast Language Generation via Discrete Diffusion Divergence Instruct Paper: Code: Project: Our report: 📬 #PapersAccepted by Jiqizhixin

机器之心 JIQIZHIXIN

18,126 views • 8 months ago

🤯🤯🤯 Music generated by finetuning Stable Diffusion on spectograms then generating any song possible

🤯🤯🤯 Music generated by finetuning Stable Diffusion on spectograms then generating any song possible

@levelsio

429,245 views • 3 years ago

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.

AK

294,442 views • 2 years ago

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models turn the publicly available, state-of-the-art text-to-image LDM Stable Diffusion into an efficient and expressive text-to-video model with resolution up to 1280 x 2048 abs: project page:

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models turn the publicly available, state-of-the-art text-to-image LDM Stable Diffusion into an efficient and expressive text-to-video model with resolution up to 1280 x 2048 abs: project page:

AK

718,746 views • 3 years ago

try out the Gradio Demo for AudioLDM: Text-to-Audio Generation with Latent Diffusion Models on Hugging Face demo:

try out the Gradio Demo for AudioLDM: Text-to-Audio Generation with Latent Diffusion Models on Hugging Face demo:

AK

82,137 views • 3 years ago

Harry Potter Anime using stable diffusion by u/Inner-Reflections

Harry Potter Anime using stable diffusion by u/Inner-Reflections

AK

730,113 views • 3 years ago

Introducing Stable Diffusion XL beta! Our latest image generation model, now available through our API, excels at photorealism & adds many cool features like enhanced face generation, minimal prompts & legible text. Try out #SDXL in DreamStudio now:

Introducing Stable Diffusion XL beta! Our latest image generation model, now available through our API, excels at photorealism & adds many cool features like enhanced face generation, minimal prompts & legible text. Try out #SDXL in DreamStudio now:

Stability AI

154,812 views • 3 years ago

📢𝐋𝟑𝐃𝐆: 𝐋𝐚𝐭𝐞𝐧𝐭 𝟑𝐃 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧 𝐃𝐢𝐟𝐟𝐮𝐬𝐢𝐨𝐧📢 #SIGGRAPHAsia We propose a generative diffusion model for 3D Gaussians. Key is a learnt latent space which substantially reduces the complexity of the diffusion process, thus facilitating room-scale scene generation! Great work by Barbara Roessle in with Norman Müller, Angela Dai, Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder!

📢𝐋𝟑𝐃𝐆: 𝐋𝐚𝐭𝐞𝐧𝐭 𝟑𝐃 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧 𝐃𝐢𝐟𝐟𝐮𝐬𝐢𝐨𝐧📢 #SIGGRAPHAsia We propose a generative diffusion model for 3D Gaussians. Key is a learnt latent space which substantially reduces the complexity of the diffusion process, thus facilitating room-scale scene generation! Great work by Barbara Roessle in with Norman Müller, Angela Dai, Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder!

Matthias Niessner

39,496 views • 1 year ago

Memory-V2V by Adobe: diffusion model with memory for consistent iterative editing; - ReCamMaster+LucyEdit; - reduces FLOPs by 30-90%; outperforming FIFO-Diffusion. high fidelity across long durations like consistent style transfer

Memory-V2V by Adobe: diffusion model with memory for consistent iterative editing; - ReCamMaster+LucyEdit; - reduces FLOPs by 30-90%; outperforming FIFO-Diffusion. high fidelity across long durations like consistent style transfer

Wildminder

10,248 views • 5 months ago

Evolution of Humanity using Stable Diffusion (AI)

Evolution of Humanity using Stable Diffusion (AI)

Evolution Of Life

96,616 views • 2 years ago

Progressive Rendering Distillation released on Hugging Face Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data

Progressive Rendering Distillation released on Hugging Face Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data

AK

12,586 views • 1 year ago

We created a series of simplified notebooks that cover essential aspects of Stable Diffusion, using the vanilla Stable Diffusion 2.1 base to utilise it as a face-editing model for building your own face app 🧵(1/3) Github :

We created a series of simplified notebooks that cover essential aspects of Stable Diffusion, using the vanilla Stable Diffusion 2.1 base to utilise it as a face-editing model for building your own face app 🧵(1/3) Github :

OutofAi

45,864 views • 2 years ago

Stable Diffusion 3.5 from Stability AI is now LIVE on Civitai! Stable Diffusion 3.5 Large is a Multimodal Diffusion Transformer text-to-image model that features improved performance in image quality, typography, complex prompt understanding, and resource-efficiency. Generate with SD 3.5 Live on Civitai here👇🏽 All images used to create this video were generated with SD 3.5 by our community 🫶🏽

Stable Diffusion 3.5 from Stability AI is now LIVE on Civitai! Stable Diffusion 3.5 Large is a Multimodal Diffusion Transformer text-to-image model that features improved performance in image quality, typography, complex prompt understanding, and resource-efficiency. Generate with SD 3.5 Live on Civitai here👇🏽 All images used to create this video were generated with SD 3.5 by our community 🫶🏽

Civitai

31,235 views • 1 year ago

3D Crowd Generation with Stable-Diffusion and Blender. A thread exploring current simplest approaches, limitations and possible improvements. #stablediffusion #crowdgen #b3d

3D Crowd Generation with Stable-Diffusion and Blender. A thread exploring current simplest approaches, limitations and possible improvements. #stablediffusion #crowdgen #b3d

Alex Martinelli

156,982 views • 3 years ago

Stable Boy, A GIMP plugin for AUTOMATIC1111's Gradio Stable Diffusion WebUI github:

Stable Boy, A GIMP plugin for AUTOMATIC1111's Gradio Stable Diffusion WebUI github:

AK

112,556 views • 3 years ago

Using stable diffusion to transform real people into animation.

Using stable diffusion to transform real people into animation.

neil wong

36,947 views • 3 years ago