Loading video...

Video Failed to Load

Go Home

I dusted of disco diffusion yesterday and did some speed optimizations. It's roughly 2x faster as a result of that (not sure exactly..), but it still takes a lot of computation to look this incoherent.

30,123 views • 4 months ago •via X (Twitter)

40 Comments

alejandro's profile picture
alejandro4 months ago

Love it. I'm still in awe of how this era's imagery were mostly blobs that trick the brain into thinking it's something, but it's really nothing, but your brain keeps saying it is something.

gandamu's profile picture
gandamu4 months ago

losing and catching things without ever having enough time to settle is really mesmerizing

Ghosty's profile picture
Ghosty4 months ago

we really need to revive disco with all the optimizations; I have also wondered if it'd be possible to run different models with the disco framework sometimes I still spin up 5.2 on visions of chaos (really can't be bothered running the notebook versions) 5.2 was the only one that seemed to keep coherent animations without going into purple or red hell vqgan is also still plenty fun new models feel like toys compared to those older ones, I mean significantly more powerful/coherent and whatever but idk there was something magic about those early models

gandamu's profile picture
gandamu4 months ago

Different models with Disco framework is basically @deforum_art It's been the successor for that since the Stable Diffusion release

Ghosty's profile picture
Ghosty4 months ago

@deforum_art yeah I haven't kept up with deforum since probably sd1.5, I've seen some people doing disco style animations with flux even

joevitrano's profile picture
joevitrano4 months ago

early gen video just hit different. everything was abstract, weird, and kinda broken—but it had soul. today's outputs are technically insane, but i still miss the REM state of a machine

gandamu's profile picture
gandamu4 months ago

the best thing about our dreams is how bad we are at generating them

Justin Trimble's profile picture
Justin Trimble4 months ago

🤌🤌🤌

ĴƦƱƓƓƑƱȻĦŦ's profile picture
ĴƦƱƓƓƑƱȻĦŦ4 months ago

Making me nostalgic for 2022

Takyon∞ - The Tokenizer's profile picture
Takyon∞ - The Tokenizer4 months ago

Remind me the first public preview you shared on X back then in 1017

gandamu's profile picture
gandamu4 months ago

@Takyon yeah. Posted a test render that accidentally failed to enable the feature that I was trying to test, and it ended up with 143k likes 😅 (down to 121k after account deletions, etc.). X is weird.

Takyon∞ - The Tokenizer's profile picture
Takyon∞ - The Tokenizer4 months ago

That was the good time

J's profile picture
J4 months ago

2x faster and it’s still a compute hog

𝐋𝓔𝙲Ќ𝕊's profile picture
𝐋𝓔𝙲Ќ𝕊4 months ago

A few nights ago, I created a 2m swampy synth track... and after rewatching your video a few times this afternoon, I realized why I was having deja vu... Respectfully, I merged them...👀

Jan Schnyder's profile picture
Jan Schnyder4 months ago

This takes me back

JΞRU's profile picture
JΞRU4 months ago

niccce

neb's profile picture
neb4 months ago

Does the fork with your speed optimizations is available somewhere ? Would love to dive back to disco

gandamu's profile picture
gandamu4 months ago

Not yet. I should be able to do that. It's still written in a way that can be converted to the Colab notebook.. but I don't think many people are using that any more (and Colab doesn't benefit from the optimizations unless you're lucky and get an A100 or something)

kuba tarkowski's profile picture
kuba tarkowski4 months ago

Still it remains one of the best AI animated experience ever!

Michael Carychao's profile picture
Michael Carychao4 months ago

The GOAT

Chris Hackett's profile picture
Chris Hackett4 months ago

Absolutely love this .

aeoniumsky's profile picture
aeoniumsky4 months ago

I really love the early day diffusions, its an art style in itself 😍

mauro's profile picture
mauro4 months ago

I love this. And now I’ve unlocked a new feeling “AI early days nostalgia”. If anyone have any idea how to revive Pytti I would appreciate the tip very much.

timeboy's profile picture
timeboy4 months ago

I miss these days

Michael Ten 🌨🎶🫐🍀's profile picture
Michael Ten 🌨🎶🫐🍀4 months ago

What is disco diffusion? Is it an early video generation model or something? Or an early live video generation model, I should say? @grok

synthiola 🎀's profile picture
synthiola 🎀4 months ago

It’d not incoherent, it’s beauty!

gandamu's profile picture
gandamu4 months ago

🙏 are you sure? I worked very hard on this

i hav \()/'s profile picture
i hav \()/4 months ago

Quick question: if someone with a software engineering background (C++ networking stuff) with a vague understanding of ML principles wanted to create something like this where would they start? Any book recommendations? Papers? Thanks! Love your work.

Michael Lulev's profile picture
Michael Lulev4 months ago

Creepy

Ericreator's profile picture
Ericreator4 months ago

yea the old stuff is still slow eh?

glark's profile picture
glark4 months ago

how much computation

gandamu's profile picture
gandamu4 months ago

Each frame was 1280x768 (higher res than most people have seen in DD animation before).. and took about 25s per frame with fairly high settings. I stopped and resumed a bit.. but the whole thing took around 11 hours to render.

AshmanRoonz's profile picture
AshmanRoonz4 months ago

@glark0x I feel like we could get this rendering in real time.

gandamu's profile picture
gandamu4 months ago

@glark0x I just need to make it about 200x faster (at this res). but actually, yes

AshmanRoonz's profile picture
AshmanRoonz4 months ago

@glark0x Maybe you could train an Ai to procdurally generate it. Look how fast the LLMs can generate text and speech. Video is at our fingertips!

gandamu's profile picture
gandamu4 months ago

@glark0x To keep some of the same chaos, I'd probably want to keep some CLIP guidance which is slow. However, an image model could be finetuned to approximate that a bit.. and then use less frequent CLIP guidance on that during gen of each frame. Also, a latent CLIP could be great.

gandamu's profile picture
gandamu4 months ago

@glark0x Actually, CLIP guidance could be applied to frames of video during generation by a video model too. It's madness due to the speed difference.. but when madness is the goal, then why not.

AbandonedMuse's profile picture
AbandonedMuse4 months ago

This is really wonderful work

Light Spreader's profile picture
Light Spreader4 months ago

This and deforum will always have a special place in my heart.

The Keepright's profile picture
The Keepright4 months ago

The optics of this at the start were defining ones but it receded under the avalanche of tighter, more literal slop imagery... but the potential for this infinite zoom to become a narrative convention is like the early dormant pianoforte potential of the piano awaiting usage!

Related Videos