Experimenting with infinite zoom out using #StableDiffusion2

Infinite zoom out from Shibuya #StableDiffusion2

Ancient underground architectural ruins of Hong Kong in a flooded apocalypse landscape of dead skyscrapers. #StableDiffusion2

Here is an infinite zoom out of a trendy bathroom catalog generated with #StableDiffusion2 It is fairly simple to produce these. I put a notebook in my GitHub repo to generate this example: #StableDiffusion #AIart

@StableDiffusion The weird part is that the end of the zoom for each frame is always a painting. That's cheating.

@StableDiffusion Starting at 1 frame, then resizing it down a bit smaller for next step, inpainting the rest at the boarder? If so that’s pretty simple for such a cool result!! Would love to add some inpainting pipelines to stable-diffusion-videos I just haven’t gotten around to it…

@StableDiffusion I use the diffusers SD2.0-512 inpainting pipeline (it's just a really simple for loop, as you mentioned), and it works quite well!

@StableDiffusion Prompt the same all the way through? Or changing a bit? Looks like a painting of a cobblestone street with transformers haha. Painting related prompts tend to get get the frame (no pun intended) on the outside

@StableDiffusion I kept them to be the same, for this one, but I also tried changing the prompts (like every N frames) and it works quite well (or even better, if done right).

@StableDiffusion Yea that’s more what I was thinking of trying! Maybe interpolating the text embeds to see if something nice comes out (changing colors is probably cool).

@StableDiffusion Simple methods can produce compelling results when iterated at scale. NNs show this if nothing else.

@StableDiffusion Feel motion sickness

@StableDiffusion how ?¿ what’s the trick to do this

@StableDiffusion

@StableDiffusion Looks very cool! Just curious (if you don't mind), what kind of a machine did you use for this, and how much effort is it? If it's cloud, what was the cost?

@StableDiffusion I ran it locally on a single GPU. It doesn’t require much VRAM on SD2-512 model. Didn’t take too long, prob < 5 minutes. Will share the notebook after polishing.

@morew4rd @StableDiffusion Sorry are you generating each frame in sd?

@MartyKemka @morew4rd @StableDiffusion

@StableDiffusion Holy cow

@StableDiffusion That's really cool, but you're just looping into pictures - how about continuing to zoom through the city and then off the planet and through the galaxy?

@StableDiffusion Yeah I should put in an option to modify the prompt over time rather than keep it constant.

@StableDiffusion yes. :) that would be really cool

@StableDiffusion how did you avoid streaks and maintain consistency?

@StableDiffusion Check out the notebook in the GitHub in the thread

@StableDiffusion Deforum?

@StableDiffusion What’s that?

@StableDiffusion Deforum for Automatic1111 My test on zoom in

@StableDiffusion Oh, haven’t tried that! This infinite zoom was just put together in a few lines of Python in a for loop.

@StableDiffusion And it's sweeeet! There wasn't a day in the last few weeks when SD didn't blow my mind in some way.

@StableDiffusion 🧐

@StableDiffusion That’s part of the prompt 😲

@StableDiffusion lots of transformers but the movie ones

@DiffusionPics @StableDiffusion

@StableDiffusion Need this feature in a future version of DreamStudio 🤔@DigThatData

@StableDiffusion Where’s the infinite zoom NFT artist?

@RichardSocher @StableDiffusion oh my jesus

@StableDiffusion Amazing stuff

@StableDiffusion Beautiful! How?

@elblu69420 @StableDiffusion

@StableDiffusion Escher would have been proud

@StableDiffusion Interesting I just saw this video and 2 similar just popped out at twitter:

@StableDiffusion Amazing

@StableDiffusion Life, if simulation was real?

@StableDiffusion We appreciate you can make us do that but we don't actually like recursion generation like that. Fiddle with our internal clocks a little more than physics expected.

@StableDiffusion 🙏

@StableDiffusion @DescargarBot