Загрузка видео...

Не удалось загрузить видео

На главную

spent some time on 🇨🇦 day making a version that's just c++ and compiled kernels most of the effort was actually a tool not seen here.. but then I didn't use the tool since I ended up automating the flying

18,027 просмотров • 4 месяцев назад •via X (Twitter)

Комментарии: 24

Фото профиля XWAVΞ
XWAVΞ4 месяцев назад

love to see it

Фото профиля The Nose
The Nose4 месяцев назад

I miss this kind of AI video

Фото профиля ‏۟
‏۟4 месяцев назад

Hell Yeah

Фото профиля J
J4 месяцев назад

What did the tool end up doing then

Фото профиля gandamu
gandamu4 месяцев назад

You can steer the video as it's rendering. Also, DD is modified so basically all the settings are per-frame in a CSV file. You can edit it as it's rendering to change the prompt or other settings. Works very well, but requires extreme patience to actually steer based on output.

Фото профиля AbandonedMuse
AbandonedMuse4 месяцев назад

Will you be putting this on GitHub?

Фото профиля gandamu
gandamu4 месяцев назад

I'm aiming for a simple Windows exe first. This isn't what most people who've gotten into it want first, but that's part of the point.

Фото профиля AbandonedMuse
AbandonedMuse4 месяцев назад

Idc I will use it with Wine. I want random Ai like this. I like having the option to do this kind of insanity

Фото профиля Chris Hackett
Chris Hackett4 месяцев назад

This is awesome

Фото профиля Chris Hackett
Chris Hackett4 месяцев назад

Is there anything you'd recommend if someone was going to have this recoded? Might try.

Фото профиля gandamu
gandamu4 месяцев назад

"rewrite this in c++ make no mistakes" hehe. In reality there is some iteration. I probably asked for c++ + libtorch first. It used TorchScript first but it was slow. Ultimately it's AOT compiled kernels that use fp16 without quality degradation. Just don't let it be mediocre.

Фото профиля Chris Hackett
Chris Hackett4 месяцев назад

Thank you so much.

Фото профиля X Girls
X Girls4 месяцев назад

@yacineMTB This is that circa 2022 ai video nostalgia vibe

Фото профиля 𓆏
𓆏4 месяцев назад

What made you rewrite it? Still love disco, best creative experience and exploration I've had with any image creation.

Фото профиля gandamu
gandamu4 месяцев назад

I knew from recent experience that I can simply ask Codex or Claude to rewrite the whole thing in C++ and it's done in no time 😅 I do need to give it some advice to do things well.. and getting it to compile the kernels in the best way required persistence, but it's easy.

Фото профиля gandamu
gandamu4 месяцев назад

I had a tool for flying the camera during rendering in late 2021 (for Pytti, then DD) but I never properly released it because: a) it was written in Python (hard to distribute), b) required dev packages for GPU use, c) most users used Colab (ToS violation when driven by my app)

Фото профиля gandamu
gandamu4 месяцев назад

A C++ rewrite ironically (similar to how native iOS apps are often easier to build and distribute than Java) is easier to distribute. I can just pack an executable with the models and prebuilt kernels and people can install it. Python on the other hand is weird.

Фото профиля gandamu
gandamu4 месяцев назад

I also almost always end up iterating faster when a project is native C/C++ rather than something that runs slower. Rather than need to profile and target certain slow points, I can just make it all good and fast and basically not worry about it. Also unintuitive.

Фото профиля 𓆏
𓆏4 месяцев назад

I hope you're going to release it with all the improvements you're cooking up. DD is something for the museums looking back at this time :)

Фото профиля Denis Shiryaev 💙💛
Denis Shiryaev 💙💛4 месяцев назад

nostalgic, will you push a code?

Фото профиля gandamu
gandamu4 месяцев назад

My primary interest has always been making an "it just works" app for Windows users who aren't developers or anything. I'm making some good progress getting AOT compiled kernels for it working on Windows MSVC (which is apparently broken in torch in at least 3 ways) so maybe 😅

Фото профиля MaoistFamineSimulatorStenchman🐧
MaoistFamineSimulatorStenchman🐧4 месяцев назад

Is this pytti?

Фото профиля gandamu
gandamu4 месяцев назад

This is Disco Diffusion (rewritten yesterday in c++) in 3D animation mode The loop is really similar since it uses optical flow to generate the init for each subsequent frame (pioneered in Pytti), but it uses CLIP-guided diffusion for the generation (not CLIP RGB opt nor VQGAN)

Фото профиля Avery
Avery4 месяцев назад

so you automated the part you built the tool for

Похожие видео