Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

SDR to HDR from ComfyUI, I've trained a LoRA over Qwen Edit 2011 based on the principle used in A research I've had the previlige to work on with Naomi Ken Korem for video HDR on LTX. Links for the LoRA and workflow (+ my fun grading node) below.

59,885 Aufrufe • vor 5 Monaten •via X (Twitter)

31 Kommentare

Profilbild von Mohamed Oumoumad
Mohamed Oumoumadvor 5 Monaten

Github : LoRA and workflow : LogC3 decode Custome node (this node is also available already in LTXV nodes) :

Profilbild von Nekodificador 💬
Nekodificador 💬vor 5 Monaten

@noamiKenKorem Do you think this could be done with Klein as well? 🤔

Profilbild von Mohamed Oumoumad
Mohamed Oumoumadvor 5 Monaten

@noamiKenKorem I have a wip lora done in klein 4b, behaves a bit differently, but we do get range, I don't think ill have time for 9 iterations like i did with qe11 so I might share that version as is :D

Profilbild von Nekodificador 💬
Nekodificador 💬vor 5 Monaten

@noamiKenKorem I wanted to try this for myself, so if you need a hand with the 9B version, I'm all in.

Profilbild von Mohamed Oumoumad
Mohamed Oumoumadvor 5 Monaten

@noamiKenKorem Sure, you got compute and time to test? Let's talk in discord

Profilbild von Jt Sanborn
Jt Sanbornvor 5 Monaten

@Nekodificador @noamiKenKorem How much compute do we need for Klein 9b? Does a 3090 24gb work? If so, I have an isolated machine I can leave running it for days.

Profilbild von Mohamed Oumoumad
Mohamed Oumoumadvor 5 Monaten

@Nekodificador @noamiKenKorem I'm releasing a klein 4b and 9b version, we've done some initial tests with @Nekodificador it's an alpha version, but it should give you a decent range already.

Profilbild von makeitrad
makeitradvor 5 Monaten

@noamiKenKorem Very cool Mohamed!

Profilbild von VJLeoLiu
VJLeoLiuvor 5 Monaten

@noamiKenKorem It's quite impressive. Could you briefly explain the training process and underlying principles?

Profilbild von Mohamed Oumoumad
Mohamed Oumoumadvor 5 Monaten

@noamiKenKorem it's explained in detail in the paper here : In summary: take existing HDRs, encode them to LogC3, train the model on that, the model generates logC3, decode that back into HDR. That's it. The model doesn't even know it's learning HDR.

Profilbild von Guille Carbonell
Guille Carbonellvor 5 Monaten

@AIAVJLeo @noamiKenKorem Would it be possible to just output logC3 images instead of HDRs?

Profilbild von Mohamed Oumoumad
Mohamed Oumoumadvor 5 Monaten

@AIAVJLeo @noamiKenKorem It is what it does, I mean what it is trained for, you can just grab the image before the logc3 decode.

Profilbild von Mistermarsblack
Mistermarsblackvor 5 Monaten

@noamiKenKorem Yooooo! This is AMAZING!!!

Profilbild von LAT𐌄NT ƝOTHING ✦
LAT𐌄NT ƝOTHING ✦vor 5 Monaten

@noamiKenKorem Amazing work!

Profilbild von side444123
side444123vor 5 Monaten

@noamiKenKorem that's 🔥 - check it out @dpreview

Profilbild von Evan Kuzminski
Evan Kuzminskivor 5 Monaten

@ComfyUI @noamiKenKorem That’s fine but 2k max resolution 😭 maybe you know the way how to get ability generate 4-8k HDRs ?

Profilbild von Mohamed Oumoumad
Mohamed Oumoumadvor 5 Monaten

@AIlover1995 @ComfyUI @noamiKenKorem Why would you be limited to 2k ? There are plenty of ways yo get much higher even if it didn't work natively. I've also been training Klein for this same task, which might be easier for doing 4k.

Profilbild von Evan Kuzminski
Evan Kuzminskivor 5 Monaten

@ComfyUI @noamiKenKorem Yeah. Digging into it RN, thanks for your work!

Profilbild von RCast
RCastvor 5 Monaten

@noamiKenKorem A powerful node for a powerful tool. Congrats!

Profilbild von Vin
Vinvor 5 Monaten

@noamiKenKorem Very nice. I hope banding issue wont be a problem now. Although i used to fix it manually

Profilbild von Ai(n) Malcolm
Ai(n) Malcolmvor 5 Monaten

@noamiKenKorem Cool, that looks nice! I like SDR to reverse tone mapping - easy and effective. But this is incredible, too.

Profilbild von Timor Kardum
Timor Kardumvor 5 Monaten

@noamiKenKorem Very very cool! Is the SDR input image supposed to be sRGB or LogC colorspace?

Profilbild von Mohamed Oumoumad
Mohamed Oumoumadvor 5 Monaten

@noamiKenKorem Input SDR is sRGB/rec.709

Profilbild von Timor Kardum
Timor Kardumvor 5 Monaten

@noamiKenKorem Awesome, thanks!

Profilbild von OpenStacks.ai
OpenStacks.aivor 5 Monaten

@noamiKenKorem This is awesome—SDR→HDR via ComfyUI + a Qwen Edit 2011 LoRA sounds like a really clever pipeline, and the “fun grading node” made me smile 😄. If you end up comparing API plans, OpenStacks ( is handy.

Profilbild von Catalaxy
Catalaxyvor 3 Monaten

@noamiKenKorem Spatial Raw

Profilbild von Syntax Diffusion
Syntax Diffusionvor 5 Monaten

@ComfyUI @noamiKenKorem Awesome

Profilbild von zeon bik
zeon bikvor 5 Monaten

@noamiKenKorem Hello, can you share this Lora?

Profilbild von Mohamed Oumoumad
Mohamed Oumoumadvor 5 Monaten

@noamiKenKorem

Profilbild von Merzmensch Kosmopol🧑‍🎨🤖
Merzmensch Kosmopol🧑‍🎨🤖vor 5 Monaten

@noamiKenKorem Amazing!

Profilbild von j’aime
j’aimevor 5 Monaten

@noamiKenKorem Kicking ass like always! This is great!

Ähnliche Videos