Loading video...

Video Failed to Load

Go Home

LoRA-Edit Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuning

_akhaliq's profile picture

AK

505,579 subscribers

25,476 views • 1 year ago •via X (Twitter)

Science & TechnologyNews & PoliticsEducation
LIVE

Anya Rossi• Live Now

Private livecam show

3 Comments

AK's profile picture
AK1 year ago

discuss with author:

Optimist Jessica's profile picture
Optimist Jessica1 year ago

wen @ComfyUI native?

Jay Sensei👾's profile picture
Jay Sensei👾1 year ago

This is really powerful for reference guided video editing and also maintain high fidelity from the source video.

Related Videos

Fine-tuning Mistral 7B with LoRA on a 32 GB M1 (laptop!) in MLX Updated example uses less RAM + support for custom datasets 🚀
0:38

Fine-tuning Mistral 7B with LoRA on a 32 GB M1 (laptop!) in MLX Updated example uses less RAM + support for custom datasets 🚀

Awni Hannun

148,141 views • 2 years ago

LoRA training is the standout feature. You can fine tune Qwen Image directly online, export the trained LoRA, and plug it straight into ComfyUI workflows like any custom model. This replaces a lot of paid LoRA setups.
0:40

LoRA training is the standout feature. You can fine tune Qwen Image directly online, export the trained LoRA, and plug it straight into ComfyUI workflows like any custom model. This replaces a lot of paid LoRA setups.

SANI BULA

15,462 views • 4 months ago

Qwen-Edit-2509-Multi-angle lighting LoRA Download link: Tongyi Lab
1:45

Qwen-Edit-2509-Multi-angle lighting LoRA Download link: Tongyi Lab

大雄

53,916 views • 7 months ago

still experimenting with LoRA based on the Thinking Machines configuration and just implemented it in colab. In this notebook I set up a fine tune of Qwen/Qwen3-0.6B on the OpenR1-Math dataset with lora rank of 1. with this setup you can get the same reward accuracy as full fine-tuning, at a fraction of vram usage.
0:45

still experimenting with LoRA based on the Thinking Machines configuration and just implemented it in colab. In this notebook I set up a fine tune of Qwen/Qwen3-0.6B on the OpenR1-Math dataset with lora rank of 1. with this setup you can get the same reward accuracy as full fine-tuning, at a fraction of vram usage.

Ben Burtenshaw

25,624 views • 8 months ago

Personalized 3D Generative Avatars from a Single Portrait Contributions: 1. Generate a personalized 3D avatar from a reference portrait image with controllable facial attributes. 2. Create high-quality synthetic 2D video datasets with diverse attribute editing from a reference portrait image. 3. Use latent space regularization with face morphing supervision for a continuous and smooth latent space, enhancing the generative ability for unseen or interpolated attribute appearances. 4. Employ an efficient fine-tuning technique via Low-Rank Adaptation (LoRA) [26] to integrate any new facial attribute into the avatar model.
0:45

Personalized 3D Generative Avatars from a Single Portrait Contributions: 1. Generate a personalized 3D avatar from a reference portrait image with controllable facial attributes. 2. Create high-quality synthetic 2D video datasets with diverse attribute editing from a reference portrait image. 3. Use latent space regularization with face morphing supervision for a continuous and smooth latent space, enhancing the generative ability for unseen or interpolated attribute appearances. 4. Employ an efficient fine-tuning technique via Low-Rank Adaptation (LoRA) [26] to integrate any new facial attribute into the avatar model.

MrNeRF

20,507 views • 1 year ago

How to Train Your Mochi: Introducing LoRA fine-tuning. Customize Mochi on a single GPU with just a few videos. Create any effect or create consistent characters. Make Mochi 1 truly yours.
0:39

How to Train Your Mochi: Introducing LoRA fine-tuning. Customize Mochi on a single GPU with just a few videos. Create any effect or create consistent characters. Make Mochi 1 truly yours.

Genmo

113,880 views • 1 year ago

Open-source might have just caught up to NanoBanana dx8152 trained a Qwen Edit LoRA that nails multi-angle shots. Here’s a product video I made using it with Kling Start/End frames. Link to LoRA below 👇
0:20

Open-source might have just caught up to NanoBanana dx8152 trained a Qwen Edit LoRA that nails multi-angle shots. Here’s a product video I made using it with Kling Start/End frames. Link to LoRA below 👇

Miguel | AP

61,137 views • 7 months ago

Next level: QLoRA fine-tuning 4-bit Llama 3 8B on iPhone 15 pro. Incoming (Q)LoRA MLX Swift example by David Koski: works with lot's of models (Mistral, Gemma, Phi-2, etc)
1:19

Next level: QLoRA fine-tuning 4-bit Llama 3 8B on iPhone 15 pro. Incoming (Q)LoRA MLX Swift example by David Koski: works with lot's of models (Mistral, Gemma, Phi-2, etc)

Awni Hannun

581,723 views • 2 years ago

🚨 POP EMERGENCY: Lora, do Bar da Lora, faz comeback como CANTORA e adota nome artístico 'Lora do Forró'.
2:35

🚨 POP EMERGENCY: Lora, do Bar da Lora, faz comeback como CANTORA e adota nome artístico 'Lora do Forró'.

POPTime

302,152 views • 6 months ago

#NosEstanMatando En Colombia masacran a familia Pastoral en un restaurante. Comparto la última prédica del Pastor Marlon Yamith Lora. Ellos eran Yurlay Rincón, Natalia Lora Rincón, Santiago Lora, y el pastor Marlon Yamith Lora QEPD 🕯️ Fuente : video de la masacre Fuente Masacre número 76
3:12

#NosEstanMatando En Colombia masacran a familia Pastoral en un restaurante. Comparto la última prédica del Pastor Marlon Yamith Lora. Ellos eran Yurlay Rincón, Natalia Lora Rincón, Santiago Lora, y el pastor Marlon Yamith Lora QEPD 🕯️ Fuente : video de la masacre Fuente Masacre número 76

Line

56,480 views • 1 year ago

6/ ASCII plays DOOM Fine-tuning Mistral 7B to play DOOM based on ASCII frame representations. Yes, it actually works. Umut Hope YILDIRIM Sammy Aťman Paul Chu 🥇First place fine tuning track
1:25

6/ ASCII plays DOOM Fine-tuning Mistral 7B to play DOOM based on ASCII frame representations. Yes, it actually works. Umut Hope YILDIRIM Sammy Aťman Paul Chu 🥇First place fine tuning track

Alex Reibman 🖇️

18,717 views • 2 years ago

T-Display K230 LoRa video transmission function progress update.
0:28

T-Display K230 LoRa video transmission function progress update.

LILYGO

39,068 views • 8 months ago

Today we're launching three new LoRAs for our open source video model, LTX Video! 🕺 Pose LoRA 🏞️ Depth LoRA ✏️ Canny LoRA Get unprecedented control over your AI videos and train new control types with just a few samples on consumer hardware. Details below 👇
0:33

Today we're launching three new LoRAs for our open source video model, LTX Video! 🕺 Pose LoRA 🏞️ Depth LoRA ✏️ Canny LoRA Get unprecedented control over your AI videos and train new control types with just a few samples on consumer hardware. Details below 👇

LTX Studio

139,861 views • 11 months ago

RedPajama-INCITE-3B, an LLM for everyone: We are excited to share llama.cpp support! Efficiently run RedPajama on commodity CPUs! This, plus new resources to fine-tune the model using LoRA, instruction-tuning tips and more on our blog:
1:20

RedPajama-INCITE-3B, an LLM for everyone: We are excited to share llama.cpp support! Efficiently run RedPajama on commodity CPUs! This, plus new resources to fine-tune the model using LoRA, instruction-tuning tips and more on our blog:

Together AI

81,769 views • 3 years ago

SDR to HDR from ComfyUI, I've trained a LoRA over Qwen Edit 2011 based on the principle used in A research I've had the previlige to work on with Naomi Ken Korem for video HDR on LTX. Links for the LoRA and workflow (+ my fun grading node) below.
1:09

SDR to HDR from ComfyUI, I've trained a LoRA over Qwen Edit 2011 based on the principle used in A research I've had the previlige to work on with Naomi Ken Korem for video HDR on LTX. Links for the LoRA and workflow (+ my fun grading node) below.

Mohamed Oumoumad

58,600 views • 1 month ago

🚴‍♂️ Lora & Primož Roglič: Slovenia is our cycling playground 🇸🇮 Discover the enchanting world of top-tier wines & authentic local gastronomy at the Sibon estate, guided by the sweet-sounding voice of Lora Klinc Roglič 🎤, alongside the 🇸🇮 cycling virtuoso, Primož Roglič 🚴‍♂️.
2:16

🚴‍♂️ Lora & Primož Roglič: Slovenia is our cycling playground 🇸🇮 Discover the enchanting world of top-tier wines & authentic local gastronomy at the Sibon estate, guided by the sweet-sounding voice of Lora Klinc Roglič 🎤, alongside the 🇸🇮 cycling virtuoso, Primož Roglič 🚴‍♂️.

Feel Slovenia

49,506 views • 2 years ago

Hermoso testimonio de Ángela Lora, asesinada junto a sus padres, los pastores Marlon Lora y Yurlay Rincón en Aguachica, Cesar. Orando por su hijo Santiago Lora y por Colombia 🙏🏻
0:39

Hermoso testimonio de Ángela Lora, asesinada junto a sus padres, los pastores Marlon Lora y Yurlay Rincón en Aguachica, Cesar. Orando por su hijo Santiago Lora y por Colombia 🙏🏻

Andrés Corson

115,825 views • 1 year ago

Miguel Lora, conocido como Happy Lora y recordado exboxeador, anunció su respaldo a Abelardo de la Espriella.
0:22

Miguel Lora, conocido como Happy Lora y recordado exboxeador, anunció su respaldo a Abelardo de la Espriella.

Revista Semana

78,347 views • 10 days ago

T-Lora Pager Progress Update
0:44

T-Lora Pager Progress Update

LILYGO

31,469 views • 1 year ago