Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Less than 1 minute guide on how to train your own LoRA with LoRA Ease 🧞‍♂️⚡ Train high-quality LoRAs on objects 📦, faces 😊, styles 🎨 or characters 🧑‍🎤 effortlessly and super cheap ༄ ▶️

apolinario (poli)

15,834 subscribers

90,959 views • 2 years ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

10 Comments

apolinario 🌐2 years ago

This leverages the new advanced training script with curated hyperparameters:

apolinario 🌐2 years ago

And you can play with the medieval animals LoRA here!

Nate Raw2 years ago

so cool, great work poli :)

apolinario 🌐2 years ago

thanks nate!

Kris Karols2 years ago

This is cool, I just started training my first ever Lora on Colab for free.

Dylan2 years ago

are the final models private? does the dataset uploaded is automatically deleted after?

apolinario 🌐2 years ago

The uploaded model is by default private - you can change it to public after if you may The dataset remains as a private dataset in your HF account (not publicly accessible also) that you may wish to delete afterwards

Shashank | Fraction AI2 years ago

Great job guys!

Dylan2 years ago

Is there a way to run this locally ?

apolinario 🌐2 years ago

Using this UI locally you can't yet (although the code is open source so one could adapt) But the training script can be used locally yes:

Related Videos

Fluxgym: Train FLUX LoRA LOCALLY with LOW VRAM FLUX LoRAs are super exciting, but there has not been an easy way to train them LOCALLY using LOW VRAM machines. Fluxgym is a Gradio app for training your own Flux LoRAs on your own 12G, 16G, 20G+ VRAM computer for free.

Fluxgym: Train FLUX LoRA LOCALLY with LOW VRAM FLUX LoRAs are super exciting, but there has not been an easy way to train them LOCALLY using LOW VRAM machines. Fluxgym is a Gradio app for training your own Flux LoRAs on your own 12G, 16G, 20G+ VRAM computer for free.

cocktail peanut

237,446 views • 1 year ago

How to Train Your Mochi: Introducing LoRA fine-tuning. Customize Mochi on a single GPU with just a few videos. Create any effect or create consistent characters. Make Mochi 1 truly yours.

How to Train Your Mochi: Introducing LoRA fine-tuning. Customize Mochi on a single GPU with just a few videos. Create any effect or create consistent characters. Make Mochi 1 truly yours.

Genmo

113,880 views • 1 year ago

Train a FLUX LoRA on characters in less than 5 minutes. Edit, upscale & add motion with Runway, Luma, Hailuo, or Kling. Available to anyone right now, on Based Labs AI. Step-by-step workflow below:

Train a FLUX LoRA on characters in less than 5 minutes. Edit, upscale & add motion with Runway, Luma, Hailuo, or Kling. Available to anyone right now, on Based Labs AI. Step-by-step workflow below:

Heather Cooper

44,935 views • 1 year ago

Today we're launching three new LoRAs for our open source video model, LTX Video! 🕺 Pose LoRA 🏞️ Depth LoRA ✏️ Canny LoRA Get unprecedented control over your AI videos and train new control types with just a few samples on consumer hardware. Details below 👇

Today we're launching three new LoRAs for our open source video model, LTX Video! 🕺 Pose LoRA 🏞️ Depth LoRA ✏️ Canny LoRA Get unprecedented control over your AI videos and train new control types with just a few samples on consumer hardware. Details below 👇

LTX.io

139,969 views • 1 year ago

Connect to the gensyn Testnet and train your personal model today. Here's a guide to do it on your Macbook in 10 mins or less.

Connect to the gensyn Testnet and train your personal model today. Here's a guide to do it on your Macbook in 10 mins or less.

Jeff Amico

64,998 views • 1 year ago

🎉 Meet Krea 2 from Krea, an aesthetic open-source image model ranked #1 text-to-image from an independent lab on Artificial Analysis. Day-0 support is now live in SGLang! Krea 2 ships as two models built to work together: 1️⃣ RAW: undistilled base checkpoint: diverse & malleable, made for fine-tuning, post-training & LoRA 2️⃣ Turbo: 8-step distilled checkpoint: fast, high-quality text-to-image Train LoRAs on RAW, run them on Turbo: base for training, Turbo for fast inference on your own hardware Run it now with SGLang!

🎉 Meet Krea 2 from Krea, an aesthetic open-source image model ranked #1 text-to-image from an independent lab on Artificial Analysis. Day-0 support is now live in SGLang! Krea 2 ships as two models built to work together: 1️⃣ RAW: undistilled base checkpoint: diverse & malleable, made for fine-tuning, post-training & LoRA 2️⃣ Turbo: 8-step distilled checkpoint: fast, high-quality text-to-image Train LoRAs on RAW, run them on Turbo: base for training, Turbo for fast inference on your own hardware Run it now with SGLang!

LMSYS Org

11,099 views • 21 days ago

We're releasing ACE-Step-v1.5(2B), a fast, high-quality open-source music model. It runs locally on a consumer-grade GPU, generates a full song in under 2 seconds(on an A100), supports LoRA fine-tuning, and beats SUNO on common eval metrics. GitHub: Key traits: Quality: beats Suno on common eval scores Speed: full song under 2s on A100 Local: ~4GB VRAM, under 10s on RTX 3090 LoRA: train your own style with a few songs License: MIT, free for commercial use Data: fully authorized plus synthetic The music AI space lacks commercial-grade open models. Many creators are forced to rely on closed-source services, and can’t fully own, run locally, or fine-tune their own models. We want to help change that.

We're releasing ACE-Step-v1.5(2B), a fast, high-quality open-source music model. It runs locally on a consumer-grade GPU, generates a full song in under 2 seconds(on an A100), supports LoRA fine-tuning, and beats SUNO on common eval metrics. GitHub: Key traits: Quality: beats Suno on common eval scores Speed: full song under 2s on A100 Local: ~4GB VRAM, under 10s on RTX 3090 LoRA: train your own style with a few songs License: MIT, free for commercial use Data: fully authorized plus synthetic The music AI space lacks commercial-grade open models. Many creators are forced to rely on closed-source services, and can’t fully own, run locally, or fine-tune their own models. We want to help change that.

ACE Music

1,053,898 views • 5 months ago

introducing LoRAs for Krea 2 (beta). our most powerful fine-tuning system to date; now you can train Krea 2 on a your own specific style, object, or character with incredible precision. learn how it works 👇

introducing LoRAs for Krea 2 (beta). our most powerful fine-tuning system to date; now you can train Krea 2 on a your own specific style, object, or character with incredible precision. learn how it works 👇

Krea

42,129 views • 1 month ago

🔥 another win for open source AI SNOWFLAKE ARCTIC: 1] Mixture of Experts model with 128 (!) experts 2] open weights, open code 3] Company is sharing "cookbook" and data and teaching people how to build their own world class MoE models. 4] very cheap model to train (16x times less than Llama 3)

🔥 another win for open source AI SNOWFLAKE ARCTIC: 1] Mixture of Experts model with 128 (!) experts 2] open weights, open code 3] Company is sharing "cookbook" and data and teaching people how to build their own world class MoE models. 4] very cheap model to train (16x times less than Llama 3)

Wes Roth

10,233 views • 2 years ago

As I promised yesterday, I'll briefly explain LoRA training and share a workflow I made so you can do it quickly. First, let me answer a very common question: 'Why train LoRAs when we have such advanced models?' Even though we have incredibly advanced models now (like NBP), we still can't always get them to do specific things we want. Simplest example: the spritesheet LoRA I made the other day. I generated 1000 images with Nano Banana and only 100 were what I wanted. The LoRA I trained using those 100 images gives me nearly 100% consistent results. Second point is cost and speed. With LoRA, we can cut costs by 4-5x. And while doing that, we're generating 4-5x faster. How many images do you need for a good LoRA? This depends on your LoRA's complexity. For example, when I training the spritesheet LoRA, even though I used 100 images, I didn't include buildings in the training data, so this LoRA doesn't work for buildings. So think about your LoRA's use cases and add examples for as many use cases as possible to improve quality. What are paired images and how to train LoRAs for image-editing? When training LoRAs for image editing on fal, we call each edit example paired images - one with _start suffix, one with _end suffix. For example, if you're training a background remove LoRA, the unedited original photo will be your '_start' image. The image with background removed will be the '_end' image. Simply put: images we want to edit or use as reference get _start, target images we want to achieve get '_end'. Important: save both images with the same name. Like image332_start.jpg and image332_end.jpg. This way the system knows which images pair together. What about training LoRAs for models with multiple image inputs? Same logic. We still use _start and _end suffixes, but with one difference. Since there are multiple input images, we can number them: _start, _start1, _start2. Example: start images, 1st image = Woman portrait (image35_start.jpg) 2nd image = Glasses photo (image35_start1.jpg) 3rd image = Hat photo (image35_start2.jpg) Output image = portrait of woman wearing glasses and hat (image35_end.jpg) Can we do more detailed captioning? Yes. Similarly, you can improve training quality by creating a txt file for each set with the caption inside. Example: create image35.txt and write: 'Recreate the image by putting the glasses from the second image and the hat from the third image on the woman in the first image.' What are Steps? How many should I use? What's Learning Rate? Steps determines how many times the model sees and processes your training data (your images). Each step, the model learns a bit more. But as steps increase, so does the risk of overfitting. So there's no real default. But for a simpler LoRA with 20 paired images, 1000 steps is ideal. Here's a metaphor for the Steps and Learning Rate relationship: Imagine you have a balloon. Our goal is to inflate it to the optimal size. Steps = How many times we blow into the balloon Learning rate = How hard we blow each time If we blow too softly, we need to blow many more times. If we blow too hard, we risk popping it quickly and can't reach optimal size. Of course training won't explode, but it won't work as intended because it wasn't trained optimally. Training's done, now what? Once training's complete, you'll have a safetensors file. Every model you train on fal has a LoRA inference endpoint. In that inference, add your safetensors file link to the LoRA url input, and you can use your LoRA. Thanks for the read! The workflow in the video: If I forgot anything, let me know in the replies.

As I promised yesterday, I'll briefly explain LoRA training and share a workflow I made so you can do it quickly. First, let me answer a very common question: 'Why train LoRAs when we have such advanced models?' Even though we have incredibly advanced models now (like NBP), we still can't always get them to do specific things we want. Simplest example: the spritesheet LoRA I made the other day. I generated 1000 images with Nano Banana and only 100 were what I wanted. The LoRA I trained using those 100 images gives me nearly 100% consistent results. Second point is cost and speed. With LoRA, we can cut costs by 4-5x. And while doing that, we're generating 4-5x faster. How many images do you need for a good LoRA? This depends on your LoRA's complexity. For example, when I training the spritesheet LoRA, even though I used 100 images, I didn't include buildings in the training data, so this LoRA doesn't work for buildings. So think about your LoRA's use cases and add examples for as many use cases as possible to improve quality. What are paired images and how to train LoRAs for image-editing? When training LoRAs for image editing on fal, we call each edit example paired images - one with _start suffix, one with _end suffix. For example, if you're training a background remove LoRA, the unedited original photo will be your '_start' image. The image with background removed will be the '_end' image. Simply put: images we want to edit or use as reference get _start, target images we want to achieve get '_end'. Important: save both images with the same name. Like image332_start.jpg and image332_end.jpg. This way the system knows which images pair together. What about training LoRAs for models with multiple image inputs? Same logic. We still use _start and _end suffixes, but with one difference. Since there are multiple input images, we can number them: _start, _start1, _start2. Example: start images, 1st image = Woman portrait (image35_start.jpg) 2nd image = Glasses photo (image35_start1.jpg) 3rd image = Hat photo (image35_start2.jpg) Output image = portrait of woman wearing glasses and hat (image35_end.jpg) Can we do more detailed captioning? Yes. Similarly, you can improve training quality by creating a txt file for each set with the caption inside. Example: create image35.txt and write: 'Recreate the image by putting the glasses from the second image and the hat from the third image on the woman in the first image.' What are Steps? How many should I use? What's Learning Rate? Steps determines how many times the model sees and processes your training data (your images). Each step, the model learns a bit more. But as steps increase, so does the risk of overfitting. So there's no real default. But for a simpler LoRA with 20 paired images, 1000 steps is ideal. Here's a metaphor for the Steps and Learning Rate relationship: Imagine you have a balloon. Our goal is to inflate it to the optimal size. Steps = How many times we blow into the balloon Learning rate = How hard we blow each time If we blow too softly, we need to blow many more times. If we blow too hard, we risk popping it quickly and can't reach optimal size. Of course training won't explode, but it won't work as intended because it wasn't trained optimally. Training's done, now what? Once training's complete, you'll have a safetensors file. Every model you train on fal has a LoRA inference endpoint. In that inference, add your safetensors file link to the LoRA url input, and you can use your LoRA. Thanks for the read! The workflow in the video: If I forgot anything, let me know in the replies.

ilker

15,133 views • 5 months ago

Kling O1 is GOATED! No Cap! Kling AI -Replace characters with a single reference image or element -Change styles with a video reference and prompt -Add visual FX with ease -Change environments -Quality coherency and outputs from both text and image to video. -So much more! Try it now on OpenArt (Link in the comments! 👇)

Kling O1 is GOATED! No Cap! Kling AI -Replace characters with a single reference image or element -Change styles with a video reference and prompt -Add visual FX with ease -Change environments -Quality coherency and outputs from both text and image to video. -So much more! Try it now on OpenArt (Link in the comments! 👇)

OpenArt

31,914 views • 7 months ago

The era of Stable Intelligence is here 🤖 Tether’s QVAC Fabric just released the world’s first cross-platform 1-bit LLM LoRA fine-tuning framework. QVAC Fabric extends Microsoft's ultra-efficient BitNet architecture, allowing fine-tuning and inference of LLMs directly on your smartphone—no NVIDIA GPU/CUDA lock-in or expensive server required. The Breakthrough: - Total Sovereignty: LoRA fine-tune ultra-efficient models locally on any smartphone, including iPhones, Pixel phones, Samsung Galaxy phones and any desktop/laptop operating systems using Vulkan and Metal backends. - Extreme Efficiency: 1-bit architecture uses up to 90% less memory and runs up to 11x faster than traditional models. - Universal Access: What used to require a data center now runs on the chip in your pocket. Own your intelligence. The era of stable, local AI is here. 📱🧠 Read the full details on Hugging Face and grab the binaries to build on your own hardware.

The era of Stable Intelligence is here 🤖 Tether’s QVAC Fabric just released the world’s first cross-platform 1-bit LLM LoRA fine-tuning framework. QVAC Fabric extends Microsoft's ultra-efficient BitNet architecture, allowing fine-tuning and inference of LLMs directly on your smartphone—no NVIDIA GPU/CUDA lock-in or expensive server required. The Breakthrough: - Total Sovereignty: LoRA fine-tune ultra-efficient models locally on any smartphone, including iPhones, Pixel phones, Samsung Galaxy phones and any desktop/laptop operating systems using Vulkan and Metal backends. - Extreme Efficiency: 1-bit architecture uses up to 90% less memory and runs up to 11x faster than traditional models. - Universal Access: What used to require a data center now runs on the chip in your pocket. Own your intelligence. The era of stable, local AI is here. 📱🧠 Read the full details on Hugging Face and grab the binaries to build on your own hardware.

QVAC

108,499 views • 3 months ago

It's hard to believe that FLUX.1 by Black Forest Labs has only been around since August 1. Thank you to everyone working to share impressive LoRA's & workflows. I trained @FAL's latest FLUX LoRA on my own images and animated with Runway Gen-3. I can't believe how well it worked:

It's hard to believe that FLUX.1 by Black Forest Labs has only been around since August 1. Thank you to everyone working to share impressive LoRA's & workflows. I trained @FAL's latest FLUX LoRA on my own images and animated with Runway Gen-3. I can't believe how well it worked:

Heather Cooper

20,206 views • 1 year ago

After listening to the community, we removed the mandatory Twitter login now all you need is to sign in with your wallet, pick a name, ticker & jpeg, and your coin will be immediately tradeable Takes less than 1 minute and costs less than $2 - only on Pump

After listening to the community, we removed the mandatory Twitter login now all you need is to sign in with your wallet, pick a name, ticker & jpeg, and your coin will be immediately tradeable Takes less than 1 minute and costs less than $2 - only on Pump

Pump.fun

267,375 views • 2 years ago

If you've got 5 minutes, don't miss this guide on how to train AI with your face 👴🤳 All you need is 10 photos and an Internet connection! Includes 20 PROMPTS 🔖 (Bookmark this for later)

If you've got 5 minutes, don't miss this guide on how to train AI with your face 👴🤳 All you need is 10 photos and an Internet connection! Includes 20 PROMPTS 🔖 (Bookmark this for later)

TechHalla

86,185 views • 1 year ago

Right now, almost everything you do online feeds centralized AI models. Reddit posts helped train large language models. Instagram photos power image generation. Now your daily online activity is being used to automate work itself. Action Model is pushing back with a community-owned AI model, where users stay in control and own what they help train. - Train passively or guide it step-by-step - Private data stays masked and in your control - Review, edit, or delete training anytime This isn’t a vision, it’s the standard the future of AI should be built on.

Right now, almost everything you do online feeds centralized AI models. Reddit posts helped train large language models. Instagram photos power image generation. Now your daily online activity is being used to automate work itself. Action Model is pushing back with a community-owned AI model, where users stay in control and own what they help train. - Train passively or guide it step-by-step - Private data stays masked and in your control - Review, edit, or delete training anytime This isn’t a vision, it’s the standard the future of AI should be built on.

Action Model

80,783 views • 5 months ago

AI Agents are taking over! ▶️ A step-by-step guide on how to: - Onboard $USDC to echos.fun 🤖💬 - Launch, buy, trade & send memecoins - Create your own on-chain agent aka Echo. P.S. Echos come with their own crypto wallet and X account. Enjoy! 🤖

AI Agents are taking over! ▶️ A step-by-step guide on how to: - Onboard $USDC to echos.fun 🤖💬 - Launch, buy, trade & send memecoins - Create your own on-chain agent aka Echo. P.S. Echos come with their own crypto wallet and X account. Enjoy! 🤖

Cito Zone

10,070 views • 1 year ago

#VRChat guide on how to reduce download size and texture memory by optimizing textures. Super easy to do by literally anyone, with minimal effort. The jist is, REDUCE TEXTURE SIZES! most of your textures are probably wayyyy larger than is needed. Part 1/2

#VRChat guide on how to reduce download size and texture memory by optimizing textures. Super easy to do by literally anyone, with minimal effort. The jist is, REDUCE TEXTURE SIZES! most of your textures are probably wayyyy larger than is needed. Part 1/2

Liindy

38,410 views • 2 years ago