Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Everybody speak about consistent character for video generation as Minimax, Kling etc... But nothing looking super stable. And so I trained for the first time a LoRA model on Hunyuan video model (open source) on a real person. It take approximatly 15h of training on a A100 GPU with...

OdinLovis's profile picture

Lovis Odin

8,570 subscribers

93,560 görüntüleme • 1 yıl önce •via X (Twitter)

EğitimBilim & TeknolojiOyun
LIVE

Anya Rossi• Live Now

Private livecam show

11 Yorum

Lovis profil fotoğrafı
Lovis1 yıl önce

Only train on 20 epoch for now.. impatient to see what it give on 100

Freepik profil fotoğrafı
Freepik1 yıl önce

🚀 Introducing Freepik AI video generator. Everything you need to create high-quality, physically accurate videos in one place. 🤩

Lovis profil fotoğrafı
Lovis1 yıl önce

For a lot of people asking : I am training on 50 vidéos of 2 second ( 50 frames ) , 448 px height by 576 width . You Can find some content online but I am using this library for training

Moozi profil fotoğrafı
Moozi1 yıl önce

This is great! So are you using the Lora in a text2video workflow or video2video?

Lovis profil fotoğrafı
Lovis1 yıl önce

For now only text 2 video, but next step is video to video with a real moving character cutting across different scene , using a volumetric capture.

Michele Rocchi ⚛️🤖 profil fotoğrafı
Michele Rocchi ⚛️🤖1 yıl önce

do you mind if I post this on LinkedIn? I'll obviously cite you as the author, I'm not stealing anything. if you have LinkedIn, tell me your name and I'll tag you (the post will be in Italian)

Van profil fotoğrafı
Van1 yıl önce

Question!! How much gpu vram ur computer has for this video, which laptop is better PC or Mac, & should I get a Nvidia 4090 or 3090 for comfyui video/image generator???

𓆏 profil fotoğrafı
𓆏1 yıl önce

@AlfredAlfer77 create your own Will

Andre.W profil fotoğrafı
Andre.W1 yıl önce

I think it's unnecessary to train with videos when it comes to a person, pictures are completely sufficient.

Ago-ra@AI profil fotoğrafı
Ago-ra@AI1 yıl önce

Wooooow

ElAndrew73Gamer profil fotoğrafı
ElAndrew73Gamer1 yıl önce

Can you show the flow of Comfy? I'm using it to create images with Flux, but I want to try it with videos. Thanks.

Benzer Videolar

Consistent character with Hunyuan and Skyreel! 🎥✨ In collaboration with Kartel.ai .ai, we worked on a pipeline using ComfyUI with the Hunyuan & Skyreel models—both designed for video. We first captured him volumetrically, then trained a LoRA model directly on video data, allowing us to generate sequences where a person remains consistent across shots. The goal is to maintain identity and style over time, pushing the limits of AI-generated video. Excited to explore this further! 🔥 with J. Salvatore in main actor , thank you ! #AI #GenAI #ComfyUI #LoRA #VideoGeneration #Hunyuan #Skyreel
1:28

Consistent character with Hunyuan and Skyreel! 🎥✨ In collaboration with Kartel.ai .ai, we worked on a pipeline using ComfyUI with the Hunyuan & Skyreel models—both designed for video. We first captured him volumetrically, then trained a LoRA model directly on video data, allowing us to generate sequences where a person remains consistent across shots. The goal is to maintain identity and style over time, pushing the limits of AI-generated video. Excited to explore this further! 🔥 with J. Salvatore in main actor , thank you ! #AI #GenAI #ComfyUI #LoRA #VideoGeneration #Hunyuan #Skyreel

Lovis Odin

13,348 görüntüleme • 1 yıl önce

I trained this LTX LTX 2.3 LoRA of George Costanza at home on my 5090 in about a day with AI Toolkit. I generated this 30 second video with ComfyUI on my 5090 in 6 minutes. Open source is, always has been, and always will be, the future of generative AI. (SOUND ON)
0:30

I trained this LTX LTX 2.3 LoRA of George Costanza at home on my 5090 in about a day with AI Toolkit. I generated this 30 second video with ComfyUI on my 5090 in 6 minutes. Open source is, always has been, and always will be, the future of generative AI. (SOUND ON)

Ostris

392,470 görüntüleme • 3 ay önce

Virtual try-on is the future of retail. Soon, we won’t even remember a time when we shopped without it. With Doji I created a fashion campaign with my favorite new products with myself as the model, an AI generated digital twin, and brought it to life additional AI video tools. Open to see more experiments and use cases for this technology:
0:50

Virtual try-on is the future of retail. Soon, we won’t even remember a time when we shopped without it. With Doji I created a fashion campaign with my favorite new products with myself as the model, an AI generated digital twin, and brought it to life additional AI video tools. Open to see more experiments and use cases for this technology:

Paige Piskin XR

52,666 görüntüleme • 1 yıl önce

This is the best AI video feature so far this year. I'm talking about Kling's AI video Lora model training. I spent all day today doing crazy faces, talking alone to the camera, smiling, crying, and all sorts of weird things around the house to train the best AI video model of myself. But oh boy, it is 99.9% accurate! It's also a bit strange to see myself doing all sorts of stuff in a highly realistic AI video. My next short film will be starring myself. Thank you, Kling AI, for letting me test this early. It's worth all the money.
1:05

This is the best AI video feature so far this year. I'm talking about Kling's AI video Lora model training. I spent all day today doing crazy faces, talking alone to the camera, smiling, crying, and all sorts of weird things around the house to train the best AI video model of myself. But oh boy, it is 99.9% accurate! It's also a bit strange to see myself doing all sorts of stuff in a highly realistic AI video. My next short film will be starring myself. Thank you, Kling AI, for letting me test this early. It's worth all the money.

Alex Patrascu

57,172 görüntüleme • 1 yıl önce

This is crazy! With LTX 2 in ComfyUI i was able to keep my original camera movement + it did a full lip-sync on the singing haha. All running locally. I made the original video back in 2021 when Metahumans first came out and we were working in Unreal Engine 4. This music video was some kind of result from my first experiments with Livelink and Control Rig at that time. Now the new AI improved version is not perfect and i didn’t train any lora for character consistency yet. I also didn’t have the original video file anymore so I downloaded the Youtube version as input haha. However the camera result + facial expressions are really promising! I wonder how it would handle more complex and fast shots though.
1:38

This is crazy! With LTX 2 in ComfyUI i was able to keep my original camera movement + it did a full lip-sync on the singing haha. All running locally. I made the original video back in 2021 when Metahumans first came out and we were working in Unreal Engine 4. This music video was some kind of result from my first experiments with Livelink and Control Rig at that time. Now the new AI improved version is not perfect and i didn’t train any lora for character consistency yet. I also didn’t have the original video file anymore so I downloaded the Youtube version as input haha. However the camera result + facial expressions are really promising! I wonder how it would handle more complex and fast shots though.

Jerome | InsaneUnreal

41,338 görüntüleme • 4 ay önce

🚨 AI just crossed into reality. A single human eye reflects an entire AI-generated world — futuristic cities, robots, and digital landscapes forming in real time. We are no longer imagining the future. We are actively creating it. Made with AI video generation (Kling model) on Yapper “This is not the future. It’s now.”
0:53

🚨 AI just crossed into reality. A single human eye reflects an entire AI-generated world — futuristic cities, robots, and digital landscapes forming in real time. We are no longer imagining the future. We are actively creating it. Made with AI video generation (Kling model) on Yapper “This is not the future. It’s now.”

Mimu | AI Tools & News

72,897 görüntüleme • 2 ay önce

I'm having fun adding a low poly car generated with Hunyuan 3D on Pinokio and applying my AI image projection shader to it, just to see the result.
1:01

I'm having fun adding a low poly car generated with Hunyuan 3D on Pinokio and applying my AI image projection shader to it, just to see the result.

Alex

25,040 görüntüleme • 5 ay önce

We have a new open source video model. These clips were all generated with LTX-2 on the creator's local machine 🤯 It can make clips up to 20 seconds at 4K resolution. And it speaks! (created by u/yanokusnir)
0:47

We have a new open source video model. These clips were all generated with LTX-2 on the creator's local machine 🤯 It can make clips up to 20 seconds at 4K resolution. And it speaks! (created by u/yanokusnir)

Justine Moore

617,776 görüntüleme • 5 ay önce

AI is out of control 🤣 Wan 2.1 14B model is the best open-source video model I have ever used. Been trying it on Novita AI Playground, and it's fast and the quality is good. - Better than SORA and close to Google Veo-2. - Other models like DeepSeek R1, V3, Hunyuan Video and more available.. - API access too. More details 👇
0:35

AI is out of control 🤣 Wan 2.1 14B model is the best open-source video model I have ever used. Been trying it on Novita AI Playground, and it's fast and the quality is good. - Better than SORA and close to Google Veo-2. - Other models like DeepSeek R1, V3, Hunyuan Video and more available.. - API access too. More details 👇

AshutoshShrivastava

74,350 görüntüleme • 1 yıl önce

A behind-the-scenes look at my process for creating this AI water video: On the left, I recorded myself performing all the actions and demonstrated some of my compositing techniques using masking and shape layers. On the right, you can see the final result after being generated in ComfyUI.
0:23

A behind-the-scenes look at my process for creating this AI water video: On the left, I recorded myself performing all the actions and demonstrated some of my compositing techniques using masking and shape layers. On the right, you can see the final result after being generated in ComfyUI.

enigmatic_e

145,292 görüntüleme • 1 yıl önce

We’re on a path to video of any kind being imagined by a model in real-time. Because it’s real-time generated, each video becomes fully interactive & personalized. Type or speak into the model, and the video will respond in real-time. A revolutionary form of media is emerging!
1:21

We’re on a path to video of any kind being imagined by a model in real-time. Because it’s real-time generated, each video becomes fully interactive & personalized. Type or speak into the model, and the video will respond in real-time. A revolutionary form of media is emerging!

Oliver Cameron

67,924 görüntüleme • 10 ay önce

This is Pika 2.1 🤯 This is serendipitous as Pika was one of the first Gen AI video tools I ever used. The first time I generated a video on Discord, my life changed forever. And now they have released a game-changing new model with fantastic fidelity—native 1080p. We have arrived at the future of storytelling. And I'm glad they are part of our journey. Cheers.
0:48

This is Pika 2.1 🤯 This is serendipitous as Pika was one of the first Gen AI video tools I ever used. The first time I generated a video on Discord, my life changed forever. And now they have released a game-changing new model with fantastic fidelity—native 1080p. We have arrived at the future of storytelling. And I'm glad they are part of our journey. Cheers.

Dave Clark

22,341 görüntüleme • 1 yıl önce

This is a pretty wild model! You can use it to turn an image into a 3D object with texture. The quality is out of this world! I'm not even a designer, and I've been using this nonstop for the last 2 hours. The model is Hunyuan 3D 2.1. It's open source. You'll find model weights, training/inference code, data pipelines, and architecture on their repository. You can even fine-tune it if you want! GitHub Repository: By the way, the model runs on consumer-grade GPUs. You don't need a datacenter for this! I've been using the model from the HuggingFace demo page: To use it, go to the link and upload an image. That's it! Check out the video I recorded for a couple of examples.
2:42

This is a pretty wild model! You can use it to turn an image into a 3D object with texture. The quality is out of this world! I'm not even a designer, and I've been using this nonstop for the last 2 hours. The model is Hunyuan 3D 2.1. It's open source. You'll find model weights, training/inference code, data pipelines, and architecture on their repository. You can even fine-tune it if you want! GitHub Repository: By the way, the model runs on consumer-grade GPUs. You don't need a datacenter for this! I've been using the model from the HuggingFace demo page: To use it, go to the link and upload an image. That's it! Check out the video I recorded for a couple of examples.

Santiago

44,783 görüntüleme • 1 yıl önce

🚨ELON: WE’RE ABOUT TO TRAIN A VIDEO MODEL WITH 100,000 GPUS “We expect to be training a video model with over a hundred thousand GB200s, and to begin that training within the next three or four weeks. So we're confident it's gonna be pretty spectacular in video generation and video understanding.” Source: xAI
1:58

🚨ELON: WE’RE ABOUT TO TRAIN A VIDEO MODEL WITH 100,000 GPUS “We expect to be training a video model with over a hundred thousand GB200s, and to begin that training within the next three or four weeks. So we're confident it's gonna be pretty spectacular in video generation and video understanding.” Source: xAI

Mario Nawfal

236,544 görüntüleme • 11 ay önce

This is amazing research result! Xun Huang and team trained a bidirectional teacher model for motion control, and used Self-Forcing to make it autoregressive. Xun recently gave a great talk at the Real Time Video AI summit about this work, and a few other projects around video world models. Here is the recording.
29:48

This is amazing research result! Xun Huang and team trained a bidirectional teacher model for motion control, and used Self-Forcing to make it autoregressive. Xun recently gave a great talk at the Real Time Video AI summit about this work, and a few other projects around video world models. Here is the recording.

Eric is Daydreaming

52,796 görüntüleme • 8 ay önce

💄AI Video Model Comparison: Text to Video 10 Models included: • Google Veo2 • Adobe Firefly Video • Hunyuan Video • Pika 2.1 • Wan-2.1 • Runway Gen-3 • Kling AI 1.6 • Luma Ray2 • Hailuo MiniMax • Sora (not on grid, but in the full video) I used the same prompt on each model x 4 generations and chose my favorite results below. ⭕ Prompt: A person stands in a bright, airy room, bathed in soft natural light streaming through a large window adorned with sheer white curtains. As they gaze into a shimmering mirror, their hand, elegantly manicured with a deep crimson polish, lifts a glossy lip applicator towards their lips. Their outfit, a flowing pastel blouse paired with chic high-waisted trousers, exudes effortless style, complemented by delicate gold jewelry that sparkles subtly in the light. Applying lipstick, lip gloss, or any makeup seems to be extremely difficult for AI video models. It was hard to get a usable result for many of these. This prompt was generated on Nim with the Video Describe feature, and it worked better than my original prompt. Let me know what you think of the results!
1:10

💄AI Video Model Comparison: Text to Video 10 Models included: • Google Veo2 • Adobe Firefly Video • Hunyuan Video • Pika 2.1 • Wan-2.1 • Runway Gen-3 • Kling AI 1.6 • Luma Ray2 • Hailuo MiniMax • Sora (not on grid, but in the full video) I used the same prompt on each model x 4 generations and chose my favorite results below. ⭕ Prompt: A person stands in a bright, airy room, bathed in soft natural light streaming through a large window adorned with sheer white curtains. As they gaze into a shimmering mirror, their hand, elegantly manicured with a deep crimson polish, lifts a glossy lip applicator towards their lips. Their outfit, a flowing pastel blouse paired with chic high-waisted trousers, exudes effortless style, complemented by delicate gold jewelry that sparkles subtly in the light. Applying lipstick, lip gloss, or any makeup seems to be extremely difficult for AI video models. It was hard to get a usable result for many of these. This prompt was generated on Nim with the Video Describe feature, and it worked better than my original prompt. Let me know what you think of the results!

Heather Cooper

61,177 görüntüleme • 1 yıl önce

None of the video gen models do a real CRT terminal animation look. So I trained my own with fal. CRT-anim : open-source LoRA for LTX-2.3 22B. Runs on fal + ComfyUI.
1:04

None of the video gen models do a real CRT terminal animation look. So I trained my own with fal. CRT-anim : open-source LoRA for LTX-2.3 22B. Runs on fal + ComfyUI.

Lovis Odin

41,576 görüntüleme • 2 ay önce

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.
0:25

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

Akshay 🚀

66,042 görüntüleme • 5 ay önce

Meta announces Movie Gen A Cast of Media Foundation Models We present Movie Gen, a cast of foundation models that generates high-quality, 1080p HD videos with different aspect ratios and synchronized audio. We also show additional capabilities such as precise instruction-based video editing and generation of personalized videos based on a user’s image. Our models set a new state-of-the-art on multiple tasks: text-to-video synthesis, video personalization, video editing, video-to-audio generation, and text-to-audio generation. Our largest video generation model is a 30B parameter transformer trained with a maximum context length of 73K video tokens, corresponding to a generated video of 16 seconds at 16 frames-per-second. We show multiple technical innovations and simplifications on the architecture, latent spaces, training objectives and recipes, data curation, evaluation protocols, parallelization techniques, and inference optimizations that allow us to reap the benefits of scaling pre-training data, model size, and training compute for training large scale media generation models. We hope this paper helps the research community to accelerate progress and innovation in media generation models
0:30

Meta announces Movie Gen A Cast of Media Foundation Models We present Movie Gen, a cast of foundation models that generates high-quality, 1080p HD videos with different aspect ratios and synchronized audio. We also show additional capabilities such as precise instruction-based video editing and generation of personalized videos based on a user’s image. Our models set a new state-of-the-art on multiple tasks: text-to-video synthesis, video personalization, video editing, video-to-audio generation, and text-to-audio generation. Our largest video generation model is a 30B parameter transformer trained with a maximum context length of 73K video tokens, corresponding to a generated video of 16 seconds at 16 frames-per-second. We show multiple technical innovations and simplifications on the architecture, latent spaces, training objectives and recipes, data curation, evaluation protocols, parallelization techniques, and inference optimizations that allow us to reap the benefits of scaling pre-training data, model size, and training compute for training large scale media generation models. We hope this paper helps the research community to accelerate progress and innovation in media generation models

AK

62,719 görüntüleme • 1 yıl önce

VIDEO | "The results are unbelievable, unexpected. I have been in politics since 1982. I have been MP four times, MLA five times. We have been talking to people in all the corners of Maharashtra, doing public meetings, but this result is unbelievable, unacceptable, because it is contrary to the people's emotions. We have talked to leaders, workers, journalists, all the section of the society, but nobody expected this result. The fight was between Mahayuti, and MVA. Exit polls had come, but we cannot believe this result," says Congress in-charge for Maharashtra Ramesh Chennithala (Ramesh Chennithala) expressing disbelief on Maharashtra Election Results. #ElectionResults2024WithPTI #MaharashtraElectionResults
2:29

VIDEO | "The results are unbelievable, unexpected. I have been in politics since 1982. I have been MP four times, MLA five times. We have been talking to people in all the corners of Maharashtra, doing public meetings, but this result is unbelievable, unacceptable, because it is contrary to the people's emotions. We have talked to leaders, workers, journalists, all the section of the society, but nobody expected this result. The fight was between Mahayuti, and MVA. Exit polls had come, but we cannot believe this result," says Congress in-charge for Maharashtra Ramesh Chennithala (Ramesh Chennithala) expressing disbelief on Maharashtra Election Results. #ElectionResults2024WithPTI #MaharashtraElectionResults

Press Trust of India

86,782 görüntüleme • 1 yıl önce