Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

Testing SCAIL-2, an open source model for motion transfer. I wanted to see how it can handle driving videos with fast, dynamic movement. The part that really impressed me was how the model retained details from the input character's outfit (especially the straps on the shorts). I attached the... show more

rob - comfyui

5,679 subscribers

29,084 просмотров • 1 месяц назад •via X (Twitter)

Искусство Наука и технологии

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

THE DEPTH MAP TRICK THAT FIXED DANCE ACCURACY IN SEEDANCE 2.0 Feed the model a video of someone dancing and it tries to interpret everything- the person, the clothes, the lighting, the room, and somewhere in there, the movement. Feed it a depth map and there's nothing left to interpret but the motion. Most creators trying to transfer a dance to a character reference the source footage directly, then wonder why the choreography drifts. The problem isn't the model - it's that you handed it ten variables when you only wanted one. Here's the workflow 1. Lock the character reference in GPT Image 2 first -face, build, costume, so identity holds independently of whatever motion gets applied to it 2. Convert the source dance footage into a depth map instead of using the raw video -this strips out the original performer's appearance, clothing, and environment entirely 3. Feed the depth map as the motion reference and the character sheet as the identity reference- two separate inputs doing two separate jobs, not one input trying to do both 5. Let the depth map carry only spatial movement -the model receives body position and momentum with no competing information about who's moving or what they look like 6. Keep the character and motion inputs isolated throughout - the moment you mix appearance data into the motion reference, the model starts negotiating between two identities Why this works • Raw footage passes the model everything at once- performer, wardrobe, room, lighting -and the choreography competes with all of it for attention • A depth map is pure spatial information, so the only thing left to transfer is movement • Separating identity from motion means the character can stay locked while the dance stays accurate - normally you're trading one for the other • The accuracy gain isn't the model getting better, it's the model getting fewer decisions to make Use cases: ⁃ Dance and choreography transfer onto original characters ⁃ Motion capture-style workflows without motion capture ⁃ Any sequence where a specific movement needs to survive intact ⁃ Character showcase content built on existing performance footage The character sheet answers who's dancing. The depth map answers how - and keeping those two questions separate is the whole trick.

THE DEPTH MAP TRICK THAT FIXED DANCE ACCURACY IN SEEDANCE 2.0 Feed the model a video of someone dancing and it tries to interpret everything- the person, the clothes, the lighting, the room, and somewhere in there, the movement. Feed it a depth map and there's nothing left to interpret but the motion. Most creators trying to transfer a dance to a character reference the source footage directly, then wonder why the choreography drifts. The problem isn't the model - it's that you handed it ten variables when you only wanted one. Here's the workflow 1. Lock the character reference in GPT Image 2 first -face, build, costume, so identity holds independently of whatever motion gets applied to it 2. Convert the source dance footage into a depth map instead of using the raw video -this strips out the original performer's appearance, clothing, and environment entirely 3. Feed the depth map as the motion reference and the character sheet as the identity reference- two separate inputs doing two separate jobs, not one input trying to do both 5. Let the depth map carry only spatial movement -the model receives body position and momentum with no competing information about who's moving or what they look like 6. Keep the character and motion inputs isolated throughout - the moment you mix appearance data into the motion reference, the model starts negotiating between two identities Why this works • Raw footage passes the model everything at once- performer, wardrobe, room, lighting -and the choreography competes with all of it for attention • A depth map is pure spatial information, so the only thing left to transfer is movement • Separating identity from motion means the character can stay locked while the dance stays accurate - normally you're trading one for the other • The accuracy gain isn't the model getting better, it's the model getting fewer decisions to make Use cases: ⁃ Dance and choreography transfer onto original characters ⁃ Motion capture-style workflows without motion capture ⁃ Any sequence where a specific movement needs to survive intact ⁃ Character showcase content built on existing performance footage The character sheet answers who's dancing. The depth map answers how - and keeping those two questions separate is the whole trick.

Nexlow

85,119 просмотров • 28 дней назад

Video Model Comparison: Image2Video Same input image + text prompt on each model: • Pika 2.0 • OpenAI Sora • Runway Gen-3 • Kling AI 1.6 • Luma Dream Machine • Hailuo MiniMax I used the same prompt that I used to generate this image in Midjourney and chose the best results for each model tested. The prompt didn't include specific camera motion, so it was interesting to see each model's interpretation:

Video Model Comparison: Image2Video Same input image + text prompt on each model: • Pika 2.0 • OpenAI Sora • Runway Gen-3 • Kling AI 1.6 • Luma Dream Machine • Hailuo MiniMax I used the same prompt that I used to generate this image in Midjourney and chose the best results for each model tested. The prompt didn't include specific camera motion, so it was interesting to see each model's interpretation:

Heather Cooper

63,079 просмотров • 1 год назад

Here it is! I wanted to make a short animation to show off the rig and model, so here's Sarahtrap from I'm Not The Purple Guy comic! Character by @TennMiddle Model, Rigging, and Animation by me! #Sarahtrap

Here it is! I wanted to make a short animation to show off the rig and model, so here's Sarahtrap from I'm Not The Purple Guy comic! Character by @TennMiddle Model, Rigging, and Animation by me! #Sarahtrap

❤️Nora Crow❤️

149,321 просмотров • 2 лет назад

Depth video workflows have been getting a lot of attention lately, so I tested one myself. Combined with Seedance 2.0, it produced more natural motion-transfer results than using Kling Motion Control directly. Why use a depth video? 1. It removes the original character and scene details, reducing copyright and sensitive-content risks. 2. It preserves the original motion, timing, and spatial structure. This separates motion extraction from visual generation, allowing you to recreate the movement with better models and any reference character. We’ve also launched a free online tool that converts regular videos into depth videos—no local setup required: In the example below, we converted a dance video from Douyin into a depth video, then regenerated it with a reference character using Seedance 2.0. The original choreography and timing are preserved, while the lighting adapts naturally to the new character and scene.

Depth video workflows have been getting a lot of attention lately, so I tested one myself. Combined with Seedance 2.0, it produced more natural motion-transfer results than using Kling Motion Control directly. Why use a depth video? 1. It removes the original character and scene details, reducing copyright and sensitive-content risks. 2. It preserves the original motion, timing, and spatial structure. This separates motion extraction from visual generation, allowing you to recreate the movement with better models and any reference character. We’ve also launched a free online tool that converts regular videos into depth videos—no local setup required: In the example below, we converted a dance video from Douyin into a depth video, then regenerated it with a reference character using Seedance 2.0. The original choreography and timing are preserved, while the lighting adapts naturally to the new character and scene.

underwood

15,968 просмотров • 12 дней назад

New Model! Egyptian Girl I made the model according to an art on Pinterest I learned a lot about how to make better hair. #lowpoly #blender #character #3DModel #animation

New Model! Egyptian Girl I made the model according to an art on Pinterest I learned a lot about how to make better hair. #lowpoly #blender #character #3DModel #animation

DrawnArtBen

41,107 просмотров • 1 год назад

Seedance 2.0 has the most accurate character swap available in my opinion. It's managed to maintain complete scene continuity. I can't see anything else that has changed in the entire scene. It's also maintained accurate camera motion and character movement and just swapped out the character as instructed. The best way to see accuracy is to showcase both clips. All you have to do is upload the video you want to replace the character in as an OMNI Reference and an image of the character to replace them with and type in the following prompt and adjust as needed: Keep the scene the same but just swap the women with the grey shirt with a completely different person, it's the black female in Image1 wearing a dark blue knitted sweater. #CapCutSeedance2 CapCut

Seedance 2.0 has the most accurate character swap available in my opinion. It's managed to maintain complete scene continuity. I can't see anything else that has changed in the entire scene. It's also maintained accurate camera motion and character movement and just swapped out the character as instructed. The best way to see accuracy is to showcase both clips. All you have to do is upload the video you want to replace the character in as an OMNI Reference and an image of the character to replace them with and type in the following prompt and adjust as needed: Keep the scene the same but just swap the women with the grey shirt with a completely different person, it's the black female in Image1 wearing a dark blue knitted sweater. #CapCutSeedance2 CapCut

Travis Davids

23,267 просмотров • 4 месяцев назад

Kling 3 is a remarkable model. This was a one-shot generation from an input image and text prompts - the model retained character, scene, and voice consistency across cuts 🤯 IMO this is a step-function change in capabilities. If you haven't tried it yet, head over to fal!

Kling 3 is a remarkable model. This was a one-shot generation from an input image and text prompts - the model retained character, scene, and voice consistency across cuts 🤯 IMO this is a step-function change in capabilities. If you haven't tried it yet, head over to fal!

Justine Moore

16,571 просмотров • 6 месяцев назад

Testing out runway’s first frame as a relighting tool. I relit the frame with Magnific. The Magnific relight isn’t perfect and can change the character a bit but it seems like the runway part stays pretty true to the input.

Testing out runway’s first frame as a relighting tool. I relit the frame with Magnific. The Magnific relight isn’t perfect and can change the character a bit but it seems like the runway part stays pretty true to the input.

Jon Finger

23,834 просмотров • 1 год назад

i built an open world minigame that's controlled with hand movements only here's a step-by-step tutorial: > started with my mediapipe + threejs template (see QT) > added a 3D model made by quaternius > sent a few prompts to gemini 3... --- prompt #1: repurpose the attached script, but now I want to import a gltf model (assets/model.gltf) and use that in the scene instead of the cube when the user moves their hand, a waypoint indicator should move around the scene, and the 3D model should smoothly move there when the user makes a fist, the model should jump the 3D model contains bundled animations in it. use the "idle", "run", and "jump" animations --- prompt #2: make this a procedural open world adventure. generate very simple procedural voxel terrain when the model gets near the edges of the screen, the camera should move, allowing the model to keep going in that direction --- prompt #3: add some floating glowing gems around the map that the user can collect --- i made some manual tweaks for styling and game feel, but that's the gist of it thanks for reading if you got all the way here full code is available at my link in bio

i built an open world minigame that's controlled with hand movements only here's a step-by-step tutorial: > started with my mediapipe + threejs template (see QT) > added a 3D model made by quaternius > sent a few prompts to gemini 3... --- prompt #1: repurpose the attached script, but now I want to import a gltf model (assets/model.gltf) and use that in the scene instead of the cube when the user moves their hand, a waypoint indicator should move around the scene, and the 3D model should smoothly move there when the user makes a fist, the model should jump the 3D model contains bundled animations in it. use the "idle", "run", and "jump" animations --- prompt #2: make this a procedural open world adventure. generate very simple procedural voxel terrain when the model gets near the edges of the screen, the camera should move, allowing the model to keep going in that direction --- prompt #3: add some floating glowing gems around the map that the user can collect --- i made some manual tweaks for styling and game feel, but that's the gist of it thanks for reading if you got all the way here full code is available at my link in bio

AA

131,799 просмотров • 8 месяцев назад

Here's a good example of how you can use Seedance 2 to edit videos. In the opening shot of the Thriller movie clip I posted last night, I had a generation that was perfect, with the exception of a man entering the scene at the end, and running past the woman. Didn't want that! So, I uploaded the video into Seedance 2's Omnireference on Dreamina AI and used the following prompt, which worked like a charm! The "EDIT THE VIDEO - remove the man in the white shirt who enters the scene at 00:07 seconds. The woman in the yellow dress is the only character we should see in this scene. Maintain all other details." Before (left) and After (right).

Here's a good example of how you can use Seedance 2 to edit videos. In the opening shot of the Thriller movie clip I posted last night, I had a generation that was perfect, with the exception of a man entering the scene at the end, and running past the woman. Didn't want that! So, I uploaded the video into Seedance 2's Omnireference on Dreamina AI and used the following prompt, which worked like a charm! The "EDIT THE VIDEO - remove the man in the white shirt who enters the scene at 00:07 seconds. The woman in the yellow dress is the only character we should see in this scene. Maintain all other details." Before (left) and After (right).

Christopher Gwinn | Grindhouse Glitch

43,995 просмотров • 4 месяцев назад

gemini omniflash is actually f*cking cracked. you can animate/edit any video with a text prompt. character swaps, object transforms, full environment changes without regenerating/rotoscoping. everyone using AI to to animate and edit videos right now hits the same wall. the clip comes out 90% right and you regenerate from scratch hoping the 10% fixes itself. it never does. the fix is using your video as the input. omniflash edits what's already there instead of rolling the dice again. here's what's in the system: > the two-layer premiere trick: generate the same shot twice (one with background removed), stack them, cut at one frame, instant scene change > character swap with a single reference image (plus the one line you need or the model keeps the original's features) > object transforms that leave the rest of the frame untouched: stone into glowing sphere, candles into flowers > style transfer from an image reference instead of text, way more accurate > why stacking edits in one prompt breaks everything and the exact step order that doesn't > the audio limitation nobody mentions and how to work around it i packaged every prompt, the edit sequence, and the premiere layering setup. RT + reply "OMNI" and i'll send it over.

gemini omniflash is actually f*cking cracked. you can animate/edit any video with a text prompt. character swaps, object transforms, full environment changes without regenerating/rotoscoping. everyone using AI to to animate and edit videos right now hits the same wall. the clip comes out 90% right and you regenerate from scratch hoping the 10% fixes itself. it never does. the fix is using your video as the input. omniflash edits what's already there instead of rolling the dice again. here's what's in the system: > the two-layer premiere trick: generate the same shot twice (one with background removed), stack them, cut at one frame, instant scene change > character swap with a single reference image (plus the one line you need or the model keeps the original's features) > object transforms that leave the rest of the frame untouched: stone into glowing sphere, candles into flowers > style transfer from an image reference instead of text, way more accurate > why stacking edits in one prompt breaks everything and the exact step order that doesn't > the audio limitation nobody mentions and how to work around it i packaged every prompt, the edit sequence, and the premiere layering setup. RT + reply "OMNI" and i'll send it over.

Sulfur

36,326 просмотров • 1 месяц назад

So remember that time machine I told you about? I managed to sneek out another video from my visit to the future.. this time I captured video of a 3d artist creating assets for a short commercial. They sculpted the bird in the video with nothing but two controllers which they used to manipulate generative matter in 3d. The AI model changed in realtime and adopted their style of work, both based on the work they did on the scene, and on reference images they gave the system. Seeing the 3d model transform in realtime as they were working on it was incredible. When it started moving and reacted to their instructions, I knew it was time to return to the present :D #art #ai

So remember that time machine I told you about? I managed to sneek out another video from my visit to the future.. this time I captured video of a 3d artist creating assets for a short commercial. They sculpted the bird in the video with nothing but two controllers which they used to manipulate generative matter in 3d. The AI model changed in realtime and adopted their style of work, both based on the work they did on the scene, and on reference images they gave the system. Seeing the 3d model transform in realtime as they were working on it was incredible. When it started moving and reacted to their instructions, I knew it was time to return to the present :D #art #ai

Martin Nebelong

22,044 просмотров • 2 лет назад

I noticed that in Runway’s Seedance 2.0 model, we can actually reference photos that include human faces. I have no idea how they managed to overcome this. By the way, there’s no information here about whether they’re using the fast version of Seedance 2.0 or the higher/pro model. I wish they had specified that too.

I noticed that in Runway’s Seedance 2.0 model, we can actually reference photos that include human faces. I have no idea how they managed to overcome this. By the way, there’s no information here about whether they’re using the fast version of Seedance 2.0 or the higher/pro model. I wish they had specified that too.

Ozan Sihay

22,630 просмотров • 4 месяцев назад

Sometimes the game doesn't register your inputs at all. In this clip you can see me trying to open the map by pressing the start button, but the game doesn't response; only when I gave an input with my left analog stick and my character started moving the map was opened...

Sometimes the game doesn't register your inputs at all. In this clip you can see me trying to open the map by pressing the start button, but the game doesn't response; only when I gave an input with my left analog stick and my character started moving the map was opened...

Peppo

30,085 просмотров • 1 год назад

Dear Tesla AI, I am on I-95 South near Washington DC. I just disengaged my Tesla because I thought it was confusing the shoulder for a lane. I logged the disengagement as critical. As you can see in the video below, it turns out that once again, I’ve mistakenly assumed my meat brain knows better than your AI model. I wanted to let you know that this disengagement can be removed from the statistics, as it once again turns out that I am the fool. Sorry about that. Thank you for reading.

Dear Tesla AI, I am on I-95 South near Washington DC. I just disengaged my Tesla because I thought it was confusing the shoulder for a lane. I logged the disengagement as critical. As you can see in the video below, it turns out that once again, I’ve mistakenly assumed my meat brain knows better than your AI model. I wanted to let you know that this disengagement can be removed from the statistics, as it once again turns out that I am the fool. Sorry about that. Thank you for reading.

Mike P

292,403 просмотров • 1 месяц назад

That awkward moment when you accidentally like a post… Today I wanted to share a new little slice-of-life scene I created with @MartiniArt_ via Seedance. I really like the fact that the whole workflow is centralized in one place.Importing 2D characters, converting them into 3D, creating reference shots, testing animations… Everything works through a node-based system, which makes it easy to get a clear overview and iterate quickly from one model to another.

That awkward moment when you accidentally like a post… Today I wanted to share a new little slice-of-life scene I created with @MartiniArt_ via Seedance. I really like the fact that the whole workflow is centralized in one place.Importing 2D characters, converting them into 3D, creating reference shots, testing animations… Everything works through a node-based system, which makes it easy to get a clear overview and iterate quickly from one model to another.

Anima

91,459 просмотров • 5 месяцев назад

NVIDIA finally released Neuralangelo's source code! The model can turn videos from any device into detailed 3D structures, fully replicating buildings, sculptures, or other real aworld objects or spaces virtually. Here's how it works: A model utilizes a 2D video with multiple angles of an object or scene. I selects frames from different viewpoints to understand depth, size, and shape. The AI creates an initial 3D representation, similar to a sculptor shaping a subject. The render is optimized to enhance details, like a sculptor refining texture. The outcome is a 3D object or scene suitable for virtual reality, digital twins, or robotics.

NVIDIA finally released Neuralangelo's source code! The model can turn videos from any device into detailed 3D structures, fully replicating buildings, sculptures, or other real aworld objects or spaces virtually. Here's how it works: A model utilizes a 2D video with multiple angles of an object or scene. I selects frames from different viewpoints to understand depth, size, and shape. The AI creates an initial 3D representation, similar to a sculptor shaping a subject. The render is optimized to enhance details, like a sculptor refining texture. The outcome is a 3D object or scene suitable for virtual reality, digital twins, or robotics.

Lior Alexander

478,052 просмотров • 3 лет назад

This one was made with Seedance 2.0 Fast via Dreamina. This is pure Omni-Reference. The only character sheet I used was for these girls, Sari and Ploy. The dude with sarung here and the location were 100% prompted. I didn’t use a character sheet or reference for either of them. Even in Fast mode, Seedance 2.0 is bloody good and it still nails the hyper-vernacular vibe that I always aim for in my work. Seedance 2.0 is both exciting and scary for me 😆 It’s exciting because it is undoubtedly the best model currently available on the market. Trust me, you’ve seen the videos I’ve made so far right? The performance of the model It’s simply the best, period. It has helped me tremendously in creating a shit ton of stories about the region where I live, Southeast Asia. It has been the most exciting thing ever. The scary part is whenever a platform or company comes to me saying, “Hey, we have this new video model. Blah blah blah. We’ll let you know more soon.” It scares the shit out of me because the big question is whether it will be better than Seedance 2.0??? 😆😆 If not, I don’t even want to bother using it. I’ve come this far and achieved this level of quality with Seedance 2.0. That’s why I skipped Happy Horse, which I already tested. It’s also why I’m not bothering with Wan or anything else for now. Their current models are still far inferior to what we already get with Seedance 2.0. I don’t want to downgrade the visual quality. This is also why I need to be really honest. There are certain platforms that host their own in-house models and i'm still part of their CPP. However, because those models are still far behind the quality of Seedance 2.0, I haven’t used them that much. Seedance 2.0 has simply become the benchmark for me. The type of output I’m looking for is also extremely specific, so I can immediately feel it when a model cannot deliver what I need. Seedance 2.0 is definitely not cheap, but it gives me so much creative satisfaction and allows me to make whatever I want. I even have a team that low-key makes softcore erotic videos in the style of Vivamax 😆 I think I’ve trimmed down so many things in my AI workflow because my main goal is to focus on the content itself. If Seedance 2.0 Mini is released soon, I’m dead curious to test it. I think I want to create more stories that revolve around drama rather than highly technical cinematic shots. Seedance 2.0 Fast has been incredibly helpful, but I’m definitely curious to check out the Mini version. But the truth is that I’m completely tool-agnostic. I don’t care which company makes the model. I only care about the quality. You might remember when I praised Grok Imagine Video so damn hard because it was genuinely amazing back then. Then the quality kept getting worse and worse, so I stopped using it. But if it gets better again, I’ll definitely want to use it again. At the end of the day, quality is the only thing that matters.

This one was made with Seedance 2.0 Fast via Dreamina. This is pure Omni-Reference. The only character sheet I used was for these girls, Sari and Ploy. The dude with sarung here and the location were 100% prompted. I didn’t use a character sheet or reference for either of them. Even in Fast mode, Seedance 2.0 is bloody good and it still nails the hyper-vernacular vibe that I always aim for in my work. Seedance 2.0 is both exciting and scary for me 😆 It’s exciting because it is undoubtedly the best model currently available on the market. Trust me, you’ve seen the videos I’ve made so far right? The performance of the model It’s simply the best, period. It has helped me tremendously in creating a shit ton of stories about the region where I live, Southeast Asia. It has been the most exciting thing ever. The scary part is whenever a platform or company comes to me saying, “Hey, we have this new video model. Blah blah blah. We’ll let you know more soon.” It scares the shit out of me because the big question is whether it will be better than Seedance 2.0??? 😆😆 If not, I don’t even want to bother using it. I’ve come this far and achieved this level of quality with Seedance 2.0. That’s why I skipped Happy Horse, which I already tested. It’s also why I’m not bothering with Wan or anything else for now. Their current models are still far inferior to what we already get with Seedance 2.0. I don’t want to downgrade the visual quality. This is also why I need to be really honest. There are certain platforms that host their own in-house models and i'm still part of their CPP. However, because those models are still far behind the quality of Seedance 2.0, I haven’t used them that much. Seedance 2.0 has simply become the benchmark for me. The type of output I’m looking for is also extremely specific, so I can immediately feel it when a model cannot deliver what I need. Seedance 2.0 is definitely not cheap, but it gives me so much creative satisfaction and allows me to make whatever I want. I even have a team that low-key makes softcore erotic videos in the style of Vivamax 😆 I think I’ve trimmed down so many things in my AI workflow because my main goal is to focus on the content itself. If Seedance 2.0 Mini is released soon, I’m dead curious to test it. I think I want to create more stories that revolve around drama rather than highly technical cinematic shots. Seedance 2.0 Fast has been incredibly helpful, but I’m definitely curious to check out the Mini version. But the truth is that I’m completely tool-agnostic. I don’t care which company makes the model. I only care about the quality. You might remember when I praised Grok Imagine Video so damn hard because it was genuinely amazing back then. Then the quality kept getting worse and worse, so I stopped using it. But if it gets better again, I’ll definitely want to use it again. At the end of the day, quality is the only thing that matters.

MXVDXN // DAN

18,949 просмотров • 2 месяцев назад

Jim Carrey drops a cosmic bombshell: "Jim Carrey is a great character, and I was lucky to get the part. But I don't think of that as me anymore." "I used to be a guy experiencing the world… now I feel like the world and the universe experiencing a guy." 19-sec clip — reality just flipped Who are you really? The character… or the one experiencing it?

Jim Carrey drops a cosmic bombshell: "Jim Carrey is a great character, and I was lucky to get the part. But I don't think of that as me anymore." "I used to be a guy experiencing the world… now I feel like the world and the universe experiencing a guy." 19-sec clip — reality just flipped Who are you really? The character… or the one experiencing it?

Camus

738,925 просмотров • 7 месяцев назад

Player stats UI animation with GPT Image 2 and MiniMax H3. This model is amazing for UI animations. Give GPT Image 2 your character image and ask it to create a stats UI. Then use that UI as a reference for MiniMax H3. You can check the prompt in the replies.

Player stats UI animation with GPT Image 2 and MiniMax H3. This model is amazing for UI animations. Give GPT Image 2 your character image and ask it to create a stats UI. Then use that UI as a reference for MiniMax H3. You can check the prompt in the replies.

Kōda

37,197 просмотров • 5 дней назад