Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

I've been playing more with this depth map motion transfer workflow, and if you're trying to recreate really specific body movements from a reference video, this works surprisingly well. Here's the workflow: 1. Grab your reference video, then create your character and environment references. 2. Run the video through... Depth Anything on fal to generate a depth map: 3. Drop that depth map into Seedance Omni as your motion reference along with your character and environment references. You don't even need the original video. I also tested this against using the original video as the motion reference in Seedance, and there's definitely a noticeable difference. One thing I found, though, is that this works much better for body movement than facial performance since the depth map can't really capture subtle facial motion. I'm running more tests to see if there's a good way to control both body movement and facial performance. If you have any workflows I should try, do share in the comments!show more

Curious Refuge

23,004 subscribers

16,801 Aufrufe • vor 3 Monaten •via X (Twitter)

Kunst Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von Alex

Alexvor 3 Monaten

what type of prompt do you use for something like this?

Profilbild von Genius💡💹🧲 🤖

Genius💡💹🧲 🤖vor 3 Monaten

Character consistency plus depth guidance is a pretty powerful combo here

Profilbild von Vini

Vinivor 3 Monaten

Recreating specific body movements this well is a real technical feat.

Profilbild von biglootpig

biglootpigvor 3 Monaten

depth map loses facial performance. not a silver bullet for all use cases

Profilbild von AI Mastery Guide

AI Mastery Guidevor 3 Monaten

Depth maps for motion instead of the video itself, clever

Profilbild von Taro Bushidō

Taro Bushidōvor 3 Monaten

Temporal consistency is the real differentiator here. Per-frame depth without it falls apart in dynamic scenes.

Profilbild von dubcreation

dubcreationvor 3 Monaten

I haven't tried this workflow yet, but have you tried feeding an audio reference along with the depth map, to see if the audio drives the lip movements?

Profilbild von madarbro

madarbrovor 3 Monaten

I tested and found that if the OG video is a slow mo then the model struggles to replicate

Profilbild von lbarqueira

lbarqueiravor 3 Monaten

Thanks. What shall be the prompt to generate the video in Seedance?

Profilbild von Trust⭕️

Trust⭕️vor 3 Monaten

This is wild

Profilbild von Sky Lu (Founder, Sky Studio)

Sky Lu (Founder, Sky Studio)vor 3 Monaten

why can’t just use video editing? Depth map make it more accurate?

Ähnliche Videos

We just tested what might be the most accurate motion transfer workflow we've seen so far. It's a little more involved than a standard workflow, but the results are pretty impressive. Here's the basic workflow: 1. Start with your reference footage. Create character and environment references. 2. Convert the reference footage into a depth map (with Depth-Anything tool on Fal: 3. (Optional) Layer on additional guidance like colorized character masks (with Meta's Segment Anything: and or skeleton poses (with 4. Feed the depth map into Seedance 2.0 Omni as your motion reference along with your character and environment references. 5. Generate your final video. After testing several variations, the depth map workflow consistently produced the cleanest and most accurate motion transfer. If you're trying to recreate specific performances or complex movement, this is one of the closest AI workflows we've seen to achieving production-quality results.

We just tested what might be the most accurate motion transfer workflow we've seen so far. It's a little more involved than a standard workflow, but the results are pretty impressive. Here's the basic workflow: 1. Start with your reference footage. Create character and environment references. 2. Convert the reference footage into a depth map (with Depth-Anything tool on Fal: 3. (Optional) Layer on additional guidance like colorized character masks (with Meta's Segment Anything: and or skeleton poses (with 4. Feed the depth map into Seedance 2.0 Omni as your motion reference along with your character and environment references. 5. Generate your final video. After testing several variations, the depth map workflow consistently produced the cleanest and most accurate motion transfer. If you're trying to recreate specific performances or complex movement, this is one of the closest AI workflows we've seen to achieving production-quality results.

Curious Refuge

31,708 Aufrufe • vor 3 Monaten

For the facial animations in my game, I use a technique that yields results similar to L.A. Noire. To keep it simple: I first generate a facial animation video using AI like LTX 2. Then, I create a video depth map from that animation and project it onto a face mask. Using vertex displacement, the depth map dynamically deforms the face as the character speaks. The result looks good in standalone VR. I actually created this workflow long time ago:

For the facial animations in my game, I use a technique that yields results similar to L.A. Noire. To keep it simple: I first generate a facial animation video using AI like LTX 2. Then, I create a video depth map from that animation and project it onto a face mask. Using vertex displacement, the depth map dynamically deforms the face as the character speaks. The result looks good in standalone VR. I actually created this workflow long time ago:

Alex

48,829 Aufrufe • vor 8 Monaten

Exploring a new storyboard format: Depth Map Storyboards. Instead of letting Seedance 2.0 inherit the storyboard's visual style, I used a reference image to define the tone and look, while the depth-map storyboard defines the composition and camera framing. workflow + system prompt below 🧵

Exploring a new storyboard format: Depth Map Storyboards. Instead of letting Seedance 2.0 inherit the storyboard's visual style, I used a reference image to define the tone and look, while the depth-map storyboard defines the composition and camera framing. workflow + system prompt below 🧵

OAK

80,362 Aufrufe • vor 3 Monaten

Kling AI 2.6 motion control is freaking awesome. All you need is one reference video and a character image. It handles facial expressions, body movement, and timing automatically. It even maintains consistent character details across frames. Here’s the full workflow 👇 1/6 #Kling #KlingAI

Kling AI 2.6 motion control is freaking awesome. All you need is one reference video and a character image. It handles facial expressions, body movement, and timing automatically. It even maintains consistent character details across frames. Here’s the full workflow 👇 1/6 #Kling #KlingAI

AshutoshShrivastava

31,682 Aufrufe • vor 9 Monaten

Comment BLENDER, for the installation guide Here’s how to connect Blender to Claude and create a video reference for Seedance 2.5, even if you’ve never used Blender before. I walk you through installing Blender, connecting it to Claude, and describing your scene to create the animation. Then we bring that video into Seedance with character and location references to generate the final result. This lets you plan your camera movement, framing, and action before spending credits on AI video generation. Save this and follow along when you set yours up. #blender #aivideo #claudeai #seedance25

Comment BLENDER, for the installation guide Here’s how to connect Blender to Claude and create a video reference for Seedance 2.5, even if you’ve never used Blender before. I walk you through installing Blender, connecting it to Claude, and describing your scene to create the animation. Then we bring that video into Seedance with character and location references to generate the final result. This lets you plan your camera movement, framing, and action before spending credits on AI video generation. Save this and follow along when you set yours up. #blender #aivideo #claudeai #seedance25

Victor C

553,400 Aufrufe • vor 1 Monat

Guide your visual styles with images in Google Flow. Here’s how: First, upload or generate a video using Omni 1.1 Flash (landscapes and environments work best). Then, upload or generate a color reference image that has the palette you want. Match the style: Drag both your video and reference image into your prompt and write: "Adapt this video into the same color style of this image," using the @ symbol to directly tag your reference asset. Lock the details: To keep your scene consistent, add "keep camera motion and environment the same.” Give style-transferring a spin in Google Flow!

Guide your visual styles with images in Google Flow. Here’s how: First, upload or generate a video using Omni 1.1 Flash (landscapes and environments work best). Then, upload or generate a color reference image that has the palette you want. Match the style: Drag both your video and reference image into your prompt and write: "Adapt this video into the same color style of this image," using the @ symbol to directly tag your reference asset. Lock the details: To keep your scene consistent, add "keep camera motion and environment the same.” Give style-transferring a spin in Google Flow!

Google Flow

13,235 Aufrufe • vor 25 Tagen

I just tested Motion Sync on Yapper and I like the cinematic Video made in minutes. Let me show you how you can do it 👇 Step 1: Open Step 2: Click on video and select Motion Sync. Then, ✅️Select base video Pick a video with the movement you want — this will drive the animation. ✅️Add reference image Upload your character or image you want to bring to life. ✅️Generate video Hit generate and watch your idea turn into a smooth motion sync clip. Simple, fast, and actually fun to experiment with.

I just tested Motion Sync on Yapper and I like the cinematic Video made in minutes. Let me show you how you can do it 👇 Step 1: Open Step 2: Click on video and select Motion Sync. Then, ✅️Select base video Pick a video with the movement you want — this will drive the animation. ✅️Add reference image Upload your character or image you want to bring to life. ✅️Generate video Hit generate and watch your idea turn into a smooth motion sync clip. Simple, fast, and actually fun to experiment with.

Leonardo

50,931 Aufrufe • vor 6 Monaten

Ran SCAIL-2 through a bunch of tests, it's extremely prompt-adherent, the motion capture is extremely impressive. Definitely recommend playing with this if you're looking to do motion transfer into a reference image.

Ran SCAIL-2 through a bunch of tests, it's extremely prompt-adherent, the motion capture is extremely impressive. Definitely recommend playing with this if you're looking to do motion transfer into a reference image.

Purz.ai

51,430 Aufrufe • vor 4 Monaten

I wanted to experiment with the image-to-video workflow on Pixmax using Seedance 2.5, and the results genuinely impressed me🔥 I created this short Lay’s commercial from just a couple of reference images, building a playful family story around them. What I really like about the workflow is the control over the environment, product and storytelling while still getting natural-looking motion.

I wanted to experiment with the image-to-video workflow on Pixmax using Seedance 2.5, and the results genuinely impressed me🔥 I created this short Lay’s commercial from just a couple of reference images, building a playful family story around them. What I really like about the workflow is the control over the environment, product and storytelling while still getting natural-looking motion.

Isabella

47,389 Aufrufe • vor 2 Monaten

How to extend videos using Seedance 2.0 in 3 easy steps 🦄 1. Generate video 1 (e.g. 15 seconds). 2. Use video 1 as a reference when generating video 2. 3. In the prompt for video two, start with "Continue this video". Both videos should have reference images of your characters. Here's a 30 second clip made with two 15 second generations. Workflow in comments below.

How to extend videos using Seedance 2.0 in 3 easy steps 🦄 1. Generate video 1 (e.g. 15 seconds). 2. Use video 1 as a reference when generating video 2. 3. In the prompt for video two, start with "Continue this video". Both videos should have reference images of your characters. Here's a 30 second clip made with two 15 second generations. Workflow in comments below.

Martin LeBlanc

25,133 Aufrufe • vor 6 Monaten

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.

Blaine Brown

1,469,030 Aufrufe • vor 2 Jahren

Character Animation is live on Customuse. → Describe a movement to generate a 3D animation. → Turn a reference video into character motion. → Create perfect animations for any Humanoid character → Full support of Roblox R6 and R15 rigs. Game-ready, editable generations. Bring your character creation and animation into the same Customuse workflow.

Character Animation is live on Customuse. → Describe a movement to generate a 3D animation. → Turn a reference video into character motion. → Create perfect animations for any Humanoid character → Full support of Roblox R6 and R15 rigs. Game-ready, editable generations. Bring your character creation and animation into the same Customuse workflow.

Customuse

127,464 Aufrufe • vor 1 Monat

Midjourney v8.2 + GPT Image 2 + Seedance 2.5 This video was created using one character reference and one environment reference. You can find the Midjourney, the character sheet and the Seedance 2.5 prompts below. Created with Seedance 2.5 on Astorie AI

Midjourney v8.2 + GPT Image 2 + Seedance 2.5 This video was created using one character reference and one environment reference. You can find the Midjourney, the character sheet and the Seedance 2.5 prompts below. Created with Seedance 2.5 on Astorie AI

Kōda

68,533 Aufrufe • vor 3 Monaten

Ok, this is absurd. You can choreograph a complex action scene in Blender with basic shapes, then let Seedance make it real. You need to try this AI filmmaking workflow: 1. Generate a start frame in Midjourney 2. Block out the action in Blender 3. Feed both to Seedance My Blender reference was just rough timing, camera shake, and spatial choreography, and Seedance tracked the speed, motion, and action way better than I expected. This is the difference between describing a shot and directing one.

Ok, this is absurd. You can choreograph a complex action scene in Blender with basic shapes, then let Seedance make it real. You need to try this AI filmmaking workflow: 1. Generate a start frame in Midjourney 2. Block out the action in Blender 3. Feed both to Seedance My Blender reference was just rough timing, camera shake, and spatial choreography, and Seedance tracked the speed, motion, and action way better than I expected. This is the difference between describing a shot and directing one.

Reid Hannaford

540,704 Aufrufe • vor 4 Monaten

Seedance 2.0 vs Gemini Omni, tested under the same conditions 👀 I was working on a new storyboard. After generating it with Seedance 2.0, I gave the exact same prompt + storyboard reference + character reference to Gemini Omni as well. Result: Gemini Omni surprised me with style quality and got closer than I expected in prompt adherence. But Seedance still feels ahead for storyboard execution, motion energy, camera language and environmental interaction. Gemini looks good. Seedance feels directed. You can see them in the video and the storyboard sheet is shown at the end. Which one do you think is more useful for this kind of work?

Seedance 2.0 vs Gemini Omni, tested under the same conditions 👀 I was working on a new storyboard. After generating it with Seedance 2.0, I gave the exact same prompt + storyboard reference + character reference to Gemini Omni as well. Result: Gemini Omni surprised me with style quality and got closer than I expected in prompt adherence. But Seedance still feels ahead for storyboard execution, motion energy, camera language and environmental interaction. Gemini looks good. Seedance feels directed. You can see them in the video and the storyboard sheet is shown at the end. Which one do you think is more useful for this kind of work?

Kōda

36,437 Aufrufe • vor 5 Monaten

Same shot. New character. With Recast in ElevenCreative, swap the character in any shot. Everything else stays exactly as it was: lighting, composition, motion, camera movement, cuts, and even the original audio. Upload your video and a reference photo of the new character. Recast does the rest.

Same shot. New character. With Recast in ElevenCreative, swap the character in any shot. Everything else stays exactly as it was: lighting, composition, motion, camera movement, cuts, and even the original audio. Upload your video and a reference photo of the new character. Recast does the rest.

ElevenCreative

625,989 Aufrufe • vor 1 Monat

FIRST TEST Seedance 2.0! From my initial tests, this is one of the more impressive AI video models I’ve tried so far. Dynamic motion feels fluid, prompt adherence is solid, and the efficiency really stood out, very little iteration needed. Everything you see here was generated using just one reference image + one prompt. I also tested a 3×3 image grid with no prompt at all, and the results stayed surprisingly consistent. Another highlight: sound design is already included, and it actually works really well. Tested via BytePlus 👉 More detail and access link to try Seedance 2.0 is in the comments.

FIRST TEST Seedance 2.0! From my initial tests, this is one of the more impressive AI video models I’ve tried so far. Dynamic motion feels fluid, prompt adherence is solid, and the efficiency really stood out, very little iteration needed. Everything you see here was generated using just one reference image + one prompt. I also tested a 3×3 image grid with no prompt at all, and the results stayed surprisingly consistent. Another highlight: sound design is already included, and it actually works really well. Tested via BytePlus 👉 More detail and access link to try Seedance 2.0 is in the comments.

Dinda Prasetyo

45,450 Aufrufe • vor 9 Monaten

while everyone was busy making bizarre AI characters, this creator found a MUCH bigger angle. he made poor person look filthy RICH. 😭 and this guy looks 100% real, crazy part is that - he grew this account to 280K+ followers in just 2 days posting multiple times a day. these videos are EXPLODING right now because they immediately catch the attention. and these videos are soo simple to make. here is the step by step workflow: STEP 1: find an interesting character reference on Pinterest and use it as inspiration to create your own original character. then attach the reference to ChatGPT and ask: "create a realistic character sheet for an original character inspired by this reference. use 3 panels against a clean studio background: full-body front view with no head visible, full-body back view with the head visible, and a close-up shot of the face." STEP 2: find a viral luxury or rich lifestyle video, then swap your character into it with Higgsfield Genjutsu. use this prompt: "replace the person in @ video1 with the character from @ image1. keep the same motion, camera movement, lighting, framing, color grading, environment, and overall video quality." this prompt makes it look 100% real. DONE. this is it.

while everyone was busy making bizarre AI characters, this creator found a MUCH bigger angle. he made poor person look filthy RICH. 😭 and this guy looks 100% real, crazy part is that - he grew this account to 280K+ followers in just 2 days posting multiple times a day. these videos are EXPLODING right now because they immediately catch the attention. and these videos are soo simple to make. here is the step by step workflow: STEP 1: find an interesting character reference on Pinterest and use it as inspiration to create your own original character. then attach the reference to ChatGPT and ask: "create a realistic character sheet for an original character inspired by this reference. use 3 panels against a clean studio background: full-body front view with no head visible, full-body back view with the head visible, and a close-up shot of the face." STEP 2: find a viral luxury or rich lifestyle video, then swap your character into it with Higgsfield Genjutsu. use this prompt: "replace the person in @ video1 with the character from @ image1. keep the same motion, camera movement, lighting, framing, color grading, environment, and overall video quality." this prompt makes it look 100% real. DONE. this is it.

ViralOps

545,827 Aufrufe • vor 1 Monat

Comment BLENDER How much does it actually cost to make an AI video with this workflow? I connected Claude to Blender to build a 15-second reference of a samurai walking through torii gates, with the camera movements planned in 3D. Then I created the character and environment references in ChatGPT and used Seedance 2.5 to turn it all into the final video. Blender is free, and you can generate the reference images within ChatGPT’s free limits. Building my scene used around 2% of my weekly quota on Claude’s $20/month plan, before edits. The final generation cost 2,280 credits on OpenArt, roughly $5.32 on my plan. Without the video reference, it would have been about $4.56. So I paid around 76 cents extra to guide the camera and movement with my Blender clip. Would you use this workflow for more control, or stick to text prompts and hope for the best? #blender #aivideo #claudeai #seedance25

Comment BLENDER How much does it actually cost to make an AI video with this workflow? I connected Claude to Blender to build a 15-second reference of a samurai walking through torii gates, with the camera movements planned in 3D. Then I created the character and environment references in ChatGPT and used Seedance 2.5 to turn it all into the final video. Blender is free, and you can generate the reference images within ChatGPT’s free limits. Building my scene used around 2% of my weekly quota on Claude’s $20/month plan, before edits. The final generation cost 2,280 credits on OpenArt, roughly $5.32 on my plan. Without the video reference, it would have been about $4.56. So I paid around 76 cents extra to guide the camera and movement with my Blender clip. Would you use this workflow for more control, or stick to text prompts and hope for the best? #blender #aivideo #claudeai #seedance25

Victor C

48,600 Aufrufe • vor 5 Tagen

Trick with Seedance 2 Omni ref on Runway • First clip text to video or your ref images. • Upload the first clip as your reference and prompt "Continue from the last frame of the input video keeping the character and environment consistent" + (extend your story)

Trick with Seedance 2 Omni ref on Runway • First clip text to video or your ref images. • Upload the first clip as your reference and prompt "Continue from the last frame of the input video keeping the character and environment consistent" + (extend your story)

madpencil_

14,312 Aufrufe • vor 5 Monaten