Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

I've been playing more with this depth map motion transfer workflow, and if you're trying to recreate really specific body movements from a reference video, this works surprisingly well. Here's the workflow: 1. Grab your reference video, then create your character and environment references. 2. Run the video through...

CuriousRefuge's profile picture

Curious Refuge

23,004 subscribers

16,801 görüntüleme • 2 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

11 Yorum

Alex profil fotoğrafı
Alex2 ay önce

what type of prompt do you use for something like this?

Genius💡💹🧲 🤖 profil fotoğrafı
Genius💡💹🧲 🤖2 ay önce

Character consistency plus depth guidance is a pretty powerful combo here

Vini profil fotoğrafı
Vini2 ay önce

Recreating specific body movements this well is a real technical feat.

biglootpig profil fotoğrafı
biglootpig2 ay önce

depth map loses facial performance. not a silver bullet for all use cases

AI Mastery Guide profil fotoğrafı
AI Mastery Guide2 ay önce

Depth maps for motion instead of the video itself, clever

Taro Bushidō profil fotoğrafı
Taro Bushidō2 ay önce

Temporal consistency is the real differentiator here. Per-frame depth without it falls apart in dynamic scenes.

dubcreation profil fotoğrafı
dubcreation2 ay önce

I haven't tried this workflow yet, but have you tried feeding an audio reference along with the depth map, to see if the audio drives the lip movements?

madarbro profil fotoğrafı
madarbro2 ay önce

I tested and found that if the OG video is a slow mo then the model struggles to replicate

lbarqueira profil fotoğrafı
lbarqueira2 ay önce

Thanks. What shall be the prompt to generate the video in Seedance?

Trust⭕️ profil fotoğrafı
Trust⭕️2 ay önce

This is wild

Sky Lu (Founder, Sky Studio) profil fotoğrafı
Sky Lu (Founder, Sky Studio)2 ay önce

why can’t just use video editing? Depth map make it more accurate?

Benzer Videolar

We just tested what might be the most accurate motion transfer workflow we've seen so far. It's a little more involved than a standard workflow, but the results are pretty impressive. Here's the basic workflow: 1. Start with your reference footage. Create character and environment references. 2. Convert the reference footage into a depth map (with Depth-Anything tool on Fal: 3. (Optional) Layer on additional guidance like colorized character masks (with Meta's Segment Anything: and or skeleton poses (with 4. Feed the depth map into Seedance 2.0 Omni as your motion reference along with your character and environment references. 5. Generate your final video. After testing several variations, the depth map workflow consistently produced the cleanest and most accurate motion transfer. If you're trying to recreate specific performances or complex movement, this is one of the closest AI workflows we've seen to achieving production-quality results.
11:34

We just tested what might be the most accurate motion transfer workflow we've seen so far. It's a little more involved than a standard workflow, but the results are pretty impressive. Here's the basic workflow: 1. Start with your reference footage. Create character and environment references. 2. Convert the reference footage into a depth map (with Depth-Anything tool on Fal: 3. (Optional) Layer on additional guidance like colorized character masks (with Meta's Segment Anything: and or skeleton poses (with 4. Feed the depth map into Seedance 2.0 Omni as your motion reference along with your character and environment references. 5. Generate your final video. After testing several variations, the depth map workflow consistently produced the cleanest and most accurate motion transfer. If you're trying to recreate specific performances or complex movement, this is one of the closest AI workflows we've seen to achieving production-quality results.

Curious Refuge

31,559 görüntüleme • 3 ay önce

For the facial animations in my game, I use a technique that yields results similar to L.A. Noire. To keep it simple: I first generate a facial animation video using AI like LTX 2. Then, I create a video depth map from that animation and project it onto a face mask. Using vertex displacement, the depth map dynamically deforms the face as the character speaks. The result looks good in standalone VR. I actually created this workflow long time ago:
0:09

For the facial animations in my game, I use a technique that yields results similar to L.A. Noire. To keep it simple: I first generate a facial animation video using AI like LTX 2. Then, I create a video depth map from that animation and project it onto a face mask. Using vertex displacement, the depth map dynamically deforms the face as the character speaks. The result looks good in standalone VR. I actually created this workflow long time ago:

Alex

48,582 görüntüleme • 7 ay önce

Exploring a new storyboard format: Depth Map Storyboards. Instead of letting Seedance 2.0 inherit the storyboard's visual style, I used a reference image to define the tone and look, while the depth-map storyboard defines the composition and camera framing. workflow + system prompt below 🧵
0:49

Exploring a new storyboard format: Depth Map Storyboards. Instead of letting Seedance 2.0 inherit the storyboard's visual style, I used a reference image to define the tone and look, while the depth-map storyboard defines the composition and camera framing. workflow + system prompt below 🧵

OAK

80,222 görüntüleme • 3 ay önce

Kling AI 2.6 motion control is freaking awesome. All you need is one reference video and a character image. It handles facial expressions, body movement, and timing automatically. It even maintains consistent character details across frames. Here’s the full workflow 👇 1/6 #Kling #KlingAI
0:20

Kling AI 2.6 motion control is freaking awesome. All you need is one reference video and a character image. It handles facial expressions, body movement, and timing automatically. It even maintains consistent character details across frames. Here’s the full workflow 👇 1/6 #Kling #KlingAI

AshutoshShrivastava

31,682 görüntüleme • 9 ay önce

I just tested Motion Sync on Yapper and I like the cinematic Video made in minutes. Let me show you how you can do it 👇 Step 1: Open Step 2: Click on video and select Motion Sync. Then, ✅️Select base video Pick a video with the movement you want — this will drive the animation. ✅️Add reference image Upload your character or image you want to bring to life. ✅️Generate video Hit generate and watch your idea turn into a smooth motion sync clip. Simple, fast, and actually fun to experiment with.
1:32

I just tested Motion Sync on Yapper and I like the cinematic Video made in minutes. Let me show you how you can do it 👇 Step 1: Open Step 2: Click on video and select Motion Sync. Then, ✅️Select base video Pick a video with the movement you want — this will drive the animation. ✅️Add reference image Upload your character or image you want to bring to life. ✅️Generate video Hit generate and watch your idea turn into a smooth motion sync clip. Simple, fast, and actually fun to experiment with.

Leonardo

50,931 görüntüleme • 6 ay önce

Ran SCAIL-2 through a bunch of tests, it's extremely prompt-adherent, the motion capture is extremely impressive. Definitely recommend playing with this if you're looking to do motion transfer into a reference image.
0:32

Ran SCAIL-2 through a bunch of tests, it's extremely prompt-adherent, the motion capture is extremely impressive. Definitely recommend playing with this if you're looking to do motion transfer into a reference image.

Purz.ai

51,316 görüntüleme • 4 ay önce

I wanted to experiment with the image-to-video workflow on Pixmax using Seedance 2.5, and the results genuinely impressed me🔥 I created this short Lay’s commercial from just a couple of reference images, building a playful family story around them. What I really like about the workflow is the control over the environment, product and storytelling while still getting natural-looking motion.
1:47

I wanted to experiment with the image-to-video workflow on Pixmax using Seedance 2.5, and the results genuinely impressed me🔥 I created this short Lay’s commercial from just a couple of reference images, building a playful family story around them. What I really like about the workflow is the control over the environment, product and storytelling while still getting natural-looking motion.

Isabella

47,389 görüntüleme • 2 ay önce

How to extend videos using Seedance 2.0 in 3 easy steps 🦄 1. Generate video 1 (e.g. 15 seconds). 2. Use video 1 as a reference when generating video 2. 3. In the prompt for video two, start with "Continue this video". Both videos should have reference images of your characters. Here's a 30 second clip made with two 15 second generations. Workflow in comments below.
0:27

How to extend videos using Seedance 2.0 in 3 easy steps 🦄 1. Generate video 1 (e.g. 15 seconds). 2. Use video 1 as a reference when generating video 2. 3. In the prompt for video two, start with "Continue this video". Both videos should have reference images of your characters. Here's a 30 second clip made with two 15 second generations. Workflow in comments below.

Martin LeBlanc

25,133 görüntüleme • 5 ay önce

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.
0:54

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.

Blaine Brown

1,468,962 görüntüleme • 2 yıl önce

Character Animation is live on Customuse. → Describe a movement to generate a 3D animation. → Turn a reference video into character motion. → Create perfect animations for any Humanoid character → Full support of Roblox R6 and R15 rigs. Game-ready, editable generations. Bring your character creation and animation into the same Customuse workflow.
0:21

Character Animation is live on Customuse. → Describe a movement to generate a 3D animation. → Turn a reference video into character motion. → Create perfect animations for any Humanoid character → Full support of Roblox R6 and R15 rigs. Game-ready, editable generations. Bring your character creation and animation into the same Customuse workflow.

Customuse

127,464 görüntüleme • 23 gün önce

Midjourney v8.2 + GPT Image 2 + Seedance 2.5 This video was created using one character reference and one environment reference. You can find the Midjourney, the character sheet and the Seedance 2.5 prompts below. Created with Seedance 2.5 on Astorie AI
0:30

Midjourney v8.2 + GPT Image 2 + Seedance 2.5 This video was created using one character reference and one environment reference. You can find the Midjourney, the character sheet and the Seedance 2.5 prompts below. Created with Seedance 2.5 on Astorie AI

Kōda

68,533 görüntüleme • 2 ay önce

Ok, this is absurd. You can choreograph a complex action scene in Blender with basic shapes, then let Seedance make it real. You need to try this AI filmmaking workflow: 1. Generate a start frame in Midjourney 2. Block out the action in Blender 3. Feed both to Seedance My Blender reference was just rough timing, camera shake, and spatial choreography, and Seedance tracked the speed, motion, and action way better than I expected. This is the difference between describing a shot and directing one.
0:30

Ok, this is absurd. You can choreograph a complex action scene in Blender with basic shapes, then let Seedance make it real. You need to try this AI filmmaking workflow: 1. Generate a start frame in Midjourney 2. Block out the action in Blender 3. Feed both to Seedance My Blender reference was just rough timing, camera shake, and spatial choreography, and Seedance tracked the speed, motion, and action way better than I expected. This is the difference between describing a shot and directing one.

Reid Hannaford

539,649 görüntüleme • 4 ay önce

Seedance 2.0 vs Gemini Omni, tested under the same conditions 👀 I was working on a new storyboard. After generating it with Seedance 2.0, I gave the exact same prompt + storyboard reference + character reference to Gemini Omni as well. Result: Gemini Omni surprised me with style quality and got closer than I expected in prompt adherence. But Seedance still feels ahead for storyboard execution, motion energy, camera language and environmental interaction. Gemini looks good. Seedance feels directed. You can see them in the video and the storyboard sheet is shown at the end. Which one do you think is more useful for this kind of work?
0:29

Seedance 2.0 vs Gemini Omni, tested under the same conditions 👀 I was working on a new storyboard. After generating it with Seedance 2.0, I gave the exact same prompt + storyboard reference + character reference to Gemini Omni as well. Result: Gemini Omni surprised me with style quality and got closer than I expected in prompt adherence. But Seedance still feels ahead for storyboard execution, motion energy, camera language and environmental interaction. Gemini looks good. Seedance feels directed. You can see them in the video and the storyboard sheet is shown at the end. Which one do you think is more useful for this kind of work?

Kōda

36,257 görüntüleme • 5 ay önce

Same shot. New character. With Recast in ElevenCreative, swap the character in any shot. Everything else stays exactly as it was: lighting, composition, motion, camera movement, cuts, and even the original audio. Upload your video and a reference photo of the new character. Recast does the rest.
0:32

Same shot. New character. With Recast in ElevenCreative, swap the character in any shot. Everything else stays exactly as it was: lighting, composition, motion, camera movement, cuts, and even the original audio. Upload your video and a reference photo of the new character. Recast does the rest.

ElevenCreative

625,395 görüntüleme • 18 gün önce

while everyone was busy making bizarre AI characters, this creator found a MUCH bigger angle. he made poor person look filthy RICH. 😭 and this guy looks 100% real, crazy part is that - he grew this account to 280K+ followers in just 2 days posting multiple times a day. these videos are EXPLODING right now because they immediately catch the attention. and these videos are soo simple to make. here is the step by step workflow: STEP 1: find an interesting character reference on Pinterest and use it as inspiration to create your own original character. then attach the reference to ChatGPT and ask: "create a realistic character sheet for an original character inspired by this reference. use 3 panels against a clean studio background: full-body front view with no head visible, full-body back view with the head visible, and a close-up shot of the face." STEP 2: find a viral luxury or rich lifestyle video, then swap your character into it with Higgsfield Genjutsu. use this prompt: "replace the person in @ video1 with the character from @ image1. keep the same motion, camera movement, lighting, framing, color grading, environment, and overall video quality." this prompt makes it look 100% real. DONE. this is it.
0:23

while everyone was busy making bizarre AI characters, this creator found a MUCH bigger angle. he made poor person look filthy RICH. 😭 and this guy looks 100% real, crazy part is that - he grew this account to 280K+ followers in just 2 days posting multiple times a day. these videos are EXPLODING right now because they immediately catch the attention. and these videos are soo simple to make. here is the step by step workflow: STEP 1: find an interesting character reference on Pinterest and use it as inspiration to create your own original character. then attach the reference to ChatGPT and ask: "create a realistic character sheet for an original character inspired by this reference. use 3 panels against a clean studio background: full-body front view with no head visible, full-body back view with the head visible, and a close-up shot of the face." STEP 2: find a viral luxury or rich lifestyle video, then swap your character into it with Higgsfield Genjutsu. use this prompt: "replace the person in @ video1 with the character from @ image1. keep the same motion, camera movement, lighting, framing, color grading, environment, and overall video quality." this prompt makes it look 100% real. DONE. this is it.

ViralOps

544,759 görüntüleme • 27 gün önce

FIRST TEST Seedance 2.0! From my initial tests, this is one of the more impressive AI video models I’ve tried so far. Dynamic motion feels fluid, prompt adherence is solid, and the efficiency really stood out, very little iteration needed. Everything you see here was generated using just one reference image + one prompt. I also tested a 3×3 image grid with no prompt at all, and the results stayed surprisingly consistent. Another highlight: sound design is already included, and it actually works really well. Tested via BytePlus 👉 More detail and access link to try Seedance 2.0 is in the comments.
1:34

FIRST TEST Seedance 2.0! From my initial tests, this is one of the more impressive AI video models I’ve tried so far. Dynamic motion feels fluid, prompt adherence is solid, and the efficiency really stood out, very little iteration needed. Everything you see here was generated using just one reference image + one prompt. I also tested a 3×3 image grid with no prompt at all, and the results stayed surprisingly consistent. Another highlight: sound design is already included, and it actually works really well. Tested via BytePlus 👉 More detail and access link to try Seedance 2.0 is in the comments.

Dinda Prasetyo

45,450 görüntüleme • 8 ay önce

Trick with Seedance 2 Omni ref on Runway • First clip text to video or your ref images. • Upload the first clip as your reference and prompt "Continue from the last frame of the input video keeping the character and environment consistent" + (extend your story)
1:05

Trick with Seedance 2 Omni ref on Runway • First clip text to video or your ref images. • Upload the first clip as your reference and prompt "Continue from the last frame of the input video keeping the character and environment consistent" + (extend your story)

madpencil_

14,312 görüntüleme • 4 ay önce

Google Gemini Omni is here Generate, animate and edit any video with one model → Edit with your words: a character, a camera angle, the action → Motion that behaves like the real world → From reference to a cinematic scene Now on Magnific, via Magnific MCP and Spaces
0:24

Google Gemini Omni is here Generate, animate and edit any video with one model → Edit with your words: a character, a camera angle, the action → Motion that behaves like the real world → From reference to a cinematic scene Now on Magnific, via Magnific MCP and Spaces

Magnific

88,179 görüntüleme • 4 ay önce

Introducing Character Motion Control for Video Diffusion Models Creators currently lack control over how characters move and act in the videos they generate with AI. Today, we’re changing that. With Character Motion Control, you can act it out and bring your exact vision to life. How it works: 1️⃣ Describe the scene with a prompt 2️⃣ Upload an acting video to guide character movement 🎥 Generate a video where character motion is driven by the acting video. Register for Early Access via the link in the comments.
0:57

Introducing Character Motion Control for Video Diffusion Models Creators currently lack control over how characters move and act in the videos they generate with AI. Today, we’re changing that. With Character Motion Control, you can act it out and bring your exact vision to life. How it works: 1️⃣ Describe the scene with a prompt 2️⃣ Upload an acting video to guide character movement 🎥 Generate a video where character motion is driven by the acting video. Register for Early Access via the link in the comments.

Kinetix

98,054 görüntüleme • 1 yıl önce

I have been wanting to test performance transfer in Seadance 2.5 since launch, now I have, I am really impressed by the results. I wrote a short script and recorded myself giving a rallying speech as an orc warlord, then fed this and an image of the orc into Seedance with this prompt "A cinematic close up of an orc warlord giving a rallying speech to his army of orcs. Transfer the performance, movement and audio from Video 1 onto the the character Image 1. Do not add any music" I didn't prompt the dialogue or performance in text. The first video you see is a a final cut of the video, the second is the final cut of the video with my video performance. As you can see it's not an exact like-for-like transfer of the performance and voice but more a interpretation by Seedance. It's made my amateur performance better IMHO, more fitting with the creator but retain the essence, nuance and context. So you don't have to feed in a long prompt to get good performance out of your AI actors you can just show them what you want with a video! I used Seedance Enterprise on bytedances lumina platform Lumina link in the comments!
0:33

I have been wanting to test performance transfer in Seadance 2.5 since launch, now I have, I am really impressed by the results. I wrote a short script and recorded myself giving a rallying speech as an orc warlord, then fed this and an image of the orc into Seedance with this prompt "A cinematic close up of an orc warlord giving a rallying speech to his army of orcs. Transfer the performance, movement and audio from Video 1 onto the the character Image 1. Do not add any music" I didn't prompt the dialogue or performance in text. The first video you see is a a final cut of the video, the second is the final cut of the video with my video performance. As you can see it's not an exact like-for-like transfer of the performance and voice but more a interpretation by Seedance. It's made my amateur performance better IMHO, more fitting with the creator but retain the essence, nuance and context. So you don't have to feed in a long prompt to get good performance out of your AI actors you can just show them what you want with a video! I used Seedance Enterprise on bytedances lumina platform Lumina link in the comments!

Uncanny Harry AI

24,094 görüntüleme • 2 ay önce