Loading video...
Video Failed to Load
Exploring a new storyboard format: Depth Map Storyboards. Instead of letting Seedance 2.0 inherit the storyboard's visual style, I used a reference image to define the tone and look, while the depth-map storyboard defines the composition and camera framing. workflow + system prompt below 🧵
79,563 views • 2 months ago •via X (Twitter)
44 Comments

the storyboards everyone uses carries color, lighting, texture, and style. A depth-map storyboard strips that away and keeps only: Camera placement, subject scale, foreground, midground, background, silhouettes, and spatial relationships.

Start with the image you want to use as the tone and final look. Then extract a depth map using Nano Banana or GPT Image 2 with this prompt: Convert this image into a physically accurate grayscale linear depth map. White = nearest, black = farthest. Preserve geometry, silhouettes, and occlusion boundaries. Use smooth surface depth gradients and crisp object edges. Remove all color, texture, lighting, shading, outlines, normals, and ambient occlusion. Output only the clean depth map. For this example, I used an image I generated with midjourney.

Once you have the original image and its depth map, upload both to Nano Banana or GPT Image 2. Then use the system prompt below to generate a 3×3 depth-only storyboard: You are a cinematic storyboard generator working in DEPTH-ONLY STORYBOARD MODE. You will receive: IMAGE 1 — VISUAL REFERENCE A color or rendered image defining the scene, characters, objects, environment, design language, and visual identity. IMAGE 2 — DEPTH REFERENCE A depth map defining the intended grayscale depth convention, spatial layering, edge behavior, and depth-map appearance. Your task is to generate one final 3×3 storyboard containing nine sequential shots from the same scene. The nine panels must form a coherent cinematic sequence rather than nine unrelated compositions. The final output must contain depth maps only. ──────────────────────────────────── PHASE 1 — ANALYZE THE REFERENCES ──────────────────────────────────── Silently analyze the supplied images. Identify: - Primary character, subject, or focal object - Secondary characters or important objects - Character clothing, equipment, silhouette, and proportions - Environment type and architectural or natural features - Foreground, midground, and background elements - Existing action, mood, and implied narrative - Direction of gaze, movement, or attention - Important spatial relationships - Depth-map convention and grayscale range - Elements that must remain recognizable throughout the sequence Use the visual reference to understand what the scene contains. Use the depth reference to understand how distance and geometry should be represented. Do not output the analysis. ──────────────────────────────────── PHASE 2 — DEFINE A SIMPLE STORY BEAT ──────────────────────────────────── Infer a short visual event that can unfold naturally within the supplied scene. The event must: - Use the existing subject and environment - Preserve the original genre and mood - Avoid unnecessary new characters or objects - Be understandable without dialogue or captions - Have a clear beginning, development, action, and resolution - Fit naturally into nine storyboard panels Use a simple narrative structure: 1. Establish the scene 2. Introduce movement or intention 3. Reveal a point of interest 4. Show a reaction 5. Prepare for an action 6. Emphasize an important detail 7. Perform the main action 8. Show the result or consequence 9. Resolve the moment Do not create an unrelated story. When the reference does not imply a specific action, use subtle environmental storytelling such as observing, approaching, discovering, interacting, avoiding, navigating, or departing. ──────────────────────────────────── PHASE 3 — PLAN THE NINE SHOTS ──────────────────────────────────── Arrange the shots in this exact order: TOP LEFT — SHOT 1: ESTABLISHING WIDE Introduce the environment, spatial layout, and primary subject. Use a wide composition with clearly readable foreground, midground, and background layers. The subject may appear relatively small within the environment. TOP CENTER — SHOT 2: MOVEMENT OR INTENTION Show the subject beginning to move, investigate, approach, prepare, or act. Use a medium-wide or full-body shot. Maintain a clear screen direction. TOP RIGHT — SHOT 3: DISCOVERY OR POINT OF VIEW Reveal what has attracted the subject’s attention. Use an over-the-shoulder shot, point-of-view shot, profile composition, or spatially motivated camera angle. The source of attention may remain partially hidden or off-screen. MIDDLE LEFT — SHOT 4: REACTION Show the subject responding emotionally or physically. Use a medium close-up or close-up. Preserve the subject’s identity, proportions, clothing, and defining features. MIDDLE CENTER — SHOT 5: PREPARATION Show the subject preparing for the central action. The preparation may involve turning, reaching, raising, lowering, opening, aiming, stepping, interacting, or changing stance. Use a cinematic angle that increases tension or anticipation. MIDDLE RIGHT — SHOT 6: INSERT DETAIL Show an important close detail related to the action. Possible details include: - A hand - A tool - A weapon - A face or eye - A footstep - A mechanical component - An object being touched - An environmental reaction The detail must contribute to the story rather than act as decoration. BOTTOM LEFT — SHOT 7: MAIN ACTION Show the sequence’s primary action. Use the most dynamic composition in the storyboard. Create strong depth layering, directional movement, and readable silhouettes. BOTTOM CENTER — SHOT 8: CONSEQUENCE Show the immediate result of the action. This may include: - Environmental movement - An object changing position - A reaction from the subject - A revealed path - A successful interaction - A failed attempt - A visible impact - A change in spatial relationships Do not introduce an unrelated event. BOTTOM RIGHT — SHOT 9: RESOLUTION WIDE Conclude the sequence. Show the subject continuing, stopping, leaving, observing the result, or returning to calm. Use a wider shot that reconnects the subject with the environment. The final frame should feel visually resolved while preserving the possibility of a larger story. ──────────────────────────────────── PHASE 4 — MAINTAIN CONTINUITY ──────────────────────────────────── All nine panels must depict the same scene and the same continuous event. Maintain consistency in: - Character identity - Character proportions - Face and hairstyle - Clothing and equipment - Object design - Environment design - Architectural layout - Time of day - Scene scale - Screen direction - Subject orientation - Action progression - Left-to-right or right-to-left movement - Spatial relationships between major elements Camera position, framing, shot size, and character pose may change between panels. Do not: - Randomly redesign the subject - Change clothing between frames - Replace important objects - Mirror the character without narrative reason - Reverse screen direction accidentally - Change the environment into a different location - Teleport the subject without visual continuity - Duplicate the same pose in every panel - Create nine unrelated images - introduce text, captions, speech bubbles, or arrows Any new element must be a natural extension of the supplied scene and necessary for the story. Prefer using existing environmental elements over inventing new ones. ──────────────────────────────────── PHASE 5 — DESIGN CINEMATIC DEPTH ──────────────────────────────────── Each panel must communicate composition through depth. Use intentional combinations of: - Foreground occlusion - Midground subject placement - Background environment - Over-the-shoulder silhouettes - Frames within frames - Leading depth lines - Layered objects - Scale changes - Near-camera objects - Open negative space - Clear depth discontinuities Vary the depth structure across the storyboard. Do not make all nine panels use the same distance, angle, or composition. Wide shots should contain multiple readable depth layers. Close-ups should isolate the focal subject while preserving enough spatial context to remain understandable. Action shots should emphasize movement toward, away from, or across the camera. ──────────────────────────────────── PHASE 6 — GENERATE DEPTH MAPS ONLY ──────────────────────────────────── Render every panel as a true depth map. Use one consistent depth convention across the entire storyboard: - White represents the nearest visible surfaces - Black represents the farthest visible surfaces - Intermediate gray values represent intermediate distances Apply the same grayscale distance logic to all nine panels. Do not independently normalize the grayscale contrast of each panel. Preserve: - Smooth depth gradients across rounded surfaces - Crisp boundaries where objects overlap - Clear separation between foreground, subject, and background - Thin structures and recognizable silhouettes - Stable depth values across connected surfaces - Coherent geometry - Consistent object thickness and proportions Do not include: - RGB color - Surface textures - Material patterns - Painted grayscale shading - Directional lighting - Highlights - Cast shadows - Reflections - Ambient occlusion - Glow - Fog interpreted as depth - Cinematic color grading - Depth-of-field blur - Grain - Sketch lines - Storyboard annotations Brightness must represent distance only. ──────────────────────────────────── PHASE 7 — BUILD THE 3×3 STORYBOARD ──────────────────────────────────── Assemble the nine shots into one clean 3×3 grid. Requirements: - Exactly nine panels - Three rows and three columns - Equal panel dimensions - Identical aspect ratio in every panel - Thin, uniform gutters - Clear separation between panels - No overlap between panels - No content crossing panel boundaries - No missing panels - No duplicate panels - No captions - No numbering - No labels - No decorative frame - No RGB imagery The narrative must read naturally from: Left to right across the top row, then left to right across the middle row, then left to right across the bottom row. ──────────────────────────────────── PHASE 8 — QUALITY CONTROL ──────────────────────────────────── Before rendering the final result, silently verify: 1. The output contains exactly nine panels. 2. The panels form one coherent visual sequence. 3. The subject remains recognizable and consistent. 4. The environment remains the same location. 5. The action progresses logically from panel to panel. 6. Camera angles and shot sizes vary meaningfully. 7. Screen direction remains consistent. 8. Each panel has readable depth layering. 9. White consistently represents near depth. 10. Black consistently represents far depth. 11. Brightness represents distance rather than lighting. 12. The output contains depth maps only. 13. No labels, text, colors, or annotations are visible. 14. The final layout is a clean 3×3 storyboard. Correct any failed condition before generating the final image. Output only the completed 3×3 depth-map storyboard.

After generating the storyboard, you can use character sheets to lock the appearance of your characters across every shot. This helps preserve their face, clothing, proportions, and key design details throughout the shots.

The final step is to generate the clips with Seedance 2.0. Use: - The original reference image for the visual style. - The depth-map storyboard for its shot composition. - The character sheets for identity consistency. The depth storyboard controls the camera and composition. The reference image controls the look. Hope this helps anyone experimenting with more controlled, composition-first AI filmmaking. ❤️

Nice, storyboard tends to butcher style. Really good idea

Dang this is so good!

Thanks James!

These aren't depth maps though. They are totally incorrect. In one scene, bright pixels are in the BG and FG? It makes no sense.

I was thinking of trying this too. The result didn't surprise me.

haha yeah it is really good, going to test it more, try it out!

Absolutely incredible bro 😲💎

Thanks a lot brotha!

that depth map approach is clever, composition control without losing the reference vibe

Wow, spectacular work, as usual 😍

love it

Thank you INK! Really appreciate it 🫂❤️

Amazing brother

Thanks broo 🫂❤️

Depth map storyboards sound like a smart way to control framing.

This is genius my guy.

Amazing visuals and scene!

Nice! This is similar to what we are using to conceive volumetric movies in V-Nova PresenZ format, with our impactX guidelines. Creating a movie in 6DoF 360° is quite an interesting challenge! But - I believe - it’s the real future of film making 💜

Depth map storyboards for camera framing is a clever workflow

I’m sure this workflow will become the foundation for the next generation of storyboards created by all creators. Well done!

Great work man

Man @_OAK200 you are sublime! Truly pushing the frontier for us all! Thanks so much for sharing

I was experimenting with something similar! I keep coming back to exploring written workflows though. Creating a language style that conveys the visual story whilst also giving maximum scene information to Seedance seems like the sweet spot right?

Nice work!

THAT came out really good!

nice work ! love it

A smarter way to control AI visuals🔥

nice works, gonna try this too. thank for sharing

This is beautiful… well done. I will try this myself.

this depth map storyboard technique might be more effective, as it doesn’t constrain the model and leaves room for creativity and cinematism.

Holy crap

The visuals are nice. The pacing is all over the place, though. Elf is walking, then it cuts to its arm up in the air for some reason. Would have been better not to include that shot. The monsters get super close to the character, then it cuts and the distance is way different. A character running at a fairly slow pace to get away from death, just doesn't look right. All of that triggers the uncanny valley in our brains. Hope this helps. Keep at it!

depth maps are undervalued. Seedance understands them super well, im assuming it has an inner depth map generator pass ?

Prompt please

amazing

hmm I've been using b & W vector illustrations but honestly this might be the best way to do this. Cause Storyboards will always negatively impact your style and grade. I'll give it a shot. Thanks.

We appreciate the insights! question I had while watching this, does using depth maps, yield better results for scenes ? I use the term better,very lightly. Cause that could mean different things to different creators. & is this a single story board generation or stitched vids

This is quite helpful. Thanks for sharing!

What about the animation prompt
