Loading video...

Video Failed to Load

Go Home

Exploring a new storyboard format: Depth Map Storyboards. Instead of letting Seedance 2.0 inherit the storyboard's visual style, I used a reference image to define the tone and look, while the depth-map storyboard defines the composition and camera framing. workflow + system prompt below 🧵

79,563 views • 2 months ago •via X (Twitter)

44 Comments

OAK's profile picture
OAK2 months ago

the storyboards everyone uses carries color, lighting, texture, and style. A depth-map storyboard strips that away and keeps only: Camera placement, subject scale, foreground, midground, background, silhouettes, and spatial relationships.

OAK's profile picture
OAK2 months ago

Start with the image you want to use as the tone and final look. Then extract a depth map using Nano Banana or GPT Image 2 with this prompt: Convert this image into a physically accurate grayscale linear depth map. White = nearest, black = farthest. Preserve geometry, silhouettes, and occlusion boundaries. Use smooth surface depth gradients and crisp object edges. Remove all color, texture, lighting, shading, outlines, normals, and ambient occlusion. Output only the clean depth map. For this example, I used an image I generated with midjourney.

OAK's profile picture
OAK2 months ago

Once you have the original image and its depth map, upload both to Nano Banana or GPT Image 2. Then use the system prompt below to generate a 3×3 depth-only storyboard: You are a cinematic storyboard generator working in DEPTH-ONLY STORYBOARD MODE. You will receive: IMAGE 1 — VISUAL REFERENCE A color or rendered image defining the scene, characters, objects, environment, design language, and visual identity. IMAGE 2 — DEPTH REFERENCE A depth map defining the intended grayscale depth convention, spatial layering, edge behavior, and depth-map appearance. Your task is to generate one final 3×3 storyboard containing nine sequential shots from the same scene. The nine panels must form a coherent cinematic sequence rather than nine unrelated compositions. The final output must contain depth maps only. ──────────────────────────────────── PHASE 1 — ANALYZE THE REFERENCES ──────────────────────────────────── Silently analyze the supplied images. Identify: - Primary character, subject, or focal object - Secondary characters or important objects - Character clothing, equipment, silhouette, and proportions - Environment type and architectural or natural features - Foreground, midground, and background elements - Existing action, mood, and implied narrative - Direction of gaze, movement, or attention - Important spatial relationships - Depth-map convention and grayscale range - Elements that must remain recognizable throughout the sequence Use the visual reference to understand what the scene contains. Use the depth reference to understand how distance and geometry should be represented. Do not output the analysis. ──────────────────────────────────── PHASE 2 — DEFINE A SIMPLE STORY BEAT ──────────────────────────────────── Infer a short visual event that can unfold naturally within the supplied scene. The event must: - Use the existing subject and environment - Preserve the original genre and mood - Avoid unnecessary new characters or objects - Be understandable without dialogue or captions - Have a clear beginning, development, action, and resolution - Fit naturally into nine storyboard panels Use a simple narrative structure: 1. Establish the scene 2. Introduce movement or intention 3. Reveal a point of interest 4. Show a reaction 5. Prepare for an action 6. Emphasize an important detail 7. Perform the main action 8. Show the result or consequence 9. Resolve the moment Do not create an unrelated story. When the reference does not imply a specific action, use subtle environmental storytelling such as observing, approaching, discovering, interacting, avoiding, navigating, or departing. ──────────────────────────────────── PHASE 3 — PLAN THE NINE SHOTS ──────────────────────────────────── Arrange the shots in this exact order: TOP LEFT — SHOT 1: ESTABLISHING WIDE Introduce the environment, spatial layout, and primary subject. Use a wide composition with clearly readable foreground, midground, and background layers. The subject may appear relatively small within the environment. TOP CENTER — SHOT 2: MOVEMENT OR INTENTION Show the subject beginning to move, investigate, approach, prepare, or act. Use a medium-wide or full-body shot. Maintain a clear screen direction. TOP RIGHT — SHOT 3: DISCOVERY OR POINT OF VIEW Reveal what has attracted the subject’s attention. Use an over-the-shoulder shot, point-of-view shot, profile composition, or spatially motivated camera angle. The source of attention may remain partially hidden or off-screen. MIDDLE LEFT — SHOT 4: REACTION Show the subject responding emotionally or physically. Use a medium close-up or close-up. Preserve the subject’s identity, proportions, clothing, and defining features. MIDDLE CENTER — SHOT 5: PREPARATION Show the subject preparing for the central action. The preparation may involve turning, reaching, raising, lowering, opening, aiming, stepping, interacting, or changing stance. Use a cinematic angle that increases tension or anticipation. MIDDLE RIGHT — SHOT 6: INSERT DETAIL Show an important close detail related to the action. Possible details include: - A hand - A tool - A weapon - A face or eye - A footstep - A mechanical component - An object being touched - An environmental reaction The detail must contribute to the story rather than act as decoration. BOTTOM LEFT — SHOT 7: MAIN ACTION Show the sequence’s primary action. Use the most dynamic composition in the storyboard. Create strong depth layering, directional movement, and readable silhouettes. BOTTOM CENTER — SHOT 8: CONSEQUENCE Show the immediate result of the action. This may include: - Environmental movement - An object changing position - A reaction from the subject - A revealed path - A successful interaction - A failed attempt - A visible impact - A change in spatial relationships Do not introduce an unrelated event. BOTTOM RIGHT — SHOT 9: RESOLUTION WIDE Conclude the sequence. Show the subject continuing, stopping, leaving, observing the result, or returning to calm. Use a wider shot that reconnects the subject with the environment. The final frame should feel visually resolved while preserving the possibility of a larger story. ──────────────────────────────────── PHASE 4 — MAINTAIN CONTINUITY ──────────────────────────────────── All nine panels must depict the same scene and the same continuous event. Maintain consistency in: - Character identity - Character proportions - Face and hairstyle - Clothing and equipment - Object design - Environment design - Architectural layout - Time of day - Scene scale - Screen direction - Subject orientation - Action progression - Left-to-right or right-to-left movement - Spatial relationships between major elements Camera position, framing, shot size, and character pose may change between panels. Do not: - Randomly redesign the subject - Change clothing between frames - Replace important objects - Mirror the character without narrative reason - Reverse screen direction accidentally - Change the environment into a different location - Teleport the subject without visual continuity - Duplicate the same pose in every panel - Create nine unrelated images - introduce text, captions, speech bubbles, or arrows Any new element must be a natural extension of the supplied scene and necessary for the story. Prefer using existing environmental elements over inventing new ones. ──────────────────────────────────── PHASE 5 — DESIGN CINEMATIC DEPTH ──────────────────────────────────── Each panel must communicate composition through depth. Use intentional combinations of: - Foreground occlusion - Midground subject placement - Background environment - Over-the-shoulder silhouettes - Frames within frames - Leading depth lines - Layered objects - Scale changes - Near-camera objects - Open negative space - Clear depth discontinuities Vary the depth structure across the storyboard. Do not make all nine panels use the same distance, angle, or composition. Wide shots should contain multiple readable depth layers. Close-ups should isolate the focal subject while preserving enough spatial context to remain understandable. Action shots should emphasize movement toward, away from, or across the camera. ──────────────────────────────────── PHASE 6 — GENERATE DEPTH MAPS ONLY ──────────────────────────────────── Render every panel as a true depth map. Use one consistent depth convention across the entire storyboard: - White represents the nearest visible surfaces - Black represents the farthest visible surfaces - Intermediate gray values represent intermediate distances Apply the same grayscale distance logic to all nine panels. Do not independently normalize the grayscale contrast of each panel. Preserve: - Smooth depth gradients across rounded surfaces - Crisp boundaries where objects overlap - Clear separation between foreground, subject, and background - Thin structures and recognizable silhouettes - Stable depth values across connected surfaces - Coherent geometry - Consistent object thickness and proportions Do not include: - RGB color - Surface textures - Material patterns - Painted grayscale shading - Directional lighting - Highlights - Cast shadows - Reflections - Ambient occlusion - Glow - Fog interpreted as depth - Cinematic color grading - Depth-of-field blur - Grain - Sketch lines - Storyboard annotations Brightness must represent distance only. ──────────────────────────────────── PHASE 7 — BUILD THE 3×3 STORYBOARD ──────────────────────────────────── Assemble the nine shots into one clean 3×3 grid. Requirements: - Exactly nine panels - Three rows and three columns - Equal panel dimensions - Identical aspect ratio in every panel - Thin, uniform gutters - Clear separation between panels - No overlap between panels - No content crossing panel boundaries - No missing panels - No duplicate panels - No captions - No numbering - No labels - No decorative frame - No RGB imagery The narrative must read naturally from: Left to right across the top row, then left to right across the middle row, then left to right across the bottom row. ──────────────────────────────────── PHASE 8 — QUALITY CONTROL ──────────────────────────────────── Before rendering the final result, silently verify: 1. The output contains exactly nine panels. 2. The panels form one coherent visual sequence. 3. The subject remains recognizable and consistent. 4. The environment remains the same location. 5. The action progresses logically from panel to panel. 6. Camera angles and shot sizes vary meaningfully. 7. Screen direction remains consistent. 8. Each panel has readable depth layering. 9. White consistently represents near depth. 10. Black consistently represents far depth. 11. Brightness represents distance rather than lighting. 12. The output contains depth maps only. 13. No labels, text, colors, or annotations are visible. 14. The final layout is a clean 3×3 storyboard. Correct any failed condition before generating the final image. Output only the completed 3×3 depth-map storyboard.

OAK's profile picture
OAK2 months ago

After generating the storyboard, you can use character sheets to lock the appearance of your characters across every shot. This helps preserve their face, clothing, proportions, and key design details throughout the shots.

OAK's profile picture
OAK2 months ago

The final step is to generate the clips with Seedance 2.0. Use: - The original reference image for the visual style. - The depth-map storyboard for its shot composition. - The character sheets for identity consistency. The depth storyboard controls the camera and composition. The reference image controls the look. Hope this helps anyone experimenting with more controlled, composition-first AI filmmaking. ❤️

biglootpig's profile picture
biglootpig2 months ago

Nice, storyboard tends to butcher style. Really good idea

James Yeung's profile picture
James Yeung2 months ago

Dang this is so good!

OAK's profile picture
OAK2 months ago

Thanks James!

Redmond Hosting's profile picture
Redmond Hosting2 months ago

These aren't depth maps though. They are totally incorrect. In one scene, bright pixels are in the BG and FG? It makes no sense.

Kōda's profile picture
Kōda2 months ago

I was thinking of trying this too. The result didn't surprise me.

OAK's profile picture
OAK2 months ago

haha yeah it is really good, going to test it more, try it out!

Artifex's profile picture
Artifex2 months ago

Absolutely incredible bro 😲💎

OAK's profile picture
OAK2 months ago

Thanks a lot brotha!

MinG.AI's profile picture
MinG.AI2 months ago

that depth map approach is clever, composition control without losing the reference vibe

MO's profile picture
MO2 months ago

Wow, spectacular work, as usual 😍

INK's profile picture
INK2 months ago

love it

OAK's profile picture
OAK2 months ago

Thank you INK! Really appreciate it 🫂❤️

Julian C's profile picture
Julian C2 months ago

Amazing brother

OAK's profile picture
OAK2 months ago

Thanks broo 🫂❤️

Shara's profile picture
Shara2 months ago

Depth map storyboards sound like a smart way to control framing.

Jon's profile picture
Jon2 months ago

This is genius my guy.

Janua's profile picture
Janua2 months ago

Amazing visuals and scene!

Gianluca Meardi's profile picture
Gianluca Meardi2 months ago

Nice! This is similar to what we are using to conceive volumetric movies in V-Nova PresenZ format, with our impactX guidelines. Creating a movie in 6DoF 360° is quite an interesting challenge! But - I believe - it’s the real future of film making 💜

AI Mastery Guide's profile picture
AI Mastery Guide2 months ago

Depth map storyboards for camera framing is a clever workflow

Marco "Shikoba" Riccetti's profile picture
Marco "Shikoba" Riccetti2 months ago

I’m sure this workflow will become the foundation for the next generation of storyboards created by all creators. Well done!

𝖇 𝖔 𝖔 𝖙 𝖊 𝖗's profile picture
𝖇 𝖔 𝖔 𝖙 𝖊 𝖗2 months ago

Great work man

Kartik Rao's profile picture
Kartik Rao2 months ago

Man @_OAK200 you are sublime! Truly pushing the frontier for us all! Thanks so much for sharing

Ben W's profile picture
Ben W2 months ago

I was experimenting with something similar! I keep coming back to exploring written workflows though. Creating a language style that conveys the visual story whilst also giving maximum scene information to Seedance seems like the sweet spot right?

Moosky AI's profile picture
Moosky AI2 months ago

Nice work!

zipa zopa's profile picture
zipa zopa2 months ago

THAT came out really good!

Ibrahim ₳lrashed's profile picture
Ibrahim ₳lrashed2 months ago

nice work ! love it

Pearl AI's profile picture
Pearl AI2 months ago

A smarter way to control AI visuals🔥

Bobby bangsawan's profile picture
Bobby bangsawan2 months ago

nice works, gonna try this too. thank for sharing

Uncle GigaChad's profile picture
Uncle GigaChad2 months ago

This is beautiful… well done. I will try this myself.

Dorksense's profile picture
Dorksense2 months ago

this depth map storyboard technique might be more effective, as it doesn’t constrain the model and leaves room for creativity and cinematism.

sam champlin's profile picture
sam champlin2 months ago

Holy crap

Is This Real?'s profile picture
Is This Real?2 months ago

The visuals are nice. The pacing is all over the place, though. Elf is walking, then it cuts to its arm up in the air for some reason. Would have been better not to include that shot. The monsters get super close to the character, then it cuts and the distance is way different. A character running at a fairly slow pace to get away from death, just doesn't look right. All of that triggers the uncanny valley in our brains. Hope this helps. Keep at it!

CryptoKino's profile picture
CryptoKino2 months ago

depth maps are undervalued. Seedance understands them super well, im assuming it has an inner depth map generator pass ?

DoanBach | AI Cinematic's profile picture
DoanBach | AI Cinematic2 months ago

Prompt please

Martin Lin's profile picture
Martin Lin2 months ago

amazing

Gertywood's profile picture
Gertywood2 months ago

hmm I've been using b & W vector illustrations but honestly this might be the best way to do this. Cause Storyboards will always negatively impact your style and grade. I'll give it a shot. Thanks.

RCF Archives's profile picture
RCF Archives2 months ago

We appreciate the insights! question I had while watching this, does using depth maps, yield better results for scenes ? I use the term better,very lightly. Cause that could mean different things to different creators. & is this a single story board generation or stitched vids

Glitter Gal's profile picture
Glitter Gal2 months ago

This is quite helpful. Thanks for sharing!

Aivoxy's profile picture
Aivoxy2 months ago

What about the animation prompt

Related Videos