Introducing 🛹 RollingDepth 🛹 — a universal monocular depth... estimator for arbitrarily long videos! Our paper, “Video Depth without Video Models,” delivers exactly that, setting new standards in temporal consistency. Check out more details in the thread 🧵show more

Depth Any Video with Scalable Synthetic Data AI physicists... and chemists continue to make strides in depth estimation from video. Check out this new paper featuring some impressive examples. See the thread for more details (unfortunately no code yet). Abstract: Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackles the challenge through two key innovations. First, we develop a scalable synthetic data pipeline, capturing real-time video depth data from diverse game environments, yielding 40,000 video clips of 5-second duration, each with precise depth annotations. Second, we leverage the powerful priors of generative video diffusion models to handle real-world videos effectively, integrating advanced techniques such as rotary position encoding and flow matching to further enhance flexibility and efficiency. Unlike previous models, which are limited to fixed-length video sequences, our approach introduces a novel mixed-duration training strategy that handles videos of varying lengths and performs robustly across different frame rates 0 - even on single frames. At inference, we propose a depth interpolation method that enables our model to infer high-resolution video depth across sequences of up to 150 frames. Our model outperforms all previous generative depth models in terms of spatial accuracy and temporal consistency.show more

🛹🛹⌐◨-◨🛹🛹 We're so thrilled to announce our mint Date... and Time ⭐️⭐️ Please check our announcement channel in Discord for more infoshow more

🤔Applying Depth Estimation models directly to videos can result... in inconsistency between frames. 💪Well, not anymore. 🔥ChronoDepth is a new approach to video depth estimation that focuses on achieving both accuracy within each frame and consistency across frames. 📜More👇show more

Introducing ⇆ Marigold-DC — our training-free zero-shot approach to... monocular Depth Completion with guided diffusion! If you have ever wondered how else a long denoising diffusion schedule can be useful, we have an answer for you! Details 🧵show more

There are so many exciting changes with our latest... update, so here’s a quick recap of the major differences 🥳 For more details, check out our blog post! Also, stay tuned for more in-depth videos 👀show more

Google just revealed an ABSOLUTE depth estimation model 🤯... As opposed to recent depth models (Marigold, PatchFusion) which aim for maximum details, DMD aims to estimate the ABSOLUTE depth (in meters) within the image More details below ⬇️⬇️show more

xAI absolutely cooked with the new Grok Imagine model!... The temporal consistency is rock-solid. The penguin's anatomy, lighting, and proportions stay locked in for the full 10 seconds with no weird morphing or melting. In less than 30 seconds, Grok created a video with snow spray building realistically, motion blur, and depth of field. The physics simulation rivals other top models.show more

The HTTP client CLI tool is now available in... Homebrew, for free! To install it, launch the `brew install ijhttp` command in the terminal. 🧵 Check out the thread below for more details! 🧵show more

Why is action chunking crucial for robot dexterity? 🤖... - We identify a natural tradeoff between temporal consistency and reactivity - New policy decoding technique that is *both* temporally consistent & fully reactive ICLR 2025 paper: A short thread 🧵show more

Doesn't look like the super low-res depth maps from... the iPhone Pro's LiDAR sensor would be too useful as supervision (or sanity check) for recent monocular depth estimators.show more

Huge news! This is a major breakthrough in character... consistency for AI videos. Kling AI released "Custom Models". You can now train your own video for superior character consistency. Let's take a look 🧵:show more

Bruce Lee vs Chuck Norris, restaged with Mozart and... Bach. The new Video Depth Anything model in FilmSpark.ai turns any video into a depth map you can use as a motion reference with Seedance 2.0. Live now in the Video Edit UI.show more

Discover what RPG delights await in Dragon Quest I... & II HD-2D Remake. New in-depth overview video details enhancements and rebuilt features:show more

A new stable motion transfer workflow for Seedance 2.0!... We built a video-to-depth-video + skeleton-binding Skill based on "Depth-Anything-V2" for motion transfer. Tell your agent to help me create a Skill that converts a normal video into a depth video with skeleton binding. Motion transfer can be achieved with only the following prompt + content description:show more

Our long-awaited Skate Core Update is now LIVE 🛹🔥... Peep all the changes in our dev blog → Don’t own Session yet? Fix that here →show more

🛹 Introducing @TOUGHIESnft DRiP, by @AbbieSolana and faceless 🟡.... Look out for redeemable Legendaries 👀show more

New fal workflow: video restyling with Video Depth Anything... and Seedance 2.0 - Restyle the first frame into your target look - Extract consistent depth across the source video - Use that depth to guide Seedance 2.0 through the full sequence - Preserve the original motion and composition while transforming the visual style A simple workflow for turning existing footage into stylized video.show more

Depth video workflows have been getting a lot of... attention lately, so I tested one myself. Combined with Seedance 2.0, it produced more natural motion-transfer results than using Kling Motion Control directly. Why use a depth video? 1. It removes the original character and scene details, reducing copyright and sensitive-content risks. 2. It preserves the original motion, timing, and spatial structure. This separates motion extraction from visual generation, allowing you to recreate the movement with better models and any reference character. We’ve also launched a free online tool that converts regular videos into depth videos—no local setup required: In the example below, we converted a dance video from Douyin into a depth video, then regenerated it with a reference character using Seedance 2.0. The original choreography and timing are preserved, while the lighting adapts naturally to the new character and scene.show more