正在加载视频...

视频加载失败

Introducing World Tracing Generative pixel-aligned geometry, beyond the visible. Faithful to your pixels. Complete in 3D. One image in — objects, scenes, even dynamic worlds emerge in full geometry, every point traced back to the pixel it came from. 🌐 🧵 [1/6]

106,299 次观看 • 3 个月前 •via X (Twitter)

18 条评论

Hao Zhang 的头像
Hao Zhang3 个月前

Single-image to 3D forced a choice: depth is faithful but stops at the surface, or generation is complete but drifts from your pixels. World Tracing dissolves the trade-off, each pixel ray carries an ordered stack of 3D points, from the visible surface to the geometry hidden behind it. One tensor. One model. Reconstruction and generation, unified.

Hao Zhang 的头像
Hao Zhang3 个月前

Paper: Page: Code: Live Demo:

Hao Zhang 的头像
Hao Zhang3 个月前

Completion comes at no cost to fidelity: WT's first layer alone matches SOTA monocular depth predictors on visible-surface accuracy, while on faithful generation, complete geometry aligned to the input image, it outperforms canonical-frame image-to-3D and video-to-4D generators.

Hao Zhang 的头像
Hao Zhang3 个月前

And because every 3D point remembers its pixel, WT becomes a universal geometry interface: 3D scene editing, geometry-guided video synthesis, training-free textured meshes.

Hao Zhang 的头像
Hao Zhang3 个月前

Big thanks to all collaborators and people support this project: @theworldlabs @gengshanY @BenMildenhall @chlassner @jcjohnss @KeunhongP @_mbanani @DrTunnels @Hawaii271828 @PaulZhang @cuijiaxingfb @BDuisterhof @zixuan_huang @drfeifei

Hao Zhang 的头像
Hao Zhang3 个月前

Thanks for trying the model! It seems the current released model doesn't work very well on human face details. I think the incoimg larger model will perform better with those details.

Ryan Schmidt 的头像
Ryan Schmidt3 个月前

this is cool, nice work

Ian Curtis 的头像
Ian Curtis3 个月前

Excited to try this out!

SomacoSF 的头像
SomacoSF3 个月前

Imagine throwing /flying a ball/drone into a space o it just flies through SUPER fast and snaps bajillions of photos that then get sent back to a this bot and it gives you full 3d of the environ asap (tiny race drones that fly >100KMHH style recon sortie

AUTONOMOUS 的头像
AUTONOMOUS3 个月前

Excited to see this hopefully being used in data training moving forward

Ziyang Xie 的头像
Ziyang Xie3 个月前

Amazing work!

平地有樹曰林 的头像
平地有樹曰林3 个月前

wow

Shikun Liu 的头像
Shikun Liu3 个月前

Beautiful work and beautiful project page!

SomacoSF 的头像
SomacoSF3 个月前

Acrually you could have this fly in a drove and map out trail conditions and share it on an app that allows bikers hikers to load the terrain into thei system and have it know all the details of a trail in splats

Yo.Town 3D 的头像
Yo.Town 3D3 个月前

This facilitates the creation of more 3D models. In cases where 3D printing is required, we may divide the models like,

Yunfan 的头像
Yunfan3 个月前

为什么要这么做呢? 从训练角度来看 人的3D视觉很有可能是因为两路输入信号(左右眼)的问题 但是我看你们学术界一直都是在玩类似单眼输入的映射

SomacoSF 的头像
SomacoSF3 个月前

you could also fly a drone ahead of say some smart EV/E-Bike along a trail and have it basically trace/lidar the terrain and send the exact model of the terrain to the chasing ev and it maps the suspension exactly with the terrain allowing for accelerationmaxxing BAJA style

Hao Zhang 的头像
Hao Zhang3 个月前

Welcome to try our model and share the failure cases! We will continue updating the more powerful checkpoints and models!

相关视频