Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway

18,714 Aufrufe • vor 1 Jahr •via X (Twitter)

8 Kommentare

Profilbild von Common Sense Machines
Common Sense Machinesvor 1 Jahr

Different style

Profilbild von Common Sense Machines
Common Sense Machinesvor 1 Jahr

"cartoon and pixar style style room"

Profilbild von AshutoshShrivastava
AshutoshShrivastavavor 1 Jahr

@Blender @runwayml Impressive..

Profilbild von Treebel ▲
Treebel ▲vor 1 Jahr

@Blender @runwayml woah

Profilbild von madpencil_
madpencil_vor 1 Jahr

@Blender @runwayml Amazing

Profilbild von Amira Zairi
Amira Zairivor 1 Jahr

@Blender @runwayml Impressive 🔥 🤩

Profilbild von Hrmkmdtv
Hrmkmdtvvor 1 Jahr

@Blender @runwayml Thats the way

Profilbild von Sergio Suave
Sergio Suavevor 1 Jahr

@Blender @runwayml Great result! You can even add a 3rd final enhancement step with my upscaler. Would like to include this scene in my next demo if you're interested.

Ähnliche Videos

DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior paper page: present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture boosting. A central focus of this work is to address the consistency issue that existing works encounter. To sculpt geometries that render coherently, we perform score distillation sampling via a view-dependent diffusion model. This 3D prior, alongside several training strategies, prioritizes the geometry consistency but compromises the texture fidelity. We further propose Bootstrapped Score Distillation to specifically boost the texture. We train a personalized diffusion model, Dreambooth, on the augmented renderings of the scene, imbuing it with 3D knowledge of the scene being optimized. The score distillation from this 3D-aware diffusion prior provides view-consistent guidance for the scene. Notably, through an alternating optimization of the diffusion prior and 3D scene representation, we achieve mutually reinforcing improvements: the optimized 3D scene aids in training the scene-specific diffusion model, which offers increasingly view-consistent guidance for 3D optimization. The optimization is thus bootstrapped and leads to substantial texture boosting. With tailored 3D priors throughout the hierarchical generation, DreamCraft3D generates coherent 3D objects with photorealistic renderings, advancing the state-of-the-art in 3D content generation.

AK

161,530 Aufrufe • vor 2 Jahren