Загрузка видео...

Не удалось загрузить видео

На главную

(1/2) 📢📢𝐃𝐢𝐟𝐟𝐮𝐬𝐢𝐨𝐧𝐀𝐯𝐚𝐭𝐚𝐫𝐬 📢📢 High-fidelity 3D head avatars with precise control over viewpoint, expression, and pose. -> Our parametric 3D model enables control & consistency + 2D diffusion makes it photoreal.

66,436 просмотров • 2 лет назад •via X (Twitter)

Комментарии: 7

Фото профиля Matthias Niessner
Matthias Niessner2 лет назад

(2/2) We propose a diffusion-based neural renderer that translates 3D renderings from a neural parametric head model (NPHM) into photorealistic images. Learnable neural features are encoded on the 3D model & enforce consistency. Awesome work by @TobiasKirschst1 with @SGiebenhain

Фото профиля AndaSeat
AndaSeat1 год назад

🎯 Holds breath in sniper mode... 🎮 X-Air Pro's clutch features: 💨 Breathable mesh for sweaty 1v5 moments 🔫 Perfect height for that winning headshot ⚡ 5D armrests for precise aim control 😅 "Why did I solo queue" comfort mode 🎯 For those who main AWP and live dangerously! 🪑✨ Aim better: 🎪 Headshot deal: Snipe $20 off! #AndaSeat #CSGO #Valorant #ESports #Gaming

Фото профиля Hermes ᯅ
Hermes ᯅ2 лет назад

Every time I think I have a grasp on what’s possible, new ai models like this appear and just blow the lid off of my imagination.

Фото профиля Ankush Singal
Ankush Singal2 лет назад

I tried something similar

Фото профиля 田中義弘 | taziku CEO / AI × Creative
田中義弘 | taziku CEO / AI × Creative2 лет назад

The detailed reproduction of facial expressions, etc., is very wonderful!

Фото профиля denverdash
denverdash2 лет назад

Cool! How do you do the scans?

Фото профиля Mind of Machine
Mind of Machine2 лет назад

@CoffeeVectors Prepare for a whole new level of catfishing 😂

Похожие видео

📢📢 𝐀𝐯𝐚𝐭𝟑𝐫 📢📢 Avat3r creates high-quality 3D head avatars from just a few input images in a single forward pass with a new dynamic 3DGS reconstruction model. Video: Project: Our core idea is to make Gaussian Reconstruction Models animatable. We find that a simple cross-attention to an expression code sequence is already sufficient to model complex facial expressions. We then incorporate position maps from DUSt3R and feature maps from Sapiens to facilitate the prediction task. While DUSt3R's position maps act as a pixel-aligned initialization for the Gaussians' positions, the Sapiens feature maps help the cross-view transformer to match corresponding image tokens in the 4 input images. One major challenge in creating a 3D head avatar from smartphone images comes from inconsistent facial expressions when the subject could not remain perfectly static during the capture. We eliminate this static requirement by simply showing our model input images with different facial expressions during training. This technique makes our model robust to inconsistent input images later on. Finally, we show that despite the model has been trained with 4 input images, one can even create a 3D head avatar when only a single image is available. To achieve this, we employ a pre-trained 3D GAN to lift the single image to 3D and then render the 4 input images for our model. This allows us to create 3D head avatars from single images and even highly out-of-distribution examples like AI generated faces, paintings or statues. Great work by Tobias Kirschstein from his internship at Meta with Javier Romero, Artem Sevastopolsky, and Shunsuke Saito

Matthias Niessner

74,818 просмотров • 1 год назад

DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior paper page: present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture boosting. A central focus of this work is to address the consistency issue that existing works encounter. To sculpt geometries that render coherently, we perform score distillation sampling via a view-dependent diffusion model. This 3D prior, alongside several training strategies, prioritizes the geometry consistency but compromises the texture fidelity. We further propose Bootstrapped Score Distillation to specifically boost the texture. We train a personalized diffusion model, Dreambooth, on the augmented renderings of the scene, imbuing it with 3D knowledge of the scene being optimized. The score distillation from this 3D-aware diffusion prior provides view-consistent guidance for the scene. Notably, through an alternating optimization of the diffusion prior and 3D scene representation, we achieve mutually reinforcing improvements: the optimized 3D scene aids in training the scene-specific diffusion model, which offers increasingly view-consistent guidance for 3D optimization. The optimization is thus bootstrapped and leads to substantial texture boosting. With tailored 3D priors throughout the hierarchical generation, DreamCraft3D generates coherent 3D objects with photorealistic renderings, advancing the state-of-the-art in 3D content generation.

AK

161,530 просмотров • 2 лет назад