Загрузка видео...

Не удалось загрузить видео

На главную

(1/2) Check out 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧𝐀𝐯𝐚𝐭𝐚𝐫𝐬: Photorealistic Head Avatars with Rigged 3D Gaussians! We create photorealistic head avatars by animating 3D Gaussians on a parametric face model - edited and rendered in *real-time*!

MattNiessner's profile picture

Matthias Niessner

49,507 subscribers

127,135 просмотров • 2 лет назад •via X (Twitter)

Наука и технологииОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

(1/2) 📢𝐍𝐏𝐆𝐀: 𝐍𝐞𝐮𝐫𝐚𝐥 𝐏𝐚𝐫𝐚𝐦𝐞𝐭𝐫𝐢𝐜 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧 𝐀𝐯𝐚𝐭𝐚𝐫𝐬 📢 #SIGGRAPHAsia We leverage a neural parametric representation to facilitate precise control over 3D Gaussians to obtain high-fidelity avatars.
0:19

(1/2) 📢𝐍𝐏𝐆𝐀: 𝐍𝐞𝐮𝐫𝐚𝐥 𝐏𝐚𝐫𝐚𝐦𝐞𝐭𝐫𝐢𝐜 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧 𝐀𝐯𝐚𝐭𝐚𝐫𝐬 📢 #SIGGRAPHAsia We leverage a neural parametric representation to facilitate precise control over 3D Gaussians to obtain high-fidelity avatars.

Matthias Niessner

30,778 просмотров • 2 лет назад

Gaussian Head Avatar: Ultra High-fidelity Head Avatar via Dynamic Gaussians paper page: Creating high-fidelity 3D head avatars has always been a research hotspot, but there remains a great challenge under lightweight sparse view setups. In this paper, we propose Gaussian Head Avatar represented by controllable 3D Gaussians for high-fidelity head avatar modeling. We optimize the neutral 3D Gaussians and a fully learned MLP-based deformation field to capture complex expressions. The two parts benefit each other, thereby our method can model fine-grained dynamic details while ensuring expression accuracy. Furthermore, we devise a well-designed geometry-guided initialization strategy based on implicit SDF and Deep Marching Tetrahedra for the stability and convergence of the training procedure. Experiments show our approach outperforms other state-of-the-art sparse-view methods, achieving ultra high-fidelity rendering quality at 2K resolution even under exaggerated expressions.
0:12

Gaussian Head Avatar: Ultra High-fidelity Head Avatar via Dynamic Gaussians paper page: Creating high-fidelity 3D head avatars has always been a research hotspot, but there remains a great challenge under lightweight sparse view setups. In this paper, we propose Gaussian Head Avatar represented by controllable 3D Gaussians for high-fidelity head avatar modeling. We optimize the neutral 3D Gaussians and a fully learned MLP-based deformation field to capture complex expressions. The two parts benefit each other, thereby our method can model fine-grained dynamic details while ensuring expression accuracy. Furthermore, we devise a well-designed geometry-guided initialization strategy based on implicit SDF and Deep Marching Tetrahedra for the stability and convergence of the training procedure. Experiments show our approach outperforms other state-of-the-art sparse-view methods, achieving ultra high-fidelity rendering quality at 2K resolution even under exaggerated expressions.

AK

65,861 просмотров • 2 лет назад

SPARK can create high-quality 3D face avatars from regular videos and track expressions and poses in real time. It improves the accuracy of 3D face reconstructions for tasks like aging, face swapping, and digital makeup. 6 examples:
0:11

SPARK can create high-quality 3D face avatars from regular videos and track expressions and poses in real time. It improves the accuracy of 3D face reconstructions for tasks like aging, face swapping, and digital makeup. 6 examples:

Dreaming Tulpa 🥓👑

193,859 просмотров • 2 лет назад

This is RICULOUSLY good, TRELLIS 3D Generation model by Microsoft! 🔥 Generate high-quality 3D assets from text or image prompts. Supports various formats like Radiance Fields, 3D Gaussians, and meshes Available for FREE on Hugging Face!
0:14

This is RICULOUSLY good, TRELLIS 3D Generation model by Microsoft! 🔥 Generate high-quality 3D assets from text or image prompts. Supports various formats like Radiance Fields, 3D Gaussians, and meshes Available for FREE on Hugging Face!

Vaibhav (VB) Srivastav

62,455 просмотров • 1 год назад

Check out CloudRT, a new 3D pixel streaming platform for Unreal Engine that lets you create photorealistic and interactive 3D experiences on the web. Learn more and get started with Arcware CloudRT: #cloud #cloudrt #unrealengine #3d #3dart ARCWARE
0:10

Check out CloudRT, a new 3D pixel streaming platform for Unreal Engine that lets you create photorealistic and interactive 3D experiences on the web. Learn more and get started with Arcware CloudRT: #cloud #cloudrt #unrealengine #3d #3dart ARCWARE

80 LEVEL

13,636 просмотров • 2 лет назад

(1/2) MonoNPHM will be presented as a #CVPR2024 Highlight! Our Neural Parametric Head Model parametrizes both geometry and appearance. With the learned model, we can then 3D reconstruct and track human heads from images or videos.
0:18

(1/2) MonoNPHM will be presented as a #CVPR2024 Highlight! Our Neural Parametric Head Model parametrizes both geometry and appearance. With the learned model, we can then 3D reconstruct and track human heads from images or videos.

Matthias Niessner

17,209 просмотров • 2 лет назад

🚨 Excited to introduce our #CVPR2023 paper, MEGANE🤓!! MEGANE is an interaction-aware compositional 3D morphable eyeglasses and head model, supporting photorealistic rendering & relighting. (1/7) 👉Project:
0:19

🚨 Excited to introduce our #CVPR2023 paper, MEGANE🤓!! MEGANE is an interaction-aware compositional 3D morphable eyeglasses and head model, supporting photorealistic rendering & relighting. (1/7) 👉Project:

Shunsuke Saito

37,050 просмотров • 3 лет назад

Google has open-sourced GNM Head, its parametric model for generating 3D human heads The model, based on real-world scan data, provides 250 controls for head shape, and 380+ for facial expressions A free add-on integrates it into Blender #B3D
0:12

Google has open-sourced GNM Head, its parametric model for generating 3D human heads The model, based on real-world scan data, provides 250 controls for head shape, and 380+ for facial expressions A free add-on integrates it into Blender #B3D

CG Channel

46,823 просмотров • 2 месяцев назад

(1/2) We released our Neural Parametric Head Models (NPHM) dataset from our #CVPR2023 paper! It includes over 5600 high-fidelity 3D scans of human heads from 272 subjects - all publicly available! Check it out!
0:15

(1/2) We released our Neural Parametric Head Models (NPHM) dataset from our #CVPR2023 paper! It includes over 5600 high-fidelity 3D scans of human heads from 272 subjects - all publicly available! Check it out!

Matthias Niessner

36,064 просмотров • 3 лет назад

Apple just trained a 3D Gaussian head reconstruction model on 10,000+ subjects. Feed-forward. No test-time optimization. New identity in, reconstructed Gaussian head out. The UV-parameterized Gaussian representation decouples the number of Gaussians from the number and resolution of input images, making it practical to train with many high resolution views. And the heads are not just static either: text-conditioned identity generation, plus blendshape-driven latent animation across identities. We've been building in the 3D Gaussian Splatting space for a while. The gap between "research demo" and "works on real people at scale" is closing fast.
0:12

Apple just trained a 3D Gaussian head reconstruction model on 10,000+ subjects. Feed-forward. No test-time optimization. New identity in, reconstructed Gaussian head out. The UV-parameterized Gaussian representation decouples the number of Gaussians from the number and resolution of input images, making it practical to train with many high resolution views. And the heads are not just static either: text-conditioned identity generation, plus blendshape-driven latent animation across identities. We've been building in the 3D Gaussian Splatting space for a while. The gap between "research demo" and "works on real people at scale" is closing fast.

KIRI Engine - 3D Scanner App

12,263 просмотров • 4 месяцев назад

Human Hair Reconstruction with Strand-Aligned 3D Gaussians Contributions (cited): – We propose a new 3D line lifting scheme that uses a modified 3DGS reconstruction technique to lift 2D orientation maps into a 3D field while also providing refinement of the camera parameters; – We introduce a dual representation of hair strand polylines and 3D Gaussians to achieve differentiable rasterization of hair strands and leverage photometric constraints for strand-based hair reconstruction; – Based on these components, we propose a coarse-to-fine optimization method for prior-guided hair reconstruction that leverages both latent and explicit representations of the hairstyle.
0:13

Human Hair Reconstruction with Strand-Aligned 3D Gaussians Contributions (cited): – We propose a new 3D line lifting scheme that uses a modified 3DGS reconstruction technique to lift 2D orientation maps into a 3D field while also providing refinement of the camera parameters; – We introduce a dual representation of hair strand polylines and 3D Gaussians to achieve differentiable rasterization of hair strands and leverage photometric constraints for strand-based hair reconstruction; – Based on these components, we propose a coarse-to-fine optimization method for prior-guided hair reconstruction that leverages both latent and explicit representations of the hairstyle.

MrNeRF

106,653 просмотров • 2 лет назад

AI meets 3D anatomy? I made a real-time interactive 3D cat that reacts to your cursor with head tracking and tail movement. The skeleton, organs and rig were generated with AI using Omma and rendered with Three.js. Curious if you would actually use something like this.
0:15

AI meets 3D anatomy? I made a real-time interactive 3D cat that reacts to your cursor with head tracking and tail movement. The skeleton, organs and rig were generated with AI using Omma and rendered with Three.js. Curious if you would actually use something like this.

Gábor Pribék

11,392 просмотров • 4 месяцев назад

GSTAR: Gaussian Surface Tracking and Reconstruction Contributions: • A new framework for tracking and reconstructing dynamic scenes, combining 3D Gaussians and meshes to effectively manage changes in topology. • A method for Gaussian unbinding and surface re-meshing, allowing for the generation of new surfaces as topologies evolve. • A method for handling large or fast deformations of surfaces between frames using scene flow warping. Abstract (excerpt): However, tracking dynamic surfaces with 3D Gaussians remains challenging due to complex topology changes, such as surfaces appearing, disappearing, or splitting. To address these challenges, we propose GSTAR, a novel method that achieves photo-realistic rendering, accurate surface reconstruction, and reliable 3D tracking for general dynamic scenes with changing topology. Given multi-view captures as input, GSTAR binds Gaussians to mesh faces to represent dynamic objects. For surfaces with consistent topology, GSTAR maintains the mesh topology and tracks the meshes using Gaussians.
0:13

GSTAR: Gaussian Surface Tracking and Reconstruction Contributions: • A new framework for tracking and reconstructing dynamic scenes, combining 3D Gaussians and meshes to effectively manage changes in topology. • A method for Gaussian unbinding and surface re-meshing, allowing for the generation of new surfaces as topologies evolve. • A method for handling large or fast deformations of surfaces between frames using scene flow warping. Abstract (excerpt): However, tracking dynamic surfaces with 3D Gaussians remains challenging due to complex topology changes, such as surfaces appearing, disappearing, or splitting. To address these challenges, we propose GSTAR, a novel method that achieves photo-realistic rendering, accurate surface reconstruction, and reliable 3D tracking for general dynamic scenes with changing topology. Given multi-view captures as input, GSTAR binds Gaussians to mesh faces to represent dynamic objects. For surfaces with consistent topology, GSTAR maintains the mesh topology and tracks the meshes using Gaussians.

MrNeRF

22,698 просмотров • 1 год назад

Wow, Gemini 3.1 Pro just crushed one of my test problems no other model could solve. "Write a photorealistic 3D ocean simulation" 3D graphics is extremely hard. It has to encode 9-10 techniques based in physics. Being off by just 1 number can lead to bonkers results
0:10

Wow, Gemini 3.1 Pro just crushed one of my test problems no other model could solve. "Write a photorealistic 3D ocean simulation" 3D graphics is extremely hard. It has to encode 9-10 techniques based in physics. Being off by just 1 number can lead to bonkers results

Deedy

5,047,160 просмотров • 7 месяцев назад

(1/2) Check out "𝐏𝐨𝐥𝐲𝐃𝐢𝐟𝐟: Generating 3D Polygonal Meshes with Diffusion Models"! Our model operates directly on the polygons of 3D meshes and generates novel shapes as output through an iterative diffusion process.
0:11

(1/2) Check out "𝐏𝐨𝐥𝐲𝐃𝐢𝐟𝐟: Generating 3D Polygonal Meshes with Diffusion Models"! Our model operates directly on the polygons of 3D meshes and generates novel shapes as output through an iterative diffusion process.

Matthias Niessner

57,947 просмотров • 2 лет назад

Also the [ 🌐 Make 3d model ] feature on Photo AI has been upgraded to Tripo's new state of the art model So you can turn any AI photo or video you took into a 3d model in about a minute AI 3d models are not photorealistic yet, but as you see they're getting closer Before the face was completely distorted, now it's at least visible but still cartooney looking! 👍
0:15

Also the [ 🌐 Make 3d model ] feature on Photo AI has been upgraded to Tripo's new state of the art model So you can turn any AI photo or video you took into a 3d model in about a minute AI 3d models are not photorealistic yet, but as you see they're getting closer Before the face was completely distorted, now it's at least visible but still cartooney looking! 👍

@levelsio

47,093 просмотров • 1 год назад

After 4 months in beta Avaturn avatars with ARKit blendshapes support released! We are live on Product Hunt! Support us at We also added TONS of new Features (see detailed description in the comment below) Shoutout to Chris Messina for hunting us, to Three.js for awesome dev tool, and a huge thank you to our phenomenal community of game developers & 3D creators - you make this journey worthwhile! #ProductHunt #3D #Avatars #Metaverse #GameDev
0:12

After 4 months in beta Avaturn avatars with ARKit blendshapes support released! We are live on Product Hunt! Support us at We also added TONS of new Features (see detailed description in the comment below) Shoutout to Chris Messina for hunting us, to Three.js for awesome dev tool, and a huge thank you to our phenomenal community of game developers & 3D creators - you make this journey worthwhile! #ProductHunt #3D #Avatars #Metaverse #GameDev

Avaturn

90,321 просмотров • 3 лет назад

New Update: Minecraft 3D generation now in under 10s in falcraft⚡ Text → Image (FLUX.2 Klein) → 3D Gaussian splat (TripoSplat) → Voxelize → Minecraft structure! ~260k colored Gaussians are returned, we filter the faint ones, drop each into a voxel cell, average the color per cell and snap it into the nearest MC block in LAB color space
0:13

New Update: Minecraft 3D generation now in under 10s in falcraft⚡ Text → Image (FLUX.2 Klein) → 3D Gaussian splat (TripoSplat) → Voxelize → Minecraft structure! ~260k colored Gaussians are returned, we filter the faint ones, drop each into a voxel cell, average the color per cell and snap it into the nearest MC block in LAB color space

Blendi

31,917 просмотров • 3 месяцев назад