Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Source code released: 3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting

janusch_patas's profile picture

MrNeRF

16,881 subscribers

18,357 görüntüleme • 2 yıl önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

2 Yorum

softyoda profil fotoğrafı
softyoda2 yıl önce

Is there a just middle between monocular video input and array of 64 1000€ cameras ? (like I got 3 GoPro + 1DSLR + 1 Smartphone, could be nice to have ways to almost sync and register all)

MrNeRF profil fotoğrafı
MrNeRF2 yıl önce

No experience with that. Why don't you try it and make a project out of it?

Benzer Videolar

This is not 3D Gaussian Splatting, it's deformable beta splatting! Thanks to Rong Liu for letting me know code was live. Congrats to the whole team at USC! #3D #Radiancefield
0:36

This is not 3D Gaussian Splatting, it's deformable beta splatting! Thanks to Rong Liu for letting me know code was live. Congrats to the whole team at USC! #3D #Radiancefield

Jonathan Stephens

16,491 görüntüleme • 1 yıl önce

Alibaba just dropped TaoAvatar on Hugging Face Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting
0:41

Alibaba just dropped TaoAvatar on Hugging Face Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting

AK

329,222 görüntüleme • 1 yıl önce

Code released: "GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting"
1:10

Code released: "GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting"

MrNeRF

22,279 görüntüleme • 2 yıl önce

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.
5:36

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.

AK

141,058 görüntüleme • 2 yıl önce

Code released: "Code for SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes"
0:22

Code released: "Code for SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes"

MrNeRF

11,951 görüntüleme • 2 yıl önce

𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗨𝗩𝗚𝗦 We introduce 𝗨𝗩𝗚𝗦, a new 2D representation of 3D Gaussian Splatting (3DGS) that leverages spherical mapping. Website: Paper:
0:23

𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗨𝗩𝗚𝗦 We introduce 𝗨𝗩𝗚𝗦, a new 2D representation of 3D Gaussian Splatting (3DGS) that leverages spherical mapping. Website: Paper:

Nikolaos Sarafianos

10,750 görüntüleme • 1 yıl önce

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2
0:22

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2

Gordon Wetzstein

52,480 görüntüleme • 2 yıl önce

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️
0:27

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️

Alex Carlier

445,878 görüntüleme • 2 yıl önce

3D Gaussian Splatting in WebGPU is ready
0:26

3D Gaussian Splatting in WebGPU is ready

el.cine

28,817 görüntüleme • 8 ay önce

Relightable Real-Time Avatars Meta Codec Avatars 2.0 gets an update, building on 3D Gaussian Splatting from Meta. Accuracy is down to the human hair strand level 🔬 🧵 A thread
0:27

Relightable Real-Time Avatars Meta Codec Avatars 2.0 gets an update, building on 3D Gaussian Splatting from Meta. Accuracy is down to the human hair strand level 🔬 🧵 A thread

Linus ✦ Ekenstam

351,972 görüntüleme • 2 yıl önce

a two minute explanation of 3D Gaussian Splatting
2:07

a two minute explanation of 3D Gaussian Splatting

dylan

254,900 görüntüleme • 3 yıl önce

HUGE NEWS for 3D Gaussian Splatting! 📢 The PlayCanvas Engine adopts SOGS for 20x Compression of 3DGS. 🗜️ Load HUGE splat scenes even on mobile! 📱 Read More:
0:32

HUGE NEWS for 3D Gaussian Splatting! 📢 The PlayCanvas Engine adopts SOGS for 20x Compression of 3DGS. 🗜️ Load HUGE splat scenes even on mobile! 📱 Read More:

PlayCanvas

22,664 görüntüleme • 1 yıl önce

We made a small open source project with 3D Gaussian Splatting. KIRI-Maker lets you turn your 3DGS scans into something more than static captures: ✨ Particle effects 🎥 Camera path animations 🖐️ Gesture controls 🎬 Exportable videos Explore, animate, and play with your 3D scans.
0:28

We made a small open source project with 3D Gaussian Splatting. KIRI-Maker lets you turn your 3DGS scans into something more than static captures: ✨ Particle effects 🎥 Camera path animations 🖐️ Gesture controls 🎬 Exportable videos Explore, animate, and play with your 3D scans.

KIRI Engine - 3D Scanner App

29,871 görüntüleme • 1 ay önce

AnySplat Feed-forward 3D Gaussian Splatting from Unconstrained Views
0:58

AnySplat Feed-forward 3D Gaussian Splatting from Unconstrained Views

AK

18,744 görüntüleme • 1 yıl önce

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️
0:37

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️

404

44,735 görüntüleme • 1 yıl önce

Presenting on Gaussian Splatting and the Future of 3D
6:55

Presenting on Gaussian Splatting and the Future of 3D

dylan

78,366 görüntüleme • 2 yıl önce

Alibaba released LHM! a new model that can generate high-quality, animatable 3D human avatars from a single image in just a few seconds
0:55

Alibaba released LHM! a new model that can generate high-quality, animatable 3D human avatars from a single image in just a few seconds

Dreaming Tulpa 🥓👑

21,853 görüntüleme • 1 yıl önce