Загрузка видео...

Не удалось загрузить видео

На главную

Source code released: 3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting

janusch_patas's profile picture

MrNeRF

16,881 subscribers

18,357 просмотров • 2 лет назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 2

Фото профиля softyoda
softyoda2 лет назад

Is there a just middle between monocular video input and array of 64 1000€ cameras ? (like I got 3 GoPro + 1DSLR + 1 Smartphone, could be nice to have ways to almost sync and register all)

Фото профиля MrNeRF
MrNeRF2 лет назад

No experience with that. Why don't you try it and make a project out of it?

Похожие видео

This is not 3D Gaussian Splatting, it's deformable beta splatting! Thanks to Rong Liu for letting me know code was live. Congrats to the whole team at USC! #3D #Radiancefield
0:36

This is not 3D Gaussian Splatting, it's deformable beta splatting! Thanks to Rong Liu for letting me know code was live. Congrats to the whole team at USC! #3D #Radiancefield

Jonathan Stephens

16,491 просмотров • 1 год назад

Alibaba just dropped TaoAvatar on Hugging Face Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting
0:41

Alibaba just dropped TaoAvatar on Hugging Face Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting

AK

329,222 просмотров • 1 год назад

Code released: "GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting"
1:10

Code released: "GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting"

MrNeRF

22,279 просмотров • 2 лет назад

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.
5:36

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.

AK

141,058 просмотров • 2 лет назад

Code released: "Code for SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes"
0:22

Code released: "Code for SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes"

MrNeRF

11,951 просмотров • 2 лет назад

𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗨𝗩𝗚𝗦 We introduce 𝗨𝗩𝗚𝗦, a new 2D representation of 3D Gaussian Splatting (3DGS) that leverages spherical mapping. Website: Paper:
0:23

𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗨𝗩𝗚𝗦 We introduce 𝗨𝗩𝗚𝗦, a new 2D representation of 3D Gaussian Splatting (3DGS) that leverages spherical mapping. Website: Paper:

Nikolaos Sarafianos

10,750 просмотров • 1 год назад

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2
0:22

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2

Gordon Wetzstein

52,480 просмотров • 2 лет назад

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️
0:27

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️

Alex Carlier

445,878 просмотров • 2 лет назад

3D Gaussian Splatting in WebGPU is ready
0:26

3D Gaussian Splatting in WebGPU is ready

el.cine

28,817 просмотров • 8 месяцев назад

Relightable Real-Time Avatars Meta Codec Avatars 2.0 gets an update, building on 3D Gaussian Splatting from Meta. Accuracy is down to the human hair strand level 🔬 🧵 A thread
0:27

Relightable Real-Time Avatars Meta Codec Avatars 2.0 gets an update, building on 3D Gaussian Splatting from Meta. Accuracy is down to the human hair strand level 🔬 🧵 A thread

Linus ✦ Ekenstam

351,972 просмотров • 2 лет назад

a two minute explanation of 3D Gaussian Splatting
2:07

a two minute explanation of 3D Gaussian Splatting

dylan

254,900 просмотров • 3 лет назад

HUGE NEWS for 3D Gaussian Splatting! 📢 The PlayCanvas Engine adopts SOGS for 20x Compression of 3DGS. 🗜️ Load HUGE splat scenes even on mobile! 📱 Read More:
0:32

HUGE NEWS for 3D Gaussian Splatting! 📢 The PlayCanvas Engine adopts SOGS for 20x Compression of 3DGS. 🗜️ Load HUGE splat scenes even on mobile! 📱 Read More:

PlayCanvas

22,664 просмотров • 1 год назад

We made a small open source project with 3D Gaussian Splatting. KIRI-Maker lets you turn your 3DGS scans into something more than static captures: ✨ Particle effects 🎥 Camera path animations 🖐️ Gesture controls 🎬 Exportable videos Explore, animate, and play with your 3D scans.
0:28

We made a small open source project with 3D Gaussian Splatting. KIRI-Maker lets you turn your 3DGS scans into something more than static captures: ✨ Particle effects 🎥 Camera path animations 🖐️ Gesture controls 🎬 Exportable videos Explore, animate, and play with your 3D scans.

KIRI Engine - 3D Scanner App

29,871 просмотров • 1 месяц назад

AnySplat Feed-forward 3D Gaussian Splatting from Unconstrained Views
0:58

AnySplat Feed-forward 3D Gaussian Splatting from Unconstrained Views

AK

18,744 просмотров • 1 год назад

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️
0:37

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️

404

44,735 просмотров • 1 год назад

Presenting on Gaussian Splatting and the Future of 3D
6:55

Presenting on Gaussian Splatting and the Future of 3D

dylan

78,366 просмотров • 2 лет назад

Alibaba released LHM! a new model that can generate high-quality, animatable 3D human avatars from a single image in just a few seconds
0:55

Alibaba released LHM! a new model that can generate high-quality, animatable 3D human avatars from a single image in just a few seconds

Dreaming Tulpa 🥓👑

21,853 просмотров • 1 год назад