正在加载视频...

视频加载失败

返回首页

Source code released: 3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting

janusch_patas's profile picture

MrNeRF

16,881 subscribers

18,357 次观看 • 2 年前 •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

2 条评论

softyoda 的头像
softyoda2 年前

Is there a just middle between monocular video input and array of 64 1000€ cameras ? (like I got 3 GoPro + 1DSLR + 1 Smartphone, could be nice to have ways to almost sync and register all)

MrNeRF 的头像
MrNeRF2 年前

No experience with that. Why don't you try it and make a project out of it?

相关视频

This is not 3D Gaussian Splatting, it's deformable beta splatting! Thanks to Rong Liu for letting me know code was live. Congrats to the whole team at USC! #3D #Radiancefield
0:36

This is not 3D Gaussian Splatting, it's deformable beta splatting! Thanks to Rong Liu for letting me know code was live. Congrats to the whole team at USC! #3D #Radiancefield

Jonathan Stephens

16,491 次观看 • 1 年前

Alibaba just dropped TaoAvatar on Hugging Face Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting
0:41

Alibaba just dropped TaoAvatar on Hugging Face Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting

AK

329,222 次观看 • 1 年前

Code released: "GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting"
1:10

Code released: "GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting"

MrNeRF

22,279 次观看 • 2 年前

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.
5:36

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.

AK

141,058 次观看 • 2 年前

Code released: "Code for SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes"
0:22

Code released: "Code for SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes"

MrNeRF

11,951 次观看 • 2 年前

𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗨𝗩𝗚𝗦 We introduce 𝗨𝗩𝗚𝗦, a new 2D representation of 3D Gaussian Splatting (3DGS) that leverages spherical mapping. Website: Paper:
0:23

𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗨𝗩𝗚𝗦 We introduce 𝗨𝗩𝗚𝗦, a new 2D representation of 3D Gaussian Splatting (3DGS) that leverages spherical mapping. Website: Paper:

Nikolaos Sarafianos

10,750 次观看 • 1 年前

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2
0:22

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2

Gordon Wetzstein

52,480 次观看 • 2 年前

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️
0:27

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️

Alex Carlier

445,878 次观看 • 2 年前

3D Gaussian Splatting in WebGPU is ready
0:26

3D Gaussian Splatting in WebGPU is ready

el.cine

28,817 次观看 • 8 个月前

Relightable Real-Time Avatars Meta Codec Avatars 2.0 gets an update, building on 3D Gaussian Splatting from Meta. Accuracy is down to the human hair strand level 🔬 🧵 A thread
0:27

Relightable Real-Time Avatars Meta Codec Avatars 2.0 gets an update, building on 3D Gaussian Splatting from Meta. Accuracy is down to the human hair strand level 🔬 🧵 A thread

Linus ✦ Ekenstam

351,972 次观看 • 2 年前

a two minute explanation of 3D Gaussian Splatting
2:07

a two minute explanation of 3D Gaussian Splatting

dylan

254,900 次观看 • 3 年前

HUGE NEWS for 3D Gaussian Splatting! 📢 The PlayCanvas Engine adopts SOGS for 20x Compression of 3DGS. 🗜️ Load HUGE splat scenes even on mobile! 📱 Read More:
0:32

HUGE NEWS for 3D Gaussian Splatting! 📢 The PlayCanvas Engine adopts SOGS for 20x Compression of 3DGS. 🗜️ Load HUGE splat scenes even on mobile! 📱 Read More:

PlayCanvas

22,664 次观看 • 1 年前

We made a small open source project with 3D Gaussian Splatting. KIRI-Maker lets you turn your 3DGS scans into something more than static captures: ✨ Particle effects 🎥 Camera path animations 🖐️ Gesture controls 🎬 Exportable videos Explore, animate, and play with your 3D scans.
0:28

We made a small open source project with 3D Gaussian Splatting. KIRI-Maker lets you turn your 3DGS scans into something more than static captures: ✨ Particle effects 🎥 Camera path animations 🖐️ Gesture controls 🎬 Exportable videos Explore, animate, and play with your 3D scans.

KIRI Engine - 3D Scanner App

29,871 次观看 • 1 个月前

AnySplat Feed-forward 3D Gaussian Splatting from Unconstrained Views
0:58

AnySplat Feed-forward 3D Gaussian Splatting from Unconstrained Views

AK

18,744 次观看 • 1 年前

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️
0:37

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️

404

44,735 次观看 • 1 年前

Presenting on Gaussian Splatting and the Future of 3D
6:55

Presenting on Gaussian Splatting and the Future of 3D

dylan

78,366 次观看 • 2 年前

Alibaba released LHM! a new model that can generate high-quality, animatable 3D human avatars from a single image in just a few seconds
0:55

Alibaba released LHM! a new model that can generate high-quality, animatable 3D human avatars from a single image in just a few seconds

Dreaming Tulpa 🥓👑

21,853 次观看 • 1 年前