Загрузка видео...

Не удалось загрузить видео

На главную

I'm testing tree generation using only two reference images. Basically, my Gaussian Splatting generation technique works with almost anything. I can't wait to see the final result once I’ve gathered a huge library of realistic assets for my game. For optimization, I’m planning to use a LOD system that...

alexfredo87's profile picture

Alex

4,015 subscribers

30,539 просмотров • 2 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

*Warning* the video is somewhat NSFW, I'm testing another new technique that can generate a Gaussian Splatting model using only three viewing angles! It already works, but there's still a kind of ghosting/doubling effect that I need to fix.
1:29

*Warning* the video is somewhat NSFW, I'm testing another new technique that can generate a Gaussian Splatting model using only three viewing angles! It already works, but there's still a kind of ghosting/doubling effect that I need to fix.

Alex

13,425 просмотров • 2 месяцев назад

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.
1:06

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

Alex

29,776 просмотров • 2 месяцев назад

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.
0:20

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

MrNeRF

27,277 просмотров • 1 год назад

I created a 3D Gaussian Splat of my kitchen using 1/3rd the images it used to take me by using NVIDIA AI Developer's 3DGRUT! I can now use 180 degree fisheye images and ray tracing to make detailed splats. The only reason the scene isn't sharper is because my input images weren't super sharp - when I took the images back in October, I was still learning to use the lens. I plan to make a "first reactions/overview video". Tutorial after that. For reference, this took 206 images and the ultrawide on my iPhone took 608 images to capture. #3D #AEC #Computervision
0:40

I created a 3D Gaussian Splat of my kitchen using 1/3rd the images it used to take me by using NVIDIA AI Developer's 3DGRUT! I can now use 180 degree fisheye images and ray tracing to make detailed splats. The only reason the scene isn't sharper is because my input images weren't super sharp - when I took the images back in October, I was still learning to use the lens. I plan to make a "first reactions/overview video". Tutorial after that. For reference, this took 206 images and the ultrawide on my iPhone took 608 images to capture. #3D #AEC #Computervision

Jonathan Stephens

30,663 просмотров • 1 год назад

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.
1:10

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 просмотров • 9 месяцев назад

Drivable 3D Gaussian Avatars paper page: present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the recently presented 3D Gaussian Splatting (3DGS) technique to render realistic humans at real-time framerates, using dense calibrated multi-view videos as input. To deform those primitives, we depart from the commonly used point deformation method of linear blend skinning (LBS) and use a classic volumetric deformation method: cage deformations. Given their smaller size, we drive these deformations with joint angles and keypoints, which are more suitable for communication applications. Our experiments on nine subjects with varied body shapes, clothes, and motions obtain higher-quality results than state-of-the-art methods when using the same training and test data.
6:20

Drivable 3D Gaussian Avatars paper page: present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the recently presented 3D Gaussian Splatting (3DGS) technique to render realistic humans at real-time framerates, using dense calibrated multi-view videos as input. To deform those primitives, we depart from the commonly used point deformation method of linear blend skinning (LBS) and use a classic volumetric deformation method: cage deformations. Given their smaller size, we drive these deformations with joint angles and keypoints, which are more suitable for communication applications. Our experiments on nine subjects with varied body shapes, clothes, and motions obtain higher-quality results than state-of-the-art methods when using the same training and test data.

AK

327,105 просмотров • 2 лет назад

BIG NEWS: Introducing SDF-Splats! 🚨 I just solved one of the biggest problems in 3D Gaussian Splatting: GAPS & HOLES! 🕳️❌ My hybrid approach combines: ✨ Explicit Gaussian Splats (for detail) ✨ Implicit SDFs (for continuity) The result? Seamless 3D reconstruction with NO visible holes, NO transparency artifacts, and REAL-TIME performance at 30-60 FPS! 🔥 Traditional Gaussian Splatting looks amazing but breaks apart in under-sampled regions. SDF-Splats fills every gap using on-demand raymarching through signed distance fields—zero preprocessing, zero neural nets, pure GPU magic! ⚡ Read the full research paper: #GaussianSplatting #SDF Radiance Fields MrNeRF #RealTime3D #VR #3DReconstruction #AIResearch
0:20

BIG NEWS: Introducing SDF-Splats! 🚨 I just solved one of the biggest problems in 3D Gaussian Splatting: GAPS & HOLES! 🕳️❌ My hybrid approach combines: ✨ Explicit Gaussian Splats (for detail) ✨ Implicit SDFs (for continuity) The result? Seamless 3D reconstruction with NO visible holes, NO transparency artifacts, and REAL-TIME performance at 30-60 FPS! 🔥 Traditional Gaussian Splatting looks amazing but breaks apart in under-sampled regions. SDF-Splats fills every gap using on-demand raymarching through signed distance fields—zero preprocessing, zero neural nets, pure GPU magic! ⚡ Read the full research paper: #GaussianSplatting #SDF Radiance Fields MrNeRF #RealTime3D #VR #3DReconstruction #AIResearch

Daniel Skaale

21,031 просмотров • 8 месяцев назад

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.
0:33

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.

Martin Nebelong

36,774 просмотров • 7 месяцев назад

Big news I found a way to convert Gaussian Splatting into a standard mesh while preserving all the visual advantages of Gaussian Splatting, such as reflections, shadows, and lighting that changes depending on the viewing angle. The result is excellent performance, even on an old laptop or a VR headset. And of course, the mesh can be animated like any regular 3D mesh, while still keeping the visual benefits of GS. I’ll soon show a full-body character animated using this technique.
1:30

Big news I found a way to convert Gaussian Splatting into a standard mesh while preserving all the visual advantages of Gaussian Splatting, such as reflections, shadows, and lighting that changes depending on the viewing angle. The result is excellent performance, even on an old laptop or a VR headset. And of course, the mesh can be animated like any regular 3D mesh, while still keeping the visual benefits of GS. I’ll soon show a full-body character animated using this technique.

Alex

37,137 просмотров • 2 месяцев назад

The Gaussian Pole in Action Here is the first capture I made on my initial attempt using standard camera settings. From a single 360-degree orbit around the bike, I extracted 452 images from the five DJI Osmo Action 4 cameras. For ease of viewing and sharing, I rendered the output with luma. While the overall result isn't bad, the details could be sharper. I'll need to tweak the camera settings. Nonetheless, I'm quite pleased with this first effort, and there's significant potential to enhance the quality further with camera setting adjustments.
0:24

The Gaussian Pole in Action Here is the first capture I made on my initial attempt using standard camera settings. From a single 360-degree orbit around the bike, I extracted 452 images from the five DJI Osmo Action 4 cameras. For ease of viewing and sharing, I rendered the output with luma. While the overall result isn't bad, the details could be sharper. I'll need to tweak the camera settings. Nonetheless, I'm quite pleased with this first effort, and there's significant potential to enhance the quality further with camera setting adjustments.

MrNeRF

24,521 просмотров • 1 год назад

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.
5:36

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.

AK

140,992 просмотров • 2 лет назад

After a lot of research, I managed to create a tool for Godot that makes it possible to animate Gaussian Splatting with bones, especially for human bodies using Godot’s Skeleton3D. There are still a few small bugs when importing animations, but I’m definitely on the right track.
1:28

After a lot of research, I managed to create a tool for Godot that makes it possible to animate Gaussian Splatting with bones, especially for human bodies using Godot’s Skeleton3D. There are still a few small bugs when importing animations, but I’m definitely on the right track.

Alex

42,086 просмотров • 2 месяцев назад

I'm not from the same generation as you are, and I don't want to see my generation that actually forms a majority of the populations on both sides of the border to be trapped by the past . BilawalBhuttoZardari #BilawalTrueStatesman
3:06

I'm not from the same generation as you are, and I don't want to see my generation that actually forms a majority of the populations on both sides of the border to be trapped by the past . BilawalBhuttoZardari #BilawalTrueStatesman

Qamar Zaman Kaira

21,746 просмотров • 1 год назад

I really want to show off the cutting edge tech the team is building and how we're turning AI image generation into real living environments using gaussian splats and at the :19 mark of this video you can see how we're blending splats together to create a real world. What this looks like from a gaming perspective is this all happens behind the players view to simulate a real world environment. As you move through the space, distance becomes a variable to consider on how images update and are experienced. We are creating a new reality in real time.
1:21

I really want to show off the cutting edge tech the team is building and how we're turning AI image generation into real living environments using gaussian splats and at the :19 mark of this video you can see how we're blending splats together to create a real world. What this looks like from a gaming perspective is this all happens behind the players view to simulate a real world environment. As you move through the space, distance becomes a variable to consider on how images update and are experienced. We are creating a new reality in real time.

𝔹𝕃𝕍ℂ𝕂𝕃!𝔾ℍ𝕋

25,084 просмотров • 1 месяц назад

Gaussian Splatting is pretty wild. Being able to take dense collections of assets and package them into fast, real-time splats opens up a ton of new possibilities for look-dev, previs, and interactive scenes. For this test, I built a pile of 400 skulls - roughly 40+ million polygons (and over 400 8K texture instances) - rendered out a 600 frame dataset on The Render Network with OTOY OctaneRender and then converted the result into a single splat asset. Now it runs in real-time as one compact Gaussian Splat.
1:55

Gaussian Splatting is pretty wild. Being able to take dense collections of assets and package them into fast, real-time splats opens up a ton of new possibilities for look-dev, previs, and interactive scenes. For this test, I built a pile of 400 skulls - roughly 40+ million polygons (and over 400 8K texture instances) - rendered out a 600 frame dataset on The Render Network with OTOY OctaneRender and then converted the result into a single splat asset. Now it runs in real-time as one compact Gaussian Splat.

Spenser Dickerson

46,560 просмотров • 8 месяцев назад

Did you know the Imperial Palace in Dune: Prophecy, a kilometer wide environment reconstructed from over 18 million gaussian splats, was reconstructed on a single RTX 4090? I spoke to julien hery and the Rodeo FX team about how they pulled it off, why Gaussian Splatting is starting to reshape VFX workflows, and what would be necessary for it to be final pixels in production. Article
0:24

Did you know the Imperial Palace in Dune: Prophecy, a kilometer wide environment reconstructed from over 18 million gaussian splats, was reconstructed on a single RTX 4090? I spoke to julien hery and the Rodeo FX team about how they pulled it off, why Gaussian Splatting is starting to reshape VFX workflows, and what would be necessary for it to be final pixels in production. Article

Radiance Fields

79,314 просмотров • 9 месяцев назад

SuperSplat's voxel collision is a game changer for 3D Gaussian splat creators. Generate a highly accurate, inescapable voxel representation of any splat, regardless of quality. Generation is performed on the GPU, so it's super-fast. The voxel representation is tiny - only 418KB for this scene. And all this magic is free and open source, courtesy of the splat-transform library from PlayCanvas.
0:50

SuperSplat's voxel collision is a game changer for 3D Gaussian splat creators. Generate a highly accurate, inescapable voxel representation of any splat, regardless of quality. Generation is performed on the GPU, so it's super-fast. The voxel representation is tiny - only 418KB for this scene. And all this magic is free and open source, courtesy of the splat-transform library from PlayCanvas.

Will Eastcott

12,653 просмотров • 2 месяцев назад

[SIGGRAPH Asia '25] Editable Physically-based Reflections in Raytraced Gaussian Radiance Fields Contributions: • A reconstruction method for radiance fields, with distinct optimization for diffuse and specular components, using path tracing for the latter. • An efficient and accurate training method that reconstructs the diffuse and specular components of the scene in a single representation. • An efficient ray tracer for Gaussian primitives, fast enough to enable treatment of multiple bounces with minimal computational overhead.
0:30

[SIGGRAPH Asia '25] Editable Physically-based Reflections in Raytraced Gaussian Radiance Fields Contributions: • A reconstruction method for radiance fields, with distinct optimization for diffuse and specular components, using path tracing for the latter. • An efficient and accurate training method that reconstructs the diffuse and specular components of the scene in a single representation. • An efficient ray tracer for Gaussian primitives, fast enough to enable treatment of multiple bounces with minimal computational overhead.

MrNeRF

15,810 просмотров • 9 месяцев назад

GPS-Gaussian+: Generalizable Pixel-wise 3D Gaussian Splatting for Real-Time Human-Scene Rendering from Sparse Views TL;DR: Are we witnessing the first steps towards 3DGS live streaming? Contributions: • We introduce a generalizable 3D Gaussian Splatting methodology that employs pixel-wise Gaussian parameter maps defined on 2D source image planes to formulate 3D Gaussians in a feed-forward manner. • We propose a fully differentiable framework composed of an iterative depth estimation module and a Gaussian parameter regression module. The intermediate depth prediction bridges the two components and allows them to benefit from joint training. • We introduce a regularization term and an epipolar attention mechanism to preserve geometry consistency between the two source views when using only rendering loss. Our method generalizes well to unseen characters even in complicated scenes. • We develop a real-time FVV system that achieves high-resolution rendering of characters in the scene without any geometry supervision.
0:23

GPS-Gaussian+: Generalizable Pixel-wise 3D Gaussian Splatting for Real-Time Human-Scene Rendering from Sparse Views TL;DR: Are we witnessing the first steps towards 3DGS live streaming? Contributions: • We introduce a generalizable 3D Gaussian Splatting methodology that employs pixel-wise Gaussian parameter maps defined on 2D source image planes to formulate 3D Gaussians in a feed-forward manner. • We propose a fully differentiable framework composed of an iterative depth estimation module and a Gaussian parameter regression module. The intermediate depth prediction bridges the two components and allows them to benefit from joint training. • We introduce a regularization term and an epipolar attention mechanism to preserve geometry consistency between the two source views when using only rendering loss. Our method generalizes well to unseen characters even in complicated scenes. • We develop a real-time FVV system that achieves high-resolution rendering of characters in the scene without any geometry supervision.

MrNeRF

25,862 просмотров • 1 год назад

The PlayCanvas team has solved collision for 3D Gaussian splats. Install splat-transform via NPM to get a CLI tool + library that can output high quality voxel-based collision. Here you can see a splat navigated in first person mode with voxel rendering toggled on/off. 🧵
0:37

The PlayCanvas team has solved collision for 3D Gaussian splats. Install splat-transform via NPM to get a CLI tool + library that can output high quality voxel-based collision. Here you can see a splat navigated in first person mode with voxel rendering toggled on/off. 🧵

Will Eastcott

30,195 просмотров • 3 месяцев назад