正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

I'm testing tree generation using only two reference images. Basically, my Gaussian Splatting generation technique works with almost anything. I can't wait to see the final result once I’ve gathered a huge library of realistic assets for my game. For optimization, I’m planning to use a LOD system that... show more

Alex

6,865 subscribers

31,041 次观看 • 5 个月前 •via X (Twitter)

科学技术游戏

Anya Rossi• Live Now

Private livecam show

23 条评论

Risichad 🦾 的头像

Risichad 🦾5 个月前

That looks very good. I wonder what it would look like with pixel art as input.

Alex 的头像

Alex5 个月前

I just tried it, and the pixel art version works too, but I find it less impressive than the realistic style especially now that there are so many great post-processing filters available to create pixel art.

Risichad 🦾 的头像

Risichad 🦾5 个月前

Nice, thank you for trying it, i like the render, it can be very useful for retro 3D pixel art games !

Bastionson 的头像

Bastionson5 个月前

Looks super cool, whats the workflow? 😮

Artemisia Lux 的头像

Artemisia Lux5 个月前

nice. whats the tech based on?

David Bui 的头像

David Bui5 个月前

this is incredible

BK 的头像

BK5 个月前

Looks nice, what is the blue color seen near edges?

Alex 的头像

Alex5 个月前

The blue background from the reference image is what caused this issue.

Erwan_mp4 🇨🇵 的头像

Erwan_mp4 🇨🇵5 个月前

Do u think ur technique would work for 4DGS ?

uɐɥdǝʇS 的头像

uɐɥdǝʇS5 个月前

wow!

Adam Roszyk 的头像

Adam Roszyk5 个月前

Really cool interested to hear more!

Danvir47 🇨🇦 的头像

Danvir47 🇨🇦5 个月前

Looks fantastic! How does it look in different lighting arrangements?

ThiirdEyeTribe 的头像

ThiirdEyeTribe5 个月前

very nice !

CAPT. Marcus Flemming 的头像

CAPT. Marcus Flemming5 个月前

Brother I’d love to chat with you

Dane Cane 的头像

Dane Cane5 个月前

How can I get started?

Jordan 的头像

Jordan5 个月前

Looks good af!

Mage 的头像

Mage5 个月前

Can other people use it too?

BELOUDEST 的头像

BELOUDEST5 个月前

That looks nice, is that GS or converted to a mesh above already?

Julian le Roux 的头像

Julian le Roux5 个月前

@dangreenheck

Hank 的头像

Hank5 个月前

TWO reference images?? How

Mike Osswald ✳️ 的头像

Mike Osswald ✳️5 个月前

Can you mix this with something like this:

Serge Seed 的头像

Serge Seed5 个月前

Cool, dude! Can you please tell me what tool you use to do this? I want to rework Half-Life 2 in this way.

Pollitoyeye 🎮♨️🎼 的头像

Pollitoyeye 🎮♨️🎼5 个月前

How many cameras does this support?

相关视频

I finally released the LOD version of VRChat Gaussian splatting that supports 100M scale splats! Compared to v3 it has a huge changelist!

I finally released the LOD version of VRChat Gaussian splatting that supports 100M scale splats! Compared to v3 it has a huge changelist!

Mykhailo Moroz

91,648 次观看 • 3 个月前

*Warning* the video is somewhat NSFW, I'm testing another new technique that can generate a Gaussian Splatting model using only three viewing angles! It already works, but there's still a kind of ghosting/doubling effect that I need to fix.

Warning the video is somewhat NSFW, I'm testing another new technique that can generate a Gaussian Splatting model using only three viewing angles! It already works, but there's still a kind of ghosting/doubling effect that I need to fix.

Alex

13,425 次观看 • 6 个月前

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

MrNeRF

27,354 次观看 • 2 年前

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

Alex

29,776 次观看 • 6 个月前

$DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline$

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline

AK

24,910 次观看 • 2 年前

Getting my hands dirty with 30 Gaussian splats scanned in my garden. Is this the most splats ever in a single shot? Made with the support of Lenovo Snapdragon and the new Gaussian Splatting plugin by irrealix

Getting my hands dirty with 30 Gaussian splats scanned in my garden. Is this the most splats ever in a single shot? Made with the support of Lenovo Snapdragon and the new Gaussian Splatting plugin by irrealix

Paul Trillo

91,099 次观看 • 2 年前

Hosting a 3D Gaussian Splatting study session soon. Made a quick video comparing point cloud vs Gaussian Splats vs trained result, all with the same number of points. Hope it sparks some interest in #3DGS among the attendees.

Hosting a 3D Gaussian Splatting study session soon. Made a quick video comparing point cloud vs Gaussian Splats vs trained result, all with the same number of points. Hope it sparks some interest in #3DGS among the attendees.

Takashi Yoshinaga

17,593 次观看 • 6 个月前

Today, PlayCanvas is sharing a live demonstration of our Streaming LOD system for 3D Gaussian Splatting. Dynamically stream vast splat-based scenes of arbitrary complexity. 100% free. 100% open source. Demo link 👇 [1 / 2]

Today, PlayCanvas is sharing a live demonstration of our Streaming LOD system for 3D Gaussian Splatting. Dynamically stream vast splat-based scenes of arbitrary complexity. 100% free. 100% open source. Demo link 👇 [1 / 2]

PlayCanvas

122,961 次观看 • 1 年前

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

Bilawal Sidhu

61,583 次观看 • 1 年前

I created a 3D Gaussian Splat of my kitchen using 1/3rd the images it used to take me by using NVIDIA AI Developer's 3DGRUT! I can now use 180 degree fisheye images and ray tracing to make detailed splats. The only reason the scene isn't sharper is because my input images weren't super sharp - when I took the images back in October, I was still learning to use the lens. I plan to make a "first reactions/overview video". Tutorial after that. For reference, this took 206 images and the ultrawide on my iPhone took 608 images to capture. #3D #AEC #Computervision

I created a 3D Gaussian Splat of my kitchen using 1/3rd the images it used to take me by using NVIDIA AI Developer's 3DGRUT! I can now use 180 degree fisheye images and ray tracing to make detailed splats. The only reason the scene isn't sharper is because my input images weren't super sharp - when I took the images back in October, I was still learning to use the lens. I plan to make a "first reactions/overview video". Tutorial after that. For reference, this took 206 images and the ultrawide on my iPhone took 608 images to capture. #3D #AEC #Computervision

Jonathan Stephens

30,732 次观看 • 1 年前

Gaussian splats in Blender 5.3! Had to take it for a quick spin ofc - here with a scene I did using a generated image, Minimax H3-Max camera control through - converted to Gaussian splats with KIRI Engine - 3D Scanner App. It is possible to relight scenes with Gaussian Splats too, but it was pretty sloggish for me, even on a 5090. Could probably get better results with some optimization. It is kinda crazy to see this unfold - from image, to video, to 3d to dynamic generative worlds.

Gaussian splats in Blender 5.3! Had to take it for a quick spin ofc - here with a scene I did using a generated image, Minimax H3-Max camera control through - converted to Gaussian splats with KIRI Engine - 3D Scanner App. It is possible to relight scenes with Gaussian Splats too, but it was pretty sloggish for me, even on a 5090. Could probably get better results with some optimization. It is kinda crazy to see this unfold - from image, to video, to 3d to dynamic generative worlds.

Martin Nebelong

22,942 次观看 • 1 个月前

It's a bird. It's a plane. It's gaussian splatting. When Framestore needed to bring Kryptonian tech to Earth, they turned to gaussian splatting. In the recently released Superman, every shot of Kal-El's parents is a dynamic splat. I spoke to the team at Framestore about capturing the splats at Infinite-Realities and how they used CG Nomads GSOPs in SideFX's Houdini to help make the highest profile public use of gaussian splatting to date. Article

Radiance Fields

102,814 次观看 • 1 年前

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 次观看 • 1 年前

Drivable 3D Gaussian Avatars paper page: present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the recently presented 3D Gaussian Splatting (3DGS) technique to render realistic humans at real-time framerates, using dense calibrated multi-view videos as input. To deform those primitives, we depart from the commonly used point deformation method of linear blend skinning (LBS) and use a classic volumetric deformation method: cage deformations. Given their smaller size, we drive these deformations with joint angles and keypoints, which are more suitable for communication applications. Our experiments on nine subjects with varied body shapes, clothes, and motions obtain higher-quality results than state-of-the-art methods when using the same training and test data.

Drivable 3D Gaussian Avatars paper page: present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the recently presented 3D Gaussian Splatting (3DGS) technique to render realistic humans at real-time framerates, using dense calibrated multi-view videos as input. To deform those primitives, we depart from the commonly used point deformation method of linear blend skinning (LBS) and use a classic volumetric deformation method: cage deformations. Given their smaller size, we drive these deformations with joint angles and keypoints, which are more suitable for communication applications. Our experiments on nine subjects with varied body shapes, clothes, and motions obtain higher-quality results than state-of-the-art methods when using the same training and test data.

AK

327,487 次观看 • 3 年前

I'm testing out Gaussian splatting generation using LTX 2.3 and Postshot. It’s working pretty well, though there are still a few minor glitches. LTX

I'm testing out Gaussian splatting generation using LTX 2.3 and Postshot. It’s working pretty well, though there are still a few minor glitches. LTX

Alex

66,578 次观看 • 6 个月前

I made a little gaussian splat game demo set in a world created in World Labs Marble, using three.js + spark + crashcat + navcat, and I made a video about it! On the World Labs youtube channel now: + project github: My interest in game programming started from a place of curiosity after watching videos like SimonDev's three.js game tutorials. I tried to create something of the same spirit for this one :) It's a tour of the building blocks and concepts that come together to build a browser game inside a gaussian splat scene. It covers: - rendering gaussian splats with three.js + spark with level of detail - splat collision mesh generation - splat navigation mesh generation - adding a first person character controller - baking light probes for a gaussian splat to get environment lighting on characters - casting shadows from characters on a proxy mesh - character pathfinding + navigation mesh queries for quest ribbons - a silly prototype fetch quest in the game world to find the missing spaceship keys I don't think the game will win any awards 😛 but I hope it is a fun & useful game technology tour. Enjoy!

I made a little gaussian splat game demo set in a world created in World Labs Marble, using three.js + spark + crashcat + navcat, and I made a video about it! On the World Labs youtube channel now: + project github: My interest in game programming started from a place of curiosity after watching videos like SimonDev's three.js game tutorials. I tried to create something of the same spirit for this one :) It's a tour of the building blocks and concepts that come together to build a browser game inside a gaussian splat scene. It covers: - rendering gaussian splats with three.js + spark with level of detail - splat collision mesh generation - splat navigation mesh generation - adding a first person character controller - baking light probes for a gaussian splat to get environment lighting on characters - casting shadows from characters on a proxy mesh - character pathfinding + navigation mesh queries for quest ribbons - a silly prototype fetch quest in the game world to find the missing spaceship keys I don't think the game will win any awards 😛 but I hope it is a fun & useful game technology tour. Enjoy!

isaacmason

27,686 次观看 • 1 个月前

PlayCanvas Engine v2.12.0 is here 🚀 Streamed LOD system for 3D Gaussian Splats enters beta. Supports the streaming of 100s of millions of Gaussians! Release Notes:

PlayCanvas Engine v2.12.0 is here 🚀 Streamed LOD system for 3D Gaussian Splats enters beta. Supports the streaming of 100s of millions of Gaussians! Release Notes:

PlayCanvas

34,552 次观看 • 1 年前

BIG NEWS: Introducing SDF-Splats! 🚨 I just solved one of the biggest problems in 3D Gaussian Splatting: GAPS & HOLES! 🕳️❌ My hybrid approach combines: ✨ Explicit Gaussian Splats (for detail) ✨ Implicit SDFs (for continuity) The result? Seamless 3D reconstruction with NO visible holes, NO transparency artifacts, and REAL-TIME performance at 30-60 FPS! 🔥 Traditional Gaussian Splatting looks amazing but breaks apart in under-sampled regions. SDF-Splats fills every gap using on-demand raymarching through signed distance fields—zero preprocessing, zero neural nets, pure GPU magic! ⚡ Read the full research paper: #GaussianSplatting #SDF Radiance Fields MrNeRF #RealTime3D #VR #3DReconstruction #AIResearch

BIG NEWS: Introducing SDF-Splats! 🚨 I just solved one of the biggest problems in 3D Gaussian Splatting: GAPS & HOLES! 🕳️❌ My hybrid approach combines: ✨ Explicit Gaussian Splats (for detail) ✨ Implicit SDFs (for continuity) The result? Seamless 3D reconstruction with NO visible holes, NO transparency artifacts, and REAL-TIME performance at 30-60 FPS! 🔥 Traditional Gaussian Splatting looks amazing but breaks apart in under-sampled regions. SDF-Splats fills every gap using on-demand raymarching through signed distance fields—zero preprocessing, zero neural nets, pure GPU magic! ⚡ Read the full research paper: #GaussianSplatting #SDF Radiance Fields MrNeRF #RealTime3D #VR #3DReconstruction #AIResearch

Daniel Skaale

21,382 次观看 • 1 年前

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.

Alexandre Morgand

15,192 次观看 • 8 个月前