Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

I'm testing tree generation using only two reference images. Basically, my Gaussian Splatting generation technique works with almost anything. I can't wait to see the final result once I’ve gathered a huge library of realistic assets for my game. For optimization, I’m planning to use a LOD system that... show more

Alex

6,865 subscribers

31,041 Aufrufe • vor 5 Monaten •via X (Twitter)

Wissenschaft & Technologie Gaming

Anya Rossi• Live Now

Private livecam show

23 Kommentare

Profilbild von Risichad 🦾

Risichad 🦾vor 5 Monaten

That looks very good. I wonder what it would look like with pixel art as input.

Profilbild von Alex

Alexvor 5 Monaten

I just tried it, and the pixel art version works too, but I find it less impressive than the realistic style especially now that there are so many great post-processing filters available to create pixel art.

Profilbild von Risichad 🦾

Risichad 🦾vor 5 Monaten

Nice, thank you for trying it, i like the render, it can be very useful for retro 3D pixel art games !

Profilbild von Bastionson

Bastionsonvor 5 Monaten

Looks super cool, whats the workflow? 😮

Profilbild von Artemisia Lux

Artemisia Luxvor 5 Monaten

nice. whats the tech based on?

Profilbild von David Bui

David Buivor 5 Monaten

this is incredible

Profilbild von BK

BKvor 5 Monaten

Looks nice, what is the blue color seen near edges?

Profilbild von Alex

Alexvor 5 Monaten

The blue background from the reference image is what caused this issue.

Profilbild von Erwan_mp4 🇨🇵

Erwan_mp4 🇨🇵vor 5 Monaten

Do u think ur technique would work for 4DGS ?

Profilbild von uɐɥdǝʇS

uɐɥdǝʇSvor 5 Monaten

wow!

Profilbild von Adam Roszyk

Adam Roszykvor 5 Monaten

Really cool interested to hear more!

Profilbild von Danvir47 🇨🇦

Danvir47 🇨🇦vor 5 Monaten

Looks fantastic! How does it look in different lighting arrangements?

Profilbild von ThiirdEyeTribe

ThiirdEyeTribevor 5 Monaten

very nice !

Profilbild von CAPT. Marcus Flemming

CAPT. Marcus Flemmingvor 5 Monaten

Brother I’d love to chat with you

Profilbild von Dane Cane

Dane Canevor 5 Monaten

How can I get started?

Profilbild von Jordan

Jordanvor 5 Monaten

Looks good af!

Profilbild von Mage

Magevor 5 Monaten

Can other people use it too?

Profilbild von BELOUDEST

BELOUDESTvor 5 Monaten

That looks nice, is that GS or converted to a mesh above already?

Profilbild von Julian le Roux

Julian le Rouxvor 5 Monaten

@dangreenheck

Profilbild von Hank

Hankvor 5 Monaten

TWO reference images?? How

Profilbild von Mike Osswald ✳️

Mike Osswald ✳️vor 5 Monaten

Can you mix this with something like this:

Profilbild von Serge Seed

Serge Seedvor 5 Monaten

Cool, dude! Can you please tell me what tool you use to do this? I want to rework Half-Life 2 in this way.

Profilbild von Pollitoyeye 🎮♨️🎼

Pollitoyeye 🎮♨️🎼vor 5 Monaten

How many cameras does this support?

Ähnliche Videos

I finally released the LOD version of VRChat Gaussian splatting that supports 100M scale splats! Compared to v3 it has a huge changelist!

I finally released the LOD version of VRChat Gaussian splatting that supports 100M scale splats! Compared to v3 it has a huge changelist!

Mykhailo Moroz

91,648 Aufrufe • vor 3 Monaten

*Warning* the video is somewhat NSFW, I'm testing another new technique that can generate a Gaussian Splatting model using only three viewing angles! It already works, but there's still a kind of ghosting/doubling effect that I need to fix.

Warning the video is somewhat NSFW, I'm testing another new technique that can generate a Gaussian Splatting model using only three viewing angles! It already works, but there's still a kind of ghosting/doubling effect that I need to fix.

Alex

13,425 Aufrufe • vor 6 Monaten

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

MrNeRF

27,354 Aufrufe • vor 2 Jahren

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

Alex

29,776 Aufrufe • vor 6 Monaten

$DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline$

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline

AK

24,910 Aufrufe • vor 2 Jahren

Getting my hands dirty with 30 Gaussian splats scanned in my garden. Is this the most splats ever in a single shot? Made with the support of Lenovo Snapdragon and the new Gaussian Splatting plugin by irrealix

Getting my hands dirty with 30 Gaussian splats scanned in my garden. Is this the most splats ever in a single shot? Made with the support of Lenovo Snapdragon and the new Gaussian Splatting plugin by irrealix

Paul Trillo

91,099 Aufrufe • vor 2 Jahren

Hosting a 3D Gaussian Splatting study session soon. Made a quick video comparing point cloud vs Gaussian Splats vs trained result, all with the same number of points. Hope it sparks some interest in #3DGS among the attendees.

Hosting a 3D Gaussian Splatting study session soon. Made a quick video comparing point cloud vs Gaussian Splats vs trained result, all with the same number of points. Hope it sparks some interest in #3DGS among the attendees.

Takashi Yoshinaga

17,593 Aufrufe • vor 6 Monaten

Today, PlayCanvas is sharing a live demonstration of our Streaming LOD system for 3D Gaussian Splatting. Dynamically stream vast splat-based scenes of arbitrary complexity. 100% free. 100% open source. Demo link 👇 [1 / 2]

Today, PlayCanvas is sharing a live demonstration of our Streaming LOD system for 3D Gaussian Splatting. Dynamically stream vast splat-based scenes of arbitrary complexity. 100% free. 100% open source. Demo link 👇 [1 / 2]

PlayCanvas

122,961 Aufrufe • vor 1 Jahr

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

Bilawal Sidhu

61,583 Aufrufe • vor 1 Jahr

I created a 3D Gaussian Splat of my kitchen using 1/3rd the images it used to take me by using NVIDIA AI Developer's 3DGRUT! I can now use 180 degree fisheye images and ray tracing to make detailed splats. The only reason the scene isn't sharper is because my input images weren't super sharp - when I took the images back in October, I was still learning to use the lens. I plan to make a "first reactions/overview video". Tutorial after that. For reference, this took 206 images and the ultrawide on my iPhone took 608 images to capture. #3D #AEC #Computervision

I created a 3D Gaussian Splat of my kitchen using 1/3rd the images it used to take me by using NVIDIA AI Developer's 3DGRUT! I can now use 180 degree fisheye images and ray tracing to make detailed splats. The only reason the scene isn't sharper is because my input images weren't super sharp - when I took the images back in October, I was still learning to use the lens. I plan to make a "first reactions/overview video". Tutorial after that. For reference, this took 206 images and the ultrawide on my iPhone took 608 images to capture. #3D #AEC #Computervision

Jonathan Stephens

30,732 Aufrufe • vor 1 Jahr

Gaussian splats in Blender 5.3! Had to take it for a quick spin ofc - here with a scene I did using a generated image, Minimax H3-Max camera control through - converted to Gaussian splats with KIRI Engine - 3D Scanner App. It is possible to relight scenes with Gaussian Splats too, but it was pretty sloggish for me, even on a 5090. Could probably get better results with some optimization. It is kinda crazy to see this unfold - from image, to video, to 3d to dynamic generative worlds.

Gaussian splats in Blender 5.3! Had to take it for a quick spin ofc - here with a scene I did using a generated image, Minimax H3-Max camera control through - converted to Gaussian splats with KIRI Engine - 3D Scanner App. It is possible to relight scenes with Gaussian Splats too, but it was pretty sloggish for me, even on a 5090. Could probably get better results with some optimization. It is kinda crazy to see this unfold - from image, to video, to 3d to dynamic generative worlds.

Martin Nebelong

22,942 Aufrufe • vor 1 Monat

It's a bird. It's a plane. It's gaussian splatting. When Framestore needed to bring Kryptonian tech to Earth, they turned to gaussian splatting. In the recently released Superman, every shot of Kal-El's parents is a dynamic splat. I spoke to the team at Framestore about capturing the splats at Infinite-Realities and how they used CG Nomads GSOPs in SideFX's Houdini to help make the highest profile public use of gaussian splatting to date. Article

Radiance Fields

102,814 Aufrufe • vor 1 Jahr

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 Aufrufe • vor 1 Jahr

Drivable 3D Gaussian Avatars paper page: present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the recently presented 3D Gaussian Splatting (3DGS) technique to render realistic humans at real-time framerates, using dense calibrated multi-view videos as input. To deform those primitives, we depart from the commonly used point deformation method of linear blend skinning (LBS) and use a classic volumetric deformation method: cage deformations. Given their smaller size, we drive these deformations with joint angles and keypoints, which are more suitable for communication applications. Our experiments on nine subjects with varied body shapes, clothes, and motions obtain higher-quality results than state-of-the-art methods when using the same training and test data.

Drivable 3D Gaussian Avatars paper page: present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the recently presented 3D Gaussian Splatting (3DGS) technique to render realistic humans at real-time framerates, using dense calibrated multi-view videos as input. To deform those primitives, we depart from the commonly used point deformation method of linear blend skinning (LBS) and use a classic volumetric deformation method: cage deformations. Given their smaller size, we drive these deformations with joint angles and keypoints, which are more suitable for communication applications. Our experiments on nine subjects with varied body shapes, clothes, and motions obtain higher-quality results than state-of-the-art methods when using the same training and test data.

AK

327,487 Aufrufe • vor 3 Jahren

I'm testing out Gaussian splatting generation using LTX 2.3 and Postshot. It’s working pretty well, though there are still a few minor glitches. LTX

I'm testing out Gaussian splatting generation using LTX 2.3 and Postshot. It’s working pretty well, though there are still a few minor glitches. LTX

Alex

66,578 Aufrufe • vor 6 Monaten

I made a little gaussian splat game demo set in a world created in World Labs Marble, using three.js + spark + crashcat + navcat, and I made a video about it! On the World Labs youtube channel now: + project github: My interest in game programming started from a place of curiosity after watching videos like SimonDev's three.js game tutorials. I tried to create something of the same spirit for this one :) It's a tour of the building blocks and concepts that come together to build a browser game inside a gaussian splat scene. It covers: - rendering gaussian splats with three.js + spark with level of detail - splat collision mesh generation - splat navigation mesh generation - adding a first person character controller - baking light probes for a gaussian splat to get environment lighting on characters - casting shadows from characters on a proxy mesh - character pathfinding + navigation mesh queries for quest ribbons - a silly prototype fetch quest in the game world to find the missing spaceship keys I don't think the game will win any awards 😛 but I hope it is a fun & useful game technology tour. Enjoy!

I made a little gaussian splat game demo set in a world created in World Labs Marble, using three.js + spark + crashcat + navcat, and I made a video about it! On the World Labs youtube channel now: + project github: My interest in game programming started from a place of curiosity after watching videos like SimonDev's three.js game tutorials. I tried to create something of the same spirit for this one :) It's a tour of the building blocks and concepts that come together to build a browser game inside a gaussian splat scene. It covers: - rendering gaussian splats with three.js + spark with level of detail - splat collision mesh generation - splat navigation mesh generation - adding a first person character controller - baking light probes for a gaussian splat to get environment lighting on characters - casting shadows from characters on a proxy mesh - character pathfinding + navigation mesh queries for quest ribbons - a silly prototype fetch quest in the game world to find the missing spaceship keys I don't think the game will win any awards 😛 but I hope it is a fun & useful game technology tour. Enjoy!

isaacmason

27,686 Aufrufe • vor 1 Monat

PlayCanvas Engine v2.12.0 is here 🚀 Streamed LOD system for 3D Gaussian Splats enters beta. Supports the streaming of 100s of millions of Gaussians! Release Notes:

PlayCanvas Engine v2.12.0 is here 🚀 Streamed LOD system for 3D Gaussian Splats enters beta. Supports the streaming of 100s of millions of Gaussians! Release Notes:

PlayCanvas

34,552 Aufrufe • vor 1 Jahr

BIG NEWS: Introducing SDF-Splats! 🚨 I just solved one of the biggest problems in 3D Gaussian Splatting: GAPS & HOLES! 🕳️❌ My hybrid approach combines: ✨ Explicit Gaussian Splats (for detail) ✨ Implicit SDFs (for continuity) The result? Seamless 3D reconstruction with NO visible holes, NO transparency artifacts, and REAL-TIME performance at 30-60 FPS! 🔥 Traditional Gaussian Splatting looks amazing but breaks apart in under-sampled regions. SDF-Splats fills every gap using on-demand raymarching through signed distance fields—zero preprocessing, zero neural nets, pure GPU magic! ⚡ Read the full research paper: #GaussianSplatting #SDF Radiance Fields MrNeRF #RealTime3D #VR #3DReconstruction #AIResearch

BIG NEWS: Introducing SDF-Splats! 🚨 I just solved one of the biggest problems in 3D Gaussian Splatting: GAPS & HOLES! 🕳️❌ My hybrid approach combines: ✨ Explicit Gaussian Splats (for detail) ✨ Implicit SDFs (for continuity) The result? Seamless 3D reconstruction with NO visible holes, NO transparency artifacts, and REAL-TIME performance at 30-60 FPS! 🔥 Traditional Gaussian Splatting looks amazing but breaks apart in under-sampled regions. SDF-Splats fills every gap using on-demand raymarching through signed distance fields—zero preprocessing, zero neural nets, pure GPU magic! ⚡ Read the full research paper: #GaussianSplatting #SDF Radiance Fields MrNeRF #RealTime3D #VR #3DReconstruction #AIResearch

Daniel Skaale

21,382 Aufrufe • vor 1 Jahr

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.

Alexandre Morgand

15,192 Aufrufe • vor 8 Monaten