Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Gaussian Splatting in VR, all code written by me from scratch on DX12 + OpenVR. 2x2016x2240 res, no clever multi-view stuff yet so just running the whole render pipeline once per eye. Left the frame timer on so you can see I've been truthful about my perf :D

Charlie Shenton

1,053 subscribers

121,806 Aufrufe • vor 2 Jahren •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von Charlie Shenton

Charlie Shentonvor 2 Jahren

Now I've tried this I have a LOT of thoughts to share. 1) I was afraid the approximate affine transform of the gaussians into 2d would not be stereoscopically consistent. I am no longer concerned about that. By the time you get close enough you're out of stereo overlap.

Profilbild von Charlie Shenton

Charlie Shentonvor 2 Jahren

2) I am thinking this is the future of geometry for VR. Why? - It is inherently anti-aliased, which is a big deal for VR - Its performance scales sublinearly with resolution - Geometric density in VR is more compelling than surface texture density

Profilbild von Charlie Shenton

Charlie Shentonvor 2 Jahren

3) Even up close where the "illusion" of photorealism is broken, this is still really visually pleasant. It's like looking at brush strokes on a paint, vs. triangles when it's clipping plane city.

Profilbild von Charlie Shenton

Charlie Shentonvor 2 Jahren

4) Photogrammetry / Novel view synthesis is not the most interesting use case, I want to be able to model these directly. Absolutely no reason you can't just replace SH colour with regular PBR material properties.

Profilbild von Charlie Shenton

Charlie Shentonvor 2 Jahren

5) Speaking of Spherical Harmonics. For their massive data cost they don't add much. Bet you didn't even notice I disabled them for this video ;) (Not for perf reasons, they are by far one of the cheaper parts of the pipeline).

Profilbild von Charlie Shenton

Charlie Shentonvor 2 Jahren

6) On aliasing, the fact we are "shading" per vertex let's us do interesting things like filtering the shaded geometry itself. In VR this could be a good way to combat specular aliasing, since we are always blending + averaging when using gaussian splats.

Profilbild von Charlie Shenton

Charlie Shentonvor 2 Jahren

7) This performance is still unacceptably low. Let's put this in perspective, this is ~5M source primitives, and we're not doing any per vertex or pixel "shading". Not doing any sort of direct or indirect illumination.

Profilbild von Charlie Shenton

Charlie Shentonvor 2 Jahren

8) So way slower than triangles. I think for this to be relevant for games, the geometry pipeline needs to be about 5-10x faster, and we need a way to scale to Billions of source primitives. Time to get working on that I guess.

Profilbild von NeubertIM 📯

NeubertIM 📯vor 2 Jahren

Amazing work

Profilbild von Charlie Shenton

Charlie Shentonvor 2 Jahren

Thanks!

Ähnliche Videos

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.

Martin Nebelong

36,774 Aufrufe • vor 8 Monaten

Now you can not only animate yourself as a #GaussianSplatting avatar, but also view it all in #VR. This is the latest addition to my list of apps and tools to view Gaussian Splatting in VR on #MetaQuest or #VisionPro. Just subscribe to the XR AI Spotlight newsletter (link on top of my profile) and you will get the link to the full list in the welcome email 😉 Special thanks to Naruya Kondo for making this demo available.

Gabriele Romagnoli

11,312 Aufrufe • vor 9 Monaten

A lot of people forget the Steam Frame is running a proper PC OS, you can do stuff like this entirely self-contained with no PC connection at all, just some chromium windows on-device. Doing stuff like this is some of my favorite casual VR use. I hope it releases soon!

A lot of people forget the Steam Frame is running a proper PC OS, you can do stuff like this entirely self-contained with no PC connection at all, just some chromium windows on-device. Doing stuff like this is some of my favorite casual VR use. I hope it releases soon!

Brian Lindenhof

61,369 Aufrufe • vor 1 Monat

Unruly, the history book I've written, is published today! So you can get it in shops! Or by clicking on the link below! To celebrate that fact, here is a video reflecting on one of the key lessons I've taken from the past: sometimes things just happen.

Unruly, the history book I've written, is published today! So you can get it in shops! Or by clicking on the link below! To celebrate that fact, here is a video reflecting on one of the key lessons I've taken from the past: sometimes things just happen.

David Mitchell

102,616 Aufrufe • vor 2 Jahren

You can explore these AI-generated worlds on #VisionPro in 2 ways 👇 Option 1 is to get a link directly from Marble, the platform from World Labs that has recently opened beta access and allows users to use a prompt image to generate worlds as #GaussianSplatting. You just click on share and get a link you can input in your browser's headset. The viewer has several limitations since you cannot adjust scale, set the starting point or navigate the scene freely. Option 2 is to use Supersplat from Will Eastcott and his team. There you can do some editing and once in VR you can navigate around, looking and pinching to explore the generated portions of the model more freely. If you are into Gaussian Splatting and #VR remember to check out the list of updated tools that allow you to experience Gaussian Splatting in any headset. Just subscribe to my newsletter (link on top of my profile) and you will get it dircetly in your inbox.

Gabriele Romagnoli

24,881 Aufrufe • vor 11 Monaten

What happens if you try to push and squash a Gaussian splat? :) Been playing with adding simplified deformation and a lightweight physics simulation layer to Gaussian splats, running directly in real time on mobile. Instead of simulating every splat, this uses a small CPU lattice to drive the deformation, plus a per-splat transform so they actually stretch and compress properly. No mesh conversion, no retraining. Just layered on top of the renderer. You can push, bend, squash a scan and it holds together surprisingly well... Still early, but I can see the potential in making splats feel more real, from static captures to something more tactile, something you can touch, throw, bounce around… or well just fold and squash on the floor :) #GaussianSplatting #3DGS #Unity

What happens if you try to push and squash a Gaussian splat? :) Been playing with adding simplified deformation and a lightweight physics simulation layer to Gaussian splats, running directly in real time on mobile. Instead of simulating every splat, this uses a small CPU lattice to drive the deformation, plus a per-splat transform so they actually stretch and compress properly. No mesh conversion, no retraining. Just layered on top of the renderer. You can push, bend, squash a scan and it holds together surprisingly well... Still early, but I can see the potential in making splats feel more real, from static captures to something more tactile, something you can touch, throw, bounce around… or well just fold and squash on the floor :) #GaussianSplatting #3DGS #Unity

𝐑𝐔𝐁𝐄𝐍🥽𝐅𝐑𝐎

51,284 Aufrufe • vor 4 Monaten

My flight sim went viral and cost me $1,200 in 24hrs So I got Claude + Codex to rebuild the whole thing from scratch v3 is live — fly anywhere on Earth in photorealistic 3D You can also nuke each other now Inspired by the OG flight sim vibe coder @levelsio

My flight sim went viral and cost me $1,200 in 24hrs So I got Claude + Codex to rebuild the whole thing from scratch v3 is live — fly anywhere on Earth in photorealistic 3D You can also nuke each other now Inspired by the OG flight sim vibe coder @levelsio

Alistair McLeay

230,508 Aufrufe • vor 6 Monaten

Jaylen Brown opened up about wrist procedures and the use of modern medicine when asked about addressing his past weakness with his left hand: “I tore all my ligaments in my wrist in 2021 and I've had some procedures and stuff post that… I've had some chips in my wrist over the last couple years… I've had some issues. I don’t usually tell the media or the world about it, but I’ve had some issues with my left wrist. But I've always felt like my whole life I've been able to get to my off-hand. I’ve dunked on people with my left hand. You know, never had an issue.”

Jaylen Brown opened up about wrist procedures and the use of modern medicine when asked about addressing his past weakness with his left hand: “I tore all my ligaments in my wrist in 2021 and I've had some procedures and stuff post that… I've had some chips in my wrist over the last couple years… I've had some issues. I don’t usually tell the media or the world about it, but I’ve had some issues with my left wrist. But I've always felt like my whole life I've been able to get to my off-hand. I’ve dunked on people with my left hand. You know, never had an issue.”

Justin Turpin

144,337 Aufrufe • vor 7 Monaten

Vibe coded something new today 😉 It’s a 3D Solana AI protocol website built using Gemini 3 Pro in Google AI Studio. All the Three.js models you see on the site have been built from scratch by AI using different geometries, PBR, Linear Interpolation, Lightformers (IBL), Shadows and more :D Live: Code:

Vibe coded something new today 😉 It’s a 3D Solana AI protocol website built using Gemini 3 Pro in Google AI Studio. All the Three.js models you see on the site have been built from scratch by AI using different geometries, PBR, Linear Interpolation, Lightformers (IBL), Shadows and more :D Live: Code:

The Bugged Dev

21,128 Aufrufe • vor 7 Monaten

SEONGHWA - SKIN Lyrics (eng trans) #성화 #ATEEZ #에이티즈 A scent that chokes me Seeps in without a trace Kill me with that look, babe She got a way that makes it look bad The sharp touch of temptation So many tangled senses With the mask peeled away You have me now Swallow me deeper, all of me I know that you want it I’m waiting for that touch The way she moves, wildfire An explosive desire Wanna see you go higher It’s written on my skin Breathless, all day night I can’t escape Hold me so tight, oh babe It’s written on my skin Trapped in the darkness We feel each other’s breath Dangerous emotions She makes me want some more Bound by breath It’s keeping me awake Waking me from sleep It’s written on my skin Hide my secret But baby, only if you want Whatever you want You know you deserve it, oh yeah I faintly hear your trembling breath I’m loving what I hear Signals felt at the brush of your fingertips A rule only we know Swallow me deeper, all of me I know that you want it I’m waiting for that touch The way she moves, wildfire An explosive desire Wanna see you go higher It’s written on my skin Breathless, all day night I can’t escape Hold me so tight, oh babe It’s written on my skin Trapped in the darkness We feel each other’s breath Dangerous emotions She makes me want some more Bound by breath It’s keeping me awake Waking me from sleep It’s written on my skin I’m waiting for that touch The way she moves, wildfire An explosive desire Wanna see you go higher It’s written on my skin Breathless, all day night I can’t escape Hold me so tight, oh babe It’s written on my skin

SEONGHWA - SKIN Lyrics (eng trans) #성화 #ATEEZ #에이티즈 A scent that chokes me Seeps in without a trace Kill me with that look, babe She got a way that makes it look bad The sharp touch of temptation So many tangled senses With the mask peeled away You have me now Swallow me deeper, all of me I know that you want it I’m waiting for that touch The way she moves, wildfire An explosive desire Wanna see you go higher It’s written on my skin Breathless, all day night I can’t escape Hold me so tight, oh babe It’s written on my skin Trapped in the darkness We feel each other’s breath Dangerous emotions She makes me want some more Bound by breath It’s keeping me awake Waking me from sleep It’s written on my skin Hide my secret But baby, only if you want Whatever you want You know you deserve it, oh yeah I faintly hear your trembling breath I’m loving what I hear Signals felt at the brush of your fingertips A rule only we know Swallow me deeper, all of me I know that you want it I’m waiting for that touch The way she moves, wildfire An explosive desire Wanna see you go higher It’s written on my skin Breathless, all day night I can’t escape Hold me so tight, oh babe It’s written on my skin Trapped in the darkness We feel each other’s breath Dangerous emotions She makes me want some more Bound by breath It’s keeping me awake Waking me from sleep It’s written on my skin I’m waiting for that touch The way she moves, wildfire An explosive desire Wanna see you go higher It’s written on my skin Breathless, all day night I can’t escape Hold me so tight, oh babe It’s written on my skin

seonghwa files

75,604 Aufrufe • vor 1 Jahr

Hello everyone, i've been very very busy with the Contra Force port. Specifically, this IRQ sequence in stage 4 which i've converted to HDMA. Hands down, the most difficult split screen i've worked on in all my years. The part that stinks about this, is the developers have the construction of the additonal sequences like this, different from this one i've worked on. So all of the wing-to-wing sequences in this have to be different from the on i've just done here. Once this level is complete, it's full speed ahead. I'm hoping for a beta before Christmas for everyone. Thank you all for your continued support and interest in these ports! 🙂

Hello everyone, i've been very very busy with the Contra Force port. Specifically, this IRQ sequence in stage 4 which i've converted to HDMA. Hands down, the most difficult split screen i've worked on in all my years. The part that stinks about this, is the developers have the construction of the additonal sequences like this, different from this one i've worked on. So all of the wing-to-wing sequences in this have to be different from the on i've just done here. Once this level is complete, it's full speed ahead. I'm hoping for a beta before Christmas for everyone. Thank you all for your continued support and interest in these ports! 🙂

infidelity

11,106 Aufrufe • vor 8 Monaten

🦣 PAINTING with ME 🌺 'The Enchanted Garden' 🎨 In this video we are going to break ground on this long flowy grass, which I etched into the gesso initially 🖼️ I've superimposed the original photo in the frame go you can have a better idea of what's going on 📹 This is long, and I don't expect many of you to watch it all the way through and that's okay 📦 A few of you have told me this is what you want to see so this is me delivering 🎶 Chill vibes by Dr. Duane Render

🦣 PAINTING with ME 🌺 'The Enchanted Garden' 🎨 In this video we are going to break ground on this long flowy grass, which I etched into the gesso initially 🖼️ I've superimposed the original photo in the frame go you can have a better idea of what's going on 📹 This is long, and I don't expect many of you to watch it all the way through and that's okay 📦 A few of you have told me this is what you want to see so this is me delivering 🎶 Chill vibes by Dr. Duane Render

Tusk 🦣

38,634 Aufrufe • vor 11 Monaten

Robot VR control. All the existing "VR" teleop systems I tried felt like shit so I put together my own. Instead of just piping a camera feed, I do a 3d reconstruction so you get depth perception and 6DoF head movement. This feels waay better than a flat image (no 3d, might as well skip the VR), or directly streaming per-eye video, which gets you depth but leaves your view locked in place (0DoF lmao). Not really sure why nobody else seems to do this.

Robot VR control. All the existing "VR" teleop systems I tried felt like shit so I put together my own. Instead of just piping a camera feed, I do a 3d reconstruction so you get depth perception and 6DoF head movement. This feels waay better than a flat image (no 3d, might as well skip the VR), or directly streaming per-eye video, which gets you depth but leaves your view locked in place (0DoF lmao). Not really sure why nobody else seems to do this.

FrostyFridge

31,073 Aufrufe • vor 4 Monaten

i wrote this song for fionna and cake season 2! it came out today on hbo max. so sick to see marshall playing banjo 🤩 song written by me, banjo by me and if you listen real close you can hear my vocal in the background. so honored i got to do this. AT means everything 2 me :’)

i wrote this song for fionna and cake season 2! it came out today on hbo max. so sick to see marshall playing banjo 🤩 song written by me, banjo by me and if you listen real close you can hear my vocal in the background. so honored i got to do this. AT means everything 2 me :’)

THEE evil

28,267 Aufrufe • vor 8 Monaten

Listen to this absolute clown on Jeremy Vine talking about "disinformation", ironically by spreading disinformation about me! I've been banned from Facebook for years, so f*ck knows who she has seen saying "they're all in this hotel let's get down there" but it certainly wasn't me. Yet the panel nods along, doesn't even try to correct her, all pushing the same lies unchallenged.

Listen to this absolute clown on Jeremy Vine talking about "disinformation", ironically by spreading disinformation about me! I've been banned from Facebook for years, so f*ck knows who she has seen saying "they're all in this hotel let's get down there" but it certainly wasn't me. Yet the panel nods along, doesn't even try to correct her, all pushing the same lies unchallenged.

Tommy Robinson 🇬🇧

182,559 Aufrufe • vor 1 Jahr

3D scanning and rendering is moving so fast - got my splats up and running and I'm mind blown getting ~100fps for this complex 3D scene ⬇️ 🤯 1. WAY faster than NeRF: For comparison, NeRFs would takes around 10 seconds per frame (!) Instead I'm zipping around with FPV controls without breaking a sweat - though I do crash a few times towards the end of the video lol 2. Old Meets New: Gaussian Splatting is cool in that it fuses classical graphics and deep learning techniques. Like NeRFs, this is still a radiance field - just without the slower (ne)ural rendering part. 3. Explicit Representation: Instead you represent a 3D scene as a collection of ellipsoidal "splats" called gaussians. Each gaussian has a position, size, and color. Rendering in real-time is done by projecting into the image plane and alpha blending. 4. Photorealistic Effects: Gaussian splatting use spherical harmonics to represent the view-dependent effects and lighting - allowing surfaces to change color when viewed from different angles, enabling greater photorealism. It doesn't use a neural network, but the training loop is similar to deep learning. 5. Enables Direct Editing: But it's not just speed - with Gaussian Splatting you also get 3D editing support! So you can select, move, and delete stuff, even relight stuff. This type of editing has been more tedious to do with NeRFs and their implicit black box representations. 📲 More tests cooking! Much more to unpack here including simpler explanations. If you enjoyed this post, you might enjoy my feed: Bilawal Sidhu

3D scanning and rendering is moving so fast - got my splats up and running and I'm mind blown getting ~100fps for this complex 3D scene ⬇️ 🤯 1. WAY faster than NeRF: For comparison, NeRFs would takes around 10 seconds per frame (!) Instead I'm zipping around with FPV controls without breaking a sweat - though I do crash a few times towards the end of the video lol 2. Old Meets New: Gaussian Splatting is cool in that it fuses classical graphics and deep learning techniques. Like NeRFs, this is still a radiance field - just without the slower (ne)ural rendering part. 3. Explicit Representation: Instead you represent a 3D scene as a collection of ellipsoidal "splats" called gaussians. Each gaussian has a position, size, and color. Rendering in real-time is done by projecting into the image plane and alpha blending. 4. Photorealistic Effects: Gaussian splatting use spherical harmonics to represent the view-dependent effects and lighting - allowing surfaces to change color when viewed from different angles, enabling greater photorealism. It doesn't use a neural network, but the training loop is similar to deep learning. 5. Enables Direct Editing: But it's not just speed - with Gaussian Splatting you also get 3D editing support! So you can select, move, and delete stuff, even relight stuff. This type of editing has been more tedious to do with NeRFs and their implicit black box representations. 📲 More tests cooking! Much more to unpack here including simpler explanations. If you enjoyed this post, you might enjoy my feed: Bilawal Sidhu

Bilawal Sidhu

337,090 Aufrufe • vor 2 Jahren

✨ New assets are now in and I've improved the soldier AI, they now start running around like mad men when they're in combat Also I managed to bake the collision maps (BVH) on the server so the game finally loads fast again I have about 9 days left in the #vibejam so I think I need to add multiplayer very soon so you can all fight each other as drones vs soldier!

✨ New assets are now in and I've improved the soldier AI, they now start running around like mad men when they're in combat Also I managed to bake the collision maps (BVH) on the server so the game finally loads fast again I have about 9 days left in the #vibejam so I think I need to add multiplayer very soon so you can all fight each other as drones vs soldier!

@levelsio

64,595 Aufrufe • vor 4 Monaten

I really wish people around him would stop calling him scary. You don't need a psychology degree to know that hearing the same words over and over can shape how you see yourself. Especially when it comes from the people closest to you, the ones you love and trust the most. (rough translation) 😽 : Let's say you guys know nothing about me, literally nothing at all. You don't know a thing about who I am. You don't know Choi San. But then, we run into each other. It's the first time we meet. 😽 : I see someone wrote 'scary' here. Do I really seem scary? So if I smile, it's okay? I appreciate it... It's just that I've been hearing that kind of thing a lot lately. Not necessarily that I'm scary, but still... 😽 : I just got curious and asked out of nowhere. It popped into my head. 😽 : As expected… I just confirmed it once again. You guys really are on my side, no doubt about it. But, these days, I just do my base makeup and fill in my eyebrows. Lately, I've completely stopped doing eye makeup. 😽 : I experimented with a lot of different eye makeup styles, but in the end, not wearing any at all seemed to suit me the most, both from my own perspective and based on what people around me said 😽 : So yeah, now I don't wear any eye makeup at all. I'll just go with bold makeup when it fits the concept. #choisan #최산 #san #산 #ateez #에이티즈

I really wish people around him would stop calling him scary. You don't need a psychology degree to know that hearing the same words over and over can shape how you see yourself. Especially when it comes from the people closest to you, the ones you love and trust the most. (rough translation) 😽 : Let's say you guys know nothing about me, literally nothing at all. You don't know a thing about who I am. You don't know Choi San. But then, we run into each other. It's the first time we meet. 😽 : I see someone wrote 'scary' here. Do I really seem scary? So if I smile, it's okay? I appreciate it... It's just that I've been hearing that kind of thing a lot lately. Not necessarily that I'm scary, but still... 😽 : I just got curious and asked out of nowhere. It popped into my head. 😽 : As expected… I just confirmed it once again. You guys really are on my side, no doubt about it. But, these days, I just do my base makeup and fill in my eyebrows. Lately, I've completely stopped doing eye makeup. 😽 : I experimented with a lot of different eye makeup styles, but in the end, not wearing any at all seemed to suit me the most, both from my own perspective and based on what people around me said 😽 : So yeah, now I don't wear any eye makeup at all. I'll just go with bold makeup when it fits the concept. #choisan #최산 #san #산 #ateez #에이티즈

퓨 🍮

86,303 Aufrufe • vor 1 Jahr

It works! ✨ I've been vibe coding with Cursor to build myself an analytics app… But instead of dashboards, I want a 2D map where the pages on my website are buildings.. The blue dots you see are live traffic to Indie Hackers! It's the start of my own little "app city" 🗺 This is just the start. Eventually I want to understand what's going on with all my apps at a glance, just by looking at my city from a birds eye view.

It works! ✨ I've been vibe coding with Cursor to build myself an analytics app… But instead of dashboards, I want a 2D map where the pages on my website are buildings.. The blue dots you see are live traffic to Indie Hackers! It's the start of my own little "app city" 🗺 This is just the start. Eventually I want to understand what's going on with all my apps at a glance, just by looking at my city from a birds eye view.

Courtland Allen

195,810 Aufrufe • vor 1 Jahr

My big bear base won't be released just yet.. (I got other stuff to work on too) but I've been so in love with the style and softness that I had to share a quick vid showcasing our adorable fluffy bear so far ❤️❤️ Please do tell me what other bear skins I should add! ^^ #Vrchat

My big bear base won't be released just yet.. (I got other stuff to work on too) but I've been so in love with the style and softness that I had to share a quick vid showcasing our adorable fluffy bear so far ❤️❤️ Please do tell me what other bear skins I should add! ^^ #Vrchat

Estefanoida 🇨🇷

40,364 Aufrufe • vor 2 Jahren