Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

A few months ago, Kyle McDonald sent me a message with a simple idea: capture my workspace as a Gaussian Splat, put a monitor back into that same space, track the viewer and make the monitor disappear. It’s been on my to-do list ever since... I finally built a... POC… Working name: Vitre. It turns a screen into a window onto a 3D capture of the space it is actually in. My office space was captured as a 3D Gaussian Splat and registered back into the physical space. A camera tracks the viewer’s position, and the scene is rendered from that point of view in real time. Move around the screen and the perspective changes with you, as if you were looking through a window. Still a POC. The calibration of the whole system needs to be more precise, and there’s still some noticeable latency between the tracking and the render. #3DGS #GaussianSplatting #ComputerVisionshow more

Hugues Bruyère

8,711 subscribers

36,816 Aufrufe • vor 11 Tagen •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

19 Kommentare

Profilbild von aidan

aidanvor 11 Tagen

@kcimc woah now this is cool. could easily see this being placed as a portal to to view historical sites through time, or placed inside a home as the future of family photos

Profilbild von Hugues Bruyère

Hugues Bruyèrevor 11 Tagen

@kcimc Absolutely… I think this could be great in a museum or public setting. That’s part of why I wanted to put this POC together. The other part was to better understand all the steps required to properly align and register a system like this.

Profilbild von Mister Macros

Mister Macrosvor 11 Tagen

@kcimc meanwhile the dude in the other dimension

Profilbild von Mark

Markvor 11 Tagen

@kcimc So, mirrors from Prey?

Profilbild von 一号野人

一号野人vor 11 Tagen

@kcimc 如果有两个的话你就可以把它做成眼镜了

Profilbild von Hugues Bruyère

Hugues Bruyèrevor 11 Tagen

@kcimc but I did that already 😉...

Profilbild von 一号野人

一号野人vor 11 Tagen

@kcimc You're so amazing, bro

Profilbild von Shadnam Khan

Shadnam Khanvor 11 Tagen

@kcimc Cool idea! Wondering how far you can move your head before the edges of the monitor start disagreeing with the splat.

Profilbild von Hugues Bruyère

Hugues Bruyèrevor 11 Tagen

@kcimc The real limitation is the tracking.

Profilbild von Shadnam Khan

Shadnam Khanvor 10 Tagen

@kcimc Makes sense. Is it latency or jitter that breaks the illusion first?

Profilbild von Hugues Bruyère

Hugues Bruyèrevor 10 Tagen

@kcimc Both are illusion killers... But I’d say the scene isn’t jittering that much. Latency is more of an issue right now, but I’m working on it.

Profilbild von ffswunnd

ffswunndvor 11 Tagen

@kcimc The white balance is bugging me

Profilbild von Hugues Bruyère

Hugues Bruyèrevor 11 Tagen

@kcimc Yes, you’re right. There’s definitely some of that. The room was also lit quite differently when I captured it... you can even see a patch of light on one of the walls. But this is something I want to fix in the next iteration.

Profilbild von Alex Coulombe

Alex Coulombevor 11 Tagen

@kcimc super cool

Profilbild von Hugues Bruyère

Hugues Bruyèrevor 11 Tagen

@kcimc Thanks 🙌😶‍🌫️

Profilbild von Zar

Zarvor 11 Tagen

@kcimc wow, you could make a real cool digital terrarium with that. put a little guy in there

Profilbild von DILI

DILIvor 11 Tagen

@kcimc Cool tech too

Profilbild von DILI

DILIvor 11 Tagen

@kcimc I smell military defense tech in your future 💪🏽

Profilbild von Ben Gatzke

Ben Gatzkevor 11 Tagen

@kcimc Stargate quantum mirror! AR some scenes into it, people looking back at you through the mirror

Ähnliche Videos

What could be better than a portal?! A portal that lets you switch between point clouds and 3D Gaussian Splats. Built a web-based 3D Gaussian Splat viewer with SparkJS, letting me freely fly through the three locations I just captured using the #PortalCam. #GaussianSplatting

What could be better than a portal?! A portal that lets you switch between point clouds and 3D Gaussian Splats. Built a web-based 3D Gaussian Splat viewer with SparkJS, letting me freely fly through the three locations I just captured using the #PortalCam. #GaussianSplatting

Hugues Bruyère

28,386 Aufrufe • vor 8 Monaten

The Ring (Montreal) — Dormant Memories series New alternate scene, and an iteration on the UX and flow. Starting from a volumetric capture of a real location in Montreal, reconstructed as 3D Gaussian Splats, I then used World Labs' Marble to generate alternate versions of that same space. Running in real time using spark. #GaussianSplatting #3DGS #pointcloud #sparkjs #threejs

The Ring (Montreal) — Dormant Memories series New alternate scene, and an iteration on the UX and flow. Starting from a volumetric capture of a real location in Montreal, reconstructed as 3D Gaussian Splats, I then used World Labs' Marble to generate alternate versions of that same space. Running in real time using spark. #GaussianSplatting #3DGS #pointcloud #sparkjs #threejs

Hugues Bruyère

34,532 Aufrufe • vor 6 Monaten

Gaussian splatting as part of the UI – a lot went into making this as performant as possible – for example, for the frosting effect I track the card in screen-space and only render to and sample the pixels touched by the blur

Gaussian splatting as part of the UI – a lot went into making this as performant as possible – for example, for the frosting effect I track the card in screen-space and only render to and sample the pixels touched by the blur

🌈 George Corney

52,213 Aufrufe • vor 6 Monaten

Three years ago, I captured Montreal's 'Radio Doctor' shop—one of those special places that make my neighborhood. Since 1960, Joseph Hovsepian has been repairing radios, turntables, and more. Here's the shop reconstructed as a 3D Gaussian splat. #gaussiansplatting #3dgs

Three years ago, I captured Montreal's 'Radio Doctor' shop—one of those special places that make my neighborhood. Since 1960, Joseph Hovsepian has been repairing radios, turntables, and more. Here's the shop reconstructed as a 3D Gaussian splat. #gaussiansplatting #3dgs

Hugues Bruyère

33,291 Aufrufe • vor 1 Jahr

More and more users are turning their 360 footage into fully explorable 3D Gaussian Splats with View it here: This reconstruction started from a simple capture and is now a fully explorable 3D Gaussian Splat rendered in the FreeGaussian viewer, complete with point cloud reconstruction and high-fidelity spatial detail. More and more creators are discovering that their existing footage can become immersive 3D scenes. And they’re doing it for free with FreeGaussian

More and more users are turning their 360 footage into fully explorable 3D Gaussian Splats with View it here: This reconstruction started from a simple capture and is now a fully explorable 3D Gaussian Splat rendered in the FreeGaussian viewer, complete with point cloud reconstruction and high-fidelity spatial detail. More and more creators are discovering that their existing footage can become immersive 3D scenes. And they’re doing it for free with FreeGaussian

Over the Reality 🌐

14,845 Aufrufe • vor 5 Monaten

oh may.. 3D Gaussian Splat is so crazy now last time we need weeks to turn a room into a 3D model.. now with AI 3DGS, you do it in seconds… even zoom into the text and looks perfect give it like 6 months… you can turn a whole city into a full detailed 3D model

oh may.. 3D Gaussian Splat is so crazy now last time we need weeks to turn a room into a 3D model.. now with AI 3DGS, you do it in seconds… even zoom into the text and looks perfect give it like 6 months… you can turn a whole city into a full detailed 3D model

el.cine

143,676 Aufrufe • vor 10 Monaten

I'm getting a new office space in November. I went today and took pictures and a 3D scan with some app on my phone. I gave all the files to Codex and told it to render it while I got on a call. Here you can see the clean render, and the 3D scan as well! Wild times.

I'm getting a new office space in November. I went today and took pictures and a 3D scan with some app on my phone. I gave all the files to Codex and told it to render it while I got on a call. Here you can see the clean render, and the 3D scan as well! Wild times.

Aaron Francis

22,318 Aufrufe • vor 22 Tagen

SplatOverflow: Asynchronous Hardware Troubleshooting TL;DR: That's probably the most creative application of 3DGS I have ever seen :) Abstract (excerpt): SplatOverflow creates a novel boundary object, the SplatOverflow scene, that users reference to communicate about hardware. The scene comprises a 3D Gaussian Splat of the user’s hardware registered onto the hardware’s CAD model. The splat captures the current state of the hardware, and the registered CAD model acts as a referential anchor for troubleshooting instructions. With SplatOverflow, maintainers can directly address issues and author instructions in the user’s workspace.

SplatOverflow: Asynchronous Hardware Troubleshooting TL;DR: That's probably the most creative application of 3DGS I have ever seen :) Abstract (excerpt): SplatOverflow creates a novel boundary object, the SplatOverflow scene, that users reference to communicate about hardware. The scene comprises a 3D Gaussian Splat of the user’s hardware registered onto the hardware’s CAD model. The splat captures the current state of the hardware, and the registered CAD model acts as a referential anchor for troubleshooting instructions. With SplatOverflow, maintainers can directly address issues and author instructions in the user’s workspace.

MrNeRF

20,093 Aufrufe • vor 1 Jahr

Introducing powered by Over the Reality. FreeGaussian is a new way to transform your existing photos, videos, and 360 captures for free into high-quality 3D Gaussian splats, directly in your browser. Whether you already have: ↳ a 360 recording captured with any 360 camera ↳ a set of photos ↳ or even a simple video from a place you visited you can now turn it into a photorealistic 3D Gaussian splat. Just go to upload your content, and let the reconstruction happen. Once it’s ready, you can download your 3D Gaussian splat and point cloud, and use them across your own projects, pipelines, or applications.

Introducing powered by Over the Reality. FreeGaussian is a new way to transform your existing photos, videos, and 360 captures for free into high-quality 3D Gaussian splats, directly in your browser. Whether you already have: ↳ a 360 recording captured with any 360 camera ↳ a set of photos ↳ or even a simple video from a place you visited you can now turn it into a photorealistic 3D Gaussian splat. Just go to upload your content, and let the reconstruction happen. Once it’s ready, you can download your 3D Gaussian splat and point cloud, and use them across your own projects, pipelines, or applications.

Over the Reality 🌐

86,340 Aufrufe • vor 5 Monaten

I'm excited to share the Geo Register Plugin for LichtFeld Studio from the LichtFeld community! This plugin helps bring Gaussian splat scenes into real-world geographic space. It registers a scene to WGS-84 and ECEF coordinates, so you can click any point on the model and get its latitude, longitude and altitude. It supports multiple georeferencing sources, including EXIF GPS data, image position CSVs, RealityScan camera parameters and saved similarity transforms. Once the scene is registered, you can export geo-referenced splat models as LAS, LAZ or 3D Tiles datasets for use in GIS and 3D mapping workflows. Built for anyone working with drone data, photogrammetry, Gaussian splatting, GIS, ArcGIS or CesiumJS. Link in the comment below!

I'm excited to share the Geo Register Plugin for LichtFeld Studio from the LichtFeld community! This plugin helps bring Gaussian splat scenes into real-world geographic space. It registers a scene to WGS-84 and ECEF coordinates, so you can click any point on the model and get its latitude, longitude and altitude. It supports multiple georeferencing sources, including EXIF GPS data, image position CSVs, RealityScan camera parameters and saved similarity transforms. Once the scene is registered, you can export geo-referenced splat models as LAS, LAZ or 3D Tiles datasets for use in GIS and 3D mapping workflows. Built for anyone working with drone data, photogrammetry, Gaussian splatting, GIS, ArcGIS or CesiumJS. Link in the comment below!

MrNeRF

51,983 Aufrufe • vor 5 Monaten

Gaussian Splatting is pretty wild. Being able to take dense collections of assets and package them into fast, real-time splats opens up a ton of new possibilities for look-dev, previs, and interactive scenes. For this test, I built a pile of 400 skulls - roughly 40+ million polygons (and over 400 8K texture instances) - rendered out a 600 frame dataset on The Render Network with OTOY OctaneRender and then converted the result into a single splat asset. Now it runs in real-time as one compact Gaussian Splat.

Gaussian Splatting is pretty wild. Being able to take dense collections of assets and package them into fast, real-time splats opens up a ton of new possibilities for look-dev, previs, and interactive scenes. For this test, I built a pile of 400 skulls - roughly 40+ million polygons (and over 400 8K texture instances) - rendered out a 600 frame dataset on The Render Network with OTOY OctaneRender and then converted the result into a single splat asset. Now it runs in real-time as one compact Gaussian Splat.

Spenser Dickerson

46,560 Aufrufe • vor 11 Monaten

Gaussian Splats are quickly becoming one of my favorite ways to move complex 3D assets between workflows. For this test I started with Panthera Spelaea, the Blender 5.2 splash artwork by Joanna Kobierska, available from under CC-BY. Using GPT-6 Astra, I had it build a 200-frame camera rig and send the renders directly to The Render Network through the API and export a COLMAP data set. NEXT: COLMAP → Postshot → Gaussian Splat. The result is a real-time, high-fidelity version of an insanely dense asset - millions of hairs and all - that I can now bring back into OTOY Octane, relight, reframe, drop into other scenes, or even publish straight to the web. Capture the visual complexity once, then carry it anywhere. Check out the splat:

Gaussian Splats are quickly becoming one of my favorite ways to move complex 3D assets between workflows. For this test I started with Panthera Spelaea, the Blender 5.2 splash artwork by Joanna Kobierska, available from under CC-BY. Using GPT-6 Astra, I had it build a 200-frame camera rig and send the renders directly to The Render Network through the API and export a COLMAP data set. NEXT: COLMAP → Postshot → Gaussian Splat. The result is a real-time, high-fidelity version of an insanely dense asset - millions of hairs and all - that I can now bring back into OTOY Octane, relight, reframe, drop into other scenes, or even publish straight to the web. Capture the visual complexity once, then carry it anywhere. Check out the splat:

Spenser Dickerson

11,721 Aufrufe • vor 1 Monat

Volumetric, animated 3D noise shader block in Unity. Where each frame is 2D space, and the 3rd dimension is time. So that, measurement of change within a slice is 'space', and measurement of change across slices is 'time'. As a 3D block, you see the noise animate into the 3rd dimension, but when looking at only a single slice, it appears to evolve in place. Likewise, for 4D... If: this were 3D noise, then: the 4th dimension would be whatever processing/frames/states of 3D data.

Volumetric, animated 3D noise shader block in Unity. Where each frame is 2D space, and the 3rd dimension is time. So that, measurement of change within a slice is 'space', and measurement of change across slices is 'time'. As a 3D block, you see the noise animate into the 3rd dimension, but when looking at only a single slice, it appears to evolve in place. Likewise, for 4D... If: this were 3D noise, then: the 4th dimension would be whatever processing/frames/states of 3D data.

Mirza Beig

126,907 Aufrufe • vor 9 Monaten

This time the tracking runs with a 120 fps global-shutter camera. Getting twice as many position updates, with much fewer gaps when tracking faster movements… It feels much better. The window is still rendering from a position roughly 20–24 ms in the past, but I compensate for some of that by predicting the position slightly forward. It still works best when tracking the phone, though. #3DGS #GaussianSplatting #ComputerVision

This time the tracking runs with a 120 fps global-shutter camera. Getting twice as many position updates, with much fewer gaps when tracking faster movements… It feels much better. The window is still rendering from a position roughly 20–24 ms in the past, but I compensate for some of that by predicting the position slightly forward. It still works best when tracking the phone, though. #3DGS #GaussianSplatting #ComputerVision

Hugues Bruyère

177,037 Aufrufe • vor 4 Tagen

A museum in France. Accessible from anywhere in the world. One of our mappers captured the Musée Archéologique du Val-d'Oise, home to more than 35,000 archaeological artifacts and over 3,000 objects on display. Using an Insta360 X5 and Over the Reality's reconstruction technology, the entire museum, including its multiple floors, has been transformed into a high-fidelity 3D Gaussian Splat and digital twin. This means anyone can now explore the museum remotely, walk through its galleries, move across different floors, and experience the space as if they were there in person. What was once a physical location is now a machine-readable 3D environment, preserved digitally and accessible through a browser, smartphone, or XR headset. From museums and cultural landmarks to entire cities, Over the Reality has built the largest 3D map of the world. The link to explore the experience remotely is available in the first comment.

A museum in France. Accessible from anywhere in the world. One of our mappers captured the Musée Archéologique du Val-d'Oise, home to more than 35,000 archaeological artifacts and over 3,000 objects on display. Using an Insta360 X5 and Over the Reality's reconstruction technology, the entire museum, including its multiple floors, has been transformed into a high-fidelity 3D Gaussian Splat and digital twin. This means anyone can now explore the museum remotely, walk through its galleries, move across different floors, and experience the space as if they were there in person. What was once a physical location is now a machine-readable 3D environment, preserved digitally and accessible through a browser, smartphone, or XR headset. From museums and cultural landmarks to entire cities, Over the Reality has built the largest 3D map of the world. The link to explore the experience remotely is available in the first comment.

Over the Reality 🌐

27,828 Aufrufe • vor 4 Monaten

What happens if you try to push and squash a Gaussian splat? :) Been playing with adding simplified deformation and a lightweight physics simulation layer to Gaussian splats, running directly in real time on mobile. Instead of simulating every splat, this uses a small CPU lattice to drive the deformation, plus a per-splat transform so they actually stretch and compress properly. No mesh conversion, no retraining. Just layered on top of the renderer. You can push, bend, squash a scan and it holds together surprisingly well... Still early, but I can see the potential in making splats feel more real, from static captures to something more tactile, something you can touch, throw, bounce around… or well just fold and squash on the floor :) #GaussianSplatting #3DGS #Unity

What happens if you try to push and squash a Gaussian splat? :) Been playing with adding simplified deformation and a lightweight physics simulation layer to Gaussian splats, running directly in real time on mobile. Instead of simulating every splat, this uses a small CPU lattice to drive the deformation, plus a per-splat transform so they actually stretch and compress properly. No mesh conversion, no retraining. Just layered on top of the renderer. You can push, bend, squash a scan and it holds together surprisingly well... Still early, but I can see the potential in making splats feel more real, from static captures to something more tactile, something you can touch, throw, bounce around… or well just fold and squash on the floor :) #GaussianSplatting #3DGS #Unity

𝐑𝐔𝐁𝐄𝐍🥽𝐅𝐑𝐎

51,478 Aufrufe • vor 6 Monaten

Holy Shit, The BitBoy said $HEX is not a scam, acknowledged it shaped DeFi as a whole + revolutionised the space, AND that #PulseChain is now revolutionising the space, That Richard will win and is smarter than the SEC, AND he is going to make a documentary to showcase that HEX isn't a security, how corrupt this space is + the lies and scrutiny this space has put HEX under. AND said it's about time Richard Heart gets the respect he deserves! Am I dreaming still? Someone want to verify I did just wake up from my nap and this is real?

Holy Shit, The BitBoy said $HEX is not a scam, acknowledged it shaped DeFi as a whole + revolutionised the space, AND that #PulseChain is now revolutionising the space, That Richard will win and is smarter than the SEC, AND he is going to make a documentary to showcase that HEX isn't a security, how corrupt this space is + the lies and scrutiny this space has put HEX under. AND said it's about time Richard Heart gets the respect he deserves! Am I dreaming still? Someone want to verify I did just wake up from my nap and this is real?

KatieePCrypto.pls

39,712 Aufrufe • vor 2 Jahren

Phase Space Is the Real Stage of Dynamics. So, Stop Watching the Object and Watch the State. Ordinary Space tells you where something is. Phase Space tells you what state it is in. Position alone is not enough because you also need the variable that tells you where the system is trying to go. In the animation, the left panel shows the particle moving in Ordinary Space, while the right panel shows the same system as a moving point in Phase Space. For one degree of freedom, the state is (x, p) and as time evolves, that state traces a trajectory t ↦ (x(t), p(t)) Instead of thinking of a differential equation as just a formula, Phase Space lets you see it as a flow on the space of states. For this lecture we use ẋ = p ṗ = x − x³ with Hamiltonian H(x,p) = 0.5 p² + 0.25 x⁴ − 0.5 x² #PhaseSpace #DynamicalSystems #NonlinearDynamics #HamiltonianMechanics #Mathematics

Phase Space Is the Real Stage of Dynamics. So, Stop Watching the Object and Watch the State. Ordinary Space tells you where something is. Phase Space tells you what state it is in. Position alone is not enough because you also need the variable that tells you where the system is trying to go. In the animation, the left panel shows the particle moving in Ordinary Space, while the right panel shows the same system as a moving point in Phase Space. For one degree of freedom, the state is (x, p) and as time evolves, that state traces a trajectory t ↦ (x(t), p(t)) Instead of thinking of a differential equation as just a formula, Phase Space lets you see it as a flow on the space of states. For this lecture we use ẋ = p ṗ = x − x³ with Hamiltonian H(x,p) = 0.5 p² + 0.25 x⁴ − 0.5 x² #PhaseSpace #DynamicalSystems #NonlinearDynamics #HamiltonianMechanics #Mathematics

Mathelirium

30,529 Aufrufe • vor 6 Monaten

When I saw the mask "Tribes of the Calf" from Kanbas I knew I had to make it into reality. The jewelry and gold really made it stand out for me. Since Sam Spratt's The Masquerade was revealed, I have been spending time sculpting and dissecting the mask to recreate it in 3D as faithfully as possible. I delved into the creation of this mask for many reasons. I love a good challenge and this mask surely was one for me. Creating something in 3D from a 2D image is not easy, and especially when the source has generative nature, some stuff is hard to interpret, but I tried my best to make sure the visual integrity of the mask is as close to the original as possible. Splitting the whole mask into parts, filling the missing pieces so I can build the textures was quite a lot of work. I tried to present the mask in my own style with a slightly different colorway to adapt to the mask itself. Please enjoy this short animation, and turn on sound🔊 This piece is my statement that I am here to stay. That I have a voice that often feels being lost in the void. That I have been creating and posting digital art for over 20 years now and will continue until I'm gone. I have a story to tell and I want to be heard. The space we have here is small, and is shrinking day by day. It doesn't have to be like that. We need to support each other and push ourselves and people here, otherwise we are all doomed. As Kanbas has put in their observation of the mask: "Inspirational. Emotional. Natural." This is what our space can be, and this is me making a statement with this homage. I will share a 4k still below as well as a short video showing the 3D GLB interactive model together with a yt link to the 4k video since compression here is pretty bad.

When I saw the mask "Tribes of the Calf" from Kanbas I knew I had to make it into reality. The jewelry and gold really made it stand out for me. Since Sam Spratt's The Masquerade was revealed, I have been spending time sculpting and dissecting the mask to recreate it in 3D as faithfully as possible. I delved into the creation of this mask for many reasons. I love a good challenge and this mask surely was one for me. Creating something in 3D from a 2D image is not easy, and especially when the source has generative nature, some stuff is hard to interpret, but I tried my best to make sure the visual integrity of the mask is as close to the original as possible. Splitting the whole mask into parts, filling the missing pieces so I can build the textures was quite a lot of work. I tried to present the mask in my own style with a slightly different colorway to adapt to the mask itself. Please enjoy this short animation, and turn on sound🔊 This piece is my statement that I am here to stay. That I have a voice that often feels being lost in the void. That I have been creating and posting digital art for over 20 years now and will continue until I'm gone. I have a story to tell and I want to be heard. The space we have here is small, and is shrinking day by day. It doesn't have to be like that. We need to support each other and push ourselves and people here, otherwise we are all doomed. As Kanbas has put in their observation of the mask: "Inspirational. Emotional. Natural." This is what our space can be, and this is me making a statement with this homage. I will share a 4k still below as well as a short video showing the 3D GLB interactive model together with a yt link to the 4k video since compression here is pretty bad.

shoneec

17,894 Aufrufe • vor 1 Jahr