正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

A few months ago, Kyle McDonald sent me a message with a simple idea: capture my workspace as a Gaussian Splat, put a monitor back into that same space, track the viewer and make the monitor disappear. It’s been on my to-do list ever since... I finally built a... POC… Working name: Vitre. It turns a screen into a window onto a 3D capture of the space it is actually in. My office space was captured as a 3D Gaussian Splat and registered back into the physical space. A camera tracks the viewer’s position, and the scene is rendered from that point of view in real time. Move around the screen and the perspective changes with you, as if you were looking through a window. Still a POC. The calibration of the whole system needs to be more precise, and there’s still some noticeable latency between the tracking and the render. #3DGS #GaussianSplatting #ComputerVisionshow more

Hugues Bruyère

8,711 subscribers

36,816 次观看 • 11 天前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

19 条评论

aidan 的头像

aidan11 天前

@kcimc woah now this is cool. could easily see this being placed as a portal to to view historical sites through time, or placed inside a home as the future of family photos

Hugues Bruyère 的头像

Hugues Bruyère11 天前

@kcimc Absolutely… I think this could be great in a museum or public setting. That’s part of why I wanted to put this POC together. The other part was to better understand all the steps required to properly align and register a system like this.

Mister Macros 的头像

Mister Macros11 天前

@kcimc meanwhile the dude in the other dimension

Mark 的头像

Mark11 天前

@kcimc So, mirrors from Prey?

一号野人的头像

一号野人11 天前

@kcimc 如果有两个的话你就可以把它做成眼镜了

Hugues Bruyère 的头像

Hugues Bruyère11 天前

@kcimc but I did that already 😉...

一号野人的头像

一号野人11 天前

@kcimc You're so amazing, bro

Shadnam Khan 的头像

Shadnam Khan11 天前

@kcimc Cool idea! Wondering how far you can move your head before the edges of the monitor start disagreeing with the splat.

Hugues Bruyère 的头像

Hugues Bruyère11 天前

@kcimc The real limitation is the tracking.

Shadnam Khan 的头像

Shadnam Khan10 天前

@kcimc Makes sense. Is it latency or jitter that breaks the illusion first?

Hugues Bruyère 的头像

Hugues Bruyère10 天前

@kcimc Both are illusion killers... But I’d say the scene isn’t jittering that much. Latency is more of an issue right now, but I’m working on it.

ffswunnd 的头像

ffswunnd11 天前

@kcimc The white balance is bugging me

Hugues Bruyère 的头像

Hugues Bruyère11 天前

@kcimc Yes, you’re right. There’s definitely some of that. The room was also lit quite differently when I captured it... you can even see a patch of light on one of the walls. But this is something I want to fix in the next iteration.

Alex Coulombe 的头像

Alex Coulombe11 天前

@kcimc super cool

Hugues Bruyère 的头像

Hugues Bruyère11 天前

@kcimc Thanks 🙌😶‍🌫️

Zar 的头像

Zar11 天前

@kcimc wow, you could make a real cool digital terrarium with that. put a little guy in there

DILI 的头像

DILI11 天前

@kcimc Cool tech too

DILI 的头像

DILI11 天前

@kcimc I smell military defense tech in your future 💪🏽

Ben Gatzke 的头像

Ben Gatzke11 天前

@kcimc Stargate quantum mirror! AR some scenes into it, people looking back at you through the mirror

相关视频

What could be better than a portal?! A portal that lets you switch between point clouds and 3D Gaussian Splats. Built a web-based 3D Gaussian Splat viewer with SparkJS, letting me freely fly through the three locations I just captured using the #PortalCam. #GaussianSplatting

What could be better than a portal?! A portal that lets you switch between point clouds and 3D Gaussian Splats. Built a web-based 3D Gaussian Splat viewer with SparkJS, letting me freely fly through the three locations I just captured using the #PortalCam. #GaussianSplatting

Hugues Bruyère

28,386 次观看 • 8 个月前

The Ring (Montreal) — Dormant Memories series New alternate scene, and an iteration on the UX and flow. Starting from a volumetric capture of a real location in Montreal, reconstructed as 3D Gaussian Splats, I then used World Labs' Marble to generate alternate versions of that same space. Running in real time using spark. #GaussianSplatting #3DGS #pointcloud #sparkjs #threejs

The Ring (Montreal) — Dormant Memories series New alternate scene, and an iteration on the UX and flow. Starting from a volumetric capture of a real location in Montreal, reconstructed as 3D Gaussian Splats, I then used World Labs' Marble to generate alternate versions of that same space. Running in real time using spark. #GaussianSplatting #3DGS #pointcloud #sparkjs #threejs

Hugues Bruyère

34,532 次观看 • 6 个月前

Gaussian splatting as part of the UI – a lot went into making this as performant as possible – for example, for the frosting effect I track the card in screen-space and only render to and sample the pixels touched by the blur

Gaussian splatting as part of the UI – a lot went into making this as performant as possible – for example, for the frosting effect I track the card in screen-space and only render to and sample the pixels touched by the blur

🌈 George Corney

52,213 次观看 • 6 个月前

Three years ago, I captured Montreal's 'Radio Doctor' shop—one of those special places that make my neighborhood. Since 1960, Joseph Hovsepian has been repairing radios, turntables, and more. Here's the shop reconstructed as a 3D Gaussian splat. #gaussiansplatting #3dgs

Three years ago, I captured Montreal's 'Radio Doctor' shop—one of those special places that make my neighborhood. Since 1960, Joseph Hovsepian has been repairing radios, turntables, and more. Here's the shop reconstructed as a 3D Gaussian splat. #gaussiansplatting #3dgs

Hugues Bruyère

33,291 次观看 • 1 年前

More and more users are turning their 360 footage into fully explorable 3D Gaussian Splats with View it here: This reconstruction started from a simple capture and is now a fully explorable 3D Gaussian Splat rendered in the FreeGaussian viewer, complete with point cloud reconstruction and high-fidelity spatial detail. More and more creators are discovering that their existing footage can become immersive 3D scenes. And they’re doing it for free with FreeGaussian

More and more users are turning their 360 footage into fully explorable 3D Gaussian Splats with View it here: This reconstruction started from a simple capture and is now a fully explorable 3D Gaussian Splat rendered in the FreeGaussian viewer, complete with point cloud reconstruction and high-fidelity spatial detail. More and more creators are discovering that their existing footage can become immersive 3D scenes. And they’re doing it for free with FreeGaussian

Over the Reality 🌐

14,845 次观看 • 5 个月前

oh may.. 3D Gaussian Splat is so crazy now last time we need weeks to turn a room into a 3D model.. now with AI 3DGS, you do it in seconds… even zoom into the text and looks perfect give it like 6 months… you can turn a whole city into a full detailed 3D model

oh may.. 3D Gaussian Splat is so crazy now last time we need weeks to turn a room into a 3D model.. now with AI 3DGS, you do it in seconds… even zoom into the text and looks perfect give it like 6 months… you can turn a whole city into a full detailed 3D model

el.cine

143,676 次观看 • 10 个月前

I'm getting a new office space in November. I went today and took pictures and a 3D scan with some app on my phone. I gave all the files to Codex and told it to render it while I got on a call. Here you can see the clean render, and the 3D scan as well! Wild times.

I'm getting a new office space in November. I went today and took pictures and a 3D scan with some app on my phone. I gave all the files to Codex and told it to render it while I got on a call. Here you can see the clean render, and the 3D scan as well! Wild times.

Aaron Francis

22,318 次观看 • 22 天前

SplatOverflow: Asynchronous Hardware Troubleshooting TL;DR: That's probably the most creative application of 3DGS I have ever seen :) Abstract (excerpt): SplatOverflow creates a novel boundary object, the SplatOverflow scene, that users reference to communicate about hardware. The scene comprises a 3D Gaussian Splat of the user’s hardware registered onto the hardware’s CAD model. The splat captures the current state of the hardware, and the registered CAD model acts as a referential anchor for troubleshooting instructions. With SplatOverflow, maintainers can directly address issues and author instructions in the user’s workspace.

SplatOverflow: Asynchronous Hardware Troubleshooting TL;DR: That's probably the most creative application of 3DGS I have ever seen :) Abstract (excerpt): SplatOverflow creates a novel boundary object, the SplatOverflow scene, that users reference to communicate about hardware. The scene comprises a 3D Gaussian Splat of the user’s hardware registered onto the hardware’s CAD model. The splat captures the current state of the hardware, and the registered CAD model acts as a referential anchor for troubleshooting instructions. With SplatOverflow, maintainers can directly address issues and author instructions in the user’s workspace.

MrNeRF

20,093 次观看 • 1 年前

Introducing powered by Over the Reality. FreeGaussian is a new way to transform your existing photos, videos, and 360 captures for free into high-quality 3D Gaussian splats, directly in your browser. Whether you already have: ↳ a 360 recording captured with any 360 camera ↳ a set of photos ↳ or even a simple video from a place you visited you can now turn it into a photorealistic 3D Gaussian splat. Just go to upload your content, and let the reconstruction happen. Once it’s ready, you can download your 3D Gaussian splat and point cloud, and use them across your own projects, pipelines, or applications.

Introducing powered by Over the Reality. FreeGaussian is a new way to transform your existing photos, videos, and 360 captures for free into high-quality 3D Gaussian splats, directly in your browser. Whether you already have: ↳ a 360 recording captured with any 360 camera ↳ a set of photos ↳ or even a simple video from a place you visited you can now turn it into a photorealistic 3D Gaussian splat. Just go to upload your content, and let the reconstruction happen. Once it’s ready, you can download your 3D Gaussian splat and point cloud, and use them across your own projects, pipelines, or applications.

Over the Reality 🌐

86,340 次观看 • 5 个月前

I'm excited to share the Geo Register Plugin for LichtFeld Studio from the LichtFeld community! This plugin helps bring Gaussian splat scenes into real-world geographic space. It registers a scene to WGS-84 and ECEF coordinates, so you can click any point on the model and get its latitude, longitude and altitude. It supports multiple georeferencing sources, including EXIF GPS data, image position CSVs, RealityScan camera parameters and saved similarity transforms. Once the scene is registered, you can export geo-referenced splat models as LAS, LAZ or 3D Tiles datasets for use in GIS and 3D mapping workflows. Built for anyone working with drone data, photogrammetry, Gaussian splatting, GIS, ArcGIS or CesiumJS. Link in the comment below!

I'm excited to share the Geo Register Plugin for LichtFeld Studio from the LichtFeld community! This plugin helps bring Gaussian splat scenes into real-world geographic space. It registers a scene to WGS-84 and ECEF coordinates, so you can click any point on the model and get its latitude, longitude and altitude. It supports multiple georeferencing sources, including EXIF GPS data, image position CSVs, RealityScan camera parameters and saved similarity transforms. Once the scene is registered, you can export geo-referenced splat models as LAS, LAZ or 3D Tiles datasets for use in GIS and 3D mapping workflows. Built for anyone working with drone data, photogrammetry, Gaussian splatting, GIS, ArcGIS or CesiumJS. Link in the comment below!

MrNeRF

51,983 次观看 • 5 个月前

Gaussian Splatting is pretty wild. Being able to take dense collections of assets and package them into fast, real-time splats opens up a ton of new possibilities for look-dev, previs, and interactive scenes. For this test, I built a pile of 400 skulls - roughly 40+ million polygons (and over 400 8K texture instances) - rendered out a 600 frame dataset on The Render Network with OTOY OctaneRender and then converted the result into a single splat asset. Now it runs in real-time as one compact Gaussian Splat.

Gaussian Splatting is pretty wild. Being able to take dense collections of assets and package them into fast, real-time splats opens up a ton of new possibilities for look-dev, previs, and interactive scenes. For this test, I built a pile of 400 skulls - roughly 40+ million polygons (and over 400 8K texture instances) - rendered out a 600 frame dataset on The Render Network with OTOY OctaneRender and then converted the result into a single splat asset. Now it runs in real-time as one compact Gaussian Splat.

Spenser Dickerson

46,560 次观看 • 11 个月前

Gaussian Splats are quickly becoming one of my favorite ways to move complex 3D assets between workflows. For this test I started with Panthera Spelaea, the Blender 5.2 splash artwork by Joanna Kobierska, available from under CC-BY. Using GPT-6 Astra, I had it build a 200-frame camera rig and send the renders directly to The Render Network through the API and export a COLMAP data set. NEXT: COLMAP → Postshot → Gaussian Splat. The result is a real-time, high-fidelity version of an insanely dense asset - millions of hairs and all - that I can now bring back into OTOY Octane, relight, reframe, drop into other scenes, or even publish straight to the web. Capture the visual complexity once, then carry it anywhere. Check out the splat:

Gaussian Splats are quickly becoming one of my favorite ways to move complex 3D assets between workflows. For this test I started with Panthera Spelaea, the Blender 5.2 splash artwork by Joanna Kobierska, available from under CC-BY. Using GPT-6 Astra, I had it build a 200-frame camera rig and send the renders directly to The Render Network through the API and export a COLMAP data set. NEXT: COLMAP → Postshot → Gaussian Splat. The result is a real-time, high-fidelity version of an insanely dense asset - millions of hairs and all - that I can now bring back into OTOY Octane, relight, reframe, drop into other scenes, or even publish straight to the web. Capture the visual complexity once, then carry it anywhere. Check out the splat:

Spenser Dickerson

11,721 次观看 • 1 个月前

Volumetric, animated 3D noise shader block in Unity. Where each frame is 2D space, and the 3rd dimension is time. So that, measurement of change within a slice is 'space', and measurement of change across slices is 'time'. As a 3D block, you see the noise animate into the 3rd dimension, but when looking at only a single slice, it appears to evolve in place. Likewise, for 4D... If: this were 3D noise, then: the 4th dimension would be whatever processing/frames/states of 3D data.

Volumetric, animated 3D noise shader block in Unity. Where each frame is 2D space, and the 3rd dimension is time. So that, measurement of change within a slice is 'space', and measurement of change across slices is 'time'. As a 3D block, you see the noise animate into the 3rd dimension, but when looking at only a single slice, it appears to evolve in place. Likewise, for 4D... If: this were 3D noise, then: the 4th dimension would be whatever processing/frames/states of 3D data.

Mirza Beig

126,907 次观看 • 9 个月前

This time the tracking runs with a 120 fps global-shutter camera. Getting twice as many position updates, with much fewer gaps when tracking faster movements… It feels much better. The window is still rendering from a position roughly 20–24 ms in the past, but I compensate for some of that by predicting the position slightly forward. It still works best when tracking the phone, though. #3DGS #GaussianSplatting #ComputerVision

This time the tracking runs with a 120 fps global-shutter camera. Getting twice as many position updates, with much fewer gaps when tracking faster movements… It feels much better. The window is still rendering from a position roughly 20–24 ms in the past, but I compensate for some of that by predicting the position slightly forward. It still works best when tracking the phone, though. #3DGS #GaussianSplatting #ComputerVision

Hugues Bruyère

177,037 次观看 • 4 天前

A museum in France. Accessible from anywhere in the world. One of our mappers captured the Musée Archéologique du Val-d'Oise, home to more than 35,000 archaeological artifacts and over 3,000 objects on display. Using an Insta360 X5 and Over the Reality's reconstruction technology, the entire museum, including its multiple floors, has been transformed into a high-fidelity 3D Gaussian Splat and digital twin. This means anyone can now explore the museum remotely, walk through its galleries, move across different floors, and experience the space as if they were there in person. What was once a physical location is now a machine-readable 3D environment, preserved digitally and accessible through a browser, smartphone, or XR headset. From museums and cultural landmarks to entire cities, Over the Reality has built the largest 3D map of the world. The link to explore the experience remotely is available in the first comment.

A museum in France. Accessible from anywhere in the world. One of our mappers captured the Musée Archéologique du Val-d'Oise, home to more than 35,000 archaeological artifacts and over 3,000 objects on display. Using an Insta360 X5 and Over the Reality's reconstruction technology, the entire museum, including its multiple floors, has been transformed into a high-fidelity 3D Gaussian Splat and digital twin. This means anyone can now explore the museum remotely, walk through its galleries, move across different floors, and experience the space as if they were there in person. What was once a physical location is now a machine-readable 3D environment, preserved digitally and accessible through a browser, smartphone, or XR headset. From museums and cultural landmarks to entire cities, Over the Reality has built the largest 3D map of the world. The link to explore the experience remotely is available in the first comment.

Over the Reality 🌐

27,828 次观看 • 4 个月前

What happens if you try to push and squash a Gaussian splat? :) Been playing with adding simplified deformation and a lightweight physics simulation layer to Gaussian splats, running directly in real time on mobile. Instead of simulating every splat, this uses a small CPU lattice to drive the deformation, plus a per-splat transform so they actually stretch and compress properly. No mesh conversion, no retraining. Just layered on top of the renderer. You can push, bend, squash a scan and it holds together surprisingly well... Still early, but I can see the potential in making splats feel more real, from static captures to something more tactile, something you can touch, throw, bounce around… or well just fold and squash on the floor :) #GaussianSplatting #3DGS #Unity

What happens if you try to push and squash a Gaussian splat? :) Been playing with adding simplified deformation and a lightweight physics simulation layer to Gaussian splats, running directly in real time on mobile. Instead of simulating every splat, this uses a small CPU lattice to drive the deformation, plus a per-splat transform so they actually stretch and compress properly. No mesh conversion, no retraining. Just layered on top of the renderer. You can push, bend, squash a scan and it holds together surprisingly well... Still early, but I can see the potential in making splats feel more real, from static captures to something more tactile, something you can touch, throw, bounce around… or well just fold and squash on the floor :) #GaussianSplatting #3DGS #Unity

𝐑𝐔𝐁𝐄𝐍🥽𝐅𝐑𝐎

51,478 次观看 • 6 个月前

Holy Shit, The BitBoy said $HEX is not a scam, acknowledged it shaped DeFi as a whole + revolutionised the space, AND that #PulseChain is now revolutionising the space, That Richard will win and is smarter than the SEC, AND he is going to make a documentary to showcase that HEX isn't a security, how corrupt this space is + the lies and scrutiny this space has put HEX under. AND said it's about time Richard Heart gets the respect he deserves! Am I dreaming still? Someone want to verify I did just wake up from my nap and this is real?

Holy Shit, The BitBoy said $HEX is not a scam, acknowledged it shaped DeFi as a whole + revolutionised the space, AND that #PulseChain is now revolutionising the space, That Richard will win and is smarter than the SEC, AND he is going to make a documentary to showcase that HEX isn't a security, how corrupt this space is + the lies and scrutiny this space has put HEX under. AND said it's about time Richard Heart gets the respect he deserves! Am I dreaming still? Someone want to verify I did just wake up from my nap and this is real?

KatieePCrypto.pls

39,712 次观看 • 2 年前

Phase Space Is the Real Stage of Dynamics. So, Stop Watching the Object and Watch the State. Ordinary Space tells you where something is. Phase Space tells you what state it is in. Position alone is not enough because you also need the variable that tells you where the system is trying to go. In the animation, the left panel shows the particle moving in Ordinary Space, while the right panel shows the same system as a moving point in Phase Space. For one degree of freedom, the state is (x, p) and as time evolves, that state traces a trajectory t ↦ (x(t), p(t)) Instead of thinking of a differential equation as just a formula, Phase Space lets you see it as a flow on the space of states. For this lecture we use ẋ = p ṗ = x − x³ with Hamiltonian H(x,p) = 0.5 p² + 0.25 x⁴ − 0.5 x² #PhaseSpace #DynamicalSystems #NonlinearDynamics #HamiltonianMechanics #Mathematics

Phase Space Is the Real Stage of Dynamics. So, Stop Watching the Object and Watch the State. Ordinary Space tells you where something is. Phase Space tells you what state it is in. Position alone is not enough because you also need the variable that tells you where the system is trying to go. In the animation, the left panel shows the particle moving in Ordinary Space, while the right panel shows the same system as a moving point in Phase Space. For one degree of freedom, the state is (x, p) and as time evolves, that state traces a trajectory t ↦ (x(t), p(t)) Instead of thinking of a differential equation as just a formula, Phase Space lets you see it as a flow on the space of states. For this lecture we use ẋ = p ṗ = x − x³ with Hamiltonian H(x,p) = 0.5 p² + 0.25 x⁴ − 0.5 x² #PhaseSpace #DynamicalSystems #NonlinearDynamics #HamiltonianMechanics #Mathematics

Mathelirium

30,529 次观看 • 6 个月前

When I saw the mask "Tribes of the Calf" from Kanbas I knew I had to make it into reality. The jewelry and gold really made it stand out for me. Since Sam Spratt's The Masquerade was revealed, I have been spending time sculpting and dissecting the mask to recreate it in 3D as faithfully as possible. I delved into the creation of this mask for many reasons. I love a good challenge and this mask surely was one for me. Creating something in 3D from a 2D image is not easy, and especially when the source has generative nature, some stuff is hard to interpret, but I tried my best to make sure the visual integrity of the mask is as close to the original as possible. Splitting the whole mask into parts, filling the missing pieces so I can build the textures was quite a lot of work. I tried to present the mask in my own style with a slightly different colorway to adapt to the mask itself. Please enjoy this short animation, and turn on sound🔊 This piece is my statement that I am here to stay. That I have a voice that often feels being lost in the void. That I have been creating and posting digital art for over 20 years now and will continue until I'm gone. I have a story to tell and I want to be heard. The space we have here is small, and is shrinking day by day. It doesn't have to be like that. We need to support each other and push ourselves and people here, otherwise we are all doomed. As Kanbas has put in their observation of the mask: "Inspirational. Emotional. Natural." This is what our space can be, and this is me making a statement with this homage. I will share a 4k still below as well as a short video showing the 3D GLB interactive model together with a yt link to the 4k video since compression here is pretty bad.

When I saw the mask "Tribes of the Calf" from Kanbas I knew I had to make it into reality. The jewelry and gold really made it stand out for me. Since Sam Spratt's The Masquerade was revealed, I have been spending time sculpting and dissecting the mask to recreate it in 3D as faithfully as possible. I delved into the creation of this mask for many reasons. I love a good challenge and this mask surely was one for me. Creating something in 3D from a 2D image is not easy, and especially when the source has generative nature, some stuff is hard to interpret, but I tried my best to make sure the visual integrity of the mask is as close to the original as possible. Splitting the whole mask into parts, filling the missing pieces so I can build the textures was quite a lot of work. I tried to present the mask in my own style with a slightly different colorway to adapt to the mask itself. Please enjoy this short animation, and turn on sound🔊 This piece is my statement that I am here to stay. That I have a voice that often feels being lost in the void. That I have been creating and posting digital art for over 20 years now and will continue until I'm gone. I have a story to tell and I want to be heard. The space we have here is small, and is shrinking day by day. It doesn't have to be like that. We need to support each other and push ourselves and people here, otherwise we are all doomed. As Kanbas has put in their observation of the mask: "Inspirational. Emotional. Natural." This is what our space can be, and this is me making a statement with this homage. I will share a 4k still below as well as a short video showing the 3D GLB interactive model together with a yt link to the 4k video since compression here is pretty bad.

shoneec

17,894 次观看 • 1 年前