Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

AI aided 3D world building is getting ridiculous. This is a large, multi-room gaussian splat (~6million splats). Has streaming, LoD, character support, spatial audio, physics, collisions, VR support, and streaming video. Audio on ... Great place to watch a movie :)

martin_casado

83,966 subscribers

47,569 views • 6 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

AI 3D workflows for web are getting scary good. Here is a demo with a large splat background (+LoD), mesh character, spatial audio, VR support, and lighting. I was able to create it in a few hours (repo in reply). built with Three.js spark World Labs Audio on :)

AI 3D workflows for web are getting scary good. Here is a demo with a large splat background (+LoD), mesh character, spatial audio, VR support, and lighting. I was able to create it in a few hours (repo in reply). built with Three.js spark World Labs Audio on :)

martin_casado

82,439 views • 7 months ago

!! I really cannot believe this works. Large splat scene in VR on a Quest 3 using sparkjs. LoD budget is 500k splats. Runs about 30 fps. Full scene is ~6million splats. It's janky (sorry about the controls) But still, just insane this works at all ... (Metaverse is coming!)

!! I really cannot believe this works. Large splat scene in VR on a Quest 3 using sparkjs. LoD budget is 500k splats. Runs about 30 fps. Full scene is ~6million splats. It's janky (sorry about the controls) But still, just insane this works at all ... (Metaverse is coming!)

martin_casado

42,141 views • 8 months ago

Sparkjs streaming+LoD is now stable(ish). This flythrough is over 100m splats rendered in browser. The splats are chunked into ~900 pages with a working set of around 16million splats. I think it can handle arbitrary size worlds now. Anyone have a 1 billion splat I can try?

Sparkjs streaming+LoD is now stable(ish). This flythrough is over 100m splats rendered in browser. The splats are chunked into ~900 pages with a working set of around 16million splats. I think it can handle arbitrary size worlds now. Anyone have a 1 billion splat I can try?

martin_casado

27,107 views • 6 months ago

Multi-splat object LOD test in sparkjs. 7 AI generated worlds, 12.5m total splats. Pretty consistent 120 fps on my laptop.

Multi-splat object LOD test in sparkjs. 7 AI generated worlds, 12.5m total splats. Pretty consistent 120 fps on my laptop.

martin_casado

95,404 views • 8 months ago

some of these 3D AI generations are getting out of hand. this is a stupidly large splat, it's not real time video.

some of these 3D AI generations are getting out of hand. this is a stupidly large splat, it's not real time video.

martin_casado

415,198 views • 9 months ago

Absolutely massive dive into a enormous splat (Mega Hell by Brittani Natali ). It's remarkable we can create scenes this large in a few days. This is an early peak at sparkjs 2.0 that has higher precision, improved paged streaming, updated Bhatt(acharyya) LoD, and a lot more.

Absolutely massive dive into a enormous splat (Mega Hell by Brittani Natali ). It's remarkable we can create scenes this large in a few days. This is an early peak at sparkjs 2.0 that has higher precision, improved paged streaming, updated Bhatt(acharyya) LoD, and a lot more.

martin_casado

22,405 views • 5 months ago

Wild. Single shot text to 3D scene (gaussian splat) with no editing. This is approaching a usable scene asset for a game / 3D application.

Wild. Single shot text to 3D scene (gaussian splat) with no editing. This is approaching a usable scene asset for a game / 3D application.

martin_casado

56,136 views • 11 months ago

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

I like big splats and I cannot lie. PlayCanvas's new LOD streaming system for 3D Gaussian Splatting is a big deal. It's a key step towards splatting the world and making it explorable. Check out a live demo below in your browser.

Bilawal Sidhu

61,583 views • 8 months ago

Integration test for all components of a prototype metaverse (protoverse?) Supports distributed hosting of worlds (~300m splats total), streaming, LoD, two way portals, on demand scene loading and collection. 160fps laptop / ~50fps VR. Next up, multiplayer.

Integration test for all components of a prototype metaverse (protoverse?) Supports distributed hosting of worlds (~300m splats total), streaming, LoD, two way portals, on demand scene loading and collection. 160fps laptop / ~50fps VR. Next up, multiplayer.

martin_casado

28,902 views • 6 months ago

splat-transform is a free and open source library and CLI tool for processing 3D Gaussian splats. It can create lightweight, accurate, voxel-based collision at scale. No human intervention required. This gym scene's voxels are perfectly generated - even large fully transparent windows are correctly filled. The voxel data file is 118KB. Start building 3D Gaussian splat apps today with PlayCanvas and splat-transform. 🧑‍💻

splat-transform is a free and open source library and CLI tool for processing 3D Gaussian splats. It can create lightweight, accurate, voxel-based collision at scale. No human intervention required. This gym scene's voxels are perfectly generated - even large fully transparent windows are correctly filled. The voxel data file is 118KB. Start building 3D Gaussian splat apps today with PlayCanvas and splat-transform. 🧑‍💻

Will Eastcott

20,265 views • 1 month ago

The low poly meshes I created are much, much faster with physics / collision than those directly from the splat to mesh translation. Amazing. I now have an end to end workflow for generated 3D worlds with usable collisions. Works great in VR and mobile too ...

The low poly meshes I created are much, much faster with physics / collision than those directly from the splat to mesh translation. Amazing. I now have an end to end workflow for generated 3D worlds with usable collisions. Works great in VR and mobile too ...

martin_casado

54,452 views • 5 months ago

Some of the large scene's being generated are really unbelievable. This is a generative 3D splat, not 2D video. The full scene is likely over 50million splats. You can see some stitching inconsistencies from the final v2v pass. Also nice music :)

Some of the large scene's being generated are really unbelievable. This is a generative 3D splat, not 2D video. The full scene is likely over 50million splats. You can see some stitching inconsistencies from the final v2v pass. Also nice music :)

martin_casado

138,482 views • 10 months ago

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Over the Reality 🌐

347,044 views • 1 month ago

Working on a tool to generate low poly collision meshes from gaussian splats. It uses marching cubes and quadric error metric (QEM) decimation. Results are pretty good, it can get a usable sub 10Mb collision mesh from a 50Mb splat.

Working on a tool to generate low poly collision meshes from gaussian splats. It uses marching cubes and quadric error metric (QEM) decimation. Results are pretty good, it can get a usable sub 10Mb collision mesh from a 50Mb splat.

martin_casado

49,759 views • 5 months ago

Total insanity. This is using an adaptive LOD scheme in sparksjs (not merged yet). The entire scene has 16million splats and this is real time navigation ... 😱😱

Total insanity. This is using an adaptive LOD scheme in sparksjs (not merged yet). The entire scene has 16million splats and this is real time navigation ... 😱😱

martin_casado

317,275 views • 9 months ago

Another ridiculously large AI generated 3D scene. Tons of detail, and nice stereoscopic audio (turn on sound if you can). Works well in VR (although some quant effects from Spark near the end). Hosted version in reply.

Another ridiculously large AI generated 3D scene. Tons of detail, and nice stereoscopic audio (turn on sound if you can). Works well in VR (although some quant effects from Spark near the end). Hosted version in reply.

martin_casado

47,742 views • 7 months ago

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 views • 9 months ago

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Over the Reality 🌐

400,097 views • 2 months ago

Marvel Studios' The Fantastic Four: First Steps is now streaming on Disney+ and watching it in 4K 3D with Spatial Audio on Apple Vision Pro is just awesome 🤩 Feels like sitting in a private cinema with a giant screen and insane clarity. Add AirPods and you’re fully immersed 🍿

Marvel Studios' The Fantastic Four: First Steps is now streaming on Disney+ and watching it in 4K 3D with Spatial Audio on Apple Vision Pro is just awesome 🤩 Feels like sitting in a private cinema with a giant screen and insane clarity. Add AirPods and you’re fully immersed 🍿

Ben Geskin

166,817 views • 8 months ago

Introducing powered by Over the Reality. FreeGaussian is a new way to transform your existing photos, videos, and 360 captures for free into high-quality 3D Gaussian splats, directly in your browser. Whether you already have: ↳ a 360 recording captured with any 360 camera ↳ a set of photos ↳ or even a simple video from a place you visited you can now turn it into a photorealistic 3D Gaussian splat. Just go to upload your content, and let the reconstruction happen. Once it’s ready, you can download your 3D Gaussian splat and point cloud, and use them across your own projects, pipelines, or applications.

Introducing powered by Over the Reality. FreeGaussian is a new way to transform your existing photos, videos, and 360 captures for free into high-quality 3D Gaussian splats, directly in your browser. Whether you already have: ↳ a 360 recording captured with any 360 camera ↳ a set of photos ↳ or even a simple video from a place you visited you can now turn it into a photorealistic 3D Gaussian splat. Just go to upload your content, and let the reconstruction happen. Once it’s ready, you can download your 3D Gaussian splat and point cloud, and use them across your own projects, pipelines, or applications.

Over the Reality 🌐

86,201 views • 2 months ago