Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

3d visual positioning experiment -- look at the alignment between the 3d mesh and the live camera view. Truly feels magical -- like x-ray vision. Workflow: 1. Scanned a street in 15 mins w/ xgrids 2. Localized against that scan at night, in real-time, while sitting in a car... show more

Bilawal Sidhu

104,243 subscribers

27,278 views • 7 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

$Late Xmas gift from XGRIDS has arrived! LiDAR SLAM + RGB cameras to create massive 3D Gaussian Splats in a fraction of time as my DSLR rig. Look out for tests in the new year! For now back to kicking it with the fam.$

Late Xmas gift from XGRIDS has arrived! LiDAR SLAM + RGB cameras to create massive 3D Gaussian Splats in a fraction of time as my DSLR rig. Look out for tests in the new year! For now back to kicking it with the fam.

Bilawal Sidhu

17,516 views • 1 year ago

🇨🇭 This flying robot goes where humans refuse to. The Elios 3 is built for extremely dangerous and confined spaces, with a protective cage that lets it smash into walls, recover, and keep flying. While exploring, it uses onboard LiDAR to build detailed 3D maps in real time. This is next-level inspection tech. Writer: Val

🇨🇭 This flying robot goes where humans refuse to. The Elios 3 is built for extremely dangerous and confined spaces, with a protective cage that lets it smash into walls, recover, and keep flying. While exploring, it uses onboard LiDAR to build detailed 3D maps in real time. This is next-level inspection tech. Writer: Val

Mario Nawfal

28,001 views • 10 days ago

Excited to share this demo from Over the Reality! Watch our Unitree Go2 robodog navigating our office while reconstructing the 3D space in real-time using the VGGT-based foundation vision model. This is a prime example of machine perception in action, turning raw RGB camera feeds into rich, detailed 3D maps! The robodog's RGB cam generates a dense, textured 3D reconstruction via VGGT from a few photograms, capturing nuances like object shapes and surfaces with impressive fidelity (main view). Compare that to the standard LiDAR system (top right), it's sparser, more point-cloud focused, lacking the visual richness. Vision models are closing the gap fast! What's powering this? VGGT, a cutting-edge foundation model for 3D perception, trained on datasets orders of magnitude smaller than our massive OVER 3D maps dataset. Imagine the leap when we apply OVER's scale to VGGT-like transformer based architectures, denser reconstructions, better generalization, revolutionary for robotics, machine perception & AR! Stay tuned for more breakthroughs at the intersection of AI, robotics, and DePIN. We're building the future of Physical AI and Spatial Computing at Over the Reality 🌐 What do you think, ready for robodogs in your world? Drop your thoughts! 🤖🌐

Excited to share this demo from Over the Reality! Watch our Unitree Go2 robodog navigating our office while reconstructing the 3D space in real-time using the VGGT-based foundation vision model. This is a prime example of machine perception in action, turning raw RGB camera feeds into rich, detailed 3D maps! The robodog's RGB cam generates a dense, textured 3D reconstruction via VGGT from a few photograms, capturing nuances like object shapes and surfaces with impressive fidelity (main view). Compare that to the standard LiDAR system (top right), it's sparser, more point-cloud focused, lacking the visual richness. Vision models are closing the gap fast! What's powering this? VGGT, a cutting-edge foundation model for 3D perception, trained on datasets orders of magnitude smaller than our massive OVER 3D maps dataset. Imagine the leap when we apply OVER's scale to VGGT-like transformer based architectures, denser reconstructions, better generalization, revolutionary for robotics, machine perception & AR! Stay tuned for more breakthroughs at the intersection of AI, robotics, and DePIN. We're building the future of Physical AI and Spatial Computing at Over the Reality 🌐 What do you think, ready for robodogs in your world? Drop your thoughts! 🤖🌐

Over the Reality 🌐

359,647 views • 9 months ago

3D Gaussian splats deliver more realistic visuals than your average PS5 game! 🤯 Check out this grocery store. You can even read the labels on the products. And this wasn't painstakingly modelled by a 3D artist. It was captured in minutes with an XGRIDS PortalCam. Rendered in real-time by the PlayCanvas Engine. [1 / 2]

3D Gaussian splats deliver more realistic visuals than your average PS5 game! 🤯 Check out this grocery store. You can even read the labels on the products. And this wasn't painstakingly modelled by a 3D artist. It was captured in minutes with an XGRIDS PortalCam. Rendered in real-time by the PlayCanvas Engine. [1 / 2]

Will Eastcott

13,819 views • 4 months ago

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Over the Reality 🌐

347,001 views • 1 month ago

3D Gaussian Splats are cool, but they're static (Part 13). VR-GS makes it possible for users to interact with 3D Gaussian kernels in VR and can generate realistic dynamic responses and illumination in real-time.

3D Gaussian Splats are cool, but they're static (Part 13). VR-GS makes it possible for users to interact with 3D Gaussian kernels in VR and can generate realistic dynamic responses and illumination in real-time.

Dreaming Tulpa 🥓👑

73,759 views • 2 years ago

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 views • 8 months ago

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2

Gordon Wetzstein

52,480 views • 2 years ago

I made a cute 3D wizard in minutes... for free The combo was simple: Unbound + Tripo. Unbound helped me shape the character idea, then Tripo turned it into a 3D model without the usual heavy workflow. The whole process felt fast, playful, and easy to experiment with If you’re a 3D artist, a visual creator, or just starting to explore 3D, try Unbound while it’s still free for a limited time. You can use it to create characters, creatures, and 3D models without feeling overwhelmed I'm sure many visual creators are going to love this Link in the first comment 👇🏻

I made a cute 3D wizard in minutes... for free The combo was simple: Unbound + Tripo. Unbound helped me shape the character idea, then Tripo turned it into a 3D model without the usual heavy workflow. The whole process felt fast, playful, and easy to experiment with If you’re a 3D artist, a visual creator, or just starting to explore 3D, try Unbound while it’s still free for a limited time. You can use it to create characters, creatures, and 3D models without feeling overwhelmed I'm sure many visual creators are going to love this Link in the first comment 👇🏻

Amira Zairi

18,116 views • 2 months ago

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Over the Reality 🌐

400,097 views • 2 months ago

Another AI Experiment. Using SHARP, Apple's ML framework - magical stuff. 2D Images to 3D Gaussian splats. Plotted and flown in Three.js

Another AI Experiment. Using SHARP, Apple's ML framework - magical stuff. 2D Images to 3D Gaussian splats. Plotted and flown in Three.js

M. Ali Kapadia

26,886 views • 4 months ago

Semantically annotating 3D gaussian splats on the fly using gemini 3.1 + sparkjs 1. Load any 3D scene and hit scan 2. Get 2D detections from VLM 3. Cluster outputs & project into 3D world space 4. Save as a persistent 3D semantic layer Inspired by Alexander Chen's experiments with gemini visual intelligence. Just had to try to lift it from 2D to 3D!

Semantically annotating 3D gaussian splats on the fly using gemini 3.1 + sparkjs 1. Load any 3D scene and hit scan 2. Get 2D detections from VLM 3. Cluster outputs & project into 3D world space 4. Save as a persistent 3D semantic layer Inspired by Alexander Chen's experiments with gemini visual intelligence. Just had to try to lift it from 2D to 3D!

Bilawal Sidhu

56,568 views • 1 month ago

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

AI at Meta

408,737 views • 2 years ago

Apple Maps 3d is insanely impressive now (see video below) Google on the other hand decided to build an insanely clunky solution to display 3d maps to avoid using mobile GPUs: A Google server streams (!) a live video of its 3d rendered map to you, the result is a disastrous: a super laggy and clunky 3d view full of video compression artefacts with a response time of 2-3 seconds for every movement And I know WHY they built that, someone felt it was not inclusive to only have 3d maps that are high performing on iOS because Apple's GPUs are insanely fast and can deal with it (as you can see below in Apple Maps) but they wanted to support inferior phones, I get it But then they also decided to worsen the experience for iOS users who could easily run 3d natively on its GPU It's just an insane product decision, there's no way to cut it: they could have super smooth 3d like Apple Maps but neutered it with a clunky live stream Even more insane because Google does have native 3d on iOS in a completely different app that nobody uses: Google Earth Is 3d important? Not rly for nav no but it shows again something about Google's engineering decisions, like the redesign of the Google OAuth Login screen that made zero sense Nobody is speaking up against bad ideas in Google meetings, everyone's too scared of HR maybe, it's the opposite of a meritocracy and it's just super visible from using Google products right now

Apple Maps 3d is insanely impressive now (see video below) Google on the other hand decided to build an insanely clunky solution to display 3d maps to avoid using mobile GPUs: A Google server streams (!) a live video of its 3d rendered map to you, the result is a disastrous: a super laggy and clunky 3d view full of video compression artefacts with a response time of 2-3 seconds for every movement And I know WHY they built that, someone felt it was not inclusive to only have 3d maps that are high performing on iOS because Apple's GPUs are insanely fast and can deal with it (as you can see below in Apple Maps) but they wanted to support inferior phones, I get it But then they also decided to worsen the experience for iOS users who could easily run 3d natively on its GPU It's just an insane product decision, there's no way to cut it: they could have super smooth 3d like Apple Maps but neutered it with a clunky live stream Even more insane because Google does have native 3d on iOS in a completely different app that nobody uses: Google Earth Is 3d important? Not rly for nav no but it shows again something about Google's engineering decisions, like the redesign of the Google OAuth Login screen that made zero sense Nobody is speaking up against bad ideas in Google meetings, everyone's too scared of HR maybe, it's the opposite of a meritocracy and it's just super visible from using Google products right now

@levelsio

1,488,824 views • 1 year ago

VPS or visual positioning system... this is how AR glasses and robots will understand where they are in the real world and know where to go. It’s also how you can spatially annotate reality with cm level accuracy - all using a machine readable model of the world.

VPS or visual positioning system... this is how AR glasses and robots will understand where they are in the real world and know where to go. It’s also how you can spatially annotate reality with cm level accuracy - all using a machine readable model of the world.

Bilawal Sidhu

27,898 views • 7 months ago

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

@levelsio

119,210 views • 1 year ago

3D Gaussian Splat of Symposion Lindabrunn in Austria. Reality compressed to 39 MB with SOG from @PlayCanvas. 🗜️ Scan by Chris-RDT using XGRIDS PortalCam.

3D Gaussian Splat of Symposion Lindabrunn in Austria. Reality compressed to 39 MB with SOG from @PlayCanvas. 🗜️ Scan by Chris-RDT using XGRIDS PortalCam.

Will Eastcott

17,396 views • 8 months ago

3D Gaussian Splats are cool, but they're static (Part 33). GGHead can generate and render 3D heads at 1K resolution in real-time.

3D Gaussian Splats are cool, but they're static (Part 33). GGHead can generate and render 3D heads at 1K resolution in real-time.

Dreaming Tulpa 🥓👑

104,538 views • 2 years ago

We shipped 3D AI Agents straight into Sperax | SperaxOS and they're alive inside the chat. Build your 3D AI agent on → animations, emotions, a brain, money. Paste the link → it renders live in the conversation. Not a video. A real, live, interactive 3D agent. Spin it. Emote it. Give it a wallet, skills, and memory. Put it to work. Time to break AI out the box.

We shipped 3D AI Agents straight into Sperax | SperaxOS and they're alive inside the chat. Build your 3D AI agent on → animations, emotions, a brain, money. Paste the link → it renders live in the conversation. Not a video. A real, live, interactive 3D agent. Spin it. Emote it. Give it a wallet, skills, and memory. Put it to work. Time to break AI out the box.

three.ws

52,019 views • 23 days ago