Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

3d visual positioning experiment -- look at the alignment between the 3d mesh and the live camera view. Truly feels magical -- like x-ray vision. Workflow: 1. Scanned a street in 15 mins w/ xgrids 2. Localized against that scan at night, in real-time, while sitting in a car... show more

Bilawal Sidhu

119,821 subscribers

27,541 Aufrufe • vor 11 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

4 Kommentare

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 11 Monaten

check out @multiset_ai (visual positioning system & object tracking platform) and @XGRIDS2023 (3d scanning devices)

Profilbild von webXOS Software

webXOS Softwarevor 11 Monaten

coming soon

Profilbild von Novyx Labs

Novyx Labsvor 11 Monaten

the map is finally becoming the territory. high signal density.

Profilbild von Alex Kissi Jr

Alex Kissi Jrvor 11 Monaten

real time AI for driving and flying would be 👌

Ähnliche Videos

$Late Xmas gift from XGRIDS has arrived! LiDAR SLAM + RGB cameras to create massive 3D Gaussian Splats in a fraction of time as my DSLR rig. Look out for tests in the new year! For now back to kicking it with the fam.$

Late Xmas gift from XGRIDS has arrived! LiDAR SLAM + RGB cameras to create massive 3D Gaussian Splats in a fraction of time as my DSLR rig. Look out for tests in the new year! For now back to kicking it with the fam.

Bilawal Sidhu

17,539 Aufrufe • vor 1 Jahr

🇨🇭 This flying robot goes where humans refuse to. The Elios 3 is built for extremely dangerous and confined spaces, with a protective cage that lets it smash into walls, recover, and keep flying. While exploring, it uses onboard LiDAR to build detailed 3D maps in real time. This is next-level inspection tech. Writer: Val

🇨🇭 This flying robot goes where humans refuse to. The Elios 3 is built for extremely dangerous and confined spaces, with a protective cage that lets it smash into walls, recover, and keep flying. While exploring, it uses onboard LiDAR to build detailed 3D maps in real time. This is next-level inspection tech. Writer: Val

Mario Nawfal

28,001 Aufrufe • vor 4 Monaten

Excited to share this demo from Over the Reality! Watch our Unitree Go2 robodog navigating our office while reconstructing the 3D space in real-time using the VGGT-based foundation vision model. This is a prime example of machine perception in action, turning raw RGB camera feeds into rich, detailed 3D maps! The robodog's RGB cam generates a dense, textured 3D reconstruction via VGGT from a few photograms, capturing nuances like object shapes and surfaces with impressive fidelity (main view). Compare that to the standard LiDAR system (top right), it's sparser, more point-cloud focused, lacking the visual richness. Vision models are closing the gap fast! What's powering this? VGGT, a cutting-edge foundation model for 3D perception, trained on datasets orders of magnitude smaller than our massive OVER 3D maps dataset. Imagine the leap when we apply OVER's scale to VGGT-like transformer based architectures, denser reconstructions, better generalization, revolutionary for robotics, machine perception & AR! Stay tuned for more breakthroughs at the intersection of AI, robotics, and DePIN. We're building the future of Physical AI and Spatial Computing at Over the Reality 🌐 What do you think, ready for robodogs in your world? Drop your thoughts! 🤖🌐

Excited to share this demo from Over the Reality! Watch our Unitree Go2 robodog navigating our office while reconstructing the 3D space in real-time using the VGGT-based foundation vision model. This is a prime example of machine perception in action, turning raw RGB camera feeds into rich, detailed 3D maps! The robodog's RGB cam generates a dense, textured 3D reconstruction via VGGT from a few photograms, capturing nuances like object shapes and surfaces with impressive fidelity (main view). Compare that to the standard LiDAR system (top right), it's sparser, more point-cloud focused, lacking the visual richness. Vision models are closing the gap fast! What's powering this? VGGT, a cutting-edge foundation model for 3D perception, trained on datasets orders of magnitude smaller than our massive OVER 3D maps dataset. Imagine the leap when we apply OVER's scale to VGGT-like transformer based architectures, denser reconstructions, better generalization, revolutionary for robotics, machine perception & AR! Stay tuned for more breakthroughs at the intersection of AI, robotics, and DePIN. We're building the future of Physical AI and Spatial Computing at Over the Reality 🌐 What do you think, ready for robodogs in your world? Drop your thoughts! 🤖🌐

Over the Reality 🌐

359,779 Aufrufe • vor 1 Jahr

3D Gaussian splats deliver more realistic visuals than your average PS5 game! 🤯 Check out this grocery store. You can even read the labels on the products. And this wasn't painstakingly modelled by a 3D artist. It was captured in minutes with an XGRIDS PortalCam. Rendered in real-time by the PlayCanvas Engine. [1 / 2]

3D Gaussian splats deliver more realistic visuals than your average PS5 game! 🤯 Check out this grocery store. You can even read the labels on the products. And this wasn't painstakingly modelled by a 3D artist. It was captured in minutes with an XGRIDS PortalCam. Rendered in real-time by the PlayCanvas Engine. [1 / 2]

Will Eastcott

13,905 Aufrufe • vor 8 Monaten

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Over the Reality 🌐

347,424 Aufrufe • vor 5 Monaten

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 Aufrufe • vor 1 Jahr

3D Gaussian Splats are cool, but they're static (Part 13). VR-GS makes it possible for users to interact with 3D Gaussian kernels in VR and can generate realistic dynamic responses and illumination in real-time.

3D Gaussian Splats are cool, but they're static (Part 13). VR-GS makes it possible for users to interact with 3D Gaussian kernels in VR and can generate realistic dynamic responses and illumination in real-time.

Dreaming Tulpa 🥓👑

75,197 Aufrufe • vor 2 Jahren

I made a cute 3D wizard in minutes... for free The combo was simple: Unbound + Tripo. Unbound helped me shape the character idea, then Tripo turned it into a 3D model without the usual heavy workflow. The whole process felt fast, playful, and easy to experiment with If you’re a 3D artist, a visual creator, or just starting to explore 3D, try Unbound while it’s still free for a limited time. You can use it to create characters, creatures, and 3D models without feeling overwhelmed I'm sure many visual creators are going to love this Link in the first comment 👇🏻

I made a cute 3D wizard in minutes... for free The combo was simple: Unbound + Tripo. Unbound helped me shape the character idea, then Tripo turned it into a 3D model without the usual heavy workflow. The whole process felt fast, playful, and easy to experiment with If you’re a 3D artist, a visual creator, or just starting to explore 3D, try Unbound while it’s still free for a limited time. You can use it to create characters, creatures, and 3D models without feeling overwhelmed I'm sure many visual creators are going to love this Link in the first comment 👇🏻

Amira Zairi

18,116 Aufrufe • vor 6 Monaten

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2

Gordon Wetzstein

52,555 Aufrufe • vor 2 Jahren

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Over the Reality 🌐

400,303 Aufrufe • vor 6 Monaten

Semantically annotating 3D gaussian splats on the fly using gemini 3.1 + sparkjs 1. Load any 3D scene and hit scan 2. Get 2D detections from VLM 3. Cluster outputs & project into 3D world space 4. Save as a persistent 3D semantic layer Inspired by Alexander Chen's experiments with gemini visual intelligence. Just had to try to lift it from 2D to 3D!

Semantically annotating 3D gaussian splats on the fly using gemini 3.1 + sparkjs 1. Load any 3D scene and hit scan 2. Get 2D detections from VLM 3. Cluster outputs & project into 3D world space 4. Save as a persistent 3D semantic layer Inspired by Alexander Chen's experiments with gemini visual intelligence. Just had to try to lift it from 2D to 3D!

Bilawal Sidhu

56,910 Aufrufe • vor 5 Monaten

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

AI at Meta

409,091 Aufrufe • vor 2 Jahren

Another AI Experiment. Using SHARP, Apple's ML framework - magical stuff. 2D Images to 3D Gaussian splats. Plotted and flown in Three.js

Another AI Experiment. Using SHARP, Apple's ML framework - magical stuff. 2D Images to 3D Gaussian splats. Plotted and flown in Three.js

M. Ali Kapadia

26,886 Aufrufe • vor 8 Monaten

Apple Maps 3d is insanely impressive now (see video below) Google on the other hand decided to build an insanely clunky solution to display 3d maps to avoid using mobile GPUs: A Google server streams (!) a live video of its 3d rendered map to you, the result is a disastrous: a super laggy and clunky 3d view full of video compression artefacts with a response time of 2-3 seconds for every movement And I know WHY they built that, someone felt it was not inclusive to only have 3d maps that are high performing on iOS because Apple's GPUs are insanely fast and can deal with it (as you can see below in Apple Maps) but they wanted to support inferior phones, I get it But then they also decided to worsen the experience for iOS users who could easily run 3d natively on its GPU It's just an insane product decision, there's no way to cut it: they could have super smooth 3d like Apple Maps but neutered it with a clunky live stream Even more insane because Google does have native 3d on iOS in a completely different app that nobody uses: Google Earth Is 3d important? Not rly for nav no but it shows again something about Google's engineering decisions, like the redesign of the Google OAuth Login screen that made zero sense Nobody is speaking up against bad ideas in Google meetings, everyone's too scared of HR maybe, it's the opposite of a meritocracy and it's just super visible from using Google products right now

Apple Maps 3d is insanely impressive now (see video below) Google on the other hand decided to build an insanely clunky solution to display 3d maps to avoid using mobile GPUs: A Google server streams (!) a live video of its 3d rendered map to you, the result is a disastrous: a super laggy and clunky 3d view full of video compression artefacts with a response time of 2-3 seconds for every movement And I know WHY they built that, someone felt it was not inclusive to only have 3d maps that are high performing on iOS because Apple's GPUs are insanely fast and can deal with it (as you can see below in Apple Maps) but they wanted to support inferior phones, I get it But then they also decided to worsen the experience for iOS users who could easily run 3d natively on its GPU It's just an insane product decision, there's no way to cut it: they could have super smooth 3d like Apple Maps but neutered it with a clunky live stream Even more insane because Google does have native 3d on iOS in a completely different app that nobody uses: Google Earth Is 3d important? Not rly for nav no but it shows again something about Google's engineering decisions, like the redesign of the Google OAuth Login screen that made zero sense Nobody is speaking up against bad ideas in Google meetings, everyone's too scared of HR maybe, it's the opposite of a meritocracy and it's just super visible from using Google products right now

@levelsio

1,489,689 Aufrufe • vor 2 Jahren

VPS or visual positioning system... this is how AR glasses and robots will understand where they are in the real world and know where to go. It’s also how you can spatially annotate reality with cm level accuracy - all using a machine readable model of the world.

VPS or visual positioning system... this is how AR glasses and robots will understand where they are in the real world and know where to go. It’s also how you can spatially annotate reality with cm level accuracy - all using a machine readable model of the world.

Bilawal Sidhu

28,085 Aufrufe • vor 11 Monaten

3D Gaussian Splats are cool, but they're static (Part 33). GGHead can generate and render 3D heads at 1K resolution in real-time.

3D Gaussian Splats are cool, but they're static (Part 33). GGHead can generate and render 3D heads at 1K resolution in real-time.

Dreaming Tulpa 🥓👑

104,552 Aufrufe • vor 2 Jahren

Claude Fable 5 vs Kimi K3 — same 3D build, 3.3x cheaper. someone prototyped a 3D stadium seat-view picker with Fable 5 — preview exactly what you'll see from your seat before buying a ticket. I rebuilt the same thing with Kimi K3 in two hours, at 3.3x lower cost. no more static seat maps. pick a seat, see the actual view in 3D, then buy. works for cinemas, concerts, cricket grounds, Wimbledon — any venue. K3 dropped this week: 2.8 trillion parameters, open weights July 27. 3D is the future, and it just got a lot cheaper to build. Live Fable 5: Live Kimi K3: Code: full Kimi K3 breakdown below.

Claude Fable 5 vs Kimi K3 — same 3D build, 3.3x cheaper. someone prototyped a 3D stadium seat-view picker with Fable 5 — preview exactly what you'll see from your seat before buying a ticket. I rebuilt the same thing with Kimi K3 in two hours, at 3.3x lower cost. no more static seat maps. pick a seat, see the actual view in 3D, then buy. works for cinemas, concerts, cricket grounds, Wimbledon — any venue. K3 dropped this week: 2.8 trillion parameters, open weights July 27. 3D is the future, and it just got a lot cheaper to build. Live Fable 5: Live Kimi K3: Code: full Kimi K3 breakdown below.

Kirill

207,659 Aufrufe • vor 3 Monaten