Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

VPS or visual positioning system... this is how AR glasses and robots will understand where they are in the real world and know where to go. It’s also how you can spatially annotate reality with cm level accuracy - all using a machine readable model of the world.

Bilawal Sidhu

106,992 subscribers

27,884 views • 6 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

You've probably heard about GPS. But have you heard about VPS? It's the visual positioning tech that gives robots and AR glasses centimeter-level accuracy where GPS fails. Here's how it works: 0:00 - Intro 0:19 - How GPS Actually Works 1:28 - The Problem with GPS for AR & Robotics 2:06 - What is VPS? (Visual Positioning System) 2:38 - Use Cases: Delivery Robots & Drones 3:17 - VPS in Action: Apple Vision Pro & Meta Quest 3:53 - Scanning Your World with an iPhone (Multiset AI) 4:31 - Key Takeaways 4:48 - The Future: Spatial Intelligence

You've probably heard about GPS. But have you heard about VPS? It's the visual positioning tech that gives robots and AR glasses centimeter-level accuracy where GPS fails. Here's how it works: 0:00 - Intro 0:19 - How GPS Actually Works 1:28 - The Problem with GPS for AR & Robotics 2:06 - What is VPS? (Visual Positioning System) 2:38 - Use Cases: Delivery Robots & Drones 3:17 - VPS in Action: Apple Vision Pro & Meta Quest 3:53 - Scanning Your World with an iPhone (Multiset AI) 4:31 - Key Takeaways 4:48 - The Future: Spatial Intelligence

Bilawal Sidhu

14,757 views • 5 months ago

Our smart glasses look at the world around them and figure out where they are. We send an image from Mentra Live smart glasses to Auki Labs Visual Positioning System (VPS). The VPS looks at the image and gives back 3D pose.

Our smart glasses look at the world around them and figure out where they are. We send an image from Mentra Live smart glasses to Auki Labs Visual Positioning System (VPS). The VPS looks at the image and gives back 3D pose.

cayden 凯登

23,381 views • 1 year ago

Have you ever seen a robot walk along a waterfront, understand its surroundings, and look out at the sea? 🤖 Thanks to Over the Reality, this is possible. Places like this are mapped every day by our global community of 360 mappers. Using our technology, they are transformed into high-fidelity machine-readable 3D Gaussian Splats. This data can be used to: • navigate robots through the physical world • train AI and Visual Models • power VPS localization • anchor persistent XR content to real-world locations This is just one of more than 250,000 real-world locations already mapped by the Over the Reality community. And unlike traditional datasets, these places can be explored directly through a smartphone, browser, or XR headset, allowing anyone to navigate and experience them in first person. From city streets and waterfronts to landmarks and cultural sites, we're building one of the world's largest machine-readable maps for AI, robotics, and spatial computing.

Have you ever seen a robot walk along a waterfront, understand its surroundings, and look out at the sea? 🤖 Thanks to Over the Reality, this is possible. Places like this are mapped every day by our global community of 360 mappers. Using our technology, they are transformed into high-fidelity machine-readable 3D Gaussian Splats. This data can be used to: • navigate robots through the physical world • train AI and Visual Models • power VPS localization • anchor persistent XR content to real-world locations This is just one of more than 250,000 real-world locations already mapped by the Over the Reality community. And unlike traditional datasets, these places can be explored directly through a smartphone, browser, or XR headset, allowing anyone to navigate and experience them in first person. From city streets and waterfronts to landmarks and cultural sites, we're building one of the world's largest machine-readable maps for AI, robotics, and spatial computing.

Over the Reality 🌐

31,714 views • 17 days ago

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Over the Reality 🌐

346,845 views • 26 days ago

Niantic and Snap partnership: AR devs will be able to use Niantic VPS to place content at millions of real-world locations with centimeter-level accuracy

Niantic and Snap partnership: AR devs will be able to use Niantic VPS to place content at millions of real-world locations with centimeter-level accuracy

Chubby♨️

40,984 views • 1 year ago

imagine a world where geospatial AI, VPS, and AR glasses meet. we’re actively exploring the magic of what that looks like with Dots as spatially intelligent agents for navigation. cc: Spectacles Peridot Niantic Spatial 🌎 ICYMI, we also announced our multi-year strategic partnership, including an investment from Snap Inc., to build the next-gen AI-powered map of the real world.

imagine a world where geospatial AI, VPS, and AR glasses meet. we’re actively exploring the magic of what that looks like with Dots as spatially intelligent agents for navigation. cc: Spectacles Peridot Niantic Spatial 🌎 ICYMI, we also announced our multi-year strategic partnership, including an investment from Snap Inc., to build the next-gen AI-powered map of the real world.

asim ᯅ

51,901 views • 1 year ago

3d visual positioning experiment -- look at the alignment between the 3d mesh and the live camera view. Truly feels magical -- like x-ray vision. Workflow: 1. Scanned a street in 15 mins w/ xgrids 2. Localized against that scan at night, in real-time, while sitting in a car The xgrids scanner (w/ rgb + lidar) is perfect to build maps for humans (3d gaussian splats). Then multiset ai makes it easy to build machine-readable maps for AR and robotics to figure out exactly where they are in 3d space with cm-level accuracy.

3d visual positioning experiment -- look at the alignment between the 3d mesh and the live camera view. Truly feels magical -- like x-ray vision. Workflow: 1. Scanned a street in 15 mins w/ xgrids 2. Localized against that scan at night, in real-time, while sitting in a car The xgrids scanner (w/ rgb + lidar) is perfect to build maps for humans (3d gaussian splats). Then multiset ai makes it easy to build machine-readable maps for AR and robotics to figure out exactly where they are in 3d space with cm-level accuracy.

Bilawal Sidhu

27,278 views • 6 months ago

With Scaniverse, every space can be captured, digitized, and transformed into a living, machine-readable twin. At Super Bowl LX Innovation Summit, we turned the venue into a live digital twin in minutes. Powered by Visual Positioning System, robots and phones shared the same spatial understanding — unlocking a true shared reality. Read more: #NianticSpatial #SuperBowl #Scaniverse #DigitalTwin #GaussianSplat #VPS #AI

With Scaniverse, every space can be captured, digitized, and transformed into a living, machine-readable twin. At Super Bowl LX Innovation Summit, we turned the venue into a live digital twin in minutes. Powered by Visual Positioning System, robots and phones shared the same spatial understanding — unlocking a true shared reality. Read more: #NianticSpatial #SuperBowl #Scaniverse #DigitalTwin #GaussianSplat #VPS #AI

Niantic Spatial 🌎

11,546 views • 4 months ago

First demo of our new aerial Visual-Inertial Positioning System (VIO+VPS): 40m positioning accuracy (CEP) in a 50 kilometer flight using a camera, consumer-grade IMU and a barometer! No GPS

First demo of our new aerial Visual-Inertial Positioning System (VIO+VPS): 40m positioning accuracy (CEP) in a 50 kilometer flight using a camera, consumer-grade IMU and a barometer! No GPS

Otto Seiskari

101,510 views • 1 year ago

Building a machine learning model isn’t just about finding the right algorithm—it’s about the right process. In Machine Learning in Production, Andrew Ng breaks down the iterative loop of model development: training, error analysis, refining hyperparameters, and improving data. Getting to a high test set accuracy is one thing, but aligning your model with real-world business metrics? That’s where the real challenge begins. Learn how to bridge the gap between models and impact:

Building a machine learning model isn’t just about finding the right algorithm—it’s about the right process. In Machine Learning in Production, Andrew Ng breaks down the iterative loop of model development: training, error analysis, refining hyperparameters, and improving data. Getting to a high test set accuracy is one thing, but aligning your model with real-world business metrics? That’s where the real challenge begins. Learn how to bridge the gap between models and impact:

DeepLearning.AI

45,248 views • 1 year ago

VPS 2.0 Outperforms GPS Alone. Niantic Spatial’s Visual Positioning System (VPS) matches live camera data to a spatial model for precise 6DoF localization—indoors, outdoors, and in complex environments where GPS fails. 🔹 ~10-15cm accuracy in mapped areas 🔹 Works in GPS-denied environments 🔹 Persistent spatial anchors Explore this deep dive to learn how VPS works: #NianticSpatial #Scaniverse #VPS #GIS #GeospatialAI #GEOINT #PhysicalAI #AI #Robotics

VPS 2.0 Outperforms GPS Alone. Niantic Spatial’s Visual Positioning System (VPS) matches live camera data to a spatial model for precise 6DoF localization—indoors, outdoors, and in complex environments where GPS fails. 🔹 ~10-15cm accuracy in mapped areas 🔹 Works in GPS-denied environments 🔹 Persistent spatial anchors Explore this deep dive to learn how VPS works: #NianticSpatial #Scaniverse #VPS #GIS #GeospatialAI #GEOINT #PhysicalAI #AI #Robotics

Niantic Spatial 🌎

19,752 views • 1 month ago

Meet the world at home, where life happens and bots become family 35 days ago, at our “Born to Bot, Bot to Family” launch event, we shared our vision of bringing robots into real homes. Today, we’re very happy to share that our robots are now gradually entering real families. For embodied AI, the real world is everyday life: different routines, different kitchens, and different ways of doing even the simplest tasks. This is where robots meet the world at home, where life happens and bots become family. They are still learning. They may move slowly, hesitate, and sometimes look a little clumsy. But every home they enter helps them understand the world a little better.

Meet the world at home, where life happens and bots become family 35 days ago, at our “Born to Bot, Bot to Family” launch event, we shared our vision of bringing robots into real homes. Today, we’re very happy to share that our robots are now gradually entering real families. For embodied AI, the real world is everyday life: different routines, different kitchens, and different ways of doing even the simplest tasks. This is where robots meet the world at home, where life happens and bots become family. They are still learning. They may move slowly, hesitate, and sometimes look a little clumsy. But every home they enter helps them understand the world a little better.

X Square Robot

1,203,760 views • 21 days ago

Elon just dropped a MAJOR nugget on how Tesla is going to be training Optimus to do real world tasks. They are building an Optimus Academy, which is a large scale, dedicated real-world training facility to accelerate the development of Optimus. The Academy will deploy thousands of Optimus units, potentially 10,000 to 30,000 robots, in a controlled realistic environment where they perform self-play, experiment with tasks, iterate on behaviors, and continuously generate training data through trial and error. The Tesla bots will also run millions of simulations in Tesla’s high-fidelity physics-accurate engine, allowing Optimus to close the “sim-to-real gap” by using these real-world observations to refine and validate the simulations! “You’re actually highlighting an important limitation and difference from cars. We’ll soon have 10 million cars on the road. It’s hard to duplicate that massive training flywheel. For the robot, what we’re going to need to do is build a lot of robots and put them in kind of an Optimus Academy so they can do self-play in reality. We’re actually building that out. We can have at least 10,000 Optimus robots, maybe 20-30,000, that are doing self-play and testing different tasks. Tesla has quite a good reality generator, a physics-accurate reality generator, that we made for the cars. We’ll do the same thing for the robots. We actually have done that for the robots. So you have a few tens of thousands of humanoid robots doing different tasks. You can do millions of simulated robots in the simulated world. You use the tens of thousands of robots in the real world to close the simulation to reality gap. Close the sim-to-real gap.”

Elon just dropped a MAJOR nugget on how Tesla is going to be training Optimus to do real world tasks. They are building an Optimus Academy, which is a large scale, dedicated real-world training facility to accelerate the development of Optimus. The Academy will deploy thousands of Optimus units, potentially 10,000 to 30,000 robots, in a controlled realistic environment where they perform self-play, experiment with tasks, iterate on behaviors, and continuously generate training data through trial and error. The Tesla bots will also run millions of simulations in Tesla’s high-fidelity physics-accurate engine, allowing Optimus to close the “sim-to-real gap” by using these real-world observations to refine and validate the simulations! “You’re actually highlighting an important limitation and difference from cars. We’ll soon have 10 million cars on the road. It’s hard to duplicate that massive training flywheel. For the robot, what we’re going to need to do is build a lot of robots and put them in kind of an Optimus Academy so they can do self-play in reality. We’re actually building that out. We can have at least 10,000 Optimus robots, maybe 20-30,000, that are doing self-play and testing different tasks. Tesla has quite a good reality generator, a physics-accurate reality generator, that we made for the cars. We’ll do the same thing for the robots. We actually have done that for the robots. So you have a few tens of thousands of humanoid robots doing different tasks. You can do millions of simulated robots in the simulated world. You use the tens of thousands of robots in the real world to close the simulation to reality gap. Close the sim-to-real gap.”

Teslaconomics

42,563 views • 4 months ago

#WATCH | Delhi: Chief Election Commissioner Gyanesh Kumar says, "The machine-readable voter list is prohibited. This decision of the Election Commission is after the judgment of the Supreme Court and is from 2019." "We have to understand the difference between a machine-readable voter list and a searchable voter list. You can search the voter list available on the Election Commission website by entering the EPIC number. You can also download it. This is not called machine-readable. Regarding machine-readable, in 2019, the Supreme Court also studied this subject in depth and found that giving a machine-readable electoral roll can violate the privacy of the voter... The machine-readable voter list is prohibited. This decision of the Election Commission is after the judgment of the Supreme Court and is from 2019..."

#WATCH | Delhi: Chief Election Commissioner Gyanesh Kumar says, "The machine-readable voter list is prohibited. This decision of the Election Commission is after the judgment of the Supreme Court and is from 2019." "We have to understand the difference between a machine-readable voter list and a searchable voter list. You can search the voter list available on the Election Commission website by entering the EPIC number. You can also download it. This is not called machine-readable. Regarding machine-readable, in 2019, the Supreme Court also studied this subject in depth and found that giving a machine-readable electoral roll can violate the privacy of the voter... The machine-readable voter list is prohibited. This decision of the Election Commission is after the judgment of the Supreme Court and is from 2019..."

ANI

281,864 views • 10 months ago

Train the AI behind real-world robots We’re hiring Data Labelers to annotate images and videos to train Optimus & autonomous systems. You’ll work with real production data & directly impact how these systems learn and operate in the real world Come join!

Train the AI behind real-world robots We’re hiring Data Labelers to annotate images and videos to train Optimus & autonomous systems. You’ll work with real production data & directly impact how these systems learn and operate in the real world Come join!

Tesla Recruiting

622,577 views • 1 month ago

Tom Hanks: "Eventually the World will have to many people in it" This is what the 'Global Elites' all believe - now they no, we are moving into an age, where Humans are expendable and can simply be replaced by robots and AI.

Tom Hanks: "Eventually the World will have to many people in it" This is what the 'Global Elites' all believe - now they no, we are moving into an age, where Humans are expendable and can simply be replaced by robots and AI.

Concerned Citizen

12,548 views • 3 months ago

Whatever this is, it’s unbelievable. And it looks like the rot goes all the way to the top, including world leaders. It’s time to demand the TRUTH and let the chips fall where they may. A system built around this level of evil does not deserve to stand.

Whatever this is, it’s unbelievable. And it looks like the rot goes all the way to the top, including world leaders. It’s time to demand the TRUTH and let the chips fall where they may. A system built around this level of evil does not deserve to stand.

Brad Lea

24,883 views • 4 months ago

I really want to show off the cutting edge tech the team is building and how we're turning AI image generation into real living environments using gaussian splats and at the :19 mark of this video you can see how we're blending splats together to create a real world. What this looks like from a gaming perspective is this all happens behind the players view to simulate a real world environment. As you move through the space, distance becomes a variable to consider on how images update and are experienced. We are creating a new reality in real time.

I really want to show off the cutting edge tech the team is building and how we're turning AI image generation into real living environments using gaussian splats and at the :19 mark of this video you can see how we're blending splats together to create a real world. What this looks like from a gaming perspective is this all happens behind the players view to simulate a real world environment. As you move through the space, distance becomes a variable to consider on how images update and are experienced. We are creating a new reality in real time.

BLVCKL!GHT

24,801 views • 7 days ago

John McAfee told the world how to crack any phone in 2016: "Any computer, any software, whether is a Android, Apple, or what you have can be done." "We can do this with any machine and it is a half-hour job." "Now I've just told all of America and the whole world how it's done. It's trivial."

John McAfee told the world how to crack any phone in 2016: "Any computer, any software, whether is a Android, Apple, or what you have can be done." "We can do this with any machine and it is a half-hour job." "Now I've just told all of America and the whole world how it's done. It's trivial."

Defiant Ghost

434,836 views • 4 months ago