Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Our CTO boyuan is demoing our new localization algorithm, which surpasses leading industry solutions. Localization enables a robot to determine its position in an environment, which is essential for navigation. While most systems require robots to start from a predefined location, ours doesn’t. It lets robots boot up anywhere... show more

OpenMind

154,160 subscribers

108,390 views • 6 months ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Demonstrating our latest localization system in action. At bootup, the robot has no prior position estimate, but within seconds it autonomously localizes itself using a fusion of three algorithms. Unlike our previous version, this updated system incorporates vision, allowing the robot to adapt to real-world changes (e.g., moved furniture) by recognizing previously seen environments. In this demo, we repeatedly reset navigation and reposition the robot to random locations, showing robust, repeatable localization. The robot then executes a full patrol, following a planned path (visualized in RViz) with real-time path tracking. Because our software is hardware-agnostic, it brings the same reliable performance to any robot it runs on.

Demonstrating our latest localization system in action. At bootup, the robot has no prior position estimate, but within seconds it autonomously localizes itself using a fusion of three algorithms. Unlike our previous version, this updated system incorporates vision, allowing the robot to adapt to real-world changes (e.g., moved furniture) by recognizing previously seen environments. In this demo, we repeatedly reset navigation and reposition the robot to random locations, showing robust, repeatable localization. The robot then executes a full patrol, following a planned path (visualized in RViz) with real-time path tracking. Because our software is hardware-agnostic, it brings the same reliable performance to any robot it runs on.

OpenMind

12,814 views • 1 month ago

Our Robotic Foundation Model, trained on data from real-world warehouse operations and simulated scenarios, enables our robots to identify objects, understand 3D spaces, and predict optimal grasping and placement.

Our Robotic Foundation Model, trained on data from real-world warehouse operations and simulated scenarios, enables our robots to identify objects, understand 3D spaces, and predict optimal grasping and placement.

Covariant

33,508 views • 1 year ago

🇨🇳 China moves from robot demos to real deployment. The plan is to deploy 10,000 humanoid robots in more than 100 real-world applications by year-end.

🇨🇳 China moves from robot demos to real deployment. The plan is to deploy 10,000 humanoid robots in more than 100 real-world applications by year-end.

Jackson Hinkle 🇺🇸

49,372 views • 3 days ago

Introducing Meta Locate 3D: a model for accurate object localization in 3D environments. Learn how Meta Locate 3D can help robots accurately understand their surroundings and interact more naturally with humans. You can download the model and dataset, read our research paper, and even try a demo!

Introducing Meta Locate 3D: a model for accurate object localization in 3D environments. Learn how Meta Locate 3D can help robots accurately understand their surroundings and interact more naturally with humans. You can download the model and dataset, read our research paper, and even try a demo!

AI at Meta

81,287 views • 1 year ago

Put simply, the real world web onboards robots to new physical spaces instantly. Simplify robot deployment → scale robot deployment. Accelerate.

Put simply, the real world web onboards robots to new physical spaces instantly. Simplify robot deployment → scale robot deployment. Accelerate.

Auki

534,978 views • 7 months ago

Humanoid and Siemens successfully completed a POC testing humanoid robots in industrial logistics. HMND 01 robot autonomously performed a tote-to-conveyor destacking task during a two-week on-site deployment at the Siemens Electronics Factory in Erlangen. This is the first step in our broader partnership with Siemens as humanoid robots move closer to real-world deployment. Learn more here:

Humanoid and Siemens successfully completed a POC testing humanoid robots in industrial logistics. HMND 01 robot autonomously performed a tote-to-conveyor destacking task during a two-week on-site deployment at the Siemens Electronics Factory in Erlangen. This is the first step in our broader partnership with Siemens as humanoid robots move closer to real-world deployment. Learn more here:

Humanoid

22,813 views • 5 months ago

Hochdynamischer Outdoor Roboter O³dyn navigation works seamlessly at the transition between indoor and outdoor areas. It is implemented using environment-based and radio-based localization algorithms. Video Credit: @FraunhoferIML #logistics #engineering #technology #robots

Hochdynamischer Outdoor Roboter O³dyn navigation works seamlessly at the transition between indoor and outdoor areas. It is implemented using environment-based and radio-based localization algorithms. Video Credit: @FraunhoferIML #logistics #engineering #technology #robots

Wevolver

17,019 views • 2 years ago

Training a Whole-Body Control Foundation Model -- new work from my team at Agility Robotics A neural network for controlling our humanoid robots which is robust to disturbances, can handle heavy objects, and is a powerful platform for learning new whole-body skills learn more in our blog post ->

Training a Whole-Body Control Foundation Model -- new work from my team at Agility Robotics A neural network for controlling our humanoid robots which is robust to disturbances, can handle heavy objects, and is a powerful platform for learning new whole-body skills learn more in our blog post ->

Chris Paxton

45,068 views • 9 months ago

Will robots and AI replace scientists? No, our goal is to create robots and ML algorithm that free scientists from labor work to focus on more impactful tasks. The recent publication on the 2nd-gen fly robot from the Schnitzer lab demonstrates our vision.

Will robots and AI replace scientists? No, our goal is to create robots and ML algorithm that free scientists from labor work to focus on more impactful tasks. The recent publication on the 2nd-gen fly robot from the Schnitzer lab demonstrates our vision.

Cheng Huang

13,624 views • 1 year ago

Make your site work for everyone, anywhere in the world. Now that Localization is available for you to implement into your builds, we want to show you exactly how to do it. Learn how to get the most out of Localization in this lesson here:

Make your site work for everyone, anywhere in the world. Now that Localization is available for you to implement into your builds, we want to show you exactly how to do it. Learn how to get the most out of Localization in this lesson here:

Webflow

12,968 views • 2 years ago

SkildAI, which is developing a foundational AI model for robots, has released a new video of their humanoid robot walking over objects and exploring environments it had never seen before. The robot is using vision & adapts in real time. SkildAI: "From raw images and joint feedback, the model directly outputs low-level motor commands. This single neural network enables humanoid robots to seamlessly walk across flat ground, climb stairs, and step over obstacles without any planning, mapping, or manual switching between behaviors. For all of our testing in this video, we deployed the robot in each new environment without any prior planning or mapping. We took off the humanoid’s shoes so you can hear it.

SkildAI, which is developing a foundational AI model for robots, has released a new video of their humanoid robot walking over objects and exploring environments it had never seen before. The robot is using vision & adapts in real time. SkildAI: "From raw images and joint feedback, the model directly outputs low-level motor commands. This single neural network enables humanoid robots to seamlessly walk across flat ground, climb stairs, and step over obstacles without any planning, mapping, or manual switching between behaviors. For all of our testing in this video, we deployed the robot in each new environment without any prior planning or mapping. We took off the humanoid’s shoes so you can hear it.

Sawyer Merritt

69,297 views • 10 months ago

One of the why questions we’re always asking is how can we help operations employees access inventory more efficiently? We’re taking a big leap forward by introducing DeepFleet, an exciting new AI model that makes our one million+ robot fleet work smarter. Think of DeepFleet as an intelligent traffic management system for our fulfillment centers. Just like smart traffic systems reduce congestion in cities, DeepFleet coordinates our robots’ movements to find optimal paths and reduce bottlenecks. By leveraging our deep expertise in robotics and combining it with AWS tools like SageMaker, we’ve built an AI model that learns from our extensive data on inventory movement to make real-time decisions that improve robot travel time by 10% (which at our scale is pretty significant). What makes this particularly exciting is how AI and robotics create value across the board. For customers, it means faster delivery times and lower costs. For employees, it opens up new opportunities – our robots handle physically demanding tasks and heavy lifting, making our fulfillment centers safer, while our people take on more technical roles. This combination of robotics and generative AI is just getting started, and am looking forward to what we’ll invent next.

One of the why questions we’re always asking is how can we help operations employees access inventory more efficiently? We’re taking a big leap forward by introducing DeepFleet, an exciting new AI model that makes our one million+ robot fleet work smarter. Think of DeepFleet as an intelligent traffic management system for our fulfillment centers. Just like smart traffic systems reduce congestion in cities, DeepFleet coordinates our robots’ movements to find optimal paths and reduce bottlenecks. By leveraging our deep expertise in robotics and combining it with AWS tools like SageMaker, we’ve built an AI model that learns from our extensive data on inventory movement to make real-time decisions that improve robot travel time by 10% (which at our scale is pretty significant). What makes this particularly exciting is how AI and robotics create value across the board. For customers, it means faster delivery times and lower costs. For employees, it opens up new opportunities – our robots handle physically demanding tasks and heavy lifting, making our fulfillment centers safer, while our people take on more technical roles. This combination of robotics and generative AI is just getting started, and am looking forward to what we’ll invent next.

Andy Jassy

42,317 views • 11 months ago

South Korea-based URobotics unveiled the E-Dong-Kit, a module for quick robot integration. It enables advanced navigation and stable movement in real-world environments. In demos, humanoid robots move smoothly and run alongside humans, showing practical, human-friendly mobility.

South Korea-based URobotics unveiled the E-Dong-Kit, a module for quick robot integration. It enables advanced navigation and stable movement in real-world environments. In demos, humanoid robots move smoothly and run alongside humans, showing practical, human-friendly mobility.

Space and Technology

18,143 views • 1 month ago

New tech lets robots read and anticipate our movements in real time Good for human-humanoid safety. A challenge for AI Governance and Privacy

New tech lets robots read and anticipate our movements in real time Good for human-humanoid safety. A challenge for AI Governance and Privacy

Glen Gilmore

31,125 views • 1 month ago

Today Mecka is announcing $60M in funding to become the data and deployment layer for physical AI This raise will allow us to scale our data infrastructure, invest into new verticals, and deploy robots into the real world

Today Mecka is announcing $60M in funding to become the data and deployment layer for physical AI This raise will allow us to scale our data infrastructure, invest into new verticals, and deploy robots into the real world

Josh

304,985 views • 13 days ago

For large-scale robotic deployment🤖 in the real-world 🌏, robots must adapt to changes in environment and objects. Ever questioned the generalizability of your robot's manipulation policy? Put it to the test with The Colosseum 🏛️. Check out our project:

For large-scale robotic deployment🤖 in the real-world 🌏, robots must adapt to changes in environment and objects. Ever questioned the generalizability of your robot's manipulation policy? Put it to the test with The Colosseum 🏛️. Check out our project:

Jiafei Duan

36,617 views • 2 years ago

How can #robots remember? 🤖 💭 For robots to understand and respond to questions that require complex multi-step reasoning in scenarios over long periods of time, we built ReMEmbR, a retrieval-augmented memory for embodied robots. 👀 Technical deep dive from #NVIDIAResearch ➡️

How can #robots remember? 🤖 💭 For robots to understand and respond to questions that require complex multi-step reasoning in scenarios over long periods of time, we built ReMEmbR, a retrieval-augmented memory for embodied robots. 👀 Technical deep dive from #NVIDIAResearch ➡️

NVIDIA AI Developer

30,485 views • 1 year ago

What if robots could learn real-world tasks from your perspective… without ever touching a robot? This is a system that trains robot policies using nothing but human-first, egocentric video data from smart glasses. No robots, no teleop, no sensors, just humans doing real tasks in the real world. Why it matters ✅ Learns robot policies from 20 minutes of human video; zero robot demos ✅ Generalizes to new objects, views, and even robot morphologies ✅ Uses 3D points for interpretable, spatially grounded learning ✅ Deploys directly to real-world robots with strong zero-shot success Thank you, Vincent Liu, for sharing!!! Learn more here: 🔗 Paper: 🌐 Website: 📍 BOOKMARK FOR LATER

What if robots could learn real-world tasks from your perspective… without ever touching a robot? This is a system that trains robot policies using nothing but human-first, egocentric video data from smart glasses. No robots, no teleop, no sensors, just humans doing real tasks in the real world. Why it matters ✅ Learns robot policies from 20 minutes of human video; zero robot demos ✅ Generalizes to new objects, views, and even robot morphologies ✅ Uses 3D points for interpretable, spatially grounded learning ✅ Deploys directly to real-world robots with strong zero-shot success Thank you, Vincent Liu, for sharing!!! Learn more here: 🔗 Paper: 🌐 Website: 📍 BOOKMARK FOR LATER

Ilir Aliu - eu/acc

10,509 views • 1 year ago

Collect robot demos from anywhere through AR! Excited to introduce 🎯DART, Dexterous AR Teleoperation interface enabling anyone to teleoperate robots in cloud-hosted simulation. With DART, anyone can collect robot demos anywhere, anytime, for multiple robots and tasks in one sitting. Every data is automatically logged on our open-sourced cloud database DexHub for public use. 🧵[1/n]

Collect robot demos from anywhere through AR! Excited to introduce 🎯DART, Dexterous AR Teleoperation interface enabling anyone to teleoperate robots in cloud-hosted simulation. With DART, anyone can collect robot demos anywhere, anytime, for multiple robots and tasks in one sitting. Every data is automatically logged on our open-sourced cloud database DexHub for public use. 🧵[1/n]

Younghyo Park

27,257 views • 1 year ago

Excited to share LWD: Learning While Deploying. Our robots learn while doing real tasks—restocking groceries, brewing Gongfu tea, making cocktails, making juice, and packing shoes. Deployment is no longer just evaluation; it becomes the training loop. 🧵

Excited to share LWD: Learning While Deploying. Our robots learn while doing real tasks—restocking groceries, brewing Gongfu tea, making cocktails, making juice, and packing shoes. Deployment is no longer just evaluation; it becomes the training loop. 🧵

Jianlan Luo

621,775 views • 1 month ago