Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Training fully autonomous robots takes more data than the real world can easily provide. Simulation lets us train, test, and deploy autonomous software without being limited by robots, space, or cost. Here’s OM1 running in simulation side-by-side to the real world.

OpenMind

154,160 subscribers

120,843 views • 6 months ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Our CoRL 2024 paper shows Reinforcement Learning can allow robots to learn skills via real-world practice, without any demonstrations or simulation engineering. Rewards are provided using language/vision models, and mobility of robots enables autonomous exploration. 1/N

Our CoRL 2024 paper shows Reinforcement Learning can allow robots to learn skills via real-world practice, without any demonstrations or simulation engineering. Rewards are provided using language/vision models, and mobility of robots enables autonomous exploration. 1/N

Russell Mendonca

38,454 views • 1 year ago

Everything that moves will be autonomous, and #physicalAI will embody robots of every kind. 🤖 Discover how NVIDIA Omniverse and #NVIDIACosmos are enabling robots to learn through simulation, training, and real-world experience. Watch the full video ▶️

Everything that moves will be autonomous, and #physicalAI will embody robots of every kind. 🤖 Discover how NVIDIA Omniverse and #NVIDIACosmos are enabling robots to learn through simulation, training, and real-world experience. Watch the full video ▶️

NVIDIA Robotics

56,496 views • 1 year ago

Train the AI behind real-world robots We’re hiring Data Labelers to annotate images and videos to train Optimus & autonomous systems. You’ll work with real production data & directly impact how these systems learn and operate in the real world Come join!

Train the AI behind real-world robots We’re hiring Data Labelers to annotate images and videos to train Optimus & autonomous systems. You’ll work with real production data & directly impact how these systems learn and operate in the real world Come join!

Tesla Recruiting

642,569 views • 1 month ago

As robotics teams scale, collecting real-world data can quickly become slow and expensive. 📉 Lightwheel is changing that with a simulation-first platform built on our technology, helping customers generate a 100:1 simulated-to-real data ratio for training autonomous systems. Together, we’re turning synthetic and real data into more capable, more reliable robots. Read the full success story 🔗

As robotics teams scale, collecting real-world data can quickly become slow and expensive. 📉 Lightwheel is changing that with a simulation-first platform built on our technology, helping customers generate a 100:1 simulated-to-real data ratio for training autonomous systems. Together, we’re turning synthetic and real data into more capable, more reliable robots. Read the full success story 🔗

NVIDIA Robotics

10,780 views • 2 months ago

🇨🇳 China moves from robot demos to real deployment. The plan is to deploy 10,000 humanoid robots in more than 100 real-world applications by year-end.

🇨🇳 China moves from robot demos to real deployment. The plan is to deploy 10,000 humanoid robots in more than 100 real-world applications by year-end.

Jackson Hinkle 🇺🇸

49,922 views • 22 days ago

We just open-sourced luwu_mjlab: an RL training environment for Luwu Dynamics quadruped robots. Built on mjlab + MuJoCo Warp, it lets us train locomotion and get-up policies in simulation, then validate them on real robots. GitHub:

We just open-sourced luwu_mjlab: an RL training environment for Luwu Dynamics quadruped robots. Built on mjlab + MuJoCo Warp, it lets us train locomotion and get-up policies in simulation, then validate them on real robots. GitHub:

XGO Robot

11,563 views • 20 days ago

🚨 NEURA unveils “NEURA Gym” — a physical AI training ground for robots. Hundreds of humanoids and robotic systems will learn real-world skills side by side, collecting data that feeds into the Neuraverse — a global infrastructure for embodied AI.

🚨 NEURA unveils “NEURA Gym” — a physical AI training ground for robots. Hundreds of humanoids and robotic systems will learn real-world skills side by side, collecting data that feeds into the Neuraverse — a global infrastructure for embodied AI.

Humanoids daily

25,469 views • 8 months ago

Jim Fan's predictions: ⦿ In the next 2–5 years, robotics will uncover its own scaling laws – similar to those seen in LLMs – by analyzing how model size, real‑world data, simulation data, and compute affect performance. ⦿ Within the next 20 years, robotics will accelerate fields like biomedical science by automating repetitive experiments, reducing time and cost in research. ⦿ Also within the next 20 years, robots may build and repair other robots and achieve recursive self‑improvement.

Jim Fan's predictions: ⦿ In the next 2–5 years, robotics will uncover its own scaling laws – similar to those seen in LLMs – by analyzing how model size, real‑world data, simulation data, and compute affect performance. ⦿ Within the next 20 years, robotics will accelerate fields like biomedical science by automating repetitive experiments, reducing time and cost in research. ⦿ Also within the next 20 years, robots may build and repair other robots and achieve recursive self‑improvement.

The Humanoid Hub

16,518 views • 1 year ago

Announcing the Dimensional Residency in Shenzhen. Deploy agents into the physical world. Real customers. Real deployments. We provide robots, $10,000 of LLM credits, free housing, office space, and customer intros to jumpstart your robotics company.

Announcing the Dimensional Residency in Shenzhen. Deploy agents into the physical world. Real customers. Real deployments. We provide robots, $10,000 of LLM credits, free housing, office space, and customer intros to jumpstart your robotics company.

stash

32,495 views • 3 months ago

At #GTC26 we are showing AlpaDreams — generative, interactive closed-loop simulation for autonomous driving. World models generate environments in real time, policies or drivers interact, and the simulator updates the world. If you are at GTC, come by the booth and try it out!

At #GTC26 we are showing AlpaDreams — generative, interactive closed-loop simulation for autonomous driving. World models generate environments in real time, policies or drivers interact, and the simulator updates the world. If you are at GTC, come by the booth and try it out!

Zian Wang

16,811 views • 3 months ago

Introducing the world's smallest, fully programmable, autonomous robots. Created by Marc Miskin of @Penn_ESE and David Blauuw of Michigan Engineering, the microscopic robots can independently sense and respond to their surroundings, operate for months and cost just a penny each.

Introducing the world's smallest, fully programmable, autonomous robots. Created by Marc Miskin of @Penn_ESE and David Blauuw of Michigan Engineering, the microscopic robots can independently sense and respond to their surroundings, operate for months and cost just a penny each.

Penn Engineering

18,164 views • 6 months ago

OpenMind wrapped up GTC on the NVIDIA Stage, showcasing our fully autonomous robots in action. We demonstrated what OM1 can do in completely new environments, navigating seamlessly through dynamic, crowded spaces. Attendees experienced firsthand how our specialized AI models power movement and enable real, social interaction with robots.

OpenMind wrapped up GTC on the NVIDIA Stage, showcasing our fully autonomous robots in action. We demonstrated what OM1 can do in completely new environments, navigating seamlessly through dynamic, crowded spaces. Attendees experienced firsthand how our specialized AI models power movement and enable real, social interaction with robots.

OpenMind

255,211 views • 3 months ago

Elon : For Optimus, it’s difficult to match the flywheel of the existing vehicle fleet. The plan is to build a fleet of 10k–30k robots to perform self-play and testing. Millions of robotic agents will train in Tesla's "reality generator" (simulation), the real robots can then close the gap between simulation and reality.

Elon : For Optimus, it’s difficult to match the flywheel of the existing vehicle fleet. The plan is to build a fleet of 10k–30k robots to perform self-play and testing. Millions of robotic agents will train in Tesla's "reality generator" (simulation), the real robots can then close the gap between simulation and reality.

The Humanoid Hub

26,474 views • 4 months ago

UCR trains its robots with a pipeline built atop NVIDIA Isaac GR00T, Isaac Lab, and Isaac Sim, making them real-world ready with a 95% deployment success rate by bridging the gap between simulation and reality. ⦿ Real2sim: Brings real-world actuator dynamics into high-fidelity simulations. ⦿ Sim2sim: Makes sure models work across different simulators, avoiding quirks. ⦿ Sim2real: Uses domain randomization and memory-driven adaptation for real-world flexibility. ⦿ Real2real: Fine-tunes AI to handle hardware differences and stay reliable. By continuously refining models with real-world data, these robots become more adaptable and reliable.

UCR trains its robots with a pipeline built atop NVIDIA Isaac GR00T, Isaac Lab, and Isaac Sim, making them real-world ready with a 95% deployment success rate by bridging the gap between simulation and reality. ⦿ Real2sim: Brings real-world actuator dynamics into high-fidelity simulations. ⦿ Sim2sim: Makes sure models work across different simulators, avoiding quirks. ⦿ Sim2real: Uses domain randomization and memory-driven adaptation for real-world flexibility. ⦿ Real2real: Fine-tunes AI to handle hardware differences and stay reliable. By continuously refining models with real-world data, these robots become more adaptable and reliable.

The Humanoid Hub

18,611 views • 1 year ago

Can robots self-improve by collecting data autonomously🤖? Introducing SOAR: a system for large-scale autonomous data collection 🚀 and autonomous improvement📈of a multi-task language-conditioned policy in diverse scenes without human interventions .

Can robots self-improve by collecting data autonomously🤖? Introducing SOAR: a system for large-scale autonomous data collection 🚀 and autonomous improvement📈of a multi-task language-conditioned policy in diverse scenes without human interventions .

Paul Zhou

47,667 views • 1 year ago

How to use simulation data for real-world robot manipulation? We present sim-and-real co-training, a simple recipe for manipulation. We demonstrate that sim data can significantly enhance real-world performance, even with notable differences between the sim and the real. (1/n)

How to use simulation data for real-world robot manipulation? We present sim-and-real co-training, a simple recipe for manipulation. We demonstrate that sim data can significantly enhance real-world performance, even with notable differences between the sim and the real. (1/n)

Zhenyu Jiang

44,263 views • 1 year ago

Given the strong community adoption and real-world deployment of MolmoAct2 on YAM, we're introducing zero-shot evaluation of MolmoAct2 Bimanual YAM in simulation. Now you can test out our models without a real-world robot and build on them! Code: Simulation built on Maniskill!

Given the strong community adoption and real-world deployment of MolmoAct2 on YAM, we're introducing zero-shot evaluation of MolmoAct2 Bimanual YAM in simulation. Now you can test out our models without a real-world robot and build on them! Code: Simulation built on Maniskill!

Jiafei Duan

36,290 views • 24 days ago

Fully autonomous parking robots

Fully autonomous parking robots

Science girl

1,136,560 views • 9 months ago

Today Mecka is announcing $60M in funding to become the data and deployment layer for physical AI This raise will allow us to scale our data infrastructure, invest into new verticals, and deploy robots into the real world

Today Mecka is announcing $60M in funding to become the data and deployment layer for physical AI This raise will allow us to scale our data infrastructure, invest into new verticals, and deploy robots into the real world

Josh

313,815 views • 1 month ago