Loading video...

Video Failed to Load

Go Home

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

NVIDIARobotics's profile picture

NVIDIA Robotics

133,975 subscribers

18,568 views • 4 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Generalist robot policies need a benchmark that works across any robot and any policy. 🦾 Introducing RoboLab, a high‑fidelity simulation benchmark built on NVIDIA Isaac and Omniverse to evaluate generalist robot policies in diverse, photoreal, physics‑based environments. Coming soon to the NVIDIA Isaac Lab‑Arena roadmap for large‑scale, robotic policy evaluation. 📖 #NationalRoboticsWeek
0:15

Generalist robot policies need a benchmark that works across any robot and any policy. 🦾 Introducing RoboLab, a high‑fidelity simulation benchmark built on NVIDIA Isaac and Omniverse to evaluate generalist robot policies in diverse, photoreal, physics‑based environments. Coming soon to the NVIDIA Isaac Lab‑Arena roadmap for large‑scale, robotic policy evaluation. 📖 #NationalRoboticsWeek

NVIDIA Robotics

23,872 views • 2 months ago

Newton 1.0 is now generally available. 🙌 Take robot learning to the next level with: 🤖 Stable Articulated & Complex Mechanism Simulation – accurate, reliable machine modeling. 🖐️ High-Fidelity Hydroelastic Contact Modeling – realistic soft contact and touch-based interactions. 🧵 Deformable Body Simulation – simulate cables, cloth, rubber, and other elastic materials with VBD. ⚡ Accelerated Robot Learning at Scale – seamless integration with open simulation and learning frameworks, NVIDIA Isaac Sim and Isaac Lab for scalable workflows. Learn how to integrate this open-source physics engine into your workflow: #NVIDIAGTC
0:10

Newton 1.0 is now generally available. 🙌 Take robot learning to the next level with: 🤖 Stable Articulated & Complex Mechanism Simulation – accurate, reliable machine modeling. 🖐️ High-Fidelity Hydroelastic Contact Modeling – realistic soft contact and touch-based interactions. 🧵 Deformable Body Simulation – simulate cables, cloth, rubber, and other elastic materials with VBD. ⚡ Accelerated Robot Learning at Scale – seamless integration with open simulation and learning frameworks, NVIDIA Isaac Sim and Isaac Lab for scalable workflows. Learn how to integrate this open-source physics engine into your workflow: #NVIDIAGTC

NVIDIA Robotics

81,951 views • 3 months ago

Multi-robot learning is getting a serious boost! 📚 Researchers have extended Isaac Lab to train heterogeneous multi-agent robotic policies at scale. The new framework supports high-resolution physics, GPU-accelerated simulation, and both homogeneous and heterogeneous agents working together on coordination tasks. They benchmarked different approaches (MAPPO: Multi-Agent Proximal Policy Optimization and HAPPO: Heterogeneous Agent PPO) across six challenging scenarios and showed that large-scale multi-robot training is not only feasible, but efficient. It’s an important step for real-world robotic collaboration, where teams of robots need to coordinate, split tasks, adapt roles, and interact dynamically, not just operate as identical clones. The code is open-source, and it pushes Isaac Lab closer to what robotics actually needs: scalable, physics-driven environments where many different robots can learn to work together. Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:16

Multi-robot learning is getting a serious boost! 📚 Researchers have extended Isaac Lab to train heterogeneous multi-agent robotic policies at scale. The new framework supports high-resolution physics, GPU-accelerated simulation, and both homogeneous and heterogeneous agents working together on coordination tasks. They benchmarked different approaches (MAPPO: Multi-Agent Proximal Policy Optimization and HAPPO: Heterogeneous Agent PPO) across six challenging scenarios and showed that large-scale multi-robot training is not only feasible, but efficient. It’s an important step for real-world robotic collaboration, where teams of robots need to coordinate, split tasks, adapt roles, and interact dynamically, not just operate as identical clones. The code is open-source, and it pushes Isaac Lab closer to what robotics actually needs: scalable, physics-driven environments where many different robots can learn to work together. Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

38,997 views • 6 months ago

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉
0:13

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉

NVIDIA

48,500 views • 8 months ago

#NVIDIAIsaac Sim 5.0 and Isaac Lab 2.2 are now available in early developer preview on Github. 🎉 These releases give #Robotics developers early access to cutting-edge tools to simulate, train, and validate robots in a physics-based simulation environment. What’s new? ✅Open-source ✅Extensions for synthetic data generation ✅Robot models Read the tech blog to learn more ➡️ #GTCParis #VivaTech
0:18

#NVIDIAIsaac Sim 5.0 and Isaac Lab 2.2 are now available in early developer preview on Github. 🎉 These releases give #Robotics developers early access to cutting-edge tools to simulate, train, and validate robots in a physics-based simulation environment. What’s new? ✅Open-source ✅Extensions for synthetic data generation ✅Robot models Read the tech blog to learn more ➡️ #GTCParis #VivaTech

NVIDIA Robotics

13,613 views • 1 year ago

Robora Sim: A PyBullet-Powered Environment for Learning Robotic Physical Intelligence We are currently building our Robora simulation environment setup for our sim based learning, leveraging PyBullet, an industry-standard physics engine widely used in AI-driven robotics research and development. The environment is optimized with GPU-accelerated learning algorithms, enabling high-speed imitation learning and reinforcement learning within a safe and controlled virtual setup before shipping out to real world. This simulation platform allows our models to learn, adapt, and generalize across different robot morphologies, terrain types and task objectives - all before deployment to the real world. At it's core, the system combines a VLA-powered high-level planner with low-level motion control algorithms, working cohesively to produce emergent, physically intelligent behaviors. This synergy between simulation, learning, and real-world transfer marks a major step forward in our pursuit of adaptive and intelligent robotic systems. Through advanced domain randomization and synthetic data generation, the Robora Simulation Environment ensures that policies trained in simulation transfer effectively to real-world robots, minimizing the sim-to-real gap. Moreover, users will be able to test and integrate their own hardware kits within selected simulation environments in the Robora Dapp, ensuring seamless compatibility and safer real-world implementation.
0:14

Robora Sim: A PyBullet-Powered Environment for Learning Robotic Physical Intelligence We are currently building our Robora simulation environment setup for our sim based learning, leveraging PyBullet, an industry-standard physics engine widely used in AI-driven robotics research and development. The environment is optimized with GPU-accelerated learning algorithms, enabling high-speed imitation learning and reinforcement learning within a safe and controlled virtual setup before shipping out to real world. This simulation platform allows our models to learn, adapt, and generalize across different robot morphologies, terrain types and task objectives - all before deployment to the real world. At it's core, the system combines a VLA-powered high-level planner with low-level motion control algorithms, working cohesively to produce emergent, physically intelligent behaviors. This synergy between simulation, learning, and real-world transfer marks a major step forward in our pursuit of adaptive and intelligent robotic systems. Through advanced domain randomization and synthetic data generation, the Robora Simulation Environment ensures that policies trained in simulation transfer effectively to real-world robots, minimizing the sim-to-real gap. Moreover, users will be able to test and integrate their own hardware kits within selected simulation environments in the Robora Dapp, ensuring seamless compatibility and safer real-world implementation.

Robora

23,489 views • 8 months ago

All robots need intelligence 🧠 Announcing #NVIDIA Isaac sim GRID integration. Develop, simulate, and deploy robot AI without complex infrastructure, across consumer and commercial robots—humanoids, quadrupeds arms. Blog: #CES #Robot #AI #CES2025 NVIDIA NVIDIA Robotics
0:10

All robots need intelligence 🧠 Announcing #NVIDIA Isaac sim GRID integration. Develop, simulate, and deploy robot AI without complex infrastructure, across consumer and commercial robots—humanoids, quadrupeds arms. Blog: #CES #Robot #AI #CES2025 NVIDIA NVIDIA Robotics

General Robotics

30,203 views • 1 year ago

The wait is over. 🥁 NVIDIA Isaac Sim 5.0 and Isaac Lab 2.2 are now generally available. Dive in and start to simulate, train, and validate your AI-powered robots with these new key features: ⚡ Instant GPU access via NVIDIA Brev 🤖 3D #GaussianSplatting with NVIDIA Omniverse NuRec libraries 📈 Policy evaluation in Isaac Lab and more. Get started 👉 #NVIDIARobotics #SIGGRAPH2025
0:18

The wait is over. 🥁 NVIDIA Isaac Sim 5.0 and Isaac Lab 2.2 are now generally available. Dive in and start to simulate, train, and validate your AI-powered robots with these new key features: ⚡ Instant GPU access via NVIDIA Brev 🤖 3D #GaussianSplatting with NVIDIA Omniverse NuRec libraries 📈 Policy evaluation in Isaac Lab and more. Get started 👉 #NVIDIARobotics #SIGGRAPH2025

NVIDIA Robotics

35,621 views • 10 months ago

Can we make Transformers better and more efficient for robot learning? Excited to introduce Body Transformer (BoT), an architecture that leverages robot embodiment in the attention mechanism, by treating it as a graph of sensors and actuators.
0:17

Can we make Transformers better and more efficient for robot learning? Excited to introduce Body Transformer (BoT), an architecture that leverages robot embodiment in the attention mechanism, by treating it as a graph of sensors and actuators.

Carlo Sferrazza

60,663 views • 1 year ago

just made it possible to evaluate generalist robotics models like Octo at 60-100x real world evaluation speeds via gpu simulation and rendering (~10x faster than original cpu sim code). All videos below are from our open source ManiSkill GPU sim!
0:12

just made it possible to evaluate generalist robotics models like Octo at 60-100x real world evaluation speeds via gpu simulation and rendering (~10x faster than original cpu sim code). All videos below are from our open source ManiSkill GPU sim!

Stone Tao

13,456 views • 1 year ago

A preview Into the future of #quantum-GPU computing: At GTC Washington, D.C., we announced NVIDIA NVQLink, an open system architecture for tightly coupling the extreme performance of GPU computing with quantum processors to build accelerated quantum supercomputers. In the expo hall, accelerated quantum computing was a centerpiece of the NVIDIA booth. See our live blog:
0:17

A preview Into the future of #quantum-GPU computing: At GTC Washington, D.C., we announced NVIDIA NVQLink, an open system architecture for tightly coupling the extreme performance of GPU computing with quantum processors to build accelerated quantum supercomputers. In the expo hall, accelerated quantum computing was a centerpiece of the NVIDIA booth. See our live blog:

NVIDIA AI Developer

54,981 views • 7 months ago

Our New Open-Source Quadruped Robot "MEVIUS2" has been accepted to IEEE Robotics and Automation Practice (RA-P)! "MEVIUS2: Practical Open-Source Quadruped Robot with Sheet Metal Welding and Multimodal Perception" Threads👇
0:13

Our New Open-Source Quadruped Robot "MEVIUS2" has been accepted to IEEE Robotics and Automation Practice (RA-P)! "MEVIUS2: Practical Open-Source Quadruped Robot with Sheet Metal Welding and Multimodal Perception" Threads👇

Kento Kawaharazuka / 河原塚 健人

26,178 views • 3 months ago

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:
0:20

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:

NVIDIA Robotics

163,386 views • 23 days ago

A robot learning to ski
0:14

A robot learning to ski

Science girl

19,813 views • 7 months ago

In our latest blog post, we detail our use of NVIDIA Isaac Lab to train our highly capable hydraulic hands to perform cutting edge manipulation tasks, first in simulation, and ultimately in reality. Learn more: #AI #Humanoid #GeneralPurposeRobots #SanctuaryAI #NVIDIA #GTC25
0:10

In our latest blog post, we detail our use of NVIDIA Isaac Lab to train our highly capable hydraulic hands to perform cutting edge manipulation tasks, first in simulation, and ultimately in reality. Learn more: #AI #Humanoid #GeneralPurposeRobots #SanctuaryAI #NVIDIA #GTC25

Sanctuary AI

105,547 views • 1 year ago

We built a bipedal robot for about $2,500. A real, mostly 3D-printed robot you can build, repair, simulate, train, and control. Today we’re releasing LeRobot Humanoid: an open robot-learning platform with hardware, runtime, identification tools, and training environments. Blog post: Repo:
0:16

We built a bipedal robot for about $2,500. A real, mostly 3D-printed robot you can build, repair, simulate, train, and control. Today we’re releasing LeRobot Humanoid: an open robot-learning platform with hardware, runtime, identification tools, and training environments. Blog post: Repo:

LeRobot

198,016 views • 1 month ago

🚀Our New Paper on Open-Source Bipeda Robot MEVITA is out! All components can be procured through e-commerce, and the robot is built with a minimal number of parts. All hardware, software, and learning environment are released as open source. 🌐 Thread👇
0:16

🚀Our New Paper on Open-Source Bipeda Robot MEVITA is out! All components can be procured through e-commerce, and the robot is built with a minimal number of parts. All hardware, software, and learning environment are released as open source. 🌐 Thread👇

Kento Kawaharazuka / 河原塚 健人

48,281 views • 10 months ago

Bring new robot testing environments to life with World Labs and Isaac Sim. 🤖 If you can describe a world 🌎, you can start testing in it the same day. Learn how to: 1. Export scenes from World Labs' Marble as Gaussian splats 2. Convert to USD using NVIDIA Omniverse NuRec 3. Import into NVIDIA Isaac Sim 4. Add a robot and run the simulation Read the guide ➡️ #SIGGRAPHAsia2025
0:12

Bring new robot testing environments to life with World Labs and Isaac Sim. 🤖 If you can describe a world 🌎, you can start testing in it the same day. Learn how to: 1. Export scenes from World Labs' Marble as Gaussian splats 2. Convert to USD using NVIDIA Omniverse NuRec 3. Import into NVIDIA Isaac Sim 4. Add a robot and run the simulation Read the guide ➡️ #SIGGRAPHAsia2025

NVIDIA Robotics

157,556 views • 6 months ago

From simulation to reality 🤖 Robotics creator Skyentific built a walking bipedal robot using a simulation-first approach to design, test, and iterating in virtual environments before deploying in the real world. Powered by the NVIDIA Isaac platform and NVIDIA Jetson for on-device AI and control. 📖 #NationalRoboticsWeek
0:12

From simulation to reality 🤖 Robotics creator Skyentific built a walking bipedal robot using a simulation-first approach to design, test, and iterating in virtual environments before deploying in the real world. Powered by the NVIDIA Isaac platform and NVIDIA Jetson for on-device AI and control. 📖 #NationalRoboticsWeek

NVIDIA Robotics

21,697 views • 2 months ago