Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Real → Sim → Robot — fast. With Gaussian splats, GRID brings physical assets into simulation tools like AirGen and NVIDIA Isaac Sim, enabling AI skills to be tested in sim and deployed to real robots in minutes. #Robotics #PhysicalAI #Simulation

General Robotics

2,818 subscribers

12,257 views • 11 months ago •via X (Twitter)

Science & Technology #Robotics #PhysicalAI #Simulation

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Big news! World Labs' Marble is officially compatible with NVIDIA Robotics' Isaac Sim. Instead of showcasing their highlight reel, our team at Lightwheel created a full environment from a 360 pano using Marble and showed you can train directly in sim. The only non-generated assets are the robot arms, coffee, and bowl. Everything else was generated with Marble. Not sure how to do this yourself? NVIDIA wrote a technical blog with full instructions. You will learn how to: 1. Export scenes from World Labs' Marble as Gaussian splats 2. Convert to USD using NVIDIA Omniverse NuRec 3. Import into NVIDIA Isaac Sim 4. Add a robot and run the simulation Read the guide ➡️ #WorldModels #Robotics

Big news! World Labs' Marble is officially compatible with NVIDIA Robotics' Isaac Sim. Instead of showcasing their highlight reel, our team at Lightwheel created a full environment from a 360 pano using Marble and showed you can train directly in sim. The only non-generated assets are the robot arms, coffee, and bowl. Everything else was generated with Marble. Not sure how to do this yourself? NVIDIA wrote a technical blog with full instructions. You will learn how to: 1. Export scenes from World Labs' Marble as Gaussian splats 2. Convert to USD using NVIDIA Omniverse NuRec 3. Import into NVIDIA Isaac Sim 4. Add a robot and run the simulation Read the guide ➡️ #WorldModels #Robotics

Jonathan Stephens

13,783 views • 7 months ago

#NVIDIAInception member @ScaFoAI is integrating Isaac Sim into its GRID platform to bridge simulation and real-world apps. Learn how to get started with GRID during this #NationalRoboticsWeek 👉

#NVIDIAInception member @ScaFoAI is integrating Isaac Sim into its GRID platform to bridge simulation and real-world apps. Learn how to get started with GRID during this #NationalRoboticsWeek 👉

NVIDIA Robotics

11,392 views • 1 year ago

Hours of manual asset authoring => Down to 1–2 minutes with 1 prompt. SR Platform generates interactive, simulation-ready 3D assets for training robotics, complete with articulated objects and physics. Native support for MuJoCo and NVIDIA Isaac Sim. Coming in July!

Hours of manual asset authoring => Down to 1–2 minutes with 1 prompt. SR Platform generates interactive, simulation-ready 3D assets for training robotics, complete with articulated objects and physics. Native support for MuJoCo and NVIDIA Isaac Sim. Coming in July!

Strike Robot

12,778 views • 14 days ago

How to use simulation data for real-world robot manipulation? We present sim-and-real co-training, a simple recipe for manipulation. We demonstrate that sim data can significantly enhance real-world performance, even with notable differences between the sim and the real. (1/n)

How to use simulation data for real-world robot manipulation? We present sim-and-real co-training, a simple recipe for manipulation. We demonstrate that sim data can significantly enhance real-world performance, even with notable differences between the sim and the real. (1/n)

Zhenyu Jiang

44,310 views • 1 year ago

New NVIDIA physical AI agent-ready skills are changing how robotics researchers work. 🤖 With NVIDIA robotics skills, researchers can automate the most common development steps from scene preparation to simulation and learning with Omniverse libraries, Isaac frameworks, and physical AI open datasets. Specialized skills like Isaac Mobility extend that even further. Learn more ➡️

New NVIDIA physical AI agent-ready skills are changing how robotics researchers work. 🤖 With NVIDIA robotics skills, researchers can automate the most common development steps from scene preparation to simulation and learning with Omniverse libraries, Isaac frameworks, and physical AI open datasets. Specialized skills like Isaac Mobility extend that even further. Learn more ➡️

NVIDIA Robotics

100,368 views • 1 month ago

From a single image to a full robotics simulation. 360 image → Marble → 3D environment → Robotics sim This is how we scale world creation for embodied AI with Lightwheel, turning lightweight capture into simulation-ready environments in minutes, not weeks.

From a single image to a full robotics simulation. 360 image → Marble → 3D environment → Robotics sim This is how we scale world creation for embodied AI with Lightwheel, turning lightweight capture into simulation-ready environments in minutes, not weeks.

World Labs

45,847 views • 6 months ago

Researchers are using Marble to generate simulation-ready robotics environments (scenes + collider meshes) then bring them into NVIDIA Robotics Isaac Sim for training + evaluation without any manual environment setup. Case Study:

Researchers are using Marble to generate simulation-ready robotics environments (scenes + collider meshes) then bring them into NVIDIA Robotics Isaac Sim for training + evaluation without any manual environment setup. Case Study:

World Labs

29,857 views • 7 months ago

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.

CyberRobo

17,092 views • 1 month ago

Hot take: Robots aren't born in factories. They're born in our imagination. Refined in games. Trained in simulations. Tested in reality. Then reality feeds back into imagination. Sim to real to sim—not a shortcut, but a loop. And the loop doesn’t stop. The beginning of infinity, from Axis Robotics

Hot take: Robots aren't born in factories. They're born in our imagination. Refined in games. Trained in simulations. Tested in reality. Then reality feeds back into imagination. Sim to real to sim—not a shortcut, but a loop. And the loop doesn’t stop. The beginning of infinity, from Axis Robotics

Axis Robotics

14,109 views • 6 months ago

The next frontier of AI is physical. 🤖 From simulation to synthetic data, developers are training robots to understand the real world with NVIDIA Cosmos, Isaac simulation frameworks and open-source physics engine, Newton. Watch the video to see how partners like Hon Hai Technology Group (Foxconn), Hexagon, Humanoid, Noble Machines, and Skild AI are building the future. 🎥

The next frontier of AI is physical. 🤖 From simulation to synthetic data, developers are training robots to understand the real world with NVIDIA Cosmos, Isaac simulation frameworks and open-source physics engine, Newton. Watch the video to see how partners like Hon Hai Technology Group (Foxconn), Hexagon, Humanoid, Noble Machines, and Skild AI are building the future. 🎥

NVIDIA Robotics

21,664 views • 3 months ago

Wow. This is crazy. A developer trained an AI agent in simulation and deployed it onto a real robotic air hockey table using reinforcement learning. This robot can track the puck with millimeter-level accuracy and react in roughly 20 milliseconds, fast enough to challenge even skilled human players. We’re moving from robots that follow programmed rules to machines that learn strategies in simulation and execute them in the physical world.

Wow. This is crazy. A developer trained an AI agent in simulation and deployed it onto a real robotic air hockey table using reinforcement learning. This robot can track the puck with millimeter-level accuracy and react in roughly 20 milliseconds, fast enough to challenge even skilled human players. We’re moving from robots that follow programmed rules to machines that learn strategies in simulation and execute them in the physical world.

SciTech Era

1,584,179 views • 1 month ago

A big part of scaling robot learning to solve real-world problems is that we somehow need to get enough diverse, high-quality data to train our robots to perform useful things. GPT and its fellow large language models were bootstrapped and proved out on a massive dataset of real-world language data. Unfortunately, despite our best efforts, similarly massive datasets don’t really exist for robotics — so, in our unending pursuit of high-quality, useful data, we turn to simulation. I compared a couple recent works on sim-to-real robot manipulation, which discuss how to train perception-driven manipulation policies in simulation, in such a way that they’re useful in the real world. - DextraH-RGB, from NVIDIA - Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation, also from NVIDIA — specifically the GEAR lab - Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids, another GEAR lab paper - Local Policies Enable Zero-shot Long-Horizon Manipulation, from CMU (video from DextrAH-RGB)

A big part of scaling robot learning to solve real-world problems is that we somehow need to get enough diverse, high-quality data to train our robots to perform useful things. GPT and its fellow large language models were bootstrapped and proved out on a massive dataset of real-world language data. Unfortunately, despite our best efforts, similarly massive datasets don’t really exist for robotics — so, in our unending pursuit of high-quality, useful data, we turn to simulation. I compared a couple recent works on sim-to-real robot manipulation, which discuss how to train perception-driven manipulation policies in simulation, in such a way that they’re useful in the real world. - DextraH-RGB, from NVIDIA - Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation, also from NVIDIA — specifically the GEAR lab - Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids, another GEAR lab paper - Local Policies Enable Zero-shot Long-Horizon Manipulation, from CMU (video from DextrAH-RGB)

Chris Paxton

20,486 views • 1 year ago

Today, a step forward in open robotics - our results show that sim-to-real zero shot transfer for manipulation is possible. MolmoBot is our open model suite for robotics, trained entirely in simulation on MolmoSpaces.🧵

Today, a step forward in open robotics - our results show that sim-to-real zero shot transfer for manipulation is possible. MolmoBot is our open model suite for robotics, trained entirely in simulation on MolmoSpaces.🧵

Ai2

64,693 views • 4 months ago

for physical AI to work in the real world, it needs high-fidelity 3D models of the real world. not just for visualization — for localization, spatial reasoning, and real-to-sim workflows that close the gap between training and deployment. at Niantic Spatial 🌎, we're turning Spexi drone imagery into exactly that — city-scale Gaussian splats grounded in the environments that matter most.

for physical AI to work in the real world, it needs high-fidelity 3D models of the real world. not just for visualization — for localization, spatial reasoning, and real-to-sim workflows that close the gap between training and deployment. at Niantic Spatial 🌎, we're turning Spexi drone imagery into exactly that — city-scale Gaussian splats grounded in the environments that matter most.

asim ᯅ

49,239 views • 1 month ago

Building AI robots costs millions of dollars. Most engineers spend years just to build basic prototypes. Today, we launched NVIDIA Isaac Sim on Open GRID - making advanced robotics possible from your laptop. Here's how we're transforming a $200B industry:

Building AI robots costs millions of dollars. Most engineers spend years just to build basic prototypes. Today, we launched NVIDIA Isaac Sim on Open GRID - making advanced robotics possible from your laptop. Here's how we're transforming a $200B industry:

Ashish Kapoor

64,536 views • 1 year ago

NVIDIA just gave every robotics beginner a cheat code. You don’t need expensive hardware. You don’t need to burn motors. You don’t need to break prototypes. You can skip all of that. Because you can build the entire robot… virtually. With Isaac Sim, you design everything in simulation: Chassis. Wheels. Joints. All running on real physics. You add sensors—RGB cameras, 2D LiDAR—so your robot can actually see. You wire up control systems using ROS 2 and OmniGraph. You stream live sensor data straight into RViz. And suddenly… You’re not guessing anymore. You’re thinking like a robot. That’s the real shift. Simulation isn’t just practice. It’s leverage. You iterate faster. You break nothing. You ship something that actually works—before touching the real world. If you’re trying to get into robotics or physical AI… This isn’t optional. This is the new starting line.

NVIDIA just gave every robotics beginner a cheat code. You don’t need expensive hardware. You don’t need to burn motors. You don’t need to break prototypes. You can skip all of that. Because you can build the entire robot… virtually. With Isaac Sim, you design everything in simulation: Chassis. Wheels. Joints. All running on real physics. You add sensors—RGB cameras, 2D LiDAR—so your robot can actually see. You wire up control systems using ROS 2 and OmniGraph. You stream live sensor data straight into RViz. And suddenly… You’re not guessing anymore. You’re thinking like a robot. That’s the real shift. Simulation isn’t just practice. It’s leverage. You iterate faster. You break nothing. You ship something that actually works—before touching the real world. If you’re trying to get into robotics or physical AI… This isn’t optional. This is the new starting line.

Nainsi Dwivedi

26,312 views • 2 months ago