Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Scale up testing for complex robot manipulation. 🤖 RoboDojo is now available on NVIDIA Isaac Lab-Arena, bringing challenging bimanual tasks like precision insertion, folding, tool use, and multi-step manipulation to scalable evaluation in simulation.

NVIDIARobotics's profile picture

NVIDIA Robotics

150,978 subscribers

14,347 Aufrufe • vor 4 Tagen •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

In our latest blog post, we detail our use of NVIDIA Isaac Lab to train our highly capable hydraulic hands to perform cutting edge manipulation tasks, first in simulation, and ultimately in reality. Learn more: #AI #Humanoid #GeneralPurposeRobots #SanctuaryAI #NVIDIA #GTC25
0:10

In our latest blog post, we detail our use of NVIDIA Isaac Lab to train our highly capable hydraulic hands to perform cutting edge manipulation tasks, first in simulation, and ultimately in reality. Learn more: #AI #Humanoid #GeneralPurposeRobots #SanctuaryAI #NVIDIA #GTC25

Sanctuary AI

105,547 Aufrufe • vor 1 Jahr

Newton 1.0 is now generally available. 🙌 Take robot learning to the next level with: 🤖 Stable Articulated & Complex Mechanism Simulation – accurate, reliable machine modeling. 🖐️ High-Fidelity Hydroelastic Contact Modeling – realistic soft contact and touch-based interactions. 🧵 Deformable Body Simulation – simulate cables, cloth, rubber, and other elastic materials with VBD. ⚡ Accelerated Robot Learning at Scale – seamless integration with open simulation and learning frameworks, NVIDIA Isaac Sim and Isaac Lab for scalable workflows. Learn how to integrate this open-source physics engine into your workflow: #NVIDIAGTC
0:10

Newton 1.0 is now generally available. 🙌 Take robot learning to the next level with: 🤖 Stable Articulated & Complex Mechanism Simulation – accurate, reliable machine modeling. 🖐️ High-Fidelity Hydroelastic Contact Modeling – realistic soft contact and touch-based interactions. 🧵 Deformable Body Simulation – simulate cables, cloth, rubber, and other elastic materials with VBD. ⚡ Accelerated Robot Learning at Scale – seamless integration with open simulation and learning frameworks, NVIDIA Isaac Sim and Isaac Lab for scalable workflows. Learn how to integrate this open-source physics engine into your workflow: #NVIDIAGTC

NVIDIA Robotics

82,939 Aufrufe • vor 7 Monaten

The wait is over. 🥁 NVIDIA Isaac Sim 5.0 and Isaac Lab 2.2 are now generally available. Dive in and start to simulate, train, and validate your AI-powered robots with these new key features: ⚡ Instant GPU access via NVIDIA Brev 🤖 3D #GaussianSplatting with NVIDIA Omniverse NuRec libraries 📈 Policy evaluation in Isaac Lab and more. Get started 👉 #NVIDIARobotics #SIGGRAPH2025
0:18

The wait is over. 🥁 NVIDIA Isaac Sim 5.0 and Isaac Lab 2.2 are now generally available. Dive in and start to simulate, train, and validate your AI-powered robots with these new key features: ⚡ Instant GPU access via NVIDIA Brev 🤖 3D #GaussianSplatting with NVIDIA Omniverse NuRec libraries 📈 Policy evaluation in Isaac Lab and more. Get started 👉 #NVIDIARobotics #SIGGRAPH2025

NVIDIA Robotics

35,787 Aufrufe • vor 1 Jahr

Multi-robot learning is getting a serious boost! 📚 Researchers have extended Isaac Lab to train heterogeneous multi-agent robotic policies at scale. The new framework supports high-resolution physics, GPU-accelerated simulation, and both homogeneous and heterogeneous agents working together on coordination tasks. They benchmarked different approaches (MAPPO: Multi-Agent Proximal Policy Optimization and HAPPO: Heterogeneous Agent PPO) across six challenging scenarios and showed that large-scale multi-robot training is not only feasible, but efficient. It’s an important step for real-world robotic collaboration, where teams of robots need to coordinate, split tasks, adapt roles, and interact dynamically, not just operate as identical clones. The code is open-source, and it pushes Isaac Lab closer to what robotics actually needs: scalable, physics-driven environments where many different robots can learn to work together. Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:16

Multi-robot learning is getting a serious boost! 📚 Researchers have extended Isaac Lab to train heterogeneous multi-agent robotic policies at scale. The new framework supports high-resolution physics, GPU-accelerated simulation, and both homogeneous and heterogeneous agents working together on coordination tasks. They benchmarked different approaches (MAPPO: Multi-Agent Proximal Policy Optimization and HAPPO: Heterogeneous Agent PPO) across six challenging scenarios and showed that large-scale multi-robot training is not only feasible, but efficient. It’s an important step for real-world robotic collaboration, where teams of robots need to coordinate, split tasks, adapt roles, and interact dynamically, not just operate as identical clones. The code is open-source, and it pushes Isaac Lab closer to what robotics actually needs: scalable, physics-driven environments where many different robots can learn to work together. Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

38,997 Aufrufe • vor 11 Monaten

Logistics is where dexterous hand manipulation gets tested for real. Packages shift under the hand. Soft parcels deform during grasping. Contact changes with every manipulation. That is why warehouse sorting needs to be evaluated in simulation before real-world deployment. Lightwheel builds evaluation infrastructure to expose failures, measure performance, and close the loop from testing to deployment for industrial teams. #PhysicalAI #Robotics #Simulation #Evaluation #DexterousManipulation #LogisticsAutomation
0:11

Logistics is where dexterous hand manipulation gets tested for real. Packages shift under the hand. Soft parcels deform during grasping. Contact changes with every manipulation. That is why warehouse sorting needs to be evaluated in simulation before real-world deployment. Lightwheel builds evaluation infrastructure to expose failures, measure performance, and close the loop from testing to deployment for industrial teams. #PhysicalAI #Robotics #Simulation #Evaluation #DexterousManipulation #LogisticsAutomation

Lightwheel

13,294 Aufrufe • vor 6 Monaten

A finer touch for humanoid robots. 🤖 At #CoRL2026, NVIDIA is introducing GR00T 2, an open world action model for humanoids, alongside new open industrial benchmarks from RLWRLD and UC Berkeley built on Isaac Lab-Arena. Explore how NVIDIA’s open world action models, scalable simulation tools and agentic workflows help researchers train, test and refine robot skills, from connecting cables to assembling small components. Discover more ➡️
0:16

A finer touch for humanoid robots. 🤖 At #CoRL2026, NVIDIA is introducing GR00T 2, an open world action model for humanoids, alongside new open industrial benchmarks from RLWRLD and UC Berkeley built on Isaac Lab-Arena. Explore how NVIDIA’s open world action models, scalable simulation tools and agentic workflows help researchers train, test and refine robot skills, from connecting cables to assembling small components. Discover more ➡️

NVIDIA Robotics

60,287 Aufrufe • vor 1 Tag

A Rerun Viewer for the DROID Dataset! DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset is a robot manipulation dataset by Alexander Khazatsky et al. with 76k demonstration trajectories or 350h of interaction data, collected across 564 scenes and 86 tasks.
0:15

A Rerun Viewer for the DROID Dataset! DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset is a robot manipulation dataset by Alexander Khazatsky et al. with 76k demonstration trajectories or 350h of interaction data, collected across 564 scenes and 86 tasks.

Rerun

21,794 Aufrufe • vor 2 Jahren

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch
0:11

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

NVIDIA Robotics

18,568 Aufrufe • vor 9 Monaten

From simulation to reality 🤖 Robotics creator Skyentific built a walking bipedal robot using a simulation-first approach to design, test, and iterating in virtual environments before deploying in the real world. Powered by the NVIDIA Isaac platform and NVIDIA Jetson for on-device AI and control. 📖 #NationalRoboticsWeek
0:12

From simulation to reality 🤖 Robotics creator Skyentific built a walking bipedal robot using a simulation-first approach to design, test, and iterating in virtual environments before deploying in the real world. Powered by the NVIDIA Isaac platform and NVIDIA Jetson for on-device AI and control. 📖 #NationalRoboticsWeek

NVIDIA Robotics

21,868 Aufrufe • vor 7 Monaten

Robot policies can succeed in a demo and still fail as tasks, environments, and conditions change. With open-source Isaac Lab-Arena 0.3, developers can use an experimental agentic workflow to generate environments, evaluate policies at scale, and identify where and why failures occur.
0:14

Robot policies can succeed in a demo and still fail as tasks, environments, and conditions change. With open-source Isaac Lab-Arena 0.3, developers can use an experimental agentic workflow to generate environments, evaluate policies at scale, and identify where and why failures occur.

NVIDIA Robotics

15,687 Aufrufe • vor 1 Monat

Learning bimanual, contact-rich robot manipulation policies that generalize over diverse objects has long been a challenge. Excited to share our work: Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulation! 🧵1/n
0:15

Learning bimanual, contact-rich robot manipulation policies that generalize over diverse objects has long been a challenge. Excited to share our work: Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulation! 🧵1/n

Xuanlin Li (Simon)

20,998 Aufrufe • vor 1 Jahr

GR00T-VisualSim2Real is now open source! VIRAL and DoorMan are now available with training code, simulation assets, and the full recipe for bringing visual sim-to-real loco-manipulation skills to your own humanoids. Repo:
0:15

GR00T-VisualSim2Real is now open source! VIRAL and DoorMan are now available with training code, simulation assets, and the full recipe for bringing visual sim-to-real loco-manipulation skills to your own humanoids. Repo:

Tairan He

123,436 Aufrufe • vor 6 Monaten

Benchmarking robot policies is broken We ran thousands of evaluations over 12 different manipulation tasks to evaluate which robot policy you should use.
0:12

Benchmarking robot policies is broken We ran thousands of evaluations over 12 different manipulation tasks to evaluate which robot policy you should use.

Ville🤖

28,673 Aufrufe • vor 3 Monaten

Bring new robot testing environments to life with World Labs and Isaac Sim. 🤖 If you can describe a world 🌎, you can start testing in it the same day. Learn how to: 1. Export scenes from World Labs' Marble as Gaussian splats 2. Convert to USD using NVIDIA Omniverse NuRec 3. Import into NVIDIA Isaac Sim 4. Add a robot and run the simulation Read the guide ➡️ #SIGGRAPHAsia2025
0:12

Bring new robot testing environments to life with World Labs and Isaac Sim. 🤖 If you can describe a world 🌎, you can start testing in it the same day. Learn how to: 1. Export scenes from World Labs' Marble as Gaussian splats 2. Convert to USD using NVIDIA Omniverse NuRec 3. Import into NVIDIA Isaac Sim 4. Add a robot and run the simulation Read the guide ➡️ #SIGGRAPHAsia2025

NVIDIA Robotics

158,790 Aufrufe • vor 10 Monaten

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:
0:20

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:

NVIDIA Robotics

175,627 Aufrufe • vor 5 Monaten

MasterBOT is officially integrating with NVIDIA Isaac Lab NVIDIA’s robotics simulation platform built for developing and training autonomous machines This brings $BOT one step closer to powering the future of decentralized Robotics AI
0:14

MasterBOT is officially integrating with NVIDIA Isaac Lab NVIDIA’s robotics simulation platform built for developing and training autonomous machines This brings $BOT one step closer to powering the future of decentralized Robotics AI

MasterBOT

103,999 Aufrufe • vor 1 Jahr

🤖Why is robot manipulation still an open challenge? This video shows a kitting task -- packing multiple items into a single product. No robot today can do this autonomously. Big challenges = big opportunities for research and industry. #robotics #manipulation #automation
0:19

🤖Why is robot manipulation still an open challenge? This video shows a kitting task -- packing multiple items into a single product. No robot today can do this autonomously. Big challenges = big opportunities for research and industry. #robotics #manipulation #automation

Yu Xiang

21,236 Aufrufe • vor 1 Jahr

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉
0:13

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉

NVIDIA

48,500 Aufrufe • vor 1 Jahr

Imitation learning is powerful, but hard to scale due to lack of high quality data. Introducing Optimus: TAMP-supervised visuomotor transformers. Optimus solves over 300 long-horizon manipulation tasks with up to 8 stages and 72 different objects. NVIDIA AI Developer CMU Robotics Institute 1/N
0:16

Imitation learning is powerful, but hard to scale due to lack of high quality data. Introducing Optimus: TAMP-supervised visuomotor transformers. Optimus solves over 300 long-horizon manipulation tasks with up to 8 stages and 72 different objects. NVIDIA AI Developer CMU Robotics Institute 1/N

Murtaza Dalal

91,565 Aufrufe • vor 3 Jahren

Surgical Hand Coordination — Building Precision Through Daily Practice! 👍 👉Finger dexterity and bimanual coordination underpin controlled needle handling, tissue manipulation, and knot tying. 👉Short, focused daily drills refine movement economy, precision, and reproducibility for operative performance.
0:17

Surgical Hand Coordination — Building Precision Through Daily Practice! 👍 👉Finger dexterity and bimanual coordination underpin controlled needle handling, tissue manipulation, and knot tying. 👉Short, focused daily drills refine movement economy, precision, and reproducibility for operative performance.

Fumiya Yoneyama, MD, PhD | WithAScalpel

76,733 Aufrufe • vor 3 Monaten