Загрузка видео...

Не удалось загрузить видео

На главную

Introducing SimReadyGen. Agentic simulation generation for Physical AI. From a text prompt to physically accurate SimReady assets at scale. Robot training demands physically accurate environments at a scale traditional asset creation can't match. SimReadyGen closes that gap. Every generated asset carries measured physics, not estimates. Behind it is SimReady...

LightwheelAI's profile picture

Lightwheel

2,396 subscribers

12,221 просмотров • 2 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.
4:31

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.

CyberRobo

17,092 просмотров • 3 месяцев назад

Jensen just announced Newton, an open-source physics engine for robotics simulation developed by NVIDIA, Google DeepMind, and Disney Research. ⦿ Built on NVIDIA Warp, it offers GPU-accelerated performance and compatibility with frameworks like MuJoCo and Isaac Lab. ⦿ Features differentiable physics, extensibility for multiphysics simulations, and integration with OpenUSD for flexible data modeling. ⦿ Newton addresses the sim-to-real gap by creating realistic virtual environments for robot training and testing. ⦿ Disney Research is using Newton to power next-gen entertainment robots, including Star Wars-inspired BDX droids.
3:32

Jensen just announced Newton, an open-source physics engine for robotics simulation developed by NVIDIA, Google DeepMind, and Disney Research. ⦿ Built on NVIDIA Warp, it offers GPU-accelerated performance and compatibility with frameworks like MuJoCo and Isaac Lab. ⦿ Features differentiable physics, extensibility for multiphysics simulations, and integration with OpenUSD for flexible data modeling. ⦿ Newton addresses the sim-to-real gap by creating realistic virtual environments for robot training and testing. ⦿ Disney Research is using Newton to power next-gen entertainment robots, including Star Wars-inspired BDX droids.

The Humanoid Hub

130,388 просмотров • 1 год назад

Big news! World Labs' Marble is officially compatible with NVIDIA Robotics' Isaac Sim. Instead of showcasing their highlight reel, our team at Lightwheel created a full environment from a 360 pano using Marble and showed you can train directly in sim. The only non-generated assets are the robot arms, coffee, and bowl. Everything else was generated with Marble. Not sure how to do this yourself? NVIDIA wrote a technical blog with full instructions. You will learn how to: 1. Export scenes from World Labs' Marble as Gaussian splats 2. Convert to USD using NVIDIA Omniverse NuRec 3. Import into NVIDIA Isaac Sim 4. Add a robot and run the simulation Read the guide ➡️ #WorldModels #Robotics
0:32

Big news! World Labs' Marble is officially compatible with NVIDIA Robotics' Isaac Sim. Instead of showcasing their highlight reel, our team at Lightwheel created a full environment from a 360 pano using Marble and showed you can train directly in sim. The only non-generated assets are the robot arms, coffee, and bowl. Everything else was generated with Marble. Not sure how to do this yourself? NVIDIA wrote a technical blog with full instructions. You will learn how to: 1. Export scenes from World Labs' Marble as Gaussian splats 2. Convert to USD using NVIDIA Omniverse NuRec 3. Import into NVIDIA Isaac Sim 4. Add a robot and run the simulation Read the guide ➡️ #WorldModels #Robotics

Jonathan Stephens

13,783 просмотров • 9 месяцев назад

Everything you love about generative models — now powered by real physics! Announcing the Genesis project — after a 24-month large-scale research collaboration involving over 20 research labs — a generative physics engine able to generate 4D dynamical worlds powered by a physics simulation platform designed for general-purpose robotics and physical AI applications. Genesis's physics engine is developed in pure Python, while being 10-80x faster than existing GPU-accelerated stacks like Isaac Gym and MJX. It delivers a simulation speed ~430,000 faster than in real-time, and takes only 26 seconds to train a robotic locomotion policy transferrable to the real world on a single RTX4090 (see tutorial: The Genesis physics engine and simulation platform is fully open source at We'll gradually roll out access to our generative framework in the near future. Genesis implements a unified simulation framework all from scratch, integrating a wide spectrum of state-of-the-art physics solvers, allowing simulation of the whole physical world in a virtual realm with the highest realism. We aim to build a universal data engine that leverages an upper-level generative framework to autonomously create physical worlds, together with various modes of data, including environments, camera motions, robotic task proposals, reward functions, robot policies, character motions, fully interactive 3D scenes, open-world articulated assets, and more, aiming towards fully automated data generation for robotics, physical AI and other applications. Open Source Code: Project webpage: Documentation: 1/n
3:26

Everything you love about generative models — now powered by real physics! Announcing the Genesis project — after a 24-month large-scale research collaboration involving over 20 research labs — a generative physics engine able to generate 4D dynamical worlds powered by a physics simulation platform designed for general-purpose robotics and physical AI applications. Genesis's physics engine is developed in pure Python, while being 10-80x faster than existing GPU-accelerated stacks like Isaac Gym and MJX. It delivers a simulation speed ~430,000 faster than in real-time, and takes only 26 seconds to train a robotic locomotion policy transferrable to the real world on a single RTX4090 (see tutorial: The Genesis physics engine and simulation platform is fully open source at We'll gradually roll out access to our generative framework in the near future. Genesis implements a unified simulation framework all from scratch, integrating a wide spectrum of state-of-the-art physics solvers, allowing simulation of the whole physical world in a virtual realm with the highest realism. We aim to build a universal data engine that leverages an upper-level generative framework to autonomously create physical worlds, together with various modes of data, including environments, camera motions, robotic task proposals, reward functions, robot policies, character motions, fully interactive 3D scenes, open-world articulated assets, and more, aiming towards fully automated data generation for robotics, physical AI and other applications. Open Source Code: Project webpage: Documentation: 1/n

Zhou Xian

3,822,134 просмотров • 1 год назад

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:
0:29

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

42,864 просмотров • 7 месяцев назад

🚨 BREAKING: ABB Robotics + NVIDIA close the sim-to-real gap with 99% accuracy! 👾 ABB Robotics is integrating NVIDIA Omniverse libraries into RobotStudio to deliver physical AI for industry, closing the gap from virtual training to real-world deployment with up to 99% accuracy. RobotStudio HyperReality, available second half of 2026, will fundamentally change how quickly manufacturers can scale production: reducing costs by up to 40%, accelerating time-to-market by 50%, and cutting setup and commissioning times by up to 80%. For decades, the deficit between simulation accuracy and real-world lighting, materials, and environments has limited manufacturers' ability to design advanced manufacturing processes in the virtual world. The only robot manufacturer with a virtual controller running the same firmware as the hardware, ensuring near-perfect correlation between simulation and real-world performance. The system uses physically accurate simulations and foundation models endlessly optimized with real-world data feedback. These models can train any number of ABB robots anywhere in the world with industrial-grade reliability. Foxconn is using RobotStudio HyperReality for consumer electronics assembly. Assembly robots are trained virtually using synthetic data to perfect multiple production processes across various scenarios, then moved to production lines with 99% accuracy. This eliminates physical training and tests, reducing setup times and costs. Workr is demonstrating AI-powered robotic systems at NVIDIA GTC 2026. Built on ABB technology, trained with synthetic data using NVIDIA Omniverse, deployed without operators needing programming knowledge . 🚨 I’ll be onsite in San Jose during GTC 2026, and will be showing all the cool stuff that ABB Robotics prepared this year! Can’t wait! 🫡 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:48

🚨 BREAKING: ABB Robotics + NVIDIA close the sim-to-real gap with 99% accuracy! 👾 ABB Robotics is integrating NVIDIA Omniverse libraries into RobotStudio to deliver physical AI for industry, closing the gap from virtual training to real-world deployment with up to 99% accuracy. RobotStudio HyperReality, available second half of 2026, will fundamentally change how quickly manufacturers can scale production: reducing costs by up to 40%, accelerating time-to-market by 50%, and cutting setup and commissioning times by up to 80%. For decades, the deficit between simulation accuracy and real-world lighting, materials, and environments has limited manufacturers' ability to design advanced manufacturing processes in the virtual world. The only robot manufacturer with a virtual controller running the same firmware as the hardware, ensuring near-perfect correlation between simulation and real-world performance. The system uses physically accurate simulations and foundation models endlessly optimized with real-world data feedback. These models can train any number of ABB robots anywhere in the world with industrial-grade reliability. Foxconn is using RobotStudio HyperReality for consumer electronics assembly. Assembly robots are trained virtually using synthetic data to perfect multiple production processes across various scenarios, then moved to production lines with 99% accuracy. This eliminates physical training and tests, reducing setup times and costs. Workr is demonstrating AI-powered robotic systems at NVIDIA GTC 2026. Built on ABB technology, trained with synthetic data using NVIDIA Omniverse, deployed without operators needing programming knowledge . 🚨 I’ll be onsite in San Jose during GTC 2026, and will be showing all the cool stuff that ABB Robotics prepared this year! Can’t wait! 🫡 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

22,482 просмотров • 6 месяцев назад

We are back again :) After three weeks of quiet building. Introducing Genesis World 1.0, our latest simulation platform, the second release in our full-stack suite. Open-sourced. Robotics is still bottlenecked by the 1× speed of the physical world. Every model, checkpoint, and data recipe eventually needs to be tested on physical hardware, slowly, expensively, and with limited coverage. One hour in reality can become 100 days in simulation. That is how robotics model iteration moves from a wall-clock bottleneck to a compute problem. To make this work, simulation has to be both fast and trustworthy. Over the past year, we rebuilt the entire stack: a GPU-accelerated cross-platform compiler, penetration-free multi-physics contact solvers, unified rigid and deformable physics, and a photo-realistic renderer purpose-built for physical AI applications. We built Nyx, a high-performance path-traced rendering engine for robotics application. Genesis World 1.0 achieves near realtime performance with our latest development for penetration-free IPC solver, supporting various types of deformables beyond rigid bodies. It supports contact-rich, dexterous manipulation simulation across different embodiments: unitree, sharpa, wuji, genesis hand and various types of grippers. Under the hood is Quadrants, our effort in pushing forward cross-platform GPU-accelerated computation. Quadrants started as a fork of Taichi, and we rebuilt most of the critical parts for optimizing simulation workloads, giving 10x faster launch time and up to 4.6x runtime performance compared to the initial Genesis release. Together, they bring us to an unprecedentedly low sim-to-real gap, enabling zero-shot real-to-sim model evaluation and much faster iteration of GENE. All available today. Genesis World 1.0: Quadrants: Nyx:
2:51

We are back again :) After three weeks of quiet building. Introducing Genesis World 1.0, our latest simulation platform, the second release in our full-stack suite. Open-sourced. Robotics is still bottlenecked by the 1× speed of the physical world. Every model, checkpoint, and data recipe eventually needs to be tested on physical hardware, slowly, expensively, and with limited coverage. One hour in reality can become 100 days in simulation. That is how robotics model iteration moves from a wall-clock bottleneck to a compute problem. To make this work, simulation has to be both fast and trustworthy. Over the past year, we rebuilt the entire stack: a GPU-accelerated cross-platform compiler, penetration-free multi-physics contact solvers, unified rigid and deformable physics, and a photo-realistic renderer purpose-built for physical AI applications. We built Nyx, a high-performance path-traced rendering engine for robotics application. Genesis World 1.0 achieves near realtime performance with our latest development for penetration-free IPC solver, supporting various types of deformables beyond rigid bodies. It supports contact-rich, dexterous manipulation simulation across different embodiments: unitree, sharpa, wuji, genesis hand and various types of grippers. Under the hood is Quadrants, our effort in pushing forward cross-platform GPU-accelerated computation. Quadrants started as a fork of Taichi, and we rebuilt most of the critical parts for optimizing simulation workloads, giving 10x faster launch time and up to 4.6x runtime performance compared to the initial Genesis release. Together, they bring us to an unprecedentedly low sim-to-real gap, enabling zero-shot real-to-sim model evaluation and much faster iteration of GENE. All available today. Genesis World 1.0: Quadrants: Nyx:

Genesis AI

320,116 просмотров • 4 месяцев назад

Do you think you could train a robot to fold clothes better than any other robotics team? Now is your chance to prove it...and win actual cash prizes! The 2026 LeHome Challenge is live! Here is the details: Phase 1: Train your best clothes folding policy in simulation with 4 garment types, each presenting unique manipulation challenges. The types of garments include long-sleeved tops, short-sleeved tops, long pants, and shorts. The simulation environment uses Lightwheel's physics accurate deformable assets and built on NVIDIA Omniverse's Isaac Sim/Lab. Submit your code by April 5th for a chance to win up to $2,000 and a SO-101 Arm Kit. Phase 2: The top 8 teams will compete in person at ICRA on June 4th to see who's policy performs best with real clothes. The top place team will take home $20,000! Learn more and sign up for the LeHome Challenge here: Robert Scoble Chris Paxton The Humanoid Hub Harrison Kinsley #Robotics
0:51

Do you think you could train a robot to fold clothes better than any other robotics team? Now is your chance to prove it...and win actual cash prizes! The 2026 LeHome Challenge is live! Here is the details: Phase 1: Train your best clothes folding policy in simulation with 4 garment types, each presenting unique manipulation challenges. The types of garments include long-sleeved tops, short-sleeved tops, long pants, and shorts. The simulation environment uses Lightwheel's physics accurate deformable assets and built on NVIDIA Omniverse's Isaac Sim/Lab. Submit your code by April 5th for a chance to win up to $2,000 and a SO-101 Arm Kit. Phase 2: The top 8 teams will compete in person at ICRA on June 4th to see who's policy performs best with real clothes. The top place team will take home $20,000! Learn more and sign up for the LeHome Challenge here: Robert Scoble Chris Paxton The Humanoid Hub Harrison Kinsley #Robotics

Jonathan Stephens

24,003 просмотров • 7 месяцев назад

Trained a humanoid entirely in a 3D scan of the office. Zero real-world fine-tuning. It just walked in and worked. RL needs hundreds of thousands of attempts, and real robots can't afford to crash. A misjudged gap or a glass door collision breaks hardware and costs hours resetting. So you train in a sim. But sim policies usually train on randomized, untextured geometry; depth is easy to fake. The robot learns structure, not the real world: no materials, no lighting, no idea what anything actually is. RGB cameras carry all of that but training RGB policies in generic fake worlds won’t generalize to the real world. Niantic Spatial 🌎 Scaniverse reconstructs your scan of the real deployment site. One 360° camera walkthrough → photorealistic 3D Gaussian splat at metric scale → collision mesh pulled from the same reconstruction, so vision and physics match exactly. Drops straight into NVIDIA Isaac Sim/Lab, no manual conversion. Flexion simulation-first approach then seamlessly enables the training of RGB-only nav policies inside that reconstruction. With added domain randomization + large image encoders for robustness, this deploys straight to hardware. No real-world fine-tuning. Deployment: months of on-site adaptation → days. Tune into the NVIDIA livestream on 12 August to hear how these companies are closing the sim2real gap: NVIDIA Robotics ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:47

Trained a humanoid entirely in a 3D scan of the office. Zero real-world fine-tuning. It just walked in and worked. RL needs hundreds of thousands of attempts, and real robots can't afford to crash. A misjudged gap or a glass door collision breaks hardware and costs hours resetting. So you train in a sim. But sim policies usually train on randomized, untextured geometry; depth is easy to fake. The robot learns structure, not the real world: no materials, no lighting, no idea what anything actually is. RGB cameras carry all of that but training RGB policies in generic fake worlds won’t generalize to the real world. Niantic Spatial 🌎 Scaniverse reconstructs your scan of the real deployment site. One 360° camera walkthrough → photorealistic 3D Gaussian splat at metric scale → collision mesh pulled from the same reconstruction, so vision and physics match exactly. Drops straight into NVIDIA Isaac Sim/Lab, no manual conversion. Flexion simulation-first approach then seamlessly enables the training of RGB-only nav policies inside that reconstruction. With added domain randomization + large image encoders for robustness, this deploys straight to hardware. No real-world fine-tuning. Deployment: months of on-site adaptation → days. Tune into the NVIDIA livestream on 12 August to hear how these companies are closing the sim2real gap: NVIDIA Robotics ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

119,739 просмотров • 1 месяц назад

We RL'ed humanoid robots to Cristiano Ronaldo, LeBron James, and Kobe Byrant! These are neural nets running on real hardware at our GEAR lab. Most robot demos you see online speed videos up. We actually *slow them down* so you can enjoy the fluid motions. I'm excited to announce "ASAP", a "real2sim2real" model that masters extremely smooth and dynamic motions for humanoid whole body control. We pretrain the robot in simulation first, but there is a notorious "sim2real" gap: it's very difficult for hand-engineered physics equations to match real world dynamics. Our fix is simple: just deploy a pretrained policy on real hardware, collect data, and replay the motion in sim. The replay will obviously have many errors, but that gives a rich signal to compensate for the physics discrepancy. Use another neural net to learn the delta. Basically, we "patch up" a traditional physics engine, so that the robot can experience almost the real world at scale in GPUs. The future is hybrid simulation: combine the power of classical sim engines refined over decades and the uncanny ability of modern NNs to capture a messy world.
0:50

We RL'ed humanoid robots to Cristiano Ronaldo, LeBron James, and Kobe Byrant! These are neural nets running on real hardware at our GEAR lab. Most robot demos you see online speed videos up. We actually *slow them down* so you can enjoy the fluid motions. I'm excited to announce "ASAP", a "real2sim2real" model that masters extremely smooth and dynamic motions for humanoid whole body control. We pretrain the robot in simulation first, but there is a notorious "sim2real" gap: it's very difficult for hand-engineered physics equations to match real world dynamics. Our fix is simple: just deploy a pretrained policy on real hardware, collect data, and replay the motion in sim. The replay will obviously have many errors, but that gives a rich signal to compensate for the physics discrepancy. Use another neural net to learn the delta. Basically, we "patch up" a traditional physics engine, so that the robot can experience almost the real world at scale in GPUs. The future is hybrid simulation: combine the power of classical sim engines refined over decades and the uncanny ability of modern NNs to capture a messy world.

Jim Fan

567,404 просмотров • 1 год назад

People who've never set foot in a factory will never understand... I watched this three times. For decades, robotics simulation has promised faster deployment. But factories still had to build the real cell to see if it actually worked. Which meant expensive physical prototypes, weeks or months!!! of commissioning, constant surprises between simulation and reality That “sim-to-real gap” has quietly been one of the biggest bottlenecks in manufacturing automation. And it’s exactly what is changing. Today, ABB Robotics announced a partnership with NVIDIA Robotics aimed at closing this gap through the new RobotStudio HyperReality platform: Simulation and real robot behavior can match with near-perfect accuracy. That means manufacturers can design, test, and validate entire production lines before a single robot is installed on the factory floor. The implications are massive: • up to 80% faster setup and commissioning • roughly 40% lower costs by removing physical prototypes • about 50% faster time-to-market for new production lines In other words: Factories can move from trial-and-error engineering to software-driven manufacturing design. Production lines become something you build and validate digitally first. Then deploy physically once everything already works. For an industry that still measures deployment timelines in months or years, this is a major shift. It changes how automation projects are planned, how factories are designed, and how fast manufacturing can adapt to new products. Physical AI actually becomes deployable at an industrial scale. I’ll be at GTC in San Jose next week to see and talk to manufacturers and robotics engineers. If you are into manufacturing like I am, hit me up; my DMs are open!
0:31

People who've never set foot in a factory will never understand... I watched this three times. For decades, robotics simulation has promised faster deployment. But factories still had to build the real cell to see if it actually worked. Which meant expensive physical prototypes, weeks or months!!! of commissioning, constant surprises between simulation and reality That “sim-to-real gap” has quietly been one of the biggest bottlenecks in manufacturing automation. And it’s exactly what is changing. Today, ABB Robotics announced a partnership with NVIDIA Robotics aimed at closing this gap through the new RobotStudio HyperReality platform: Simulation and real robot behavior can match with near-perfect accuracy. That means manufacturers can design, test, and validate entire production lines before a single robot is installed on the factory floor. The implications are massive: • up to 80% faster setup and commissioning • roughly 40% lower costs by removing physical prototypes • about 50% faster time-to-market for new production lines In other words: Factories can move from trial-and-error engineering to software-driven manufacturing design. Production lines become something you build and validate digitally first. Then deploy physically once everything already works. For an industry that still measures deployment timelines in months or years, this is a major shift. It changes how automation projects are planned, how factories are designed, and how fast manufacturing can adapt to new products. Physical AI actually becomes deployable at an industrial scale. I’ll be at GTC in San Jose next week to see and talk to manufacturers and robotics engineers. If you are into manufacturing like I am, hit me up; my DMs are open!

Ilir Aliu

69,120 просмотров • 6 месяцев назад

That's sick! 🤯 Genesis AI simulates robots playing yo-yo! 🪀 Genesis AI just open-sourced Genesis World 1.0, and it might be one of the most important infrastructure releases in robotics this year. Robotics is still bottlenecked by the 1× speed of the physical world. Every model needs to be tested on real hardware, slowly, expensively, with limited coverage. Genesis World 1.0 from Genesis AI flips that equation: One hour in reality becomes 100 days in simulation. That turns a wall-clock bottleneck into a compute problem. And compute problems are solvable. The technical stack they rebuilt from scratch is serious: → GPU-accelerated cross-platform compiler via Quadrants, 10x faster launch time and up to 4.6x runtime vs the initial Genesis release → Penetration-free multi-physics contact solvers, the thing that makes simulation actually trustworthy → Unified rigid AND deformable physics in a single engine → Nyx, a high-performance path-traced rendering engine purpose-built for physical AI The sim-to-real gap has historically been the graveyard of robotics research. Policies that work beautifully in simulation fall apart on real hardware. Genesis World 1.0 is a direct attack on that problem. And it's fully open-source. The companies that master simulation infrastructure will train better robots faster than anyone else. Find it here: Genesis World 1.0: Quadrants: Nyx: Theophile Gervet, Zhou Xian congrats! 👏🏼 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:46

That's sick! 🤯 Genesis AI simulates robots playing yo-yo! 🪀 Genesis AI just open-sourced Genesis World 1.0, and it might be one of the most important infrastructure releases in robotics this year. Robotics is still bottlenecked by the 1× speed of the physical world. Every model needs to be tested on real hardware, slowly, expensively, with limited coverage. Genesis World 1.0 from Genesis AI flips that equation: One hour in reality becomes 100 days in simulation. That turns a wall-clock bottleneck into a compute problem. And compute problems are solvable. The technical stack they rebuilt from scratch is serious: → GPU-accelerated cross-platform compiler via Quadrants, 10x faster launch time and up to 4.6x runtime vs the initial Genesis release → Penetration-free multi-physics contact solvers, the thing that makes simulation actually trustworthy → Unified rigid AND deformable physics in a single engine → Nyx, a high-performance path-traced rendering engine purpose-built for physical AI The sim-to-real gap has historically been the graveyard of robotics research. Policies that work beautifully in simulation fall apart on real hardware. Genesis World 1.0 is a direct attack on that problem. And it's fully open-source. The companies that master simulation infrastructure will train better robots faster than anyone else. Find it here: Genesis World 1.0: Quadrants: Nyx: Theophile Gervet, Zhou Xian congrats! 👏🏼 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

57,061 просмотров • 4 месяцев назад

Historically, RL policies for robots have been trained in synthetic, untextured environments, limiting perceptive policies to depth images where the sim-to-real gap is manageable. RGB has always had more potential, but leveraging it to train policies in simulation remained an open problem. Partnering with Niantic Spatial 🌎 and NVIDIA Robotics, we built a pipeline that addresses exactly that. We can now scan a real deployment site with off-the-shelf hardware, reconstruct it into a photorealistic Gaussian splat, and run massively parallel RL training. The policies trained in our Gym environment then transfer zero-shot to the real robot and environments they were trained for. This enables faster deployment of more capable and robust policies for the end user. The new resulting capabilities are a big step towards solving sim-to-real and also apply well beyond navigation. Read the full technical breakdown on our blog; link in the comments. #HumanoidRobots #Flexion #NianticSpatial #NVIDIA
1:21

Historically, RL policies for robots have been trained in synthetic, untextured environments, limiting perceptive policies to depth images where the sim-to-real gap is manageable. RGB has always had more potential, but leveraging it to train policies in simulation remained an open problem. Partnering with Niantic Spatial 🌎 and NVIDIA Robotics, we built a pipeline that addresses exactly that. We can now scan a real deployment site with off-the-shelf hardware, reconstruct it into a photorealistic Gaussian splat, and run massively parallel RL training. The policies trained in our Gym environment then transfer zero-shot to the real robot and environments they were trained for. This enables faster deployment of more capable and robust policies for the end user. The new resulting capabilities are a big step towards solving sim-to-real and also apply well beyond navigation. Read the full technical breakdown on our blog; link in the comments. #HumanoidRobots #Flexion #NianticSpatial #NVIDIA

Flexion

72,778 просмотров • 2 месяцев назад

NVIDIA just gave every robotics beginner a cheat code. You don’t need expensive hardware. You don’t need to burn motors. You don’t need to break prototypes. You can skip all of that. Because you can build the entire robot… virtually. With Isaac Sim, you design everything in simulation: Chassis. Wheels. Joints. All running on real physics. You add sensors—RGB cameras, 2D LiDAR—so your robot can actually see. You wire up control systems using ROS 2 and OmniGraph. You stream live sensor data straight into RViz. And suddenly… You’re not guessing anymore. You’re thinking like a robot. That’s the real shift. Simulation isn’t just practice. It’s leverage. You iterate faster. You break nothing. You ship something that actually works—before touching the real world. If you’re trying to get into robotics or physical AI… This isn’t optional. This is the new starting line.
0:50

NVIDIA just gave every robotics beginner a cheat code. You don’t need expensive hardware. You don’t need to burn motors. You don’t need to break prototypes. You can skip all of that. Because you can build the entire robot… virtually. With Isaac Sim, you design everything in simulation: Chassis. Wheels. Joints. All running on real physics. You add sensors—RGB cameras, 2D LiDAR—so your robot can actually see. You wire up control systems using ROS 2 and OmniGraph. You stream live sensor data straight into RViz. And suddenly… You’re not guessing anymore. You’re thinking like a robot. That’s the real shift. Simulation isn’t just practice. It’s leverage. You iterate faster. You break nothing. You ship something that actually works—before touching the real world. If you’re trying to get into robotics or physical AI… This isn’t optional. This is the new starting line.

Nainsi Dwivedi

26,312 просмотров • 4 месяцев назад

The World Model as NEO's Cognitive Core 1X has revealed a major AI development where the NEO humanoid can translate any natural language prompt into robotic action. It demonstrates this capability even for novel tasks, objects, and environments not found in its robot dataset. - the 1X World Model is trained on internet-scale human interaction videos and fine-tuned with robot data to ground its understanding in physics and in NEO's embodiment - from a simple voice or text prompt, the world model generates a visualization of future actions - a built-in inverse dynamics model then translates these into precise motor movements for NEO
1:02

The World Model as NEO's Cognitive Core 1X has revealed a major AI development where the NEO humanoid can translate any natural language prompt into robotic action. It demonstrates this capability even for novel tasks, objects, and environments not found in its robot dataset. - the 1X World Model is trained on internet-scale human interaction videos and fine-tuned with robot data to ground its understanding in physics and in NEO's embodiment - from a simple voice or text prompt, the world model generates a visualization of future actions - a built-in inverse dynamics model then translates these into precise motor movements for NEO

The Humanoid Hub

68,453 просмотров • 8 месяцев назад

15–30 minutes of real-world robot data. That's now enough to go from sim-to-real failure to working robot. Let’s see… You train a robot in simulation. You deploy it in the real world. It fails. The physics don't match. So you try to fine-tune it with real data, but… you never have enough real data, and the fine-tuning breaks everything the simulation taught it. SimDist fixes this with one key decision: don't transfer the policy. Transfer the world model. Keep the reward and value knowledge from simulation frozen. Only update the part that's actually wrong, how the robot predicts physics. Now the robot doesn't have to relearn the entire task in the real world. It already knows what success looks like. It just needs to correct its understanding of how the real world moves. The part that makes this work: they also trained on failures and recoveries; not just perfect demonstrations. Without that, the planner finds the gaps and exploits them. With it, the robot can tell a good future from a bad one. That's all it needs. Results on peg insertion, table leg assembly, locomotion on slippery and uneven surfaces. Tasks that require precision, force, and quick reaction. Thanks for sharing, Tyler Westenbroek ([Tyler Westenbroek]. Interactive visualization + paper: ——- Weekly robotics and AI insights. Subscribe free:
0:41

15–30 minutes of real-world robot data. That's now enough to go from sim-to-real failure to working robot. Let’s see… You train a robot in simulation. You deploy it in the real world. It fails. The physics don't match. So you try to fine-tune it with real data, but… you never have enough real data, and the fine-tuning breaks everything the simulation taught it. SimDist fixes this with one key decision: don't transfer the policy. Transfer the world model. Keep the reward and value knowledge from simulation frozen. Only update the part that's actually wrong, how the robot predicts physics. Now the robot doesn't have to relearn the entire task in the real world. It already knows what success looks like. It just needs to correct its understanding of how the real world moves. The part that makes this work: they also trained on failures and recoveries; not just perfect demonstrations. Without that, the planner finds the gaps and exploits them. With it, the robot can tell a good future from a bad one. That's all it needs. Results on peg insertion, table leg assembly, locomotion on slippery and uneven surfaces. Tasks that require precision, force, and quick reaction. Thanks for sharing, Tyler Westenbroek ([Tyler Westenbroek]. Interactive visualization + paper: ——- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

14,222 просмотров • 4 месяцев назад

Robotics has a massive, silent bottleneck. It isn’t just data collection—it’s the brutal 1x speed of the physical world. Genesis AI Genesis AI just unveiled Genesis World 1.0, and they are attempting to turn the notorious Sim2Real gap into a pure compute problem. Evaluating a robotics foundation model across edge cases usually means hundreds of hours of physical lab testing. With Genesis World 1.0, what traditionally takes nearly a week of continuous, real-world operation is being compressed into 30 minutes in simulation. What makes this different from just dropping a robot model into an off-the-shelf game engine? 1️⃣ Nyx Renderer: A custom, real-time path-traced engine rendering noise-free 1080p frames in under 4ms. Game engines use rasterization tricks that confuse AI; Nyx uses physically accurate multi-bounce lighting so the model's "eyes" see exactly what real sensors see. 2️⃣ Quadrants Compiler: A custom Python-to-GPU compiler to run heavily parallelized multi-physics simulations (rigid bodies, fluids, deformables) natively across architectures. 3️⃣ Evaluation First: They aren't rushing to train on synthetic data. They are using this purely for closed-loop evaluation to perfect the physics first, currently claiming an impressive 89% correlation with real-world hardware tests. If the industry can accurately evaluate models in simulation without the physical world bottleneck, humanoid development stops moving at wall-clock time and starts scaling with compute.
1:36

Robotics has a massive, silent bottleneck. It isn’t just data collection—it’s the brutal 1x speed of the physical world. Genesis AI Genesis AI just unveiled Genesis World 1.0, and they are attempting to turn the notorious Sim2Real gap into a pure compute problem. Evaluating a robotics foundation model across edge cases usually means hundreds of hours of physical lab testing. With Genesis World 1.0, what traditionally takes nearly a week of continuous, real-world operation is being compressed into 30 minutes in simulation. What makes this different from just dropping a robot model into an off-the-shelf game engine? 1️⃣ Nyx Renderer: A custom, real-time path-traced engine rendering noise-free 1080p frames in under 4ms. Game engines use rasterization tricks that confuse AI; Nyx uses physically accurate multi-bounce lighting so the model's "eyes" see exactly what real sensors see. 2️⃣ Quadrants Compiler: A custom Python-to-GPU compiler to run heavily parallelized multi-physics simulations (rigid bodies, fluids, deformables) natively across architectures. 3️⃣ Evaluation First: They aren't rushing to train on synthetic data. They are using this purely for closed-loop evaluation to perfect the physics first, currently claiming an impressive 89% correlation with real-world hardware tests. If the industry can accurately evaluate models in simulation without the physical world bottleneck, humanoid development stops moving at wall-clock time and starts scaling with compute.

Humanoids daily

17,302 просмотров • 4 месяцев назад

Simulation-first approach to robotic production lines! 👾 At Hannover Messe, Amazon Web Services (AWS) and SoftServe are demonstrating a fully autonomous, AI-powered manufacturing workflow. Design a product using generative AI, then watch it move through the entire process: engraving, inspection, and delivery, handled by a mix of robots working together powered by physical AI on AWS. The interesting part is how the system is built. Getting robots into production is usually where things fall apart. SoftServe takes a simulation-first approach using AWS. They build and test the entire system virtually: robot behavior, production flow, before deploying anything physically. This enables faster iteration, safe edge case testing, and significantly reduced sim-to-real gap. Their demo includes AMRs handling transport, cobots doing precise manipulation, AI-driven quality inspection, and humanoid interaction at the end. All connected through a unified, software-defined layer powered by AWS. It's about building a system where robots can adapt, coordinate, and scale without rebuilding everything from scratch every time. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:38

Simulation-first approach to robotic production lines! 👾 At Hannover Messe, Amazon Web Services (AWS) and SoftServe are demonstrating a fully autonomous, AI-powered manufacturing workflow. Design a product using generative AI, then watch it move through the entire process: engraving, inspection, and delivery, handled by a mix of robots working together powered by physical AI on AWS. The interesting part is how the system is built. Getting robots into production is usually where things fall apart. SoftServe takes a simulation-first approach using AWS. They build and test the entire system virtually: robot behavior, production flow, before deploying anything physically. This enables faster iteration, safe edge case testing, and significantly reduced sim-to-real gap. Their demo includes AMRs handling transport, cobots doing precise manipulation, AI-driven quality inspection, and humanoid interaction at the end. All connected through a unified, software-defined layer powered by AWS. It's about building a system where robots can adapt, coordinate, and scale without rebuilding everything from scratch every time. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

17,709 просмотров • 5 месяцев назад

We trained a robot dog to balance and walk on top of a yoga ball purely in simulation, and then transfer zero-shot to the real world. No fine-tuning. Just works. I’m excited to announce DrEureka, an LLM agent that writes code to train robot skills in simulation, and writes more code to bridge the difficult simulation-reality gap. It fully automates the pipeline from new skill learning to real-world deployment. The Yoga ball task is particularly hard because it is not possible to accurately simulate the bouncy ball surface. Yet DrEureka has no trouble searching over a vast space of sim-to-real configurations, and enables the dog to steer the ball on various terrains, even walking sideways! Traditionally, the sim-to-real transfer is achieved by domain randomization, a tedious process that requires expert human roboticists to stare at every parameter and adjust by hand. Frontier LLMs like GPT-4 have tons of built-in physical intuition for friction, damping, stiffness, gravity, etc. We are (mildly) surprised to find that DrEureka can tune these parameters competently and explain its reasoning well. DrEureka builds on our prior work Eureka, the algorithm that teaches a 5-finger robot hand to do pen spinning. It takes one step further on our quest to automate the entire robot learning pipeline by an AI agent system. One model that outputs strings will supervise another model that outputs torque control. We open-source everything! Welcome you all to check out the paper, more videos, and try the codebase today: Code:
0:24

We trained a robot dog to balance and walk on top of a yoga ball purely in simulation, and then transfer zero-shot to the real world. No fine-tuning. Just works. I’m excited to announce DrEureka, an LLM agent that writes code to train robot skills in simulation, and writes more code to bridge the difficult simulation-reality gap. It fully automates the pipeline from new skill learning to real-world deployment. The Yoga ball task is particularly hard because it is not possible to accurately simulate the bouncy ball surface. Yet DrEureka has no trouble searching over a vast space of sim-to-real configurations, and enables the dog to steer the ball on various terrains, even walking sideways! Traditionally, the sim-to-real transfer is achieved by domain randomization, a tedious process that requires expert human roboticists to stare at every parameter and adjust by hand. Frontier LLMs like GPT-4 have tons of built-in physical intuition for friction, damping, stiffness, gravity, etc. We are (mildly) surprised to find that DrEureka can tune these parameters competently and explain its reasoning well. DrEureka builds on our prior work Eureka, the algorithm that teaches a 5-finger robot hand to do pen spinning. It takes one step further on our quest to automate the entire robot learning pipeline by an AI agent system. One model that outputs strings will supervise another model that outputs torque control. We open-source everything! Welcome you all to check out the paper, more videos, and try the codebase today: Code:

Jim Fan

909,210 просмотров • 2 лет назад