Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Unreal Engine's high-quality real-time 3D graphics is allowing the simulation industry to implement realistic, immersive simulation environments 🏞️ Korea Aerospace Industries (KAI) is driving innovation by adopting Unreal Engine's VR/AR/MR integration, enabling real-world and experience-based learning across several industries. Get the scoop on how it all comes together here:

Unreal Engine

597,841 subscribers

10,438 views • 1 year ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Fei-Fei Li on what simulation can do for robotics that real-world data can't: "You play out events that haven't happened, or cannot happen... And while you play it out, you learn how to act in it." "That's really important in robotics, because we cannot possibly have enough real-world data for that." "Here is a real life example: the industry of self-driving cars. Waymo has officially said they use billions of hours of simulation." "Cars are the simplest kind of robots. So clearly simulation plays a huge role in robotic learning." Fei-Fei Li Yunzhu Li World Labs martin_casado

Fei-Fei Li on what simulation can do for robotics that real-world data can't: "You play out events that haven't happened, or cannot happen... And while you play it out, you learn how to act in it." "That's really important in robotics, because we cannot possibly have enough real-world data for that." "Here is a real life example: the industry of self-driving cars. Waymo has officially said they use billions of hours of simulation." "Cars are the simplest kind of robots. So clearly simulation plays a huge role in robotic learning." Fei-Fei Li Yunzhu Li World Labs martin_casado

a16z

35,733 views • 1 month ago

Discover how Badass Studios is using Unreal Engine to help the E1 Series World Championship Presented by PIF redefine racing. Using UE5, they're bringing electric powerboats, real-time digital twins, immersive AR experiences, and live gaming to a new generation of fans 🚤➡️

Discover how Badass Studios is using Unreal Engine to help the E1 Series World Championship Presented by PIF redefine racing. Using UE5, they're bringing electric powerboats, real-time digital twins, immersive AR experiences, and live gaming to a new generation of fans 🚤➡️

Unreal Engine

18,784 views • 6 months ago

AI for robotics has some monumental challenges, like high dimensionality and reasoning with the physical world. Ashok Elluswamy, AI lead at Tesla, thinks the hardest problem is Evaluation. - Loss isn't a perfect indicator of Policy Neural Network's quality. - Testing in the real world for all the long-tail failure cases is not possible. To solve the evaluation challenge, Tesla has developed a World Simulator Model. It is trained on state and action pairs, so for a given current camera feed and current action, the model generates the next frame in the cameras. Once the world simulation is good enough, it can be hooked up to the policy network for a closed-loop simulation. In this setup, the model generates the next video frames, and based on those, the policy network comes up with the next action, which feeds back into the world simulation; this continuous loop creates a coherent simulation. The world simulation neural network is not just applicable to self-driving but also to humanoids, because Tesla trains it on common data. The examples show Optimus navigating or manipulating inside the world simulation, with all the pixels being generated by the world simulation model. The robotic agents can be tested in an accurately reproduced edge case and in other potential variations of the same edge case.

AI for robotics has some monumental challenges, like high dimensionality and reasoning with the physical world. Ashok Elluswamy, AI lead at Tesla, thinks the hardest problem is Evaluation. - Loss isn't a perfect indicator of Policy Neural Network's quality. - Testing in the real world for all the long-tail failure cases is not possible. To solve the evaluation challenge, Tesla has developed a World Simulator Model. It is trained on state and action pairs, so for a given current camera feed and current action, the model generates the next frame in the cameras. Once the world simulation is good enough, it can be hooked up to the policy network for a closed-loop simulation. In this setup, the model generates the next video frames, and based on those, the policy network comes up with the next action, which feeds back into the world simulation; this continuous loop creates a coherent simulation. The world simulation neural network is not just applicable to self-driving but also to humanoids, because Tesla trains it on common data. The examples show Optimus navigating or manipulating inside the world simulation, with all the pixels being generated by the world simulation model. The robotic agents can be tested in an accurately reproduced edge case and in other potential variations of the same edge case.

The Humanoid Hub

17,065 views • 7 months ago

✨ The power of AI cutting-edge technology to revolutionize Immersive experience within Earniverse. ✨ Today, get an introduction of some of the core AI features inside Earniverse! 🌊 State-of-the-art Ocean AI Simulation to Immerse yourself in stunning realism 🌤️ Dynamic Skies where AI seamlessly adjusts lighting and atmospheric conditions to match your surroundings, creating a truly dynamic environment that responds to your every move. 🌦️ AI Meteo Management system to ensure that weather changes naturally and organically, driven by AI algorithms that mimic real-world patterns ⚙️ And that's not all – our Performance Management has taken a giant leap forward. 📈 AI technology intelligently optimizes resource usage, by enhancing graphics quality as you approach specific 3D elements in the map. The closer your look, the higher the quality of graphics you'll experience without putting down your hardware, all in real-time! 🎥 Curious to see the magic in action? Check out the video to witness how our AI-powered system delivers top-notch performance and ultra-realistic simulations. 📹👀 🌐 The future of virtual reality is here, and it's waiting for you in Earniverse Metaverse! Join us on this exhilarating journey as we redefine what's possible in the realm of immersive experiences. 🚀 #Earniverse #Metaverse #ImmersiveReality #AI #Performance #Simulation

✨ The power of AI cutting-edge technology to revolutionize Immersive experience within Earniverse. ✨ Today, get an introduction of some of the core AI features inside Earniverse! 🌊 State-of-the-art Ocean AI Simulation to Immerse yourself in stunning realism 🌤️ Dynamic Skies where AI seamlessly adjusts lighting and atmospheric conditions to match your surroundings, creating a truly dynamic environment that responds to your every move. 🌦️ AI Meteo Management system to ensure that weather changes naturally and organically, driven by AI algorithms that mimic real-world patterns ⚙️ And that's not all – our Performance Management has taken a giant leap forward. 📈 AI technology intelligently optimizes resource usage, by enhancing graphics quality as you approach specific 3D elements in the map. The closer your look, the higher the quality of graphics you'll experience without putting down your hardware, all in real-time! 🎥 Curious to see the magic in action? Check out the video to witness how our AI-powered system delivers top-notch performance and ultra-realistic simulations. 📹👀 🌐 The future of virtual reality is here, and it's waiting for you in Earniverse Metaverse! Join us on this exhilarating journey as we redefine what's possible in the realm of immersive experiences. 🚀 #Earniverse #Metaverse #ImmersiveReality #AI #Performance #Simulation

Earniverse

109,684 views • 3 years ago

Today we present Morpheus, a persistent enterprise simulation platform designed to make Continual Learning a reality. Morpheus is the world’s first real world Reinforcement Learning environment. Every Reinforcement Learning environment operates in the game world. Benchmarks like Atari, OpenAI Gym, MuJoCo, and Procgen are all small, game-like worlds that reset every few minutes. But the real world never resets. A business keeps running and evolving everyday. We tested how frontier LLMs would perform in realistic and dynamic business environments 🧬on Morpheus. The main conclusion was that LLMs are not continual learners. 🧵Here’s how we did it and what we learned:

Today we present Morpheus, a persistent enterprise simulation platform designed to make Continual Learning a reality. Morpheus is the world’s first real world Reinforcement Learning environment. Every Reinforcement Learning environment operates in the game world. Benchmarks like Atari, OpenAI Gym, MuJoCo, and Procgen are all small, game-like worlds that reset every few minutes. But the real world never resets. A business keeps running and evolving everyday. We tested how frontier LLMs would perform in realistic and dynamic business environments 🧬on Morpheus. The main conclusion was that LLMs are not continual learners. 🧵Here’s how we did it and what we learned:

Skyfall AI

268,567 views • 2 months ago

Crypto Policy is being written in real time Kevin Wysocki leads policy at Anchorage Digital ⚓️ and advocates in the rooms where these rules are getting shaped and how their frameworks will impact across industries and countries alike Keep an eye on policy as it gets shaped and the people helping the industry move forward like Kevin Wysocki Brought to you by Wrapped and Real Motion

Crypto Policy is being written in real time Kevin Wysocki leads policy at Anchorage Digital ⚓️ and advocates in the rooms where these rules are getting shaped and how their frameworks will impact across industries and countries alike Keep an eye on policy as it gets shaped and the people helping the industry move forward like Kevin Wysocki Brought to you by Wrapped and Real Motion

Real Motion

13,132 views • 25 days ago

A big part of scaling robot learning to solve real-world problems is that we somehow need to get enough diverse, high-quality data to train our robots to perform useful things. GPT and its fellow large language models were bootstrapped and proved out on a massive dataset of real-world language data. Unfortunately, despite our best efforts, similarly massive datasets don’t really exist for robotics — so, in our unending pursuit of high-quality, useful data, we turn to simulation. I compared a couple recent works on sim-to-real robot manipulation, which discuss how to train perception-driven manipulation policies in simulation, in such a way that they’re useful in the real world. - DextraH-RGB, from NVIDIA - Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation, also from NVIDIA — specifically the GEAR lab - Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids, another GEAR lab paper - Local Policies Enable Zero-shot Long-Horizon Manipulation, from CMU (video from DextrAH-RGB)

A big part of scaling robot learning to solve real-world problems is that we somehow need to get enough diverse, high-quality data to train our robots to perform useful things. GPT and its fellow large language models were bootstrapped and proved out on a massive dataset of real-world language data. Unfortunately, despite our best efforts, similarly massive datasets don’t really exist for robotics — so, in our unending pursuit of high-quality, useful data, we turn to simulation. I compared a couple recent works on sim-to-real robot manipulation, which discuss how to train perception-driven manipulation policies in simulation, in such a way that they’re useful in the real world. - DextraH-RGB, from NVIDIA - Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation, also from NVIDIA — specifically the GEAR lab - Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids, another GEAR lab paper - Local Policies Enable Zero-shot Long-Horizon Manipulation, from CMU (video from DextrAH-RGB)

Chris Paxton

20,486 views • 1 year ago

Real-time Fire and Liquid Simulation 🤯 Achieved using NVIDIA RTX PRO 6000 with 96 GB of VRAM 🤯🤯 Only Nerds like us get why this awesome!! Anybody who worked with 3D softwares knows how hard is it to learn and work with particle simulations in Real-time. Thanks to Dell Technologies and JangaFX Software we saw this Demo using the amazing softwares of EmberGen and LiquiGen where newcomers can quickly learn and execute complex simulations in real-time. Best part is you can export these simulations and bring it to your 3D software of choice such as Unreal Engine or Blender 🔶 😎😎

Real-time Fire and Liquid Simulation 🤯 Achieved using NVIDIA RTX PRO 6000 with 96 GB of VRAM 🤯🤯 Only Nerds like us get why this awesome!! Anybody who worked with 3D softwares knows how hard is it to learn and work with particle simulations in Real-time. Thanks to Dell Technologies and JangaFX Software we saw this Demo using the amazing softwares of EmberGen and LiquiGen where newcomers can quickly learn and execute complex simulations in real-time. Best part is you can export these simulations and bring it to your 3D software of choice such as Unreal Engine or Blender 🔶 😎😎

Bad Decisions Studio

40,028 views • 1 year ago

MEET BLUE: NVIDIA’S REAL-LIFE WALL-E Blue is an AI robot that moves, reacts, and talks like something straight out of a Pixar film. Blue runs on 2 NVIDIA computers and uses a physics engine for ultra-realistic tactile feedback, rigid and soft body simulation, all in real time. This isn’t a concept, this is how NVIDIA plans to train robots for the real world. And yes, it casually stole the show. Source: entrepreneurialogy

MEET BLUE: NVIDIA’S REAL-LIFE WALL-E Blue is an AI robot that moves, reacts, and talks like something straight out of a Pixar film. Blue runs on 2 NVIDIA computers and uses a physics engine for ultra-realistic tactile feedback, rigid and soft body simulation, all in real time. This isn’t a concept, this is how NVIDIA plans to train robots for the real world. And yes, it casually stole the show. Source: entrepreneurialogy

Mario Nawfal

38,388 views • 1 year ago

Today I’m excited to introduce micro1 Intelligence, the world’s most advanced platform for training frontier AI models. Achieving AGI is bottlenecked by one main thing: high-quality data. Data based on real-world environments that capture human expert workflows, complex decision-making, and reward signals models need to learn. With micro1 Intelligence, frontier labs can train on RL environments across every subject matter all in one place.

Today I’m excited to introduce micro1 Intelligence, the world’s most advanced platform for training frontier AI models. Achieving AGI is bottlenecked by one main thing: high-quality data. Data based on real-world environments that capture human expert workflows, complex decision-making, and reward signals models need to learn. With micro1 Intelligence, frontier labs can train on RL environments across every subject matter all in one place.

Ali Ansari

333,129 views • 9 months ago

At Avalon we are building "Real-time creating" - the ability to generate gameplay ready persistent worlds prompted from text. While others are building real-time video world models, Avalon is building real-time world generation inside a fully playable, persistent multiplayer engine. Internally running at 3840×2180 at 60 FPS. Built on Unreal Engine. Multiplayer by default. Persistent by default. Gameplay-ready by default. This is not a video latent replay. Not a simulation of interaction. It is a real 3D world with physics, logic, and authoritative multiplayer state. Avalon is trained on proprietary Avalon interaction data and powered by a hybrid system that combines language understanding, 3D model generation, procedural systems, and structured gameplay logic synthesis. Players can walk through a live world and generate environments, assets, mechanics, and entirely new gameplay modes using natural language. We accomplish this through a combination of 3D model generation, game logic generation based on our proprietary systems, and AI driven world creation. While other players are inside it. Changes persist instantly. State is synchronized in real time. Creation happens inside the world, not outside of it. Describe a biome. Spawn a civilization. Create a survival mode. Build a dungeon crawler. Launch a new game inside the world. Avalon interprets intent and integrates it directly into the live multiplayer environment. This is not a world model predicting video. This is a gameplay engine that understands language. If you can describe it, you can build it. And others can walk into it instantly.

At Avalon we are building "Real-time creating" - the ability to generate gameplay ready persistent worlds prompted from text. While others are building real-time video world models, Avalon is building real-time world generation inside a fully playable, persistent multiplayer engine. Internally running at 3840×2180 at 60 FPS. Built on Unreal Engine. Multiplayer by default. Persistent by default. Gameplay-ready by default. This is not a video latent replay. Not a simulation of interaction. It is a real 3D world with physics, logic, and authoritative multiplayer state. Avalon is trained on proprietary Avalon interaction data and powered by a hybrid system that combines language understanding, 3D model generation, procedural systems, and structured gameplay logic synthesis. Players can walk through a live world and generate environments, assets, mechanics, and entirely new gameplay modes using natural language. We accomplish this through a combination of 3D model generation, game logic generation based on our proprietary systems, and AI driven world creation. While other players are inside it. Changes persist instantly. State is synchronized in real time. Creation happens inside the world, not outside of it. Describe a biome. Spawn a civilization. Create a survival mode. Build a dungeon crawler. Launch a new game inside the world. Avalon interprets intent and integrates it directly into the live multiplayer environment. This is not a world model predicting video. This is a gameplay engine that understands language. If you can describe it, you can build it. And others can walk into it instantly.

AVALON

65,011 views • 7 months ago

📢 Announcing one of the most exciting works from us this year on **scalable robot policy evaluation through real-to-sim transfer**, moving toward a scalable evaluation engine with structured world models that capture the appearance, geometry, and dynamics of environments involving deformable objects. 🤖 Evaluation remains one of the biggest bottlenecks in building general-purpose robots. Today, robots are still evaluated only in the real world, which is **orders of magnitude slower** than the development of language agents. We propose a new framework where simulation performance **strongly correlates** with the real world (r > 0.9), even for deformable objects. The key difference from existing work lies in the correlation between simulation and reality: if a robot model performs better in the digital world, does it also perform better in the real world? This question has long made people hesitant about simulation-based evaluation — especially for deformable objects. We are changing that. Our pipeline achieves effective real-to-sim transfer, establishing **state-of-the-art correlation** between simulation and reality for deformable object manipulation. It provides a **scalable and reproducible evaluation engine** for robot learning. 🌐

📢 Announcing one of the most exciting works from us this year on scalable robot policy evaluation through real-to-sim transfer, moving toward a scalable evaluation engine with structured world models that capture the appearance, geometry, and dynamics of environments involving deformable objects. 🤖 Evaluation remains one of the biggest bottlenecks in building general-purpose robots. Today, robots are still evaluated only in the real world, which is orders of magnitude slower than the development of language agents. We propose a new framework where simulation performance strongly correlates with the real world (r > 0.9), even for deformable objects. The key difference from existing work lies in the correlation between simulation and reality: if a robot model performs better in the digital world, does it also perform better in the real world? This question has long made people hesitant about simulation-based evaluation — especially for deformable objects. We are changing that. Our pipeline achieves effective real-to-sim transfer, establishing state-of-the-art correlation between simulation and reality for deformable object manipulation. It provides a scalable and reproducible evaluation engine for robot learning. 🌐

Yunzhu Li

39,960 views • 10 months ago

NEWS: Waymo has introduced the Waymo World Model, "a frontier generative model built on Google DeepMind’s Genie 3 that sets a new bar for large-scale, hyper-realistic autonomous driving simulation." "By simulating the “impossible”, we proactively prepare the Waymo Driver for some of the most rare and complex scenarios—from tornadoes to planes landing on freeways—long before it encounters them in the real world. The model’s architecture offers high controllability, allowing our engineers to modify simulations with simple language prompts, driving inputs, and scene layouts. Notably, the Waymo World Model generates high-fidelity, multi-sensor outputs that include both camera and lidar data. This combination of broad world knowledge, fine-grained controllability, and multi-modal realism enhances Waymo’s ability to safely scale our service across more places and new driving environments. In the following sections we showcase the Waymo World Model in action, featuring simulations of the Waymo Driver navigating diverse rare edge-case scenarios." More info below.

NEWS: Waymo has introduced the Waymo World Model, "a frontier generative model built on Google DeepMind’s Genie 3 that sets a new bar for large-scale, hyper-realistic autonomous driving simulation." "By simulating the “impossible”, we proactively prepare the Waymo Driver for some of the most rare and complex scenarios—from tornadoes to planes landing on freeways—long before it encounters them in the real world. The model’s architecture offers high controllability, allowing our engineers to modify simulations with simple language prompts, driving inputs, and scene layouts. Notably, the Waymo World Model generates high-fidelity, multi-sensor outputs that include both camera and lidar data. This combination of broad world knowledge, fine-grained controllability, and multi-modal realism enhances Waymo’s ability to safely scale our service across more places and new driving environments. In the following sections we showcase the Waymo World Model in action, featuring simulations of the Waymo Driver navigating diverse rare edge-case scenarios." More info below.

Sawyer Merritt

133,325 views • 7 months ago

🎉The MMORPG World of Jade Dynasty will be officially launching on December 19! Adapted from the popular Chinese Xianxia novel Jade Dynasty and powered by the Unreal Engine 5, World of Jade Dynasty stays true to the essence of classic MMORPGs. It designed for MMO enthusiasts to deliver a high-quality, immersive experience in the world of Chinese Xianxia. The showcased video features real in-game footage, inviting players to explore the captivating charm of Chinese Xianxia culture. #WorldofJadeDynasty #JadeDynasty #ZhuXian #PerfectWorldGames #MMORPG

🎉The MMORPG World of Jade Dynasty will be officially launching on December 19! Adapted from the popular Chinese Xianxia novel Jade Dynasty and powered by the Unreal Engine 5, World of Jade Dynasty stays true to the essence of classic MMORPGs. It designed for MMO enthusiasts to deliver a high-quality, immersive experience in the world of Chinese Xianxia. The showcased video features real in-game footage, inviting players to explore the captivating charm of Chinese Xianxia culture. #WorldofJadeDynasty #JadeDynasty #ZhuXian #PerfectWorldGames #MMORPG

Perfect World Games

15,152 views • 1 year ago

This Roman Real-Time Environment is a project by Junior 3D Artist Davide Maddalo for presentation in Unreal Engine 5. Modelled mainly in Maya, the project was a practice in exploring the full real-time pipeline with a focus on how all aspects, from assets to lighting, work together. "One feature I found particularly useful while working on this environment was tri-planar mapping. I learned how it can help project textures consistently across surfaces without relying entirely on traditional UV mapping, which was especially useful for creating more flexible and natural-looking materials within the environment." - Davide Maddalo

This Roman Real-Time Environment is a project by Junior 3D Artist Davide Maddalo for presentation in Unreal Engine 5. Modelled mainly in Maya, the project was a practice in exploring the full real-time pipeline with a focus on how all aspects, from assets to lighting, work together. "One feature I found particularly useful while working on this environment was tri-planar mapping. I learned how it can help project textures consistently across surfaces without relying entirely on traditional UV mapping, which was especially useful for creating more flexible and natural-looking materials within the environment." - Davide Maddalo

Unreal Engine

20,422 views • 8 days ago

Everything you love about generative models — now powered by real physics! Announcing the Genesis project — after a 24-month large-scale research collaboration involving over 20 research labs — a generative physics engine able to generate 4D dynamical worlds powered by a physics simulation platform designed for general-purpose robotics and physical AI applications. Genesis's physics engine is developed in pure Python, while being 10-80x faster than existing GPU-accelerated stacks like Isaac Gym and MJX. It delivers a simulation speed ~430,000 faster than in real-time, and takes only 26 seconds to train a robotic locomotion policy transferrable to the real world on a single RTX4090 (see tutorial: The Genesis physics engine and simulation platform is fully open source at We'll gradually roll out access to our generative framework in the near future. Genesis implements a unified simulation framework all from scratch, integrating a wide spectrum of state-of-the-art physics solvers, allowing simulation of the whole physical world in a virtual realm with the highest realism. We aim to build a universal data engine that leverages an upper-level generative framework to autonomously create physical worlds, together with various modes of data, including environments, camera motions, robotic task proposals, reward functions, robot policies, character motions, fully interactive 3D scenes, open-world articulated assets, and more, aiming towards fully automated data generation for robotics, physical AI and other applications. Open Source Code: Project webpage: Documentation: 1/n

Everything you love about generative models — now powered by real physics! Announcing the Genesis project — after a 24-month large-scale research collaboration involving over 20 research labs — a generative physics engine able to generate 4D dynamical worlds powered by a physics simulation platform designed for general-purpose robotics and physical AI applications. Genesis's physics engine is developed in pure Python, while being 10-80x faster than existing GPU-accelerated stacks like Isaac Gym and MJX. It delivers a simulation speed ~430,000 faster than in real-time, and takes only 26 seconds to train a robotic locomotion policy transferrable to the real world on a single RTX4090 (see tutorial: The Genesis physics engine and simulation platform is fully open source at We'll gradually roll out access to our generative framework in the near future. Genesis implements a unified simulation framework all from scratch, integrating a wide spectrum of state-of-the-art physics solvers, allowing simulation of the whole physical world in a virtual realm with the highest realism. We aim to build a universal data engine that leverages an upper-level generative framework to autonomously create physical worlds, together with various modes of data, including environments, camera motions, robotic task proposals, reward functions, robot policies, character motions, fully interactive 3D scenes, open-world articulated assets, and more, aiming towards fully automated data generation for robotics, physical AI and other applications. Open Source Code: Project webpage: Documentation: 1/n

Zhou Xian

3,821,114 views • 1 year ago

In my past research experience, finding or developing an appropriate simulation environment, dataset, and benchmark has always been a challenge. Missing features, limited support, or unexpected bugs often occupied my days and nights. Moreover, current simulation platforms are relatively fragmented—making it challenging to replicate the success of the RT-X dataset in unifying community efforts. Introducing RoboVerse, we provide a unified platform, dataset, and benchmark for scalable and generalizable robot learning. We hope to build a shared foundation to combine the community efforts. RoboVerse includes: MetaSim: We carefully designed a configuration system and a universal interface to align current robotic simulators. With MetaSim, you can use any simulator with the same code—bringing together the community’s diverse efforts under one framework! RoboVerse Dataset and Benchmark: We unify popular simulation environments and benchmarks into a single cohesive system and introduce the RoboVerse dataset—a large-scale, high-quality synthetic dataset. Additionally, we propose a standardized benchmark across both imitation learning and reinforcement learning. A cool feature enabled by our unified framework: Hybrid Simulation! You can now integrate physics engines and renderers from different simulators—e.g., using MuJoCo precise physics with Isaac photorealistic rendering. This not only elevates simulation fidelity but also significantly enhances real-world transfer performance across complex robotic applications. Hopefully, our team’s efforts could serve the robotic community to thrive vibrantly in the years to come. RoboVerse is open-sourced🥳!!! Project Page: Documentation: Github Repo: Paper:

In my past research experience, finding or developing an appropriate simulation environment, dataset, and benchmark has always been a challenge. Missing features, limited support, or unexpected bugs often occupied my days and nights. Moreover, current simulation platforms are relatively fragmented—making it challenging to replicate the success of the RT-X dataset in unifying community efforts. Introducing RoboVerse, we provide a unified platform, dataset, and benchmark for scalable and generalizable robot learning. We hope to build a shared foundation to combine the community efforts. RoboVerse includes: MetaSim: We carefully designed a configuration system and a universal interface to align current robotic simulators. With MetaSim, you can use any simulator with the same code—bringing together the community’s diverse efforts under one framework! RoboVerse Dataset and Benchmark: We unify popular simulation environments and benchmarks into a single cohesive system and introduce the RoboVerse dataset—a large-scale, high-quality synthetic dataset. Additionally, we propose a standardized benchmark across both imitation learning and reinforcement learning. A cool feature enabled by our unified framework: Hybrid Simulation! You can now integrate physics engines and renderers from different simulators—e.g., using MuJoCo precise physics with Isaac photorealistic rendering. This not only elevates simulation fidelity but also significantly enhances real-world transfer performance across complex robotic applications. Hopefully, our team’s efforts could serve the robotic community to thrive vibrantly in the years to come. RoboVerse is open-sourced🥳!!! Project Page: Documentation: Github Repo: Paper:

Haoran Geng

84,318 views • 1 year ago