Loading video...

Video Failed to Load

Go Home

At #GTC26 we are showing AlpaDreams — generative, interactive closed-loop simulation for autonomous driving. World models generate environments in real time, policies or drivers interact, and the simulator updates the world. If you are at GTC, come by the booth and try it out!

zianwang97's profile picture

Zian Wang

1,115 subscribers

16,730 views • 2 months ago •via X (Twitter)

#GTC26
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

#AGIBOTAIWeek Day4: Introducing GE-Sim 2.0 (Genie Envisioner World Simulator 2.0) , a comprehensive embodied world simulator for robotic manipulation. By integrating future video generation, proprioceptive state estimation, and reward-based policy assessment, GE-Sim 2.0 moves beyond visual simulation toward an embodied world simulator with built-in evaluation capability, laying the foundation for a world-model-centric platform for closed-loop and interactive policy learning. It provides a practical framework for scalable evaluation and training of robotic manipulation policies. Project page: #AGIBOT #AGIBOTAIWeek #GenieEnvisioner #Robotics #visualsimulation
2:52

#AGIBOTAIWeek Day4: Introducing GE-Sim 2.0 (Genie Envisioner World Simulator 2.0) , a comprehensive embodied world simulator for robotic manipulation. By integrating future video generation, proprioceptive state estimation, and reward-based policy assessment, GE-Sim 2.0 moves beyond visual simulation toward an embodied world simulator with built-in evaluation capability, laying the foundation for a world-model-centric platform for closed-loop and interactive policy learning. It provides a practical framework for scalable evaluation and training of robotic manipulation policies. Project page: #AGIBOT #AGIBOTAIWeek #GenieEnvisioner #Robotics #visualsimulation

AGIBOT

28,219 views • 2 months ago

Today we are announcing Genie 3, a general purpose world model by Google DeepMind that can generate dynamic, interactive environments with a single text prompt. World models are AI that understand facets of the world (like Veo's knowledge of intuitive physics or Genie's mastery of new environments), and serve as a key stepping stone on the path to AGI. Genie 3 is our first world model to allow interaction in real-time, while also improving consistency and realism compared to Genie 2. Learn more ➡️
0:33

Today we are announcing Genie 3, a general purpose world model by Google DeepMind that can generate dynamic, interactive environments with a single text prompt. World models are AI that understand facets of the world (like Veo's knowledge of intuitive physics or Genie's mastery of new environments), and serve as a key stepping stone on the path to AGI. Genie 3 is our first world model to allow interaction in real-time, while also improving consistency and realism compared to Genie 2. Learn more ➡️

Google AI

102,408 views • 10 months ago

The next frontier of autonomous driving is unlocked by reasoning models. NVIDIA Alpamayo brings together open AI models with reasoning capabilities, closed-loop simulation tools, and massive real-world driving datasets. Alpamayo 1 is a vision–language–action model that explains its own decisions through explicit reasoning traces, enabling trustworthy, humanlike decision-making. Together with NVIDIA’s Physical AI dataset and AlpaSim simulation, Alpamayo provides the tools and scale required to enable level 4 autonomous vehicles. ▶️ Watch now:
0:45

The next frontier of autonomous driving is unlocked by reasoning models. NVIDIA Alpamayo brings together open AI models with reasoning capabilities, closed-loop simulation tools, and massive real-world driving datasets. Alpamayo 1 is a vision–language–action model that explains its own decisions through explicit reasoning traces, enabling trustworthy, humanlike decision-making. Together with NVIDIA’s Physical AI dataset and AlpaSim simulation, Alpamayo provides the tools and scale required to enable level 4 autonomous vehicles. ▶️ Watch now:

NVIDIA DRIVE

35,324 views • 5 months ago

Roman Yampolskiy says we are probably in a computer simulation run by advanced AI to simulate an interesting time in history and we should try to hack out of it to take over avatar bodies in the "real world"
1:27

Roman Yampolskiy says we are probably in a computer simulation run by advanced AI to simulate an interesting time in history and we should try to hack out of it to take over avatar bodies in the "real world"

Tsarathustra

115,135 views • 1 year ago

Training fully autonomous robots takes more data than the real world can easily provide. Simulation lets us train, test, and deploy autonomous software without being limited by robots, space, or cost. Here’s OM1 running in simulation side-by-side to the real world.
1:26

Training fully autonomous robots takes more data than the real world can easily provide. Simulation lets us train, test, and deploy autonomous software without being limited by robots, space, or cost. Here’s OM1 running in simulation side-by-side to the real world.

OpenMind

120,172 views • 5 months ago

this is the craziest AI we have now Google’s Genie 3 can generate any interactive 3D world, you can literally walk around in it and interact with things.. example 1: step inside an old painting or a real location and explore it…
0:26

this is the craziest AI we have now Google’s Genie 3 can generate any interactive 3D world, you can literally walk around in it and interact with things.. example 1: step inside an old painting or a real location and explore it…

el.cine

238,017 views • 10 months ago

XPENG is thrilled to introduce X-World, our controllable multi-view generative world model powered by video diffusion technology. Pushing the boundaries of smart mobility, X-World delivers real-time response and continuous multi-view generation to simulate complex driving environments. Xianming Liu, Head of XPENG’s General AI Center, emphasizes: "Beyond generation, X-World serves as the scalable infrastructure critical for training and validating the next leap in autonomous driving." $XPEV
1:36

XPENG is thrilled to introduce X-World, our controllable multi-view generative world model powered by video diffusion technology. Pushing the boundaries of smart mobility, X-World delivers real-time response and continuous multi-view generation to simulate complex driving environments. Xianming Liu, Head of XPENG’s General AI Center, emphasizes: "Beyond generation, X-World serves as the scalable infrastructure critical for training and validating the next leap in autonomous driving." $XPEV

XPENG

4,070,444 views • 2 months ago

we are introducing a state-of-the-art real-time object detection model, RF-DETR RF-DETR outperforms all existing object detection models on real world datasets and is the first real-time model to achieve 60+ Average Precision on COCO talked w/ NVIDIA about it at GTC:
2:31

we are introducing a state-of-the-art real-time object detection model, RF-DETR RF-DETR outperforms all existing object detection models on real world datasets and is the first real-time model to achieve 60+ Average Precision on COCO talked w/ NVIDIA about it at GTC:

Joseph Nelson

18,231 views • 1 year ago

Rollouts in the real world are slow and expensive. What if we could rollout trajectories entirely inside a world model (WM)? Introducing 🚀Ctrl-World🚀, a generative manipulation WM that can interact with advanced VLA policy in imagination. 🧵1/6
1:37

Rollouts in the real world are slow and expensive. What if we could rollout trajectories entirely inside a world model (WM)? Introducing 🚀Ctrl-World🚀, a generative manipulation WM that can interact with advanced VLA policy in imagination. 🧵1/6

Yanjiang Guo

95,391 views • 7 months ago

How good are your skill checks? Come test them out at the Dandy’s World booth at LVL Up Expo! And yes, the Twisteds noticing sound is scarier in IRL.
0:30

How good are your skill checks? Come test them out at the Dandy’s World booth at LVL Up Expo! And yes, the Twisteds noticing sound is scarier in IRL.

CultureFly

4,959,505 views • 1 month ago

AI for robotics has some monumental challenges, like high dimensionality and reasoning with the physical world. Ashok Elluswamy, AI lead at Tesla, thinks the hardest problem is Evaluation. - Loss isn't a perfect indicator of Policy Neural Network's quality. - Testing in the real world for all the long-tail failure cases is not possible. To solve the evaluation challenge, Tesla has developed a World Simulator Model. It is trained on state and action pairs, so for a given current camera feed and current action, the model generates the next frame in the cameras. Once the world simulation is good enough, it can be hooked up to the policy network for a closed-loop simulation. In this setup, the model generates the next video frames, and based on those, the policy network comes up with the next action, which feeds back into the world simulation; this continuous loop creates a coherent simulation. The world simulation neural network is not just applicable to self-driving but also to humanoids, because Tesla trains it on common data. The examples show Optimus navigating or manipulating inside the world simulation, with all the pixels being generated by the world simulation model. The robotic agents can be tested in an accurately reproduced edge case and in other potential variations of the same edge case.
1:29

AI for robotics has some monumental challenges, like high dimensionality and reasoning with the physical world. Ashok Elluswamy, AI lead at Tesla, thinks the hardest problem is Evaluation. - Loss isn't a perfect indicator of Policy Neural Network's quality. - Testing in the real world for all the long-tail failure cases is not possible. To solve the evaluation challenge, Tesla has developed a World Simulator Model. It is trained on state and action pairs, so for a given current camera feed and current action, the model generates the next frame in the cameras. Once the world simulation is good enough, it can be hooked up to the policy network for a closed-loop simulation. In this setup, the model generates the next video frames, and based on those, the policy network comes up with the next action, which feeds back into the world simulation; this continuous loop creates a coherent simulation. The world simulation neural network is not just applicable to self-driving but also to humanoids, because Tesla trains it on common data. The examples show Optimus navigating or manipulating inside the world simulation, with all the pixels being generated by the world simulation model. The robotic agents can be tested in an accurately reproduced edge case and in other potential variations of the same edge case.

The Humanoid Hub

15,907 views • 4 months ago

Genie 3 feels like a watershed moment for world models 🌐: we can now generate multi-minute, real-time interactive simulations of any imaginable world. This could be the key missing piece for embodied AGI… and it can also create beautiful beaches with my dog, playable real time
0:30

Genie 3 feels like a watershed moment for world models 🌐: we can now generate multi-minute, real-time interactive simulations of any imaginable world. This could be the key missing piece for embodied AGI… and it can also create beautiful beaches with my dog, playable real time

Jack Parker-Holder

2,062,886 views • 10 months ago

Introducing Starchild-1 from Odyssey, the first ever real-time multimodal world model. This a model that can generate interactive simulations of the world that you can—for the first time ever—hear. Starchild-1 represents a big step towards a general-purpose world simulator.
2:15

Introducing Starchild-1 from Odyssey, the first ever real-time multimodal world model. This a model that can generate interactive simulations of the world that you can—for the first time ever—hear. Starchild-1 represents a big step towards a general-purpose world simulator.

Oliver Cameron

243,010 views • 23 days ago

2GOOD4U out now in the Philippines and for the rest of the world... dropping at midnight in your time zone, wherever you are ♡
0:39

2GOOD4U out now in the Philippines and for the rest of the world... dropping at midnight in your time zone, wherever you are ♡

denise julia ♡

35,694 views • 2 months ago

Everything you love about generative models — now powered by real physics! Announcing the Genesis project — after a 24-month large-scale research collaboration involving over 20 research labs — a generative physics engine able to generate 4D dynamical worlds powered by a physics simulation platform designed for general-purpose robotics and physical AI applications. Genesis's physics engine is developed in pure Python, while being 10-80x faster than existing GPU-accelerated stacks like Isaac Gym and MJX. It delivers a simulation speed ~430,000 faster than in real-time, and takes only 26 seconds to train a robotic locomotion policy transferrable to the real world on a single RTX4090 (see tutorial: The Genesis physics engine and simulation platform is fully open source at We'll gradually roll out access to our generative framework in the near future. Genesis implements a unified simulation framework all from scratch, integrating a wide spectrum of state-of-the-art physics solvers, allowing simulation of the whole physical world in a virtual realm with the highest realism. We aim to build a universal data engine that leverages an upper-level generative framework to autonomously create physical worlds, together with various modes of data, including environments, camera motions, robotic task proposals, reward functions, robot policies, character motions, fully interactive 3D scenes, open-world articulated assets, and more, aiming towards fully automated data generation for robotics, physical AI and other applications. Open Source Code: Project webpage: Documentation: 1/n
3:26

Everything you love about generative models — now powered by real physics! Announcing the Genesis project — after a 24-month large-scale research collaboration involving over 20 research labs — a generative physics engine able to generate 4D dynamical worlds powered by a physics simulation platform designed for general-purpose robotics and physical AI applications. Genesis's physics engine is developed in pure Python, while being 10-80x faster than existing GPU-accelerated stacks like Isaac Gym and MJX. It delivers a simulation speed ~430,000 faster than in real-time, and takes only 26 seconds to train a robotic locomotion policy transferrable to the real world on a single RTX4090 (see tutorial: The Genesis physics engine and simulation platform is fully open source at We'll gradually roll out access to our generative framework in the near future. Genesis implements a unified simulation framework all from scratch, integrating a wide spectrum of state-of-the-art physics solvers, allowing simulation of the whole physical world in a virtual realm with the highest realism. We aim to build a universal data engine that leverages an upper-level generative framework to autonomously create physical worlds, together with various modes of data, including environments, camera motions, robotic task proposals, reward functions, robot policies, character motions, fully interactive 3D scenes, open-world articulated assets, and more, aiming towards fully automated data generation for robotics, physical AI and other applications. Open Source Code: Project webpage: Documentation: 1/n

Zhou Xian

3,814,443 views • 1 year ago

Introducing Universal Simulator (UniSim), an interactive simulator of the real world. Interactive website: Paper:
1:57

Introducing Universal Simulator (UniSim), an interactive simulator of the real world. Interactive website: Paper:

Sherry Yang

440,007 views • 2 years ago

Introducing Driver — a transformer-based, real-time, vision-only path prediction model for highway and urban driving. It predicts the vehicle’s future path using only camera-based perception—no Lidar, HD maps, or additional sensors required. We deployed it in closed-loop simulation with CARLA Simulator + GenSim-2, our generative AI model that re-renders realistic camera visuals. (top: original CARLA; bottom: GenSim-2 re-render). See more details in thread👇
0:48

Introducing Driver — a transformer-based, real-time, vision-only path prediction model for highway and urban driving. It predicts the vehicle’s future path using only camera-based perception—no Lidar, HD maps, or additional sensors required. We deployed it in closed-loop simulation with CARLA Simulator + GenSim-2, our generative AI model that re-renders realistic camera visuals. (top: original CARLA; bottom: GenSim-2 re-render). See more details in thread👇

Helm.ai

4,040,896 views • 1 year ago

Real-time World Models are the next AI frontier. Today, we reactor are taking the first step towards this reality: our early preview lets you experience worlds generated in real-time, running on our global low-latency infrastructure. Try it now:
0:34

Real-time World Models are the next AI frontier. Today, we reactor are taking the first step towards this reality: our early preview lets you experience worlds generated in real-time, running on our global low-latency infrastructure. Try it now:

Bryce Schmidtchen

8,486,910 views • 1 month ago

The launch of My First Gran Turismo at the #GTWS World Finals in Amsterdam brought together GT fans, drivers, and car lovers to explore iconic cars and try them out. Whether you’re discovering it for the first time or reigniting your passion, there’s something for everyone.
0:51

The launch of My First Gran Turismo at the #GTWS World Finals in Amsterdam brought together GT fans, drivers, and car lovers to explore iconic cars and try them out. Whether you’re discovering it for the first time or reigniting your passion, there’s something for everyone.

Gran Turismo

25,106 views • 1 year ago

Did you know you can print an AT-4 Clone? This is the AT-420 and we are rolling the V2 soon. We are looking for some more testers to come and help out! More videos in the comments. The AT-420 uses 84mm black powder rounds come and check it out!
0:16

Did you know you can print an AT-4 Clone? This is the AT-420 and we are rolling the V2 soon. We are looking for some more testers to come and help out! More videos in the comments. The AT-420 uses 84mm black powder rounds come and check it out!

Moderator Gage

27,129 views • 1 year ago