Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

NVIDIA just introduced Cosmos, a platform for world foundation models designed for robotics. ⦿ It features advanced tokenizers, an AI-accelerated data pipeline, and integration with NVIDIA Omniverse. Humanoid makers 1X, Figure, and Agility are among the first to adopt Cosmos. ⦿ Cosmos generates synthetic, physics-based data, accelerating model training... show more

The Humanoid Hub

107,592 subscribers

129,383 views • 1 year ago •via X (Twitter)

Science & Technology News & Politics Education

Anya Rossi• Live Now

Private livecam show

10 Comments

The Humanoid Hub1 year ago

Technical Blog:

ARK Electronics1 year ago

Excited about the latest tech for your drone product? Our NDAA-compliant, US-made flight controllers are designed to accelerate your path to market and provide a solid platform for developing your autonomous software. Check them out! #Drones #UAV #UAS #Robotics #MadeInUSA

Briscoe Crain IV1 year ago

I’m buying more NVIDIA in the morning! 😂

Robot Machines1 year ago

This is the foreseeable future of robotics.

Appy Pie1 year ago

Game-changer for robotics! Cosmos is setting a new standard for scalable training and deployment. Excited to see how pioneers like 1X and Agility leverage this!

Leo Grundström1 year ago

Can this be used for video generation?

Brent1 year ago

This Blew Me Away !!! 😮 Entire video:

Bruno P. Boutteau1 year ago

Cosmos is not Newton for the moment.

odesha1 year ago

Must try this out!

Uri Gil1 year ago

Havent they already announced that? I didn't hear of anybody who uses those two train robots

Related Videos

NEWS: Nvidia has just introduced "Cosmos," a world foundation model created to understand the physical world. The model can generate synthetic data to train robotics.

NEWS: Nvidia has just introduced "Cosmos," a world foundation model created to understand the physical world. The model can generate synthetic data to train robotics.

Sawyer Merritt

254,296 views • 1 year ago

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.

CyberRobo

17,092 views • 13 days ago

A humanoid robot policy trained solely on synthetic data generated by a world model. Research Scientist Joel Jang presents NVIDIA's DreamGen pipeline: ⦿ Post-train the world model Cosmos-Predict2 with a small set of real teleoperation demos. ⦿ Prompt the world model to generate synthetic video data with verbs and scenarios not used in the world model’s post-training. ⦿ Auto-label synthetic video data with action sequences. ⦿ Train robot policies using only synthetic data. That's it. Deploy zero-shot to a real humanoid robot.

A humanoid robot policy trained solely on synthetic data generated by a world model. Research Scientist Joel Jang presents NVIDIA's DreamGen pipeline: ⦿ Post-train the world model Cosmos-Predict2 with a small set of real teleoperation demos. ⦿ Prompt the world model to generate synthetic video data with verbs and scenarios not used in the world model’s post-training. ⦿ Auto-label synthetic video data with action sequences. ⦿ Train robot policies using only synthetic data. That's it. Deploy zero-shot to a real humanoid robot.

The Humanoid Hub

20,968 views • 11 months ago

Sat down with Rev Labaredian, VP of Omniverse & Simulation Technology @ NVIDIA, to discuss the age of physical AI, how companies are using NVIDIA's Cosmos models, and why Robotics continues to accelerate. Thank you to Rev NVIDIA Robotics @NVIDIAOmniverse for taking the time!

Sat down with Rev Labaredian, VP of Omniverse & Simulation Technology @ NVIDIA, to discuss the age of physical AI, how companies are using NVIDIA's Cosmos models, and why Robotics continues to accelerate. Thank you to Rev NVIDIA Robotics @NVIDIAOmniverse for taking the time!

amit

50,947 views • 4 months ago

Fun fact: 11% of the 20M hours of data that trained NVIDIA AI Developer Cosmos was driving footage. I put it to the test. Here are some of my favorites. I have a guide for generating videos locally with Cosmos. Watch it here: #AI #GenerativeAI

Fun fact: 11% of the 20M hours of data that trained NVIDIA AI Developer Cosmos was driving footage. I put it to the test. Here are some of my favorites. I have a guide for generating videos locally with Cosmos. Watch it here: #AI #GenerativeAI

Jonathan Stephens

12,386 views • 1 year ago

🤔Want a principled way to RL your diffusion model? Check Data-regularized Reinforcement Learning (DDRL)! Post-train NVIDIA #Cosmos World Foundation models with a million GPU hours! 🤯 Novel formulation ➡️ Theoretically integrates SFT into RL ➡️ Robust to Reward Hacking 🛑 Details: #DDRL #Diffusion #RL #NVIDIA #Cosmos

🤔Want a principled way to RL your diffusion model? Check Data-regularized Reinforcement Learning (DDRL)! Post-train NVIDIA #Cosmos World Foundation models with a million GPU hours! 🤯 Novel formulation ➡️ Theoretically integrates SFT into RL ➡️ Robust to Reward Hacking 🛑 Details: #DDRL #Diffusion #RL #NVIDIA #Cosmos

Haotian Ye

77,504 views • 6 months ago

NVIDIA Cosmos 3 launches with a full model family — Cosmos Super for highest-accuracy robotics and AV post-training, Cosmos Nano for high-speed video and action reasoning, and Cosmos Edge for real-time edge inference. Read the release ➡️

NVIDIA Cosmos 3 launches with a full model family — Cosmos Super for highest-accuracy robotics and AV post-training, Cosmos Nano for high-speed video and action reasoning, and Cosmos Edge for real-time edge inference. Read the release ➡️

NVIDIA Newsroom

46,156 views • 14 days ago

The next frontier of AI is physical. 🤖 From simulation to synthetic data, developers are training robots to understand the real world with NVIDIA Cosmos, Isaac simulation frameworks and open-source physics engine, Newton. Watch the video to see how partners like Hon Hai Technology Group (Foxconn), Hexagon, Humanoid, Noble Machines, and Skild AI are building the future. 🎥

The next frontier of AI is physical. 🤖 From simulation to synthetic data, developers are training robots to understand the real world with NVIDIA Cosmos, Isaac simulation frameworks and open-source physics engine, Newton. Watch the video to see how partners like Hon Hai Technology Group (Foxconn), Hexagon, Humanoid, Noble Machines, and Skild AI are building the future. 🎥

NVIDIA Robotics

21,515 views • 2 months ago

🎬 Higgsfield AI 🧩 is accelerating professional video production, enabling millions of creators to produce content at unprecedented speed and scale, powered by NVIDIA Blackwell. They utilized our accelerated computing platform for: ✅ 30% faster training on NVIDIA HGX B200 and B300 systems, including on Nebius ✅ Infrastructure reliability through NVIDIA NVSentinel and DCGM ✅ Advanced creative control and optimized performance with NVIDIA CUDA libraries and InfiniBand networking Learn more ➡️

🎬 Higgsfield AI 🧩 is accelerating professional video production, enabling millions of creators to produce content at unprecedented speed and scale, powered by NVIDIA Blackwell. They utilized our accelerated computing platform for: ✅ 30% faster training on NVIDIA HGX B200 and B300 systems, including on Nebius ✅ Infrastructure reliability through NVIDIA NVSentinel and DCGM ✅ Advanced creative control and optimized performance with NVIDIA CUDA libraries and InfiniBand networking Learn more ➡️

NVIDIA AI Infrastructure

59,447 views • 1 month ago

Jensen just announced Newton, an open-source physics engine for robotics simulation developed by NVIDIA, Google DeepMind, and Disney Research. ⦿ Built on NVIDIA Warp, it offers GPU-accelerated performance and compatibility with frameworks like MuJoCo and Isaac Lab. ⦿ Features differentiable physics, extensibility for multiphysics simulations, and integration with OpenUSD for flexible data modeling. ⦿ Newton addresses the sim-to-real gap by creating realistic virtual environments for robot training and testing. ⦿ Disney Research is using Newton to power next-gen entertainment robots, including Star Wars-inspired BDX droids.

Jensen just announced Newton, an open-source physics engine for robotics simulation developed by NVIDIA, Google DeepMind, and Disney Research. ⦿ Built on NVIDIA Warp, it offers GPU-accelerated performance and compatibility with frameworks like MuJoCo and Isaac Lab. ⦿ Features differentiable physics, extensibility for multiphysics simulations, and integration with OpenUSD for flexible data modeling. ⦿ Newton addresses the sim-to-real gap by creating realistic virtual environments for robot training and testing. ⦿ Disney Research is using Newton to power next-gen entertainment robots, including Star Wars-inspired BDX droids.

The Humanoid Hub

127,482 views • 1 year ago

We are excited to share Cosmos-Drive-Dreams 🚀 A bold new synthetic data generation (SDG) pipeline powered by world foundation models—designed to synthesize rich, challenging driving scenarios at scale. Models, Code, Dataset, Tookit are released. Website:

We are excited to share Cosmos-Drive-Dreams 🚀 A bold new synthetic data generation (SDG) pipeline powered by world foundation models—designed to synthesize rich, challenging driving scenarios at scale. Models, Code, Dataset, Tookit are released. Website:

Huan Ling

24,221 views • 1 year ago

Introducing the NVIDIA Project DIGITS personal AI supercomputer, powered by the GB10 Grace Blackwell Superchip: Project DIGITS enables developers to prototype, fine-tune and inference models locally and seamlessly deploy at scale to the data center or cloud. #CES2025 #NVIDIAGraceBlackwell

Introducing the NVIDIA Project DIGITS personal AI supercomputer, powered by the GB10 Grace Blackwell Superchip: Project DIGITS enables developers to prototype, fine-tune and inference models locally and seamlessly deploy at scale to the data center or cloud. #CES2025 #NVIDIAGraceBlackwell

NVIDIA

51,983 views • 1 year ago

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:

NVIDIA Robotics

160,428 views • 14 days ago

🤝 Alphabet and NVIDIA are expanding their decade-long partnership to advance agentic AI, robotics, drug discovery, and more. This involves deep co-engineering with integrated platforms, open-source frameworks, and managed services. ✅ Google Cloud is one of the first to bring the NVIDIA Blackwell platform to the cloud. ✅ Google Distributed Cloud using NVIDIA Confidential Computing on #NVIDIABlackwell for enterprises to run Google Gemini on-premises. ✅ Integration of the NVIDIA AI platform across Vertex AI, Cluster Director and Google Kubernetes Engine. ✅ Bringing the NVIDIA Nemotron family of open models to Vertex AI Model Garden. Watch the full video to learn more ➡️

🤝 Alphabet and NVIDIA are expanding their decade-long partnership to advance agentic AI, robotics, drug discovery, and more. This involves deep co-engineering with integrated platforms, open-source frameworks, and managed services. ✅ Google Cloud is one of the first to bring the NVIDIA Blackwell platform to the cloud. ✅ Google Distributed Cloud using NVIDIA Confidential Computing on #NVIDIABlackwell for enterprises to run Google Gemini on-premises. ✅ Integration of the NVIDIA AI platform across Vertex AI, Cluster Director and Google Kubernetes Engine. ✅ Bringing the NVIDIA Nemotron family of open models to Vertex AI Model Garden. Watch the full video to learn more ➡️

NVIDIA AI Infrastructure

268,498 views • 5 months ago

🚀 We just open-sourced Cosmos DiffusionRenderer! This major upgrade brings significantly improved video de-lighting and re-lighting—powered by NVIDIA Cosmos and enhanced data curation. Released under Apache 2.0 and Open Model License. Try it out! 🔗

🚀 We just open-sourced Cosmos DiffusionRenderer! This major upgrade brings significantly improved video de-lighting and re-lighting—powered by NVIDIA Cosmos and enhanced data curation. Released under Apache 2.0 and Open Model License. Try it out! 🔗

Zian Wang

55,954 views • 1 year ago

In 2006, NVIDIA made a bold bet on a parallel computing platform that would eventually redefine the limits of science and industry. 20 years later, CUDA serves as the foundation for 6 million developers worldwide—and we are only just beginning. Join the next wave of architects and build what’s next on two decades of innovation. 🔗

In 2006, NVIDIA made a bold bet on a parallel computing platform that would eventually redefine the limits of science and industry. 20 years later, CUDA serves as the foundation for 6 million developers worldwide—and we are only just beginning. Join the next wave of architects and build what’s next on two decades of innovation. 🔗

NVIDIA

21,714 views • 2 months ago

NVIDIA open models provide the foundation to innovate across agentic AI, robotics, autonomous vehicles, and research. 🤖 This release contributes 10 trillion language tokens, 500,000 robotics trajectories, and 100 terabytes of vehicle sensor data to the community. These frameworks are designed to significantly accelerate specialized AI development and discovery. Learn more:

NVIDIA open models provide the foundation to innovate across agentic AI, robotics, autonomous vehicles, and research. 🤖 This release contributes 10 trillion language tokens, 500,000 robotics trajectories, and 100 terabytes of vehicle sensor data to the community. These frameworks are designed to significantly accelerate specialized AI development and discovery. Learn more:

NVIDIA

36,378 views • 2 months ago

We are teaming up with @Databricks to supercharge AI workflows. ⚡ #CUDA will soon be at the heart of Databricks' Data Intelligence Platform, starting with AI-accelerated Photon, delivering improved speed and efficiency for customers’ data warehousing and analytics workflows.

We are teaming up with @Databricks to supercharge AI workflows. ⚡ #CUDA will soon be at the heart of Databricks' Data Intelligence Platform, starting with AI-accelerated Photon, delivering improved speed and efficiency for customers’ data warehousing and analytics workflows.

NVIDIA AI Developer

22,927 views • 1 year ago