Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

NVIDIA DROPPED A MOTION DIFFUSION MODEL FOR HUMANOID ROBOTS trained on 700 hours of mocap data kimodo generates high-quality 3D human and robot motions from text prompts you control it with: → full-body pose keyframes → end-effector positions/rotations → 2D paths and waypoints works on human skeletons and unitree... show more

Vaishnavi

20,272 subscribers

17,495 views • 1 month ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

NVIDIA's Kimodo is the release of the week 🔥 Prompt the timeline whatever your want like: "a person walks forward" → "a person starts jumping", hit Generate, and watch a 3D character do it in seconds (700hrs of pro mocap training. Works on human + robot skeletons. Super fast + free to use on HF)

NVIDIA's Kimodo is the release of the week 🔥 Prompt the timeline whatever your want like: "a person walks forward" → "a person starts jumping", hit Generate, and watch a 3D character do it in seconds (700hrs of pro mocap training. Works on human + robot skeletons. Super fast + free to use on HF)

Victor M

417,969 views • 2 months ago

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:

NVIDIA Robotics

156,830 views • 6 days ago

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.

Ruihan Yang

58,591 views • 10 months ago

SAM 3D Body is a CVPR 2026 award candidate paper from AI at Meta model recovers a full 3D human body mesh from a single RGB image you can run it automatically, or guide the reconstruction with masks and 2D keypoints thx to Niels Rogge for awesome demo idea

SAM 3D Body is a CVPR 2026 award candidate paper from AI at Meta model recovers a full 3D human body mesh from a single RGB image you can run it automatically, or guide the reconstruction with masks and 2D keypoints thx to Niels Rogge for awesome demo idea

SkalskiP @ CVPR2026

69,316 views • 3 days ago

Announcing the OpenMind BrainPack, launching today. What you can get: - BrainPack: Our hardware add-on to robots, giving them autonomous features - NVIDIA Thor GPU - UniTree Go2 Robot Dog or UniTree G1 Humanoid - OM1 Credits Pre-order today:

Announcing the OpenMind BrainPack, launching today. What you can get: - BrainPack: Our hardware add-on to robots, giving them autonomous features - NVIDIA Thor GPU - UniTree Go2 Robot Dog or UniTree G1 Humanoid - OM1 Credits Pre-order today:

OpenMind

335,410 views • 6 months ago

🤖 INTERESTING: Unitree Robotics’ G1 humanoid robot played table tennis against a human during a live demo in Hangzhou, China.

🤖 INTERESTING: Unitree Robotics’ G1 humanoid robot played table tennis against a human during a live demo in Hangzhou, China.

Cointelegraph

50,086 views • 15 days ago

We’ve seen humanoid robots walk around for a while, but when will they actually help with useful tasks in daily life? The challenge here is the diversity and complexity of real-world scenes. Our new work tackles this problem via 3D visuomotor policy learning. Using data from only 1 scene, our Improved 3D Diffusion Policy (iDP3) enables a full-sized humanoid robot to autonomously pick&place objects, pour water, and wipe tables, in the wild open world. (and all these skills are useful, right?) Web: Fully open-sourced code:

We’ve seen humanoid robots walk around for a while, but when will they actually help with useful tasks in daily life? The challenge here is the diversity and complexity of real-world scenes. Our new work tackles this problem via 3D visuomotor policy learning. Using data from only 1 scene, our Improved 3D Diffusion Policy (iDP3) enables a full-sized humanoid robot to autonomously pick&place objects, pour water, and wipe tables, in the wild open world. (and all these skills are useful, right?) Web: Fully open-sourced code:

Yanjie Ze

75,194 views • 1 year ago

Controlling a CM6 robot with a LEAP motion controller. J2 of the robot is a bit underpowered but we mainly tested our algorithm here that we will implement on our other robots. Data is shared at 125Hz between robot and Leap over local network.

Controlling a CM6 robot with a LEAP motion controller. J2 of the robot is a bit underpowered but we mainly tested our algorithm here that we will implement on our other robots. Data is shared at 125Hz between robot and Leap over local network.

SourceRobotics

14,433 views • 1 year ago

Excited to share our #CoRL2024 paper on humanoid motion generation! Combining human motion priors with VLM feedback, Harmon generates natural, expressive, and text-aligned humanoid motion from freeform text descriptions. 👇(1/4)

Excited to share our #CoRL2024 paper on humanoid motion generation! Combining human motion priors with VLM feedback, Harmon generates natural, expressive, and text-aligned humanoid motion from freeform text descriptions. 👇(1/4)

Zhenyu Jiang

36,830 views • 1 year ago

Early results from my AI training runs. I've trained my $200 robot arm on a simple picking task using imitation learning. It has learned to control the robot arm using only camera images and joint states.

Early results from my AI training runs. I've trained my $200 robot arm on a simple picking task using imitation learning. It has learned to control the robot arm using only camera images and joint states.

Alexander Koch

330,559 views • 2 years ago

hi all, excited to join! i'm building an expressive mini "shoggoth" robot which will eventually be hooked up to gpt4o realtime voice. i'm currently working on the low-level policies, which are trained in a mujoco simulation with RL. to delay working on raw-pixels for now, i trained a pose-estimation model using deeplabcut and triangulate the position in 3d space using the stereo cameras. eventually, i'll use gpt4o's tool calling capabilities to activate several of these policies (closed and open loop) based on the dialog flow! captions: manual actuation of the tentacle / 3d pose estimation / target design

hi all, excited to join! i'm building an expressive mini "shoggoth" robot which will eventually be hooked up to gpt4o realtime voice. i'm currently working on the low-level policies, which are trained in a mujoco simulation with RL. to delay working on raw-pixels for now, i trained a pose-estimation model using deeplabcut and triangulate the position in 3d space using the stereo cameras. eventually, i'll use gpt4o's tool calling capabilities to activate several of these policies (closed and open loop) based on the dialog flow! captions: manual actuation of the tentacle / 3d pose estimation / target design

Matthieu LC

45,506 views • 1 year ago

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!

Lukas Ziegler

37,221 views • 9 months ago

Describe a part → get a 3D model. text-to-cad Open source harness that lets coding agents generate CAD: • STEP, STL, 3MF, DXF • URDF + robot motion • geometry-aware edits Runs locally. No backend. Explore more:

Describe a part → get a 3D model. text-to-cad Open source harness that lets coding agents generate CAD: • STEP, STL, 3MF, DXF • URDF + robot motion • geometry-aware edits Runs locally. No backend. Explore more:

GitHub Projects Community

21,520 views • 1 month ago

Unitree humanoid robot boxing match vs a human

Unitree humanoid robot boxing match vs a human

KABClub

25,869 views • 6 months ago

New open-source library speeds up whole-body imitation learning. Train the policy below in under 20 minutes ⬇️ LocoMuJoCo2 brings biomechanics and humanoid robotics into one clean, high-speed benchmark. Built for researchers who want to train smarter and faster. What it offers ✅ 22K+ motion trajectories per humanoid model ✅ Supports both MuJoCo and MJX ✅ JAX-based PPO, GAIL, AMP, DeepMimic implementations ✅ Plug-and-play robot2robot retargeting pipeline Whether you’re building humanoids or studying human motion, this toolkit saves you weeks of setup. Github: Thank you, Firas Al-Hafez for sharing this great work!

New open-source library speeds up whole-body imitation learning. Train the policy below in under 20 minutes ⬇️ LocoMuJoCo2 brings biomechanics and humanoid robotics into one clean, high-speed benchmark. Built for researchers who want to train smarter and faster. What it offers ✅ 22K+ motion trajectories per humanoid model ✅ Supports both MuJoCo and MJX ✅ JAX-based PPO, GAIL, AMP, DeepMimic implementations ✅ Plug-and-play robot2robot retargeting pipeline Whether you’re building humanoids or studying human motion, this toolkit saves you weeks of setup. Github: Thank you, Firas Al-Hafez for sharing this great work!

Ilir Aliu

23,122 views • 1 year ago

🚀 ASAP is now FULLY open-source! 🚀 ✅ Humanoid RL motion tracking & delta actions ✅ Motion retargeting to any humanoid ✅ ASAP Benchmark motions + pretrained policies ✅ Sim2Sim & Sim2Real ready — run ASAP in sim or on your G1 robot! 🔗 🎥👇

🚀 ASAP is now FULLY open-source! 🚀 ✅ Humanoid RL motion tracking & delta actions ✅ Motion retargeting to any humanoid ✅ ASAP Benchmark motions + pretrained policies ✅ Sim2Sim & Sim2Real ready — run ASAP in sim or on your G1 robot! 🔗 🎥👇

Tairan He

39,412 views • 9 months ago

A new wheeled humanoid robot DARWIN-01 From Shenzhen Standard Robotics. This is a humanoid robot for industrial manufacturing and warehouses. The foldable body can adapt to a variety of spatial operations, and the end effector can also be switched to adapt to personalized business goals. The maximum load is 10kg. The universal wheels can shuttle between shelves, workshops and assembly lines at will, with a speed greater than 2m/s. Automatic charging or battery replacement, with a battery life of 12 hours.

A new wheeled humanoid robot DARWIN-01 From Shenzhen Standard Robotics. This is a humanoid robot for industrial manufacturing and warehouses. The foldable body can adapt to a variety of spatial operations, and the end effector can also be switched to adapt to personalized business goals. The maximum load is 10kg. The universal wheels can shuttle between shelves, workshops and assembly lines at will, with a speed greater than 2m/s. Automatic charging or battery replacement, with a battery life of 12 hours.

CyberRobo

39,350 views • 1 year ago

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.

Physical Intelligence

120,595 views • 5 months ago

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉

NVIDIA

48,500 views • 8 months ago

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.

MrNeRF

24,580 views • 10 months ago