NVIDIA DROPPED A MOTION DIFFUSION MODEL FOR HUMANOID ROBOTS... trained on 700 hours of mocap data kimodo generates high-quality 3D human and robot motions from text prompts you control it with: → full-body pose keyframes → end-effector positions/rotations → 2D paths and waypoints works on human skeletons and unitree G1 robot plug the outputs directly into mujoco or retarget to other robots using GMR has a web-based interactive demo with a timeline editor. runs locally needs ~17GB VRAM to run inference open source under apache 2.0show more

NVIDIA's Kimodo is the release of the week 🔥... Prompt the timeline whatever your want like: "a person walks forward" → "a person starts jumping", hit Generate, and watch a 3D character do it in seconds (700hrs of pro mocap training. Works on human + robot skeletons. Super fast + free to use on HF)show more

Turns out you can train humanoid hands without any... robot data. The idea in HUG is quite simple: (a) collect human data with smart glasses, (b) train a human manipulation model, (c) retarget to multi-fingered robot hands.show more

AI Animation runs now free & local without your... GPU! Nvidia Kimodo CPP enables you to run Ai animation locally. You can create animations via text prompts, chaining different prompts together and retarget the movement to your 3D Character shoutout to Richard Palethorpe for developing the toolshow more

NVIDIA announces the first open humanoid robot reference design... built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:show more

How can we leverage diverse human videos to improve... robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.show more

SAM 3D Body is open-source, so it can be... run locally or on Comfy Cloud. Extract motion from a recording → bring it into Blender → control the camera → use the result with Seedance 2.5 More control over body motion and camera movement. To try this workflows, links below 👇show more

SAM 3D Body is a CVPR 2026 award candidate... paper from AI at Meta model recovers a full 3D human body mesh from a single RGB image you can run it automatically, or guide the reconstruction with masks and 2D keypoints thx to Niels Rogge for awesome demo ideashow more

Announcing the OpenMind BrainPack, launching today. What you can... get: - BrainPack: Our hardware add-on to robots, giving them autonomous features - NVIDIA Thor GPU - UniTree Go2 Robot Dog or UniTree G1 Humanoid - OM1 Credits Pre-order today:show more

🤖 INTERESTING: Unitree Robotics’ G1 humanoid robot played table... tennis against a human during a live demo in Hangzhou, China.show more

SAM 3D Body turns video into motion capture, full-body... 3D mesh from footage. Runs in ComfyUI, locally or on Comfy Cloud. Extract motion from a recording → bring it into Blender → control the camera → use the result with Seedance 2.5 More control over body motion and camera movement. To try this workflows, link below 👇show more

What does a real humanoid robotics dataset actually look... like? Humanoid robots are expensive and complex, which makes their data unusually difficult to collect - and difficult for most people to get hands-on experience with. We previously shared a post on conversion code for the new Human in the Wild dataset by BitRobot 🦾, Hugging Face, and Unitree. Now we’re publishing the full HIW-500 data converted to RRD, so you can explore that data directly with Rerun. Watch the robot move. Inspect cameras and robot states together. Zoom in on a moment and query episodes through Rerun catalog! If you’re curious about a real-world humanoid dataset, HIW-500 is now a lot easier to explore. We share the conversion code along with our previous abc-130k dataset conversion example.show more

ViewCrafter can generate high-quality 3D views from single or... few images using a video diffusion model! It allows for precise camera control and is useful for real-time rendering and turning text into 3D scenes. Links ⬇️show more

Pi Ventures-Backed OpenMind Opens Waitlist For Humanoid Robot Control... Pi Network (Pi Network) Ventures backed OpenMind (OpenMind) has opened the waitlist for Instabody, a platform that lets users remotely control a real humanoid robot. The company said users can see the world through the robot's eyes and directly control its movements. It believes giving people the controls will help shape how robots evolve. OpenMind previously launched a robot app store built on its OM1 operating system, allowing developers to add new skills to humanoid and quadruped robots.show more

Wow Nvidia has just released a tool to turn... any image into an explorable 3D world And they made it 100% open source 🔥 - Model available on Hugging Face - UI code available on GitHub Lyra 2.0 creates a world you can walk through, turn around in, and even drop a robot into for simulation.show more

We’ve seen humanoid robots walk around for a while,... but when will they actually help with useful tasks in daily life? The challenge here is the diversity and complexity of real-world scenes. Our new work tackles this problem via 3D visuomotor policy learning. Using data from only 1 scene, our Improved 3D Diffusion Policy (iDP3) enables a full-sized humanoid robot to autonomously pick&place objects, pour water, and wipe tables, in the wild open world. (and all these skills are useful, right?) Web: Fully open-sourced code:show more

Super excited about Hydra-0 from Hongyu Li and team!... The key idea is to use flow as a shared visual interface across embodiments/objects for controllable video generation, allowing a single generalist world model to learn from human, handheld-gripper, and robot interaction data. My favorite result is the video below: start from a real video of a human doing the task (left), extract the desired object flow, and condition the model on that flow (right). The model then hallucinates a plausible robot motion that could produce the same object motion. Very cool glimpse of how a generalist world model can bridge human demonstrations and robot control.show more

Controlling a CM6 robot with a LEAP motion controller.... J2 of the robot is a bit underpowered but we mainly tested our algorithm here that we will implement on our other robots. Data is shared at 125Hz between robot and Leap over local network.show more

Excited to share our #CoRL2024 paper on humanoid motion... generation! Combining human motion priors with VLM feedback, Harmon generates natural, expressive, and text-aligned humanoid motion from freeform text descriptions. 👇(1/4)show more

Announcing our commercial partnership with Booster Robotics Booster builds... humanoid robot hardware, OS, and developer tools to make humanoid robots more affordable, reliable, and practical. The partnership centers on using simulation to multiply the value of real-robot data—expanding teleoperation demonstrations into scalable training data across diverse tasks and scenes. This joint effort powers sim-real co-training and foundation-model development, accelerating progress from hardware iteration to deployable robot policies. Together, we're building simulation‑powered data infrastructure for Physical AI — making scalable training data accessible to model developers and the broader robotics ecosystem.show more

Early results from my AI training runs. I've trained... my $200 robot arm on a simple picking task using imitation learning. It has learned to control the robot arm using only camera images and joint states.show more