Загрузка видео...

Не удалось загрузить видео

На главную

NVIDIA DROPPED A MOTION DIFFUSION MODEL FOR HUMANOID ROBOTS trained on 700 hours of mocap data kimodo generates high-quality 3D human and robot motions from text prompts you control it with: → full-body pose keyframes → end-effector positions/rotations → 2D paths and waypoints works on human skeletons and unitree...

_vmlops's profile picture

Vaishnavi

20,435 subscribers

17,520 просмотров • 1 месяц назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

NVIDIA's Kimodo is the release of the week 🔥 Prompt the timeline whatever your want like: "a person walks forward" → "a person starts jumping", hit Generate, and watch a 3D character do it in seconds (700hrs of pro mocap training. Works on human + robot skeletons. Super fast + free to use on HF)
0:13

NVIDIA's Kimodo is the release of the week 🔥 Prompt the timeline whatever your want like: "a person walks forward" → "a person starts jumping", hit Generate, and watch a 3D character do it in seconds (700hrs of pro mocap training. Works on human + robot skeletons. Super fast + free to use on HF)

Victor M

418,276 просмотров • 2 месяцев назад

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:
0:20

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:

NVIDIA Robotics

160,607 просмотров • 14 дней назад

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.
0:14

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.

Ruihan Yang

58,591 просмотров • 10 месяцев назад

SAM 3D Body is a CVPR 2026 award candidate paper from AI at Meta model recovers a full 3D human body mesh from a single RGB image you can run it automatically, or guide the reconstruction with masks and 2D keypoints thx to Niels Rogge for awesome demo idea
0:13

SAM 3D Body is a CVPR 2026 award candidate paper from AI at Meta model recovers a full 3D human body mesh from a single RGB image you can run it automatically, or guide the reconstruction with masks and 2D keypoints thx to Niels Rogge for awesome demo idea

SkalskiP

71,212 просмотров • 11 дней назад

Announcing the OpenMind BrainPack, launching today. What you can get: - BrainPack: Our hardware add-on to robots, giving them autonomous features - NVIDIA Thor GPU - UniTree Go2 Robot Dog or UniTree G1 Humanoid - OM1 Credits Pre-order today:
0:13

Announcing the OpenMind BrainPack, launching today. What you can get: - BrainPack: Our hardware add-on to robots, giving them autonomous features - NVIDIA Thor GPU - UniTree Go2 Robot Dog or UniTree G1 Humanoid - OM1 Credits Pre-order today:

OpenMind

335,587 просмотров • 6 месяцев назад

🤖 INTERESTING: Unitree Robotics’ G1 humanoid robot played table tennis against a human during a live demo in Hangzhou, China.
0:16

🤖 INTERESTING: Unitree Robotics’ G1 humanoid robot played table tennis against a human during a live demo in Hangzhou, China.

Cointelegraph

50,104 просмотров • 23 дней назад

Controlling a CM6 robot with a LEAP motion controller. J2 of the robot is a bit underpowered but we mainly tested our algorithm here that we will implement on our other robots. Data is shared at 125Hz between robot and Leap over local network.
0:17

Controlling a CM6 robot with a LEAP motion controller. J2 of the robot is a bit underpowered but we mainly tested our algorithm here that we will implement on our other robots. Data is shared at 125Hz between robot and Leap over local network.

SourceRobotics

14,433 просмотров • 1 год назад

We’ve seen humanoid robots walk around for a while, but when will they actually help with useful tasks in daily life? The challenge here is the diversity and complexity of real-world scenes. Our new work tackles this problem via 3D visuomotor policy learning. Using data from only 1 scene, our Improved 3D Diffusion Policy (iDP3) enables a full-sized humanoid robot to autonomously pick&place objects, pour water, and wipe tables, in the wild open world. (and all these skills are useful, right?) Web: Fully open-sourced code:
0:18

We’ve seen humanoid robots walk around for a while, but when will they actually help with useful tasks in daily life? The challenge here is the diversity and complexity of real-world scenes. Our new work tackles this problem via 3D visuomotor policy learning. Using data from only 1 scene, our Improved 3D Diffusion Policy (iDP3) enables a full-sized humanoid robot to autonomously pick&place objects, pour water, and wipe tables, in the wild open world. (and all these skills are useful, right?) Web: Fully open-sourced code:

Yanjie Ze

75,194 просмотров • 1 год назад

Excited to share our #CoRL2024 paper on humanoid motion generation! Combining human motion priors with VLM feedback, Harmon generates natural, expressive, and text-aligned humanoid motion from freeform text descriptions. 👇(1/4)
0:14

Excited to share our #CoRL2024 paper on humanoid motion generation! Combining human motion priors with VLM feedback, Harmon generates natural, expressive, and text-aligned humanoid motion from freeform text descriptions. 👇(1/4)

Zhenyu Jiang

36,830 просмотров • 1 год назад

Early results from my AI training runs. I've trained my $200 robot arm on a simple picking task using imitation learning. It has learned to control the robot arm using only camera images and joint states.
0:18

Early results from my AI training runs. I've trained my $200 robot arm on a simple picking task using imitation learning. It has learned to control the robot arm using only camera images and joint states.

Alexander Koch

330,566 просмотров • 2 лет назад

Unitree humanoid robot boxing match vs a human
0:12

Unitree humanoid robot boxing match vs a human

KABClub

25,869 просмотров • 6 месяцев назад

hi all, excited to join! i'm building an expressive mini "shoggoth" robot which will eventually be hooked up to gpt4o realtime voice. i'm currently working on the low-level policies, which are trained in a mujoco simulation with RL. to delay working on raw-pixels for now, i trained a pose-estimation model using deeplabcut and triangulate the position in 3d space using the stereo cameras. eventually, i'll use gpt4o's tool calling capabilities to activate several of these policies (closed and open loop) based on the dialog flow! captions: manual actuation of the tentacle / 3d pose estimation / target design
0:29

hi all, excited to join! i'm building an expressive mini "shoggoth" robot which will eventually be hooked up to gpt4o realtime voice. i'm currently working on the low-level policies, which are trained in a mujoco simulation with RL. to delay working on raw-pixels for now, i trained a pose-estimation model using deeplabcut and triangulate the position in 3d space using the stereo cameras. eventually, i'll use gpt4o's tool calling capabilities to activate several of these policies (closed and open loop) based on the dialog flow! captions: manual actuation of the tentacle / 3d pose estimation / target design

Matthieu LC

45,506 просмотров • 1 год назад

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!
0:18

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!

Lukas Ziegler

37,221 просмотров • 9 месяцев назад

Describe a part → get a 3D model. text-to-cad Open source harness that lets coding agents generate CAD: • STEP, STL, 3MF, DXF • URDF + robot motion • geometry-aware edits Runs locally. No backend. Explore more:
0:18

Describe a part → get a 3D model. text-to-cad Open source harness that lets coding agents generate CAD: • STEP, STL, 3MF, DXF • URDF + robot motion • geometry-aware edits Runs locally. No backend. Explore more:

GitHub Projects Community

21,520 просмотров • 1 месяц назад

🚀 ASAP is now FULLY open-source! 🚀 ✅ Humanoid RL motion tracking & delta actions ✅ Motion retargeting to any humanoid ✅ ASAP Benchmark motions + pretrained policies ✅ Sim2Sim & Sim2Real ready — run ASAP in sim or on your G1 robot! 🔗 🎥👇
0:12

🚀 ASAP is now FULLY open-source! 🚀 ✅ Humanoid RL motion tracking & delta actions ✅ Motion retargeting to any humanoid ✅ ASAP Benchmark motions + pretrained policies ✅ Sim2Sim & Sim2Real ready — run ASAP in sim or on your G1 robot! 🔗 🎥👇

Tairan He

39,412 просмотров • 10 месяцев назад

New open-source library speeds up whole-body imitation learning. Train the policy below in under 20 minutes ⬇️ LocoMuJoCo2 brings biomechanics and humanoid robotics into one clean, high-speed benchmark. Built for researchers who want to train smarter and faster. What it offers ✅ 22K+ motion trajectories per humanoid model ✅ Supports both MuJoCo and MJX ✅ JAX-based PPO, GAIL, AMP, DeepMimic implementations ✅ Plug-and-play robot2robot retargeting pipeline Whether you’re building humanoids or studying human motion, this toolkit saves you weeks of setup. Github: Thank you, Firas Al-Hafez for sharing this great work!
0:10

New open-source library speeds up whole-body imitation learning. Train the policy below in under 20 minutes ⬇️ LocoMuJoCo2 brings biomechanics and humanoid robotics into one clean, high-speed benchmark. Built for researchers who want to train smarter and faster. What it offers ✅ 22K+ motion trajectories per humanoid model ✅ Supports both MuJoCo and MJX ✅ JAX-based PPO, GAIL, AMP, DeepMimic implementations ✅ Plug-and-play robot2robot retargeting pipeline Whether you’re building humanoids or studying human motion, this toolkit saves you weeks of setup. Github: Thank you, Firas Al-Hafez for sharing this great work!

Ilir Aliu

23,156 просмотров • 1 год назад

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.
0:10

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.

Physical Intelligence

120,595 просмотров • 6 месяцев назад

A new wheeled humanoid robot DARWIN-01 From Shenzhen Standard Robotics. This is a humanoid robot for industrial manufacturing and warehouses. The foldable body can adapt to a variety of spatial operations, and the end effector can also be switched to adapt to personalized business goals. The maximum load is 10kg. The universal wheels can shuttle between shelves, workshops and assembly lines at will, with a speed greater than 2m/s. Automatic charging or battery replacement, with a battery life of 12 hours.
0:18

A new wheeled humanoid robot DARWIN-01 From Shenzhen Standard Robotics. This is a humanoid robot for industrial manufacturing and warehouses. The foldable body can adapt to a variety of spatial operations, and the end effector can also be switched to adapt to personalized business goals. The maximum load is 10kg. The universal wheels can shuttle between shelves, workshops and assembly lines at will, with a speed greater than 2m/s. Automatic charging or battery replacement, with a battery life of 12 hours.

CyberRobo

39,350 просмотров • 1 год назад

In the future, it might just be humanoid robots doing the refueling!🤖⛽️ Sinopec plans to introduce humanoid robot workers across its gas stations. They will handle tasks like fueling, picking up items, restocking, and inspections,working alongside human staff, especially during peak holiday periods in China to ease service pressure. With more than 30,000 gas stations across the country (most of them equipped with convenience stores), this implies a deployment of at least 30,000 humanoid robots. The robot is a wheeled humanoid developed by Beijing-based company FIVEAGES.
0:16

In the future, it might just be humanoid robots doing the refueling!🤖⛽️ Sinopec plans to introduce humanoid robot workers across its gas stations. They will handle tasks like fueling, picking up items, restocking, and inspections,working alongside human staff, especially during peak holiday periods in China to ease service pressure. With more than 30,000 gas stations across the country (most of them equipped with convenience stores), this implies a deployment of at least 30,000 humanoid robots. The robot is a wheeled humanoid developed by Beijing-based company FIVEAGES.

CyberRobo

23,536 просмотров • 1 месяц назад

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.
0:10

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.

MrNeRF

24,729 просмотров • 11 месяцев назад