Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

NVIDIA has open-sourced SONIC, a humanoid behavior foundation model that gives robots a core set of motor skills learned from large-scale human motion data.

TheHumanoidHub's profile picture

The Humanoid Hub

103,438 subscribers

33,542 Aufrufe • vor 3 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Earlier this year, AgiBot open-sourced a large-scale dataset of real-world humanoid robot tasks. Now, they've announced AgiBot Digital World, a large-scale simulation framework that includes an open-sourced dataset covering 180+ object categories and 12 core skills.
2:25

Earlier this year, AgiBot open-sourced a large-scale dataset of real-world humanoid robot tasks. Now, they've announced AgiBot Digital World, a large-scale simulation framework that includes an open-sourced dataset covering 180+ object categories and 12 core skills.

The Humanoid Hub

43,709 Aufrufe • vor 1 Jahr

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos
1:21

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos

AK

38,690 Aufrufe • vor 3 Monaten

Scientists developed HumanX, a system that lets humanoid robots learn new skills by watching just one short human video. It learns directly from demonstrations instead of large datasets or complex training rewards. Using this, the Unitree G1 humanoid robot learned 10 different real-world skills without extra training.
0:34

Scientists developed HumanX, a system that lets humanoid robots learn new skills by watching just one short human video. It learns directly from demonstrations instead of large datasets or complex training rewards. Using this, the Unitree G1 humanoid robot learned 10 different real-world skills without extra training.

Space and Technology

27,686 Aufrufe • vor 1 Monat

Want to experience humanoid behavior foundation model in your browser? SONIC Web demo now live at Featuring: - Motion tracking - Text to motion using Kimodo Try it out!
1:00

Want to experience humanoid behavior foundation model in your browser? SONIC Web demo now live at Featuring: - Motion tracking - Text to motion using Kimodo Try it out!

Zhengyi “Zen” Luo

38,188 Aufrufe • vor 1 Monat

Can we use wearable devices to collect robot data without actual robots? Yes! With a pair of gloves🧤! Introducing DexCap, a portable hand motion capture system that collects 3D data (point cloud + finger motion) for training robots with dexterous hands Everything open-sourced
1:42

Can we use wearable devices to collect robot data without actual robots? Yes! With a pair of gloves🧤! Introducing DexCap, a portable hand motion capture system that collects 3D data (point cloud + finger motion) for training robots with dexterous hands Everything open-sourced

Chen Wang

234,658 Aufrufe • vor 2 Jahren

Nvidia CEO Jensen Huang debuts Groot N1, a general-purpose foundation model for humanoid robots, in Disney’s BDX Droids at GTC 2025
1:02

Nvidia CEO Jensen Huang debuts Groot N1, a general-purpose foundation model for humanoid robots, in Disney’s BDX Droids at GTC 2025

TechCrunch

62,891 Aufrufe • vor 1 Jahr

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.
0:58

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

The Humanoid Hub

46,715 Aufrufe • vor 1 Jahr

NVIDIA just announced EgoScale 🤖🧠 NVIDIA Research has uncovered a log-linear scaling law for robot dexterity by pretraining VLA models on over 20,000 hours of egocentric human video This massive dataset is 20 times larger than previous efforts and proves that robot intelligence follows a predictable path: the more human data, the lower the loss The secret is a simple recipe combining large-scale human pretraining with a small amount of aligned human-robot mid-training to bridge the gap In testing, this method boosted the average success rate by 54% on a 22-DoF robotic hand compared to policies built without pretraining EgoScale also enables one-shot task adaptation and works across different hardware, suggesting that human motion is a universal motor prior for robots Website: Paper: Source: NVIDIA Research #Robot #Humanoid #Robotics #AI #EmbodiedAI #PhysicalAI #NVIDIA #EgoScale #GR00T
1:25

NVIDIA just announced EgoScale 🤖🧠 NVIDIA Research has uncovered a log-linear scaling law for robot dexterity by pretraining VLA models on over 20,000 hours of egocentric human video This massive dataset is 20 times larger than previous efforts and proves that robot intelligence follows a predictable path: the more human data, the lower the loss The secret is a simple recipe combining large-scale human pretraining with a small amount of aligned human-robot mid-training to bridge the gap In testing, this method boosted the average success rate by 54% on a 22-DoF robotic hand compared to policies built without pretraining EgoScale also enables one-shot task adaptation and works across different hardware, suggesting that human motion is a universal motor prior for robots Website: Paper: Source: NVIDIA Research #Robot #Humanoid #Robotics #AI #EmbodiedAI #PhysicalAI #NVIDIA #EgoScale #GR00T

RoboHub🤖

43,631 Aufrufe • vor 3 Monaten

Introduce HumanPlus - Autonomous Skills part Humanoids are born for using human data. Imitating humans, our humanoid learns: - fold sweatshirts - unload objects from warehouse racks - diverse locomotion skills (squatting, jumping, standing) - greet another robot Open-sourced!
0:46

Introduce HumanPlus - Autonomous Skills part Humanoids are born for using human data. Imitating humans, our humanoid learns: - fold sweatshirts - unload objects from warehouse racks - diverse locomotion skills (squatting, jumping, standing) - greet another robot Open-sourced!

Zipeng Fu

158,126 Aufrufe • vor 2 Jahren

🔥 INTERESTING: A humanoid robot learned tennis from just 5 hours of motion data, now rallying at 90% success.
1:31

🔥 INTERESTING: A humanoid robot learned tennis from just 5 hours of motion data, now rallying at 90% success.

Cointelegraph

127,875 Aufrufe • vor 2 Monaten

Humanoid robotics is entering a new phase： Xiaomi Robotics 0 (XR-0) explores learning manipulation directly from large-scale human videos — aligning video understanding with robot embodiment to generate executable actions. Watch humans->learn representations ->map to robot control. Robot data is scarce. Internet video is not. If video pretraining transfers reliably into embodied control, the scaling law of robotics changes. Deployment speed becomes a function of model alignment, not just hardware iteration. We’re moving from engineered skills to learned behavior. That’s a structural shift. project:
0:52

Humanoid robotics is entering a new phase： Xiaomi Robotics 0 (XR-0) explores learning manipulation directly from large-scale human videos — aligning video understanding with robot embodiment to generate executable actions. Watch humans->learn representations ->map to robot control. Robot data is scarce. Internet video is not. If video pretraining transfers reliably into embodied control, the scaling law of robotics changes. Deployment speed becomes a function of model alignment, not just hardware iteration. We’re moving from engineered skills to learned behavior. That’s a structural shift. project:

CyberRobo

18,356 Aufrufe • vor 3 Monaten

Remarkably lifelike motion and fluidity. BeyondMimic is a framework for training humanoid whole-body control from large mocap datasets. First, an open-source motion-tracking pipeline to reproduce diverse, highly dynamic human skills on real hardware, then distilling them into a guided state-action diffusion model for zero-shot, task-specific control. Project page:
2:42

Remarkably lifelike motion and fluidity. BeyondMimic is a framework for training humanoid whole-body control from large mocap datasets. First, an open-source motion-tracking pipeline to reproduce diverse, highly dynamic human skills on real hardware, then distilling them into a guided state-action diffusion model for zero-shot, task-specific control. Project page:

The Humanoid Hub

58,081 Aufrufe • vor 9 Monaten

Figure has finally unveiled its F.03 fleet. This marks their first large-scale physical demonstration of their humanoid robots. Brett states that a humanoid robot is now rolling off the assembly line every hour.
0:55

Figure has finally unveiled its F.03 fleet. This marks their first large-scale physical demonstration of their humanoid robots. Brett states that a humanoid robot is now rolling off the assembly line every hour.

CyberRobo

94,687 Aufrufe • vor 1 Monat

How can we build a general-purpose “foundation model” for robot motion? Zhengyi “Zen” Luo joins us to talk about SONIC, which uses motion tracking as a foundational task for humanoid robot control, and scales humanoid control training to 9k GPU hours and 100 million frames worth of data. The result: a model with a generally-useful embedding space that can be controlled by a VLA, or from human video, to perform a wide variety of humanoid whole-body-control tasks, including with zero-shot transfer to previously unseen motions. Watch episode 72 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan, now!
59:44

How can we build a general-purpose “foundation model” for robot motion? Zhengyi “Zen” Luo joins us to talk about SONIC, which uses motion tracking as a foundational task for humanoid robot control, and scales humanoid control training to 9k GPU hours and 100 million frames worth of data. The result: a model with a generally-useful embedding space that can be controlled by a VLA, or from human video, to perform a wide variety of humanoid whole-body-control tasks, including with zero-shot transfer to previously unseen motions. Watch episode 72 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan, now!

RoboPapers

24,649 Aufrufe • vor 1 Monat

Meta PARTNR is a research framework supporting seamless human-robot collaboration. Building on our research with Habitat, we’re open sourcing a large-scale benchmark, dataset and large planning model that we hope will enable the community to effectively train social robots.
2:46

Meta PARTNR is a research framework supporting seamless human-robot collaboration. Building on our research with Habitat, we’re open sourcing a large-scale benchmark, dataset and large planning model that we hope will enable the community to effectively train social robots.

AI at Meta

106,792 Aufrufe • vor 1 Jahr

HumanX: a scalable framework that converts single monocular human videos into agile, generalizable interaction skills for humanoid robots without task-specific rewards. Core parts: - XGen: retargets human motion + synthesizes diverse physically plausible training data (via physics-driven object trajectories and augmentation). - XMimic: unified imitation pipeline for robust generalization. Shows promising results for both Blind (no external sensors) and MoCap modes.
1:08

HumanX: a scalable framework that converts single monocular human videos into agile, generalizable interaction skills for humanoid robots without task-specific rewards. Core parts: - XGen: retargets human motion + synthesizes diverse physically plausible training data (via physics-driven object trajectories and augmentation). - XMimic: unified imitation pipeline for robust generalization. Shows promising results for both Blind (no external sensors) and MoCap modes.

The Humanoid Hub

20,358 Aufrufe • vor 4 Monaten

German robotics company NEURA Robotics has created NEURA Gym: a large-scale, physical AI gym and training ground where hundreds of robots, including the humanoid 4NE-1, learn through real-world interactions. The company is collaborating with the Neuraverse ecosystem to create the world's largest repository of physical training data, promoting the application of humanoid robots.
1:39

German robotics company NEURA Robotics has created NEURA Gym: a large-scale, physical AI gym and training ground where hundreds of robots, including the humanoid 4NE-1, learn through real-world interactions. The company is collaborating with the Neuraverse ecosystem to create the world's largest repository of physical training data, promoting the application of humanoid robots.

CyberRobo

71,698 Aufrufe • vor 7 Monaten

Unitree Humanoid Robots Updated With Open-Source Full-Body Motion Dataset 🤗 We’ve adapted motion capture data for Unitree H1, H1-2, and G1 humanoid robots, using numerical optimization methods to make their movement trajectories more natural. Open-Source： #AI #OpenSourceDataset #Unitree #EmbodiedAI #Humanoid #DataCollection #AGI #Dance
1:04

Unitree Humanoid Robots Updated With Open-Source Full-Body Motion Dataset 🤗 We’ve adapted motion capture data for Unitree H1, H1-2, and G1 humanoid robots, using numerical optimization methods to make their movement trajectories more natural. Open-Source： #AI #OpenSourceDataset #Unitree #EmbodiedAI #Humanoid #DataCollection #AGI #Dance

Unitree

197,278 Aufrufe • vor 1 Jahr

Jensen Huang open-sourced NVIDIA's flagship AI model, its weights, its data, AND how they created it. "We open sourced the models," Huang says. "We open sourced the weights." "We open sourced the data." "We open sourced how we created it." Four layers of openness in one model release. "Open source is fundamentally necessary for many industries to join the AI revolution." "NVIDIA has the scale and the motivation to build and continue to build these AI models for as long as we shall live." The chip seller benefits when every model is open. NVIDIA is the chip seller. P.S. I made a playbook breaking down 100+ most powerful decision making mental models used by history's greatest thinkers. 5,000+ downloads. 113 five-star reviews. Grab a free copy here: If you're new here, follow GeniusThinking for content on the greatest minds in economics, psychology, and history. — Jensen Huang ( NVIDIA ), NVIDIA CEO, on Lex Fridman's ( Lex Fridman ) podcast
1:29

Jensen Huang open-sourced NVIDIA's flagship AI model, its weights, its data, AND how they created it. "We open sourced the models," Huang says. "We open sourced the weights." "We open sourced the data." "We open sourced how we created it." Four layers of openness in one model release. "Open source is fundamentally necessary for many industries to join the AI revolution." "NVIDIA has the scale and the motivation to build and continue to build these AI models for as long as we shall live." The chip seller benefits when every model is open. NVIDIA is the chip seller. P.S. I made a playbook breaking down 100+ most powerful decision making mental models used by history's greatest thinkers. 5,000+ downloads. 113 five-star reviews. Grab a free copy here: If you're new here, follow GeniusThinking for content on the greatest minds in economics, psychology, and history. — Jensen Huang ( NVIDIA ), NVIDIA CEO, on Lex Fridman's ( Lex Fridman ) podcast

GeniusThinking

12,548 Aufrufe • vor 1 Tag

We discovered an emergent property of VLAs like π0/π0.5/π0.6: as we scale up pre-training, the model learns to align human videos and robot data! This gives us a simple way to leverage human videos. Once π0.5 knows how to control robots, it can naturally learn from human video.
2:02

We discovered an emergent property of VLAs like π0/π0.5/π0.6: as we scale up pre-training, the model learns to align human videos and robot data! This gives us a simple way to leverage human videos. Once π0.5 knows how to control robots, it can naturally learn from human video.

Physical Intelligence

1,181,036 Aufrufe • vor 5 Monaten