Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Deployment-Ready RL: Pitfalls, Lessons, and Best Practices We’ve published a full transcript of a webinar with Kyle🤖🚀🦭 (UT Austin) and the Humanoid team on our blog. He explores Sim2Real RL: - Action Space - Observation Space - Dealing with Model Mismatch - Reward Tuning Intuition - RL with Motion...

TheHumanoidAI's profile picture

Humanoid

2,629 subscribers

60,003 Aufrufe • vor 9 Monaten •via X (Twitter)

Wissenschaft & TechnologieNachrichten & PolitikBildung
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Excited to present FastTD3: a simple, fast, and capable off-policy RL algorithm for humanoid control -- with an open-source code to run your own humanoid RL experiments in no time! Thread below 🧵
0:25

Excited to present FastTD3: a simple, fast, and capable off-policy RL algorithm for humanoid control -- with an open-source code to run your own humanoid RL experiments in no time! Thread below 🧵

Younggyo Seo

130,877 Aufrufe • vor 1 Jahr

Meet BFM-Zero: A Promptable Humanoid Behavioral Foundation Model w/ Unsupervised RL👉 🧩ONE latent space for ALL tasks ⚡Zero-shot goal reaching, tracking, and reward optimization (any reward at test time), from ONE policy 🤖Natural recovery & transition
1:17

Meet BFM-Zero: A Promptable Humanoid Behavioral Foundation Model w/ Unsupervised RL👉 🧩ONE latent space for ALL tasks ⚡Zero-shot goal reaching, tracking, and reward optimization (any reward at test time), from ONE policy 🤖Natural recovery & transition

Yitang Li

80,758 Aufrufe • vor 7 Monaten

We developed an RL method for fine-tuning our models for precise tasks in just a few hours or even minutes. Instead of training the whole model, we add an “RL token” output to π-0.6, our latest model, which is used by a tiny actor and critic to learn quickly with RL.
2:15

We developed an RL method for fine-tuning our models for precise tasks in just a few hours or even minutes. Instead of training the whole model, we add an “RL token” output to π-0.6, our latest model, which is used by a tiny actor and critic to learn quickly with RL.

Physical Intelligence

428,837 Aufrufe • vor 2 Monaten

Sim2Real RL for Vision-Based Dexterous Manipulation on Humanoids TLDR - we train a humanoid robot with two multifingered hands to perform a range of dexterous manipulation tasks robust generalization and high performance without human demonstration :D
0:20

Sim2Real RL for Vision-Based Dexterous Manipulation on Humanoids TLDR - we train a humanoid robot with two multifingered hands to perform a range of dexterous manipulation tasks robust generalization and high performance without human demonstration :D

Toru

49,425 Aufrufe • vor 1 Jahr

Going to ICRA next week in Atlanta!! We are on a mission to build the most cracked team on humanoid robotics. Hiring the best talents on the research frontier of VLA, world models, RL, and simulation! DM or email me for meetup! linxif@nvidia.com
0:50

Going to ICRA next week in Atlanta!! We are on a mission to build the most cracked team on humanoid robotics. Hiring the best talents on the research frontier of VLA, world models, RL, and simulation! DM or email me for meetup! [email protected]

Jim Fan

130,549 Aufrufe • vor 1 Jahr

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.
0:49

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.

Qiayuan Liao

80,294 Aufrufe • vor 1 Jahr

I've long wondered if we can make a humanoid robot do a 𝘄𝗮𝗹𝗹𝗳𝗹𝗶𝗽 - and we just made it happen by leveraging 𝗢𝗺𝗻𝗶𝗥𝗲𝘁𝗮𝗿𝗴𝗲𝘁 with BeyondMimic tracking! This came after our original OmniRetarget experiments, with only minor tweaks to RL training: relaxing a termination threshold and removing one reward term. The policy achieved a 𝟱/𝟱 success rate in our real-world experiments, showing the strength of high-quality, interaction-preserving motion retargeting combined with BeyondMimic’s minimal RL tracking. Here is the updated arXiv: (In Sec. V. A)
0:20

I've long wondered if we can make a humanoid robot do a 𝘄𝗮𝗹𝗹𝗳𝗹𝗶𝗽 - and we just made it happen by leveraging 𝗢𝗺𝗻𝗶𝗥𝗲𝘁𝗮𝗿𝗴𝗲𝘁 with BeyondMimic tracking! This came after our original OmniRetarget experiments, with only minor tweaks to RL training: relaxing a termination threshold and removing one reward term. The policy achieved a 𝟱/𝟱 success rate in our real-world experiments, showing the strength of high-quality, interaction-preserving motion retargeting combined with BeyondMimic’s minimal RL tracking. Here is the updated arXiv: (In Sec. V. A)

Zhen Wu

1,050,904 Aufrufe • vor 8 Monaten

My 10-week independent project for the Northwestern University MSR (MS in Robotics) program: Northwestern Humanoid. In short, I built the humanoid robot's hardware, integrated its motors and sensors with ROS, and successfully simulated its walking using an RL policy. #Robotics
0:29

My 10-week independent project for the Northwestern University MSR (MS in Robotics) program: Northwestern Humanoid. In short, I built the humanoid robot's hardware, integrated its motors and sensors with ROS, and successfully simulated its walking using an RL policy. #Robotics

Lele Burger

37,740 Aufrufe • vor 1 Jahr

A new paper by Disney Research introduces a 2-stage technique for motion tracking in physics-based character animation, using a pretrained latent space and RL to control diverse and unseen motions on both virtual and real-world humanoid robots. Paper:
0:46

A new paper by Disney Research introduces a 2-stage technique for motion tracking in physics-based character animation, using a pretrained latent space and RL to control diverse and unseen motions on both virtual and real-world humanoid robots. Paper:

The Humanoid Hub

20,051 Aufrufe • vor 1 Jahr

🤖 Introducing H2O (Human2HumanOid): - 🧠 An RL-based human-to-humanoid real-time whole-body teleoperation framework - 💃 Scalable retargeting and training using large human motion dataset - 🎥 With just an RGB camera, everyone can teleoperate a full-sized humanoid to perform actions like pick and place, walking, kicking, boxing, etc - 💡Unleash the potential of humanoids with human cognitive skills and adaptability 🔗:
1:27

🤖 Introducing H2O (Human2HumanOid): - 🧠 An RL-based human-to-humanoid real-time whole-body teleoperation framework - 💃 Scalable retargeting and training using large human motion dataset - 🎥 With just an RGB camera, everyone can teleoperate a full-sized humanoid to perform actions like pick and place, walking, kicking, boxing, etc - 💡Unleash the potential of humanoids with human cognitive skills and adaptability 🔗:

Tairan He

96,662 Aufrufe • vor 2 Jahren

🚨 Without Any Motion Priors, how to make humanoids do versatile parkour jumping🦘, clapping dance🤸, cliff traversal🧗, and box pick-and-move📦 with a unified RL framework? Introduce WoCoCo: 🧗 Whole-body humanoid Control with sequential Contacts 🎯Unified designs for minimal tuning across tasks 🤖Generalize to various high-DoF robots Website:
0:54

🚨 Without Any Motion Priors, how to make humanoids do versatile parkour jumping🦘, clapping dance🤸, cliff traversal🧗, and box pick-and-move📦 with a unified RL framework? Introduce WoCoCo: 🧗 Whole-body humanoid Control with sequential Contacts 🎯Unified designs for minimal tuning across tasks 🤖Generalize to various high-DoF robots Website:

Wenli Xiao

70,296 Aufrufe • vor 2 Jahren

What’s Up with 4NE-1’s Knees? How Neura Robotics Is Rethinking Humanoid Bot Design 🤖 ➡️Watch full video here: Listen on Spotify: NEURA Robotics Humanoid Botangelist
2:08

What’s Up with 4NE-1’s Knees? How Neura Robotics Is Rethinking Humanoid Bot Design 🤖 ➡️Watch full video here: Listen on Spotify: NEURA Robotics Humanoid Botangelist

Marwa ElDiwiny

19,001 Aufrufe • vor 1 Jahr

In-hand cylinder rotation with RL. IROS 2025 Different sizes, zero-shot sim-to-real, and full dynamic tactile feedback — all in one hand. #Sharpa #SharpaWave #IROS2025 #Robotics #DexterousHand #Humanoid #TactileSensing #ReinforcementLearning #IssacSim
0:20

In-hand cylinder rotation with RL. IROS 2025 Different sizes, zero-shot sim-to-real, and full dynamic tactile feedback — all in one hand. #Sharpa #SharpaWave #IROS2025 #Robotics #DexterousHand #Humanoid #TactileSensing #ReinforcementLearning #IssacSim

Sharpa

112,341 Aufrufe • vor 7 Monaten

Humanoid motion tracking performance is greatly determined by retargeting quality! Introducing 𝗢𝗺𝗻𝗶𝗥𝗲𝘁𝗮𝗿𝗴𝗲𝘁🎯, generating high-quality interaction-preserving data from human motions for learning complex humanoid skills with 𝗺𝗶𝗻𝗶𝗺𝗮𝗹 RL: - 5 rewards, - 4 DR terms, - Proprio. ONLY, - NO history/curriculum. Ready for agile, human-like 🤖? (Best with 🎧) 🔗 🎥 1/9
0:54

Humanoid motion tracking performance is greatly determined by retargeting quality! Introducing 𝗢𝗺𝗻𝗶𝗥𝗲𝘁𝗮𝗿𝗴𝗲𝘁🎯, generating high-quality interaction-preserving data from human motions for learning complex humanoid skills with 𝗺𝗶𝗻𝗶𝗺𝗮𝗹 RL: - 5 rewards, - 4 DR terms, - Proprio. ONLY, - NO history/curriculum. Ready for agile, human-like 🤖? (Best with 🎧) 🔗 🎥 1/9

Zhen Wu

807,937 Aufrufe • vor 8 Monaten

Our work, "A Primer on SO(3) Action Representations in Deep Reinforcement Learning," was accepted to #ICLR2026! We provide a systematic study of action representation choices in RL, showing that they fundamentally impact training stability and performance. #Robotics #AI #RL
0:21

Our work, "A Primer on SO(3) Action Representations in Deep Reinforcement Learning," was accepted to #ICLR2026! We provide a systematic study of action representation choices in RL, showing that they fundamentally impact training stability and performance. #Robotics #AI #RL

Learning Systems and Robotics Lab (is hiring!)

49,596 Aufrufe • vor 3 Monaten

AGIBOT has launched a cloud platform that lets users upload raw videos of dance, martial arts or gestures. It captures the motion, trains an RL policy for the X2 humanoid. It also includes tools to sync voiceovers and facial expressions with choreography.
4:57

AGIBOT has launched a cloud platform that lets users upload raw videos of dance, martial arts or gestures. It captures the motion, trains an RL policy for the X2 humanoid. It also includes tools to sync voiceovers and facial expressions with choreography.

The Humanoid Hub

32,733 Aufrufe • vor 7 Monaten

PNDbotics’ humanoid Adam now walks more naturally and efficiently thanks to RL-based control.
1:18

PNDbotics’ humanoid Adam now walks more naturally and efficiently thanks to RL-based control.

The Humanoid Hub

46,003 Aufrufe • vor 1 Jahr

This is . . . how to build a humanoid. We went to Foundation Robotics and hung with Sankaet and shot the process of making a humanoid in stunning detail. Full episode right here -
0:52

This is . . . how to build a humanoid. We went to Foundation Robotics and hung with Sankaet and shot the process of making a humanoid in stunning detail. Full episode right here -

Ashlee Vance

14,464 Aufrufe • vor 4 Monaten

UK-based startup 'Humanoid' announced KinetIQ, an AI framework with a Vision-Language-Action (VLA) model at its core. It uses a four-layer architecture: fleet orchestration, task decomposition, VLA, and RL for whole-body control. It works on both bipedal and wheeled robots.
1:23

UK-based startup 'Humanoid' announced KinetIQ, an AI framework with a Vision-Language-Action (VLA) model at its core. It uses a four-layer architecture: fleet orchestration, task decomposition, VLA, and RL for whole-body control. It works on both bipedal and wheeled robots.

The Humanoid Hub

21,954 Aufrufe • vor 4 Monaten