Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

In the last month, we’ve been building an open-source framework for robot learning and sim-to-real transfer, made for RL whole-body control from simple walking to complex human imitation Check out the details on HN: Get started in 5 minutes ⬇️

kscalelabs's profile picture

K-Scale Labs

13,099 subscribers

75,983 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & TeknolojiHaberler & PolitikaEğitim
LIVE

Anya Rossi• Live Now

Private livecam show

8 Yorum

K-Scale Labs profil fotoğrafı
K-Scale Labs1 yıl önce

Try it now:

K-Scale Labs profil fotoğrafı
K-Scale Labs1 yıl önce

Want to help solve some of the biggest problems in robotics? Join the leaderboard. Train an RL policy tonight; watch it run on a real humanoid tomorrow:

K-Scale Labs profil fotoğrafı
K-Scale Labs1 yıl önce

We would love to hear your feedback :) What would you like your humanoid robot to do?

The Rundown AI profil fotoğrafı
The Rundown AI1 yıl önce

If you're not learning AI in 2025, you're falling behind. Join 1,000,000+ early adopters reading and learn AI in just 5 minutes a day (for free).

Kevin Zakka profil fotoğrafı
Kevin Zakka1 yıl önce

No brax and mujoco playground acknowledgment is crazy

btaba profil fotoğrafı
btaba1 yıl önce

Would y'all be down to donate a few of your robots to our lab? Would love to try 'em out on the latest and greatest MuJoCo/MJX releases

Pierre-Louis Biojout (PLB) profil fotoğrafı
Pierre-Louis Biojout (PLB)1 yıl önce

That's very cool but how can we get a bot to test? Looks like it's preorders only...

David Hansen 🇺🇸🇳🇿 profil fotoğrafı
David Hansen 🇺🇸🇳🇿1 yıl önce

Ordered

Benzer Videolar

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.
0:49

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.

Qiayuan Liao

80,663 görüntüleme • 2 yıl önce

HDMI (HumanoiD iMitation for Interaction) is a framework enabling humanoid robots to learn whole-body object interaction skills from monocular RGB human videos. It extracts and retargets human poses and object trajectories using GVHMR and LocoMujoco, building reference datasets with contact annotations. The data is used to train an RL policy via robot-object co-tracking. HDMI achieved 67 consecutive door traversals.
0:45

HDMI (HumanoiD iMitation for Interaction) is a framework enabling humanoid robots to learn whole-body object interaction skills from monocular RGB human videos. It extracts and retargets human poses and object trajectories using GVHMR and LocoMujoco, building reference datasets with contact annotations. The data is used to train an RL policy via robot-object co-tracking. HDMI achieved 67 consecutive door traversals.

The Humanoid Hub

17,395 görüntüleme • 1 yıl önce

Day 170 of building Asimov, an open-source humanoid. Started testing the full body to get the robot to walk.
0:29

Day 170 of building Asimov, an open-source humanoid. Started testing the full body to get the robot to walk.

Asimov

13,062 görüntüleme • 8 ay önce

1/ 🧠Humans are the best robot data source! 2/ 👓Human egocentric video is rich in quantity, but poor in quality. 3/ Beyond scaling data, smarter representation and architecture matter just as much. 4/ Want an open-source framework to train your own learn-from-human-data robot policy? 🚀We introduce HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Robot-Data-Free ✦ Just 30 min of data per task ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Easy-to-Implement Let's squeeze every bit of signal out of human data! 🌐 Website: 📄 Paper: 💻 Code: 📹 Video: 🧵 1/n
1:28

1/ 🧠Humans are the best robot data source! 2/ 👓Human egocentric video is rich in quantity, but poor in quality. 3/ Beyond scaling data, smarter representation and architecture matter just as much. 4/ Want an open-source framework to train your own learn-from-human-data robot policy? 🚀We introduce HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Robot-Data-Free ✦ Just 30 min of data per task ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Easy-to-Implement Let's squeeze every bit of signal out of human data! 🌐 Website: 📄 Paper: 💻 Code: 📹 Video: 🧵 1/n

Zhi (Leo) Wang

128,291 görüntüleme • 5 ay önce

Boston Dynamics taught Atlas a Rabona kick. Learned from human mocap, retargeted to Atlas, trained in sim via RL, deployed zero-shot to the real robot. Soccer skills demand whole-body coordination, and similar recipe transfers to warehouse work.
0:58

Boston Dynamics taught Atlas a Rabona kick. Learned from human mocap, retargeted to Atlas, trained in sim via RL, deployed zero-shot to the real robot. Soccer skills demand whole-body coordination, and similar recipe transfers to warehouse work.

The Humanoid Hub

11,338 görüntüleme • 5 ay önce

AI Sapiens is ROBOTIS’ upcoming open-source humanoid platform for whole-body motion, imitation learning, reinforcement learning, and Sim2Real deployment on real hardware. Dance demonstration by SNU’s SHAPE team.
0:30

AI Sapiens is ROBOTIS’ upcoming open-source humanoid platform for whole-body motion, imitation learning, reinforcement learning, and Sim2Real deployment on real hardware. Dance demonstration by SNU’s SHAPE team.

ROBOTIS AMERICA

26,485 görüntüleme • 3 ay önce

Day 212 of building Asimov, an open-source humanoid. Started to free the robot from the harness.
0:46

Day 212 of building Asimov, an open-source humanoid. Started to free the robot from the harness.

Asimov

21,830 görüntüleme • 6 ay önce

RoboParty built a humanoid robot in 4 months. Now, the full project is open source. ROBOTO ORIGIN stands about 1.25 m tall, weighs 34 kg and has 23 degrees of freedom. The technical details: • 120 Nm peak torque at the leg joints • 48 V, 15 Ah battery • Mechanical CAD, PCB designs and BOM • Firmware, motor control and ROS 2 deployment • URDF/MJCF models for simulation • Reinforcement learning with Isaac Lab and RSL-RL • Sim-to-sim transfer to MuJoCo and sim-to-real validation The robot can walk, run and jump. What caught my attention is the training to hardware workflow. You can study how learned motion policies move from simulation to a physical humanoid.
1:25

RoboParty built a humanoid robot in 4 months. Now, the full project is open source. ROBOTO ORIGIN stands about 1.25 m tall, weighs 34 kg and has 23 degrees of freedom. The technical details: • 120 Nm peak torque at the leg joints • 48 V, 15 Ah battery • Mechanical CAD, PCB designs and BOM • Firmware, motor control and ROS 2 deployment • URDF/MJCF models for simulation • Reinforcement learning with Isaac Lab and RSL-RL • Sim-to-sim transfer to MuJoCo and sim-to-real validation The robot can walk, run and jump. What caught my attention is the training to hardware workflow. You can study how learned motion policies move from simulation to a physical humanoid.

Techniahqrobot | humanoid robots

12,329 görüntüleme • 12 gün önce

X-Humanoid unveiled TG-VLA, which it calls the world's first whole-body VLA framework for full-size humanoid robots. The goal: move humanoids past "mobile dual-arm systems" to human-like, whole-body coordinated operation. Built on three technologies: - HEX: an open-source full-size humanoid VLA that learns across embodiments and coordinates the whole body. Claimed SOTA on real-world whole-body manipulation - HAF-VLA: hierarchical action flow that decomposes whole-body motion into subtasks. Best or joint-best on 6 benchmarks - DSRL-DCT: online RL for high-DoF humanoids in a compressed latent space. 100% success on mobile manipulation HEX is open-source.
2:48

X-Humanoid unveiled TG-VLA, which it calls the world's first whole-body VLA framework for full-size humanoid robots. The goal: move humanoids past "mobile dual-arm systems" to human-like, whole-body coordinated operation. Built on three technologies: - HEX: an open-source full-size humanoid VLA that learns across embodiments and coordinates the whole body. Claimed SOTA on real-world whole-body manipulation - HAF-VLA: hierarchical action flow that decomposes whole-body motion into subtasks. Best or joint-best on 6 benchmarks - DSRL-DCT: online RL for high-DoF humanoids in a compressed latent space. 100% success on mobile manipulation HEX is open-source.

The Humanoid Hub

19,563 görüntüleme • 4 ay önce

We're hiring in robot learning at World Labs! Join me, Fei-Fei Li, and the team to define and scale the next generation of world models for robot learning! Atlas for Robotics: Real-to-Sim-to-Real: Apply:
0:41

We're hiring in robot learning at World Labs! Join me, Fei-Fei Li, and the team to define and scale the next generation of world models for robot learning! Atlas for Robotics: Real-to-Sim-to-Real: Apply:

Yunzhu Li

177,209 görüntüleme • 1 ay önce

Today, we're joined by Nikita Rudin, co-founder and CEO of Flexion to discuss the gap between current robotic capabilities and what’s required to deploy fully autonomous robots in the real world. Nikita explains how reinforcement learning and simulation have driven rapid progress in robot locomotion—and why locomotion is still far from “solved.” We dig into the sim2real gap, and how adding visual inputs introduces noise and significantly complicates sim-to-real transfer. We also explore the debate between end-to-end models and modular approaches, and why separating locomotion, planning, and semantics remains a pragmatic approach today. Nikita also introduces the concept of "real-to-sim", which uses real-world data to refine simulation parameters for higher fidelity training, discusses how reinforcement learning, imitation learning, and teleoperation data are combined to train robust policies for both quadruped and humanoid robots, and introduces Flexion's hierarchical approach that utilizes pre-trained Vision-Language Models (VLMs) for high-level task orchestration with Vision-Language-Action (VLA) models and low-level whole-body trackers. Finally, Nikita shares the behind-the-scenes in humanoid robot demos, his take on reinforcement learning in simulation versus the real world, the nuances of reward tuning, and offers practical advice for researchers and practitioners looking to get started in robotics today. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 04:07 - Is robot locomotion solved? 06:04 - Sim-to-real gap 08:58 - Adding semantics to policies 09:42 - Modular vs end-to-end architectures 10:29 - Planner model 12:21 - Adapting RL techniques from quadrupeds to humanoids 15:39 - Behind robot demos 18:09 - Humanoid robots in home environments 22:03 - Training approach 23:56 - VLA models 27:59 - Closing the sim-to-real gap 32:55 - Task orchestration using VLMs 36:38 - Tool use 38:10 - Model hierarchy 43:37 - Simulator versus simulation environment 44:57 - Combining imitation learning and reinforcement learning 46:42 - RL in real world versus RL in simulation 52:58 - Reward tuning and value functions in robotics 56:38 - Predictions 1:00:10 - Humanoids, quadropeds, and wheeled platforms 1:02:45 - Advice, recommended robot kits, and community pla
1:06:07

Today, we're joined by Nikita Rudin, co-founder and CEO of Flexion to discuss the gap between current robotic capabilities and what’s required to deploy fully autonomous robots in the real world. Nikita explains how reinforcement learning and simulation have driven rapid progress in robot locomotion—and why locomotion is still far from “solved.” We dig into the sim2real gap, and how adding visual inputs introduces noise and significantly complicates sim-to-real transfer. We also explore the debate between end-to-end models and modular approaches, and why separating locomotion, planning, and semantics remains a pragmatic approach today. Nikita also introduces the concept of "real-to-sim", which uses real-world data to refine simulation parameters for higher fidelity training, discusses how reinforcement learning, imitation learning, and teleoperation data are combined to train robust policies for both quadruped and humanoid robots, and introduces Flexion's hierarchical approach that utilizes pre-trained Vision-Language Models (VLMs) for high-level task orchestration with Vision-Language-Action (VLA) models and low-level whole-body trackers. Finally, Nikita shares the behind-the-scenes in humanoid robot demos, his take on reinforcement learning in simulation versus the real world, the nuances of reward tuning, and offers practical advice for researchers and practitioners looking to get started in robotics today. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 04:07 - Is robot locomotion solved? 06:04 - Sim-to-real gap 08:58 - Adding semantics to policies 09:42 - Modular vs end-to-end architectures 10:29 - Planner model 12:21 - Adapting RL techniques from quadrupeds to humanoids 15:39 - Behind robot demos 18:09 - Humanoid robots in home environments 22:03 - Training approach 23:56 - VLA models 27:59 - Closing the sim-to-real gap 32:55 - Task orchestration using VLMs 36:38 - Tool use 38:10 - Model hierarchy 43:37 - Simulator versus simulation environment 44:57 - Combining imitation learning and reinforcement learning 46:42 - RL in real world versus RL in simulation 52:58 - Reward tuning and value functions in robotics 56:38 - Predictions 1:00:10 - Humanoids, quadropeds, and wheeled platforms 1:02:45 - Advice, recommended robot kits, and community pla

The TWIML AI Podcast

22,592 görüntüleme • 10 ay önce

Excited to present FastTD3: a simple, fast, and capable off-policy RL algorithm for humanoid control -- with an open-source code to run your own humanoid RL experiments in no time! Thread below 🧵
0:25

Excited to present FastTD3: a simple, fast, and capable off-policy RL algorithm for humanoid control -- with an open-source code to run your own humanoid RL experiments in no time! Thread below 🧵

Younggyo Seo

131,743 görüntüleme • 1 yıl önce

Today, we’re introducing KinetIQ, our own AI framework for end-to-end orchestration of humanoid robot fleets. One system, multiple robot embodiments. Industrial, service and home environments coordinated in real time. The framework consists of 4 cognitive layers: from high-level task allocation and workflow optimisation down to VLA-based task execution and RL-trained whole-body control. Watch how KinetIQ runs both our wheeled and bipedal robots. Read more on our blog:
3:47

Today, we’re introducing KinetIQ, our own AI framework for end-to-end orchestration of humanoid robot fleets. One system, multiple robot embodiments. Industrial, service and home environments coordinated in real time. The framework consists of 4 cognitive layers: from high-level task allocation and workflow optimisation down to VLA-based task execution and RL-trained whole-body control. Watch how KinetIQ runs both our wheeled and bipedal robots. Read more on our blog:

Humanoid

23,975 görüntüleme • 9 ay önce

Very impressed by the new Tesla Optimus end2end skill learning video! Our TRILL work ( spills some secret sauce: 1. VR teleoperation, 2. deep imitation learning, 3. real-time whole-body control. It's all open-source! Dive in if you're into humanoids! 👾
0:46

Very impressed by the new Tesla Optimus end2end skill learning video! Our TRILL work ( spills some secret sauce: 1. VR teleoperation, 2. deep imitation learning, 3. real-time whole-body control. It's all open-source! Dive in if you're into humanoids! 👾

Yuke Zhu

50,680 görüntüleme • 3 yıl önce

TidyBot++ is an open-source mobile manipulator optimized for household tasks. The robot can be teleoperated using a mobile phone interface, enabling data collection for imitation learning.
0:22

TidyBot++ is an open-source mobile manipulator optimized for household tasks. The robot can be teleoperated using a mobile phone interface, enabling data collection for imitation learning.

The Humanoid Hub

30,105 görüntüleme • 1 yıl önce

We present HDMI, a simple and general framework for learning whole-body interaction skills directly from human videos — no manual reward engineering, no task-specific pipelines. 🤖 67 door traversals, 6 real-world tasks, 14 in simulation. 🔗
1:32

We present HDMI, a simple and general framework for learning whole-body interaction skills directly from human videos — no manual reward engineering, no task-specific pipelines. 🤖 67 door traversals, 6 real-world tasks, 14 in simulation. 🔗

Haoyang Weng

137,221 görüntüleme • 1 yıl önce

A closer look at the evolution of the research from Meta FAIR that led to our latest open source work for human-robot collaboration. Details on Meta PARTNR ➡️
1:37

A closer look at the evolution of the research from Meta FAIR that led to our latest open source work for human-robot collaboration. Details on Meta PARTNR ➡️

AI at Meta

41,527 görüntüleme • 1 yıl önce