正在加载视频...

视频加载失败

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning investigated the application of Deep Reinforcement Learning (Deep RL) for low-cost, miniature humanoid hardware in a dynamic environment, showing the method can synthesize sophisticated and safe movement skills making up complex behavioral strategies in a simplified one-versus-one...

293,474 次观看 • 3 年前 •via X (Twitter)

30 条评论

Pablo Moncada-Larrotiz 的头像
Pablo Moncada-Larrotiz3 年前

I hope to see the best human team vs best robot team play in my lifetime. Like Deep Blue vs Kasparov but for football

kache 的头像
kache3 年前

super cool how they penalized it on torque/strain on its joints and got a smoother gait in the policy as a result

AgiDoomerAnon 的头像
AgiDoomerAnon3 年前

You are here.

murtaza 的头像
murtaza3 年前

I saw something similar but couldn't find it where , now i got it 👇

sam laki 的头像
sam laki3 年前

@yacineMTB Bruh how are they playing better than me

Julia (Blackhole) 的头像
Julia (Blackhole)3 年前

In terms of real-world dynamic humanoid locomotion this is nearly the best I've ever seen second only to Atlas, and this is on cheap stock hardware and with a fully automatically trained policy? Amazing work

Alberto Hojel 的头像
Alberto Hojel3 年前

I never knew something could be so adorable yet mind-blowing. Seems like RL is paying off.

Fabian Paischer 的头像
Fabian Paischer3 年前

What does "safe" refer to in this regard? The robots are consistently falling over Also, the only thing that appears to be dynamic in this environment while watching the video is the ball Are there any other dynamic aspects to it?

pranav 的头像
pranav3 年前

DeepMind are based out of London. Calling it soccer is a punishable offence!

My Art Ontario 🐢 的头像
My Art Ontario 🐢3 年前

I want a robo baby yoda

SOPLECHNER SOPLECHNER 的头像
SOPLECHNER SOPLECHNER3 年前

Juegan mejor que la seleccion de Chile jajaja monos qls

7racker 的头像
7racker3 年前

Super toys are coming ☾

Sebastian Bitsch 的头像
Sebastian Bitsch3 年前

Fun watch, are they “stock” OP3 models?

Benny Johansson 的头像
Benny Johansson3 年前

Amazing and fun to watch 😀👍

Jinani 的头像
Jinani3 年前

FIFA 2030 in the making!

Jorge Villegas 的头像
Jorge Villegas3 年前

RIP Messi

Alexander Septian Arfe 的头像
Alexander Septian Arfe3 年前

@SaveToNotion #tweet #ai #ResearchPaper

Astro 的头像
Astro3 年前

It's football

lithium534 的头像
lithium5343 年前

Very impressie.

Amit Khanna 的头像
Amit Khanna3 年前

That is one cruel lady, tripping that poor little robot like that.

Heather Brown 的头像
Heather Brown3 年前

I saw this on 60 minutes last week...too cool!

AU ⏸️⏹️▶️⏩️⏮️⏬️⏯️🔀🔁 的头像
AU ⏸️⏹️▶️⏩️⏮️⏬️⏯️🔀🔁3 年前

@DotCSV

Darryl Mason 的头像
Darryl Mason3 年前

'I'm not playing on the same team as a fkng robot!' 'But that's who the crowds are coming to see! If we don't robot up the team, we lose supporters. The league wants this.' 'But they don't have the skills of human players!' 'They do know how to dive.' 'Yeah....that is true....'

🌞FORMATS 的头像
🌞FORMATS3 年前

@Wickedlander

Nico Bohlinger 的头像
Nico Bohlinger3 年前

When do we see DeepMind in RoboCup?👀

Furkan Gözükara 的头像
Furkan Gözükara3 年前

Nice

Long | 科技与商业沉思录 的头像
Long | 科技与商业沉思录3 年前

@SaveToNotion #tweet #AIofPaper

Trist 的头像
Trist3 年前

awww adorable!

BabbleBones 的头像
BabbleBones3 年前

@yacineMTB This sparks joy

Rom_AI 的头像
Rom_AI3 年前

In the future, we will have World vs Robots in Wembley.

相关视频

Today, we're joined by Nikita Rudin, co-founder and CEO of Flexion to discuss the gap between current robotic capabilities and what’s required to deploy fully autonomous robots in the real world. Nikita explains how reinforcement learning and simulation have driven rapid progress in robot locomotion—and why locomotion is still far from “solved.” We dig into the sim2real gap, and how adding visual inputs introduces noise and significantly complicates sim-to-real transfer. We also explore the debate between end-to-end models and modular approaches, and why separating locomotion, planning, and semantics remains a pragmatic approach today. Nikita also introduces the concept of "real-to-sim", which uses real-world data to refine simulation parameters for higher fidelity training, discusses how reinforcement learning, imitation learning, and teleoperation data are combined to train robust policies for both quadruped and humanoid robots, and introduces Flexion's hierarchical approach that utilizes pre-trained Vision-Language Models (VLMs) for high-level task orchestration with Vision-Language-Action (VLA) models and low-level whole-body trackers. Finally, Nikita shares the behind-the-scenes in humanoid robot demos, his take on reinforcement learning in simulation versus the real world, the nuances of reward tuning, and offers practical advice for researchers and practitioners looking to get started in robotics today. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 04:07 - Is robot locomotion solved? 06:04 - Sim-to-real gap 08:58 - Adding semantics to policies 09:42 - Modular vs end-to-end architectures 10:29 - Planner model 12:21 - Adapting RL techniques from quadrupeds to humanoids 15:39 - Behind robot demos 18:09 - Humanoid robots in home environments 22:03 - Training approach 23:56 - VLA models 27:59 - Closing the sim-to-real gap 32:55 - Task orchestration using VLMs 36:38 - Tool use 38:10 - Model hierarchy 43:37 - Simulator versus simulation environment 44:57 - Combining imitation learning and reinforcement learning 46:42 - RL in real world versus RL in simulation 52:58 - Reward tuning and value functions in robotics 56:38 - Predictions 1:00:10 - Humanoids, quadropeds, and wheeled platforms 1:02:45 - Advice, recommended robot kits, and community pla

The TWIML AI Podcast

22,592 次观看 • 9 个月前