Loading video...

Video Failed to Load

Go Home

We just released our work on robot soccer. I've been working on this for quite some time with my amazing colleagues at DeepMind. It's exciting how deep RL can produce such beautiful behaviors with low-cost robots. Full paper is available at Enjoy!

haarnoja's profile picture

Tuomas Haarnoja

3,744 subscribers

758,752 views • 3 years ago •via X (Twitter)

Science & TechnologyNews & PoliticsEducation
LIVE

Anya Rossi• Live Now

Private livecam show

10 Comments

🌱Simon🌱's profile picture
🌱Simon🌱3 years ago

I never watch football, but I would pay a lot to watch a match between two robot teams.

Jouko Salonen's profile picture
Jouko Salonen3 years ago

Congrats! btw, I'm gonna do grandchild babysitting the whole coming 1st of May weekend. Do you happen to have a full 90 min video of this?

Nicholas Horbaczewski's profile picture
Nicholas Horbaczewski3 years ago

What, we’re just going to let that handball slide? The future of sports is robotic sports. Proud that @DroneRaceLeague is the first globally televised robotic sport.

Pieter Abbeel's profile picture
Pieter Abbeel3 years ago

very nice work @haarnoja, and fun to watch!

Karol Hausman's profile picture
Karol Hausman3 years ago

Some of these behaviors are beautiful! Congrats Tuomas!

Bernhard Jaeger's profile picture
Bernhard Jaeger3 years ago

Very cute robots. Feels much like small kids playing soccer.

Nolan's profile picture
Nolan3 years ago

I could dust both of these

Tony Hansmann's profile picture
Tony Hansmann3 years ago

Wow! How low-cost?

Erwin Coumans 🇺🇦's profile picture
Erwin Coumans 🇺🇦3 years ago

Very impressing on this low-cost hardware (Dynamixels?) @haarnoja , congrats!

Sélim's profile picture
Sélim3 years ago

so cute!! .. and obviously impressive 🤯 @FloMaushart

Related Videos

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.
0:49

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.

Qiayuan Liao

80,294 views • 1 year ago

Happy to announce our neurips’25 paper, real world RL of active perception behaviors! I am pretty excited about this project - I learned that real world robot RL is actually quite straightforward. Details below:
1:05

Happy to announce our neurips’25 paper, real world RL of active perception behaviors! I am pretty excited about this project - I learned that real world robot RL is actually quite straightforward. Details below:

Edward Hu

24,565 views • 7 months ago

🚀Meet Gemini Diffusion, our first diffusion-based and super fast language model, just announced at Google I/O!🚀 Very excited to be able to share what I've been working on for the past little while with our amazing small team Google DeepMind.
0:32

🚀Meet Gemini Diffusion, our first diffusion-based and super fast language model, just announced at Google I/O!🚀 Very excited to be able to share what I've been working on for the past little while with our amazing small team Google DeepMind.

Ivana Balazevic

43,472 views • 1 year ago

Working on my board for tonights game and every time I look up I see this face! How can I focus on work with this face looking at me?!?
0:20

Working on my board for tonights game and every time I look up I see this face! How can I focus on work with this face looking at me?!?

Kirk Herbstreit

883,705 views • 1 year ago

It's been a rollercoaster with some high highs and low lows, but I've loved my time getting to work and pour my passion into Lost Ark. 9yrs at Amazon, 8 at Amazon Games. 4 Games launched. See you on the next journey. o7
2:18

It's been a rollercoaster with some high highs and low lows, but I've loved my time getting to work and pour my passion into Lost Ark. 9yrs at Amazon, 8 at Amazon Games. 4 Games launched. See you on the next journey. o7

HardcoreHenry

55,279 views • 3 months ago

Proud to share what I’ve been working on with my colleagues at Rhoda AI: Direct Video-Action Models (DVA). TL;DR: - We pre-train causal video models from scratch to control robots - They handle complex production tasks for hours without intervention - Only use ~10 hours of robot data How? 🧵👇
6:01

Proud to share what I’ve been working on with my colleagues at Rhoda AI: Direct Video-Action Models (DVA). TL;DR: - We pre-train causal video models from scratch to control robots - They handle complex production tasks for hours without intervention - Only use ~10 hours of robot data How? 🧵👇

Tongzhou Mu 🤖🦾🦿

19,102 views • 3 months ago

Meet Cabinet: Paper Clip + KB. for quite some time I've been thinking how LLMs are missing the knowledge base - where I can dump CSVs, PDFs, and most important - inline web app. running on Claude Code with agents with heartbeats and jobs
0:59

Meet Cabinet: Paper Clip + KB. for quite some time I've been thinking how LLMs are missing the knowledge base - where I can dump CSVs, PDFs, and most important - inline web app. running on Claude Code with agents with heartbeats and jobs

Hila Shmuel

493,783 views • 3 months ago

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning investigated the application of Deep Reinforcement Learning (Deep RL) for low-cost, miniature humanoid hardware in a dynamic environment, showing the method can synthesize sophisticated and safe movement skills making up complex behavioral strategies in a simplified one-versus-one (1v1) soccer game abs: project page:
4:28

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning investigated the application of Deep Reinforcement Learning (Deep RL) for low-cost, miniature humanoid hardware in a dynamic environment, showing the method can synthesize sophisticated and safe movement skills making up complex behavioral strategies in a simplified one-versus-one (1v1) soccer game abs: project page:

AK

293,335 views • 3 years ago

My weekend gift to you, my take on billie eilish’s “CHIHIRO” is now available for streaming on YouTube + SoundCloud only! I’ve been eager to share this with you for quite some time now 🙏🏿
7:38

My weekend gift to you, my take on billie eilish’s “CHIHIRO” is now available for streaming on YouTube + SoundCloud only! I’ve been eager to share this with you for quite some time now 🙏🏿

Black Coffee

62,762 views • 1 year ago

NEWS: DeepMind teaches robots to play soccer. In a paper released today Google's DeepMind details how they used Deep Reinforcement Learning (Deep RL) to train low-cost, miniature humanoid robots in dynamic environments, allowing them to play a simplified one-versus-one (1v1) soccer game. The robots, equipped with 20 actuated joints, were initially trained in simulation using the MuJoCo physics engine. Through this training, they learned robust and dynamic movement skills like rapid fall recovery, walking, turning, and kicking. The robots seamlessly transitioned between these skills, even surpassing expectations, and developed a basic strategic understanding of the game. During matches, the trained robots demonstrated agile skills such as turning, kicking moving balls, and dynamic defensive blocking. They quickly combined these skills, showcasing their adaptability and outperforming scripted baselines. The robots walked faster, got up quicker, and kicked faster than their counterparts. Individual skills were first trained in isolation within the simulation environment, and then composed in a self-play setting. The robots successfully transferred these skills to real-world scenarios. Full paper can be found here:
2:34

NEWS: DeepMind teaches robots to play soccer. In a paper released today Google's DeepMind details how they used Deep Reinforcement Learning (Deep RL) to train low-cost, miniature humanoid robots in dynamic environments, allowing them to play a simplified one-versus-one (1v1) soccer game. The robots, equipped with 20 actuated joints, were initially trained in simulation using the MuJoCo physics engine. Through this training, they learned robust and dynamic movement skills like rapid fall recovery, walking, turning, and kicking. The robots seamlessly transitioned between these skills, even surpassing expectations, and developed a basic strategic understanding of the game. During matches, the trained robots demonstrated agile skills such as turning, kicking moving balls, and dynamic defensive blocking. They quickly combined these skills, showcasing their adaptability and outperforming scripted baselines. The robots walked faster, got up quicker, and kicked faster than their counterparts. Individual skills were first trained in isolation within the simulation environment, and then composed in a self-play setting. The robots successfully transferred these skills to real-world scenarios. Full paper can be found here:

Dave Lee

372,039 views • 3 years ago

"A Bang at the Beach" a commission for: DaJester SFX pack: OpenNSFW A BIG commission I've been working on for quite some time now! I'm glad I can finally reveal it to you guys! 😚❤️❤️❤️ (✨HQ/download available through my bi0✨) #TheAmazingDigitalCircus #TADCEp7
1:12

"A Bang at the Beach" a commission for: DaJester SFX pack: OpenNSFW A BIG commission I've been working on for quite some time now! I'm glad I can finally reveal it to you guys! 😚❤️❤️❤️ (✨HQ/download available through my bi0✨) #TheAmazingDigitalCircus #TADCEp7

🔞✨Morado Arts✨(COMMS 3/5)

51,063 views • 6 months ago

Q: "are you naturally calm or is it something you consciously work on?" Oscar: "both. it comes naturally for me, but it's also something i've been working on for a while. i'm not perfect, i'm not a robot, there are emotions there. it's just about how well you can control them."
0:26

Q: "are you naturally calm or is it something you consciously work on?" Oscar: "both. it comes naturally for me, but it's also something i've been working on for a while. i'm not perfect, i'm not a robot, there are emotions there. it's just about how well you can control them."

ari

26,327 views • 1 year ago

Introducing 𝐀𝐋𝐎𝐇𝐀 𝐔𝐧𝐥𝐞𝐚𝐬𝐡𝐞𝐝 🌋 - Pushing the boundaries of dexterity with low-cost robots and AI. Google DeepMind Finally got to share some videos after a few months. Robots are fully autonomous filmed in one continuous shot. Enjoy!
1:22

Introducing 𝐀𝐋𝐎𝐇𝐀 𝐔𝐧𝐥𝐞𝐚𝐬𝐡𝐞𝐝 🌋 - Pushing the boundaries of dexterity with low-cost robots and AI. Google DeepMind Finally got to share some videos after a few months. Robots are fully autonomous filmed in one continuous shot. Enjoy!

Tony Zhao

353,928 views • 2 years ago

Everyone can now train high-dimensional muscle agents with RL, as we just released our code! Come join me at the #MyoChallenge workshop tomorrow at 10:00 in room 354 at #NeurIPS2023 to see my poster. Code is here!
0:28

Everyone can now train high-dimensional muscle agents with RL, as we just released our code! Come join me at the #MyoChallenge workshop tomorrow at 10:00 in room 354 at #NeurIPS2023 to see my poster. Code is here!

Pierre Schumacher

159,528 views • 2 years ago

I've been working on procedural movement for my busy little duck and I'm stoked with how it's turning out! 🦆 #screenshotsaturday #gamedev
0:38

I've been working on procedural movement for my busy little duck and I'm stoked with how it's turning out! 🦆 #screenshotsaturday #gamedev

Mike Sebele

109,075 views • 2 years ago

I've been making movies with my best friends for 10 years. Now it's our full time job.
0:48

I've been making movies with my best friends for 10 years. Now it's our full time job.

Jason Carman

10,654 views • 9 months ago

I've been working on deformable object manipulation since my PhD. It was totally a nightmare years ago and my PhD advisor was telling me not to work on it for my own good. Today, at ByteDance Seed, we are dropping GR-RL, a new VLA+RL system that manages long-horizon precise dexterous manipulation of deformable objects. This is probably the first real-world RL system to make a robot: ✅ Lace up your shoes end to end ✅ Hit millimeter tolerance repeatedly ✅ Recover from mistakes (See video!) ✅ And complete continuous shoelace threading on a real bimanual platform 📈 Success rate: ↑ from 45.7% → 83.3% Yes, robots can now actually do this. Project page: ArXiv:
3:45

I've been working on deformable object manipulation since my PhD. It was totally a nightmare years ago and my PhD advisor was telling me not to work on it for my own good. Today, at ByteDance Seed, we are dropping GR-RL, a new VLA+RL system that manages long-horizon precise dexterous manipulation of deformable objects. This is probably the first real-world RL system to make a robot: ✅ Lace up your shoes end to end ✅ Hit millimeter tolerance repeatedly ✅ Recover from mistakes (See video!) ✅ And complete continuous shoelace threading on a real bimanual platform 📈 Success rate: ↑ from 45.7% → 83.3% Yes, robots can now actually do this. Project page: ArXiv:

Xiao Ma

109,462 views • 7 months ago

How can robots acquire fine-grained manipulation skills? Introducing ACT: Action Chunking with Transformers 🤖 Key idea: Imitation, but predict actions in chunks instead of one at a time. Here are results with only ~15min of demonstrations, running on low-cost arms:
0:40

How can robots acquire fine-grained manipulation skills? Introducing ACT: Action Chunking with Transformers 🤖 Key idea: Imitation, but predict actions in chunks instead of one at a time. Here are results with only ~15min of demonstrations, running on low-cost arms:

Tony Zhao

237,038 views • 3 years ago

"RAD New World☢️" [Concept] This little project is something I've been tinkering with on and off for quite a while now — it's basically my love letter to some of my all-time favorite games: Fallout 1,2 & Tactics. Cheers!🫡
1:19

"RAD New World☢️" [Concept] This little project is something I've been tinkering with on and off for quite a while now — it's basically my love letter to some of my all-time favorite games: Fallout 1,2 & Tactics. Cheers!🫡

Frontline: Games Series

32,325 views • 3 months ago

Rad New World☢️ [Dialogue System] This little project is something I've been tinkering with on and off for quite a while now — it's basically my love letter to some of my all-time favorite games: Fallout 1,2 & Tactics. Cheers!🫡
1:35

Rad New World☢️ [Dialogue System] This little project is something I've been tinkering with on and off for quite a while now — it's basically my love letter to some of my all-time favorite games: Fallout 1,2 & Tactics. Cheers!🫡

Frontline: Games Series

29,488 views • 1 month ago