Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

right now my reinforcement learning model is basically doing this and i came up with a solution for it all by myself (by stealing it from pufferlib) that not only solves it, but also helps keep training stable and fast

kache

201,365 subscribers

60,094 views • 8 months ago •via X (Twitter)

Science & Technology Education Arts

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

This work makes a humanoid robot do simple parkour moves by looking with a depth camera and choosing the right move on the fly. The big deal is that it turns lots of small human moves into long, real-time robot behavior, without hand-coding every transition or retraining for each new course. A humanoid robot is usually good at steady walking, but it often fails when it has to do fast moves like jumping up, vaulting, or rolling, and then keep going to the next obstacle. The hard part is that you cannot easily collect training data for every possible obstacle shape, distance, and mistake, so robots end up learning a few moves that only work in a narrow setup. This work starts from short clips of real human parkour moves, like stepping over, vaulting, climbing, and rolling. It uses motion matching, which is basically a smart “pick the next clip that fits best right now” search, to stitch those short clips into a long, smooth plan that looks like a human doing a whole course. Then it trains a controller with reinforcement learning (RL), which means the robot learns by trial and error to copy that plan while staying balanced and not falling. After training separate expert controllers for different moves, it compresses them into 1 controller that uses only onboard depth sensing and a simple “go this fast in this direction” command. In real tests on a Unitree G1 humanoid, it can clear multiple obstacles in a row, adapt when obstacles get moved, and climb a wall up to 1.25m.

This work makes a humanoid robot do simple parkour moves by looking with a depth camera and choosing the right move on the fly. The big deal is that it turns lots of small human moves into long, real-time robot behavior, without hand-coding every transition or retraining for each new course. A humanoid robot is usually good at steady walking, but it often fails when it has to do fast moves like jumping up, vaulting, or rolling, and then keep going to the next obstacle. The hard part is that you cannot easily collect training data for every possible obstacle shape, distance, and mistake, so robots end up learning a few moves that only work in a narrow setup. This work starts from short clips of real human parkour moves, like stepping over, vaulting, climbing, and rolling. It uses motion matching, which is basically a smart “pick the next clip that fits best right now” search, to stitch those short clips into a long, smooth plan that looks like a human doing a whole course. Then it trains a controller with reinforcement learning (RL), which means the robot learns by trial and error to copy that plan while staying balanced and not falling. After training separate expert controllers for different moves, it compresses them into 1 controller that uses only onboard depth sensing and a simple “go this fast in this direction” command. In real tests on a Unitree G1 humanoid, it can clear multiple obstacles in a row, adapt when obstacles get moved, and climb a wall up to 1.25m.

Rohan Paul

37,121 views • 4 months ago

🐶: changbin wrote this a year ago as a birthday present. i recorded it last week by myself and i worked on the tune myself and i mixed it myself and i sent it to hyung. hyung liked it but it's not the final version yet so i'll polish it a bit more and release it for stay~

🐶: changbin wrote this a year ago as a birthday present. i recorded it last week by myself and i worked on the tune myself and i mixed it myself and i sent it to hyung. hyung liked it but it's not the final version yet so i'll polish it a bit more and release it for stay~

lena ✰

62,178 views • 6 months ago

Finally, I now own a laptop! If someone had told me in January that I'll own a laptop by now, I wouldn't believe it. But God honestly came through. Might not be the best out there but I'm heavy on starting small and growing gradually.💜 Keep showing up with that phone because it'll definitely be worth it at the end.

Finally, I now own a laptop! If someone had told me in January that I'll own a laptop by now, I wouldn't believe it. But God honestly came through. Might not be the best out there but I'm heavy on starting small and growing gradually.💜 Keep showing up with that phone because it'll definitely be worth it at the end.

𝐃𝐄𝐂𝐄𝐍𝐂𝐘💜

210,386 views • 1 year ago

I came up with this silly idea after an art block and rotting from boredom. I hope someone likes it. I’m calling it Pointer Pet . It’s basically a pet that hovers next to a vtuber model and is a mouse tracker where the pet bites the cursor when you click. #live2dwip #vtuberassets #live2dwip

I came up with this silly idea after an art block and rotting from boredom. I hope someone likes it. I’m calling it Pointer Pet . It’s basically a pet that hovers next to a vtuber model and is a mouse tracker where the pet bites the cursor when you click. #live2dwip #vtuberassets #live2dwip

Chisa ♡ Live2D Artist

21,620 views • 2 months ago

I animated them all with my finger using flipaclip 32 gb ipad mini storage. All of them are unsuccessful. But all of my failure helps me improve myself until now. this app is a junk now 👎. I don’t use it anymore.

I animated them all with my finger using flipaclip 32 gb ipad mini storage. All of them are unsuccessful. But all of my failure helps me improve myself until now. this app is a junk now 👎. I don’t use it anymore.

FizzyNCasey

54,784 views • 11 months ago

BOYNEXTDOOR's Jaehyun at Music Bank mentions doing a dance challenge solo since he couldn’t do one with #Jungkook 😭 🐶 “since I can’t film with Jungkook sunbaenim, I’ll just do it alone, by myself…! Ah, I practiced hard today, but I got nervous so it didn’t go well. I’ll film it separately by myself and upload it. Please watch it a lot, and I’ll keep working hard. Thank you.” Cr. phille1204

BOYNEXTDOOR's Jaehyun at Music Bank mentions doing a dance challenge solo since he couldn’t do one with #Jungkook 😭 🐶 “since I can’t film with Jungkook sunbaenim, I’ll just do it alone, by myself…! Ah, I practiced hard today, but I got nervous so it didn’t go well. I’ll film it separately by myself and upload it. Please watch it a lot, and I’ll keep working hard. Thank you.” Cr. phille1204

𝗥𝗔𝗣𝗣𝗘𝗥 𝗝𝗞

81,678 views • 7 months ago

should i keep working on this? I was just doing it for fun but I'm getting kinda bored and stressed from it lol

should i keep working on this? I was just doing it for fun but I'm getting kinda bored and stressed from it lol

JOY of 3D

20,855 views • 9 months ago

i went to a party by myself last night. got on the stage, danced, threw my leg up and hit a split. the crowd enjoyed it but now my body is like girllllllllll.

i went to a party by myself last night. got on the stage, danced, threw my leg up and hit a split. the crowd enjoyed it but now my body is like girllllllllll.

holistic mami✨

142,453 views • 5 months ago

My biggest passion right now is coding agents that figure out the storyboard and prompts from a script, as well as the ingredients (characters, locations, props). And it does all of it with great camera control and direction. It's not perfect yet, but it gets better every day!

My biggest passion right now is coding agents that figure out the storyboard and prompts from a script, as well as the ingredients (characters, locations, props). And it does all of it with great camera control and direction. It's not perfect yet, but it gets better every day!

Alex Patrascu

15,049 views • 5 days ago

We just launched Claude Sonnet 4.5 and “Imagine with Claude”, a 5-day preview that creates dynamic experiences for you in real-time (and the first product I’ve worked on at Anthropic!). It pioneers the concept of “model-as-backend”, using a model to not only generate interfaces on the fly but also power all the functionality behind it – all made possible by our newest model, Claude Sonnet 4.5. Here’s a "choose your own adventure" version of my founder journey, as retold by Imagine with Claude:

We just launched Claude Sonnet 4.5 and “Imagine with Claude”, a 5-day preview that creates dynamic experiences for you in real-time (and the first product I’ve worked on at Anthropic!). It pioneers the concept of “model-as-backend”, using a model to not only generate interfaces on the fly but also power all the functionality behind it – all made possible by our newest model, Claude Sonnet 4.5. Here’s a "choose your own adventure" version of my founder journey, as retold by Imagine with Claude:

Sean Strong

115,687 views • 8 months ago

Happy Black History Month! It may be the last day but it’s never over! I’m proud to be a black woman making music and subverting expectations. The world is hard to live in right now but I’ll follow my dreams and keep moving forward, always loving myself and where I came from!

Happy Black History Month! It may be the last day but it’s never over! I’m proud to be a black woman making music and subverting expectations. The world is hard to live in right now but I’ll follow my dreams and keep moving forward, always loving myself and where I came from!

PAiDA👽new song out now!

26,966 views • 1 year ago

Talking about bicycle scene’s filming 🚲 Junho: “It was comfortable, right?” YoonA: “It was comfortable, but since I also had to hold my skirt, I put strength on my legs and it felt like I was exercising.” Junho: “I know this because I’ve ridden bicycles a lot, but that must be difficult.” YoonA: “(The ride) was stable.” Junho: “I just finished doing cardio.”

Talking about bicycle scene’s filming 🚲 Junho: “It was comfortable, right?” YoonA: “It was comfortable, but since I also had to hold my skirt, I put strength on my legs and it felt like I was exercising.” Junho: “I know this because I’ve ridden bicycles a lot, but that must be difficult.” YoonA: “(The ride) was stable.” Junho: “I just finished doing cardio.”

😵‍💫🍬

40,197 views • 3 years ago

Ummmm no WALLHACK© sp005 review anymore? I didn’t slam it, drop it, or anything. I noticed the small break on the edge today, haven’t moved this pad for over a week. My only thought is it’s my keyboard running into it. And I pushed my keyboard too hard into the pad and it broke. I tried to pick it up right after seeing that and it exploded in my face making this much larger crack. The pad basically isn’t useable anymore.

Ummmm no WALLHACK© sp005 review anymore? I didn’t slam it, drop it, or anything. I noticed the small break on the edge today, haven’t moved this pad for over a week. My only thought is it’s my keyboard running into it. And I pushed my keyboard too hard into the pad and it broke. I tried to pick it up right after seeing that and it exploded in my face making this much larger crack. The pad basically isn’t useable anymore.

Mighty+

41,093 views • 1 month ago

Pro-Palestine supporter proudly posted a video stealing coffee from Starbucks, as if that somehow supports people in Gaza. This demonstrates that the left is not only willing to engage in criminal behavior, but also quick to justify it by invoking their cause.

Pro-Palestine supporter proudly posted a video stealing coffee from Starbucks, as if that somehow supports people in Gaza. This demonstrates that the left is not only willing to engage in criminal behavior, but also quick to justify it by invoking their cause.

I Meme Therefore I Am 🇺🇸

39,851 views • 8 months ago

💌 260202 1:11 AM 🎥 🦊 i ate jjimdak with hyeongjun 🦊 and i went for a walk by myself 🦊 it was snowing so i filmed it 🦊 and i came home and sent it 🦊 have a pitch black dream 💜

💌 260202 1:11 AM 🎥 🦊 i ate jjimdak with hyeongjun 🦊 and i went for a walk by myself 🦊 it was snowing so i filmed it 🦊 and i came home and sent it 🦊 have a pitch black dream 💜

🦊

25,003 views • 4 months ago

With it being St. Patrick’s Day this week I thought it was only right to put you on to some Irish talent KhakiKid is taking Ireland by storm right now, and I can totally see why

With it being St. Patrick’s Day this week I thought it was only right to put you on to some Irish talent KhakiKid is taking Ireland by storm right now, and I can totally see why

UK Rap Daily

58,151 views • 1 year ago

kling 3.0 is crazy... this model works very different than any other model this is from giving it just 2 images and a multi prompt then it handled all the scenes by itself... now imagine what it could do if you gave it more references and an even more detailed multi prompt going to test this a lot more but kling definetly cooked on this one

kling 3.0 is crazy... this model works very different than any other model this is from giving it just 2 images and a multi prompt then it handled all the scenes by itself... now imagine what it could do if you gave it more references and an even more detailed multi prompt going to test this a lot more but kling definetly cooked on this one

Miko

95,650 views • 4 months ago

I’m all-in on peer pressure. You’ll hit the gym if your friends are watching. You’ll go for that run if the group chat is roasting you. You’ll actually stick with it - if you’re not doing it alone. I teamed up with Alex Lieberman to build FistBump - the app that uses friendly peer pressure to keep you going. This is the first drop from Bump Apps - a studio building apps that help people level up. We’re building in public, launching fast, and learning faster. Live on Believe: $BUMP CA 5fG1KadrP3yD66gx4GgkFpvLE2UvzxwGKJLWsd1cyoNv

I’m all-in on peer pressure. You’ll hit the gym if your friends are watching. You’ll go for that run if the group chat is roasting you. You’ll actually stick with it - if you’re not doing it alone. I teamed up with Alex Lieberman to build FistBump - the app that uses friendly peer pressure to keep you going. This is the first drop from Bump Apps - a studio building apps that help people level up. We’re building in public, launching fast, and learning faster. Live on Believe: $BUMP CA 5fG1KadrP3yD66gx4GgkFpvLE2UvzxwGKJLWsd1cyoNv

Miles Feldstein

231,454 views • 1 year ago