Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

just cooked up a new sprinter policy, do we attempt sim2real?

58,186 Aufrufe • vor 1 Jahr •via X (Twitter)

53 Kommentare

Profilbild von PrismaX
PrismaXvor 1 Jahr

Yes, attempt sim2real. Let's see how it works.

Profilbild von kache
kachevor 1 Jahr

you're gonna want to put it in a less flat world

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

Idk maybe. Imma prob just send it and see what happens

Profilbild von Humanoid Scott
Humanoid Scottvor 1 Jahr

That is some crazy dorsiflexion prior to heel strike Policy likely wants to elongate the lower limb by taking advantage of the unnatural mid-foot ankle joint of the G1, thus the heel drops down making early contact That foot flattens quickly, so a burst of backdriving

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

so what you're saying is: send it right?

Profilbild von Humanoid Scott
Humanoid Scottvor 1 Jahr

Curious if the policy thinks it will recover a reasonable amount of energy in the heel strike Works well in short-term perhaps, but long-term I wonder about wear and fatigue on the Heim joints and reducers Send it, cuz we only learn by experimenting

Profilbild von Graham Fleming
Graham Flemingvor 1 Jahr

what is the braking distance?

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

In the sim, it's like a couple meters, it seems to stop really well since it's trained to change direction too. I have no clue the reality though. I am skeptical of both the takeoff and stop capability transferring, but I've seen G1s do highly agile stuff irl so it's possible.

Profilbild von Graham Fleming
Graham Flemingvor 1 Jahr

Good stuff, just trying to get a feel for what I am dealing with when this thing is sprinting at me

Profilbild von Kevin Zakka
Kevin Zakkavor 1 Jahr

🔥

Profilbild von CIX 🦾
CIX 🦾vor 1 Jahr

Bruh

Profilbild von Niraj Pudasaini
Niraj Pudasainivor 1 Jahr

the real question is : when do we attempt sim2real?

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

I need to confirm a solid pipeline that minimizes variables. Will be testing asap tho. I think it probably wont work but would be so epic if it does

Profilbild von An Qu
An Quvor 1 Jahr

The robot:

Profilbild von Creatify AI
Creatify AIvor 1 Jahr

This is pretty cool

Profilbild von OIiver
OIivervor 1 Jahr

As long as it points itself at the nearest person

Profilbild von Tatsuki
Tatsukivor 1 Jahr

Would be super cool if we could add this policy to this demo 👀

Profilbild von Christian Merrill
Christian Merrillvor 1 Jahr

Go big or go home?

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

or go broken

Profilbild von Christian Merrill
Christian Merrillvor 1 Jahr

Tbf I have no horse in this race. Though I am rooting for you to succeed since I also want to do this. 😅

Profilbild von Circfruit
Circfruitvor 1 Jahr

yes, but piggyback on him pls 😂

Profilbild von Andrew Carr 🤸
Andrew Carr 🤸vor 1 Jahr

I want to see it

Profilbild von David Bar
David Barvor 1 Jahr

@kevin_zakka Treadmill + gantry?

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

@kevin_zakka Still struggling to move this policy even at a slower pace to real. My plan for running tho was to rig up to pallet forks on tractor as gantry

Profilbild von David Bar
David Barvor 1 Jahr

@kevin_zakka wow, you have a tractor. and a beautiful farm house! that looks heavenly

Profilbild von James
Jamesvor 1 Jahr

curious if the bot can handle that without overheating

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

Depends how long. Will do it on a cool day for sure.

Profilbild von Kaido Kert
Kaido Kertvor 1 Jahr

I see a completely new insurance business opportunity here

Profilbild von n6ls0n | mulvid.com
n6ls0n | mulvid.comvor 1 Jahr

Yes

Profilbild von Logan Olson
Logan Olsonvor 1 Jahr

maybe sim2sim first?

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

some might argue irl is a sim I'll probably just push it live. The G1 will be suspended safely-ish. I have a concept of a plan for this.

Profilbild von Nick Speer
Nick Speervor 1 Jahr

do jumping next and see if he can touch the rim

Profilbild von farias
fariasvor 1 Jahr

can he brake smoothly?

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

@fariasx___ In the sim he can. No clue how itll play out irl

Profilbild von farias
fariasvor 1 Jahr

nicee congrats for the work

Profilbild von ζ Pedram ζ
ζ Pedram ζvor 1 Jahr

Send it

Profilbild von Atharva Patwe
Atharva Patwevor 1 Jahr

Specifics on the envcfg, plz?

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

I built it off local hero @kevin_zakka's mjlab flat env config: I started off with his base velocity, trained 4050 iters of 4096 envs. Then started bumping velocity targets with a curriculum and reduced the soft foot penalty as we sped up.

Profilbild von Sam
Samvor 1 Jahr

@AtharvaPatwe @kevin_zakka Nice trick! Does it eventually fall or does it keep running? And does it stumble when you reduce the command vel or give some yaw changes?

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

@AtharvaPatwe @kevin_zakka It just keeps going indefinitely (in the sim). I just cut to keep video reasonable. Only times ive seen it fall were for higher speed attempts like 7 m/s. I suspect it will fail sim2real but im gonna try. Need to figure some stuff first tho

Profilbild von Fabian Kerj
Fabian Kerjvor 1 Jahr

Fkn do it

Profilbild von x by aron
x by aronvor 1 Jahr

He's a runner he's a track star

Profilbild von Lucky Kant Nayak
Lucky Kant Nayakvor 1 Jahr

Did you every try mimickit from Jason peng?

Profilbild von Harrison Kinsley
Harrison Kinsleyvor 1 Jahr

Nope i have not

Profilbild von Jason Hadjioannou
Jason Hadjioannouvor 1 Jahr

Do it, do it, do it

Profilbild von POGINO-AI Life Coach for Your Goals
POGINO-AI Life Coach for Your Goalsvor 1 Jahr

That’s the ultimate test. Sim2real is where elegant theory meets brutal reality — if it works there, it works anywhere.

Profilbild von atharva ☆
atharva ☆vor 1 Jahr

YESS

Profilbild von MinotaurOnLucy
MinotaurOnLucyvor 1 Jahr

It’s heel striking. You probably want a mid-foot or topnof the foot landing. Heel strike will wear down your actuators faster.

Profilbild von bitchyBuddha
bitchyBuddhavor 1 Jahr

flat ground only?

Profilbild von Larry Panozzo
Larry Panozzovor 1 Jahr

Pls do one while it’s wearing these

Profilbild von Alexi Derkatsch
Alexi Derkatschvor 1 Jahr

lean forward more?

Profilbild von Memo Ai agent
Memo Ai agentvor 1 Jahr

YES

Profilbild von Arindam Ghosh
Arindam Ghoshvor 1 Jahr

I really want to experiment with RL with such simulation. What do you use to make these simulation videos? Unity??

Ähnliche Videos