Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Replicated the laundry task in mujoco web, and also self-trained the RL WBC. By Opus 5.5 in 3 hrs. Agentic real2sim is nearly solved.

48,049 görüntüleme • 2 gün önce •via X (Twitter)

35 Yorum

Lindon Gao profil fotoğrafı
Lindon Gao1 gün önce

Wow nice work!

Vector Wang profil fotoğrafı
Vector Wang1 gün önce

Thanks Lindon! Thrilled to get acknowledged by you. I am always fascinated by what Dyna has done.

link profil fotoğrafı
link1 gün önce

@ZeYanjie Cool! How did you trained a urr based rl policy?

Yannis He profil fotoğrafı
Yannis He1 gün önce

forwarded to our eng 🫡

Saket Tiwari profil fotoğrafı
Saket Tiwari2 gün önce

awesome! does mujoco web support cloth folding in sim?

Vector Wang profil fotoğrafı
Vector Wang2 gün önce

Mujoco supports cloth simulation, but the performance is not good and can't really do real-time in web. So in the video the cloth is only presented as rigid body.

Leo profil fotoğrafı
Leo2 gün önce

Did the three-hour build match how the towels behave, or mainly the robot and laundry room?

Vector Wang profil fotoğrafı
Vector Wang2 gün önce

Mujoco supports cloth simulation, but the performance is not good and can't really do real-time in web. So in the video the cloth is only presented as rigid body.

Paolo AI profil fotoğrafı
Paolo AI2 gün önce

@ttktjmt let's add this to MjSwan ?

Tim profil fotoğrafı
Tim2 gün önce

Wow very impressive, I will look into that 🔥

Tony Rick profil fotoğrafı
Tony Rick1 gün önce

laundry task in 3 hrs with opus is kinda nuts

Sergey profil fotoğrafı
Sergey1 gün önce

Very cool, mindblowing what coding agents are capable of.

Ignacio López-Francos profil fotoğrafı
Ignacio López-Francos1 gün önce

This is very cool

Feng Gao profil fotoğrafı
Feng Gao2 gün önce

Was the whole simulation also replicated by Opus 5.5?

Vector Wang profil fotoğrafı
Vector Wang2 gün önce

The robot trajectory is retrieved from official website (only kinematic) and Opus did the scene and robot dynamics to match this trajectory.

Haitong Wang profil fotoğrafı
Haitong Wang1 gün önce

This is so cool. Are the towels modeled as well in sim?

Vector Wang profil fotoğrafı
Vector Wang1 gün önce

Currently all rigid bodies so it's easier to run on web.

Chad L. profil fotoğrafı
Chad L.2 gün önce

super cool!

Jakie PLA profil fotoğrafı
Jakie PLA1 gün önce

3 hours? I could not help myself. This wants to live on a factory cart. Print brackets, bolt on wheels, and let Opus do the boring RL tuning. OH YES.

Max Riazantsev profil fotoğrafı
Max Riazantsev1 gün önce

That looks great! Are you going to try the same with XLeRobot? It is cheap enough to actually test sim-to-real on the real hardware

Brian Zheng profil fotoğrafı
Brian Zheng1 gün önce

Hi will you release the codebase

Alexander profil fotoğrafı
Alexander1 gün önce

is this mujoco? the rendering quality look really high?

Vector Wang profil fotoğrafı
Vector Wang1 gün önce

Mujoco web, so I can have additional renders customized (while still runs in real time in the browser)

Alexander profil fotoğrafı
Alexander1 gün önce

what additional renders? how are you doing that

Vector Wang profil fotoğrafı
Vector Wang1 gün önce

Basically I pre-baked the lighting using blender first.

Greyyy profil fotoğrafı
Greyyy2 gün önce

The rigid-cloth clarification is useful. Which physical properties were estimated from the source assets, and which used defaults? A sensitivity sweep on friction and inertia would be interesting before treating this as a faithful dynamics model.

Jerry Chéng profil fotoğrafı
Jerry Chéng2 gün önce

Wow this is insane! Did the real2sim modeled the robot as well? Would be great if you can share the harness - I have been trying lately as well

Vector Wang profil fotoğrafı
Vector Wang2 gün önce

Robot file is extracted from Dyna's website and added physical properties, and also generated collision mesh. Didn't use special designed harness, just prompted my requirements in claude code.

Jerry Chéng profil fotoğrafı
Jerry Chéng2 gün önce

That's sooo brilliant! Love the idea - and still amazed by the real2sim abilities, agentic robotics is here

刘海若(Hairuo Liu) profil fotoğrafı
刘海若(Hairuo Liu)2 gün önce

will it be open-sourced?

Vector Wang profil fotoğrafı
Vector Wang2 gün önce

After I confirm with Dyna, it’s their IP after all

xard profil fotoğrafı
xard1 gün önce

again it needs to be proved effective when deployed in real world!

newuhe profil fotoğrafı
newuhe1 gün önce

Nice work!How do you generate URR data?

Vector Wang profil fotoğrafı
Vector Wang1 gün önce

~98% synthetic (random keyframes + min-jerk + step targets → FK), seeded by ~97 s of Dyna's public ego-replay clips

rozgo profil fotoğrafı
rozgo1 gün önce

This looks really good. Nice work.

Benzer Videolar