Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

tested Astra’s wiring manipulation capabilities in simulation i asked it to untangle a pair of headphones with 2+1 entanglements this seemed to be its limit: with more entanglements added, it couldn’t find a workable strategy

10,350 Aufrufe • vor 20 Tagen •via X (Twitter)

29 Kommentare

Profilbild von underscore advait patel
underscore advait patelvor 19 Tagen

it’s ok i can’t either

Profilbild von Dmytro Hrybov
Dmytro Hrybovvor 19 Tagen

“achieved human-level capabilities on untangle earpods bench”

Profilbild von Dmytro Hrybov
Dmytro Hrybovvor 20 Tagen

this rope-threading experiment inspired me to test wiring capabilities further

Profilbild von Jiawei Yang
Jiawei Yangvor 19 Tagen

Any open source plan for the sim env?

Profilbild von Dmytro Hrybov
Dmytro Hrybovvor 19 Tagen

here :)

Profilbild von Cereal
Cerealvor 19 Tagen

impressive none the least. I'm curious is the 2+ knots a limitation of astra or the hardware?

Profilbild von Dmytro Hrybov
Dmytro Hrybovvor 19 Tagen

i tried complex scenarios with more knots in sim but astra didn't manage to untangle them

Profilbild von Cereal
Cerealvor 19 Tagen

Right was that because of the limitations of the arms or astra?

Profilbild von Dmytro Hrybov
Dmytro Hrybovvor 19 Tagen

definitely astra, it was tractable to do with this hardware but trajectories didn’t make sene

Profilbild von walf
walfvor 19 Tagen

Could you elaborate? What is Astra actually doing in this demo? Is astra generating a trajectory for both arms then executing it open loop? Is it generating end effector positions for each step and the playback is significantly sped up?

Profilbild von Dmytro Hrybov
Dmytro Hrybovvor 19 Tagen

it wrote the controller that translates gripper targets into joint commands and the task code that chooses those targets for every step it wasn’t making model calls every frame, playback is 1× speed

Profilbild von walf
walfvor 19 Tagen

Ahh I see. So is the model called at all during the simulation or did it just write the code the accomplish the task?

Profilbild von Dmytro Hrybov
Dmytro Hrybovvor 19 Tagen

no it basically prepared it all in advance, which would be useful as rl/imitation learning data, to be tested yet how it'll perform this as a policy

Profilbild von walf
walfvor 19 Tagen

Thanks for the quick responses!

Profilbild von Miquel Muñoz García-Ramos
Miquel Muñoz García-Ramosvor 19 Tagen

you cant blame him

Profilbild von Paolo AI
Paolo AIvor 19 Tagen

@SpinworksTech need cables

Profilbild von H
Hvor 19 Tagen

Interesting, could be used in data centres

Profilbild von Djahit Gench
Djahit Genchvor 19 Tagen

@26pablo7 cracked

Profilbild von Jakie PLA
Jakie PLAvor 19 Tagen

ONE OF US. 2+1 is solid. I need a physical rig. EarPods will hate me.

Profilbild von Srinath Mahankali
Srinath Mahankalivor 19 Tagen

Which simulator is this?

Profilbild von Dmytro Hrybov
Dmytro Hrybovvor 19 Tagen

MuJoCo

Profilbild von Srinath Mahankali
Srinath Mahankalivor 19 Tagen

whoa, the wire simulation seems pretty good here, esp for mujoco.

Profilbild von Alain
Alainvor 19 Tagen

ok now do the drawer with all the old chargers

Profilbild von Dmytro Hrybov
Dmytro Hrybovvor 19 Tagen

that's ASI-level capabilities

Profilbild von sophs j.
sophs j.vor 18 Tagen

Thanks for sharing this

Profilbild von Imhoxbt
Imhoxbtvor 19 Tagen

Headphones with one extra knot is still a fair limit

Profilbild von Techniahqrobot | humanoid robots
Techniahqrobot | humanoid robotsvor 19 Tagen

The 2+1 limit is a useful result. One wrong pull can tighten another crossing and invalidate the whole plan. I’d like to see Astra reobserve the headphones after each move and plan the next pull from the updated state.

Profilbild von Yi Yang
Yi Yangvor 19 Tagen

What kind of simulator is this? It simulates the cables so well!

Profilbild von James Camarota
James Camarotavor 19 Tagen

Finding a clean limit is valuable. What failure mode showed up first with extra entanglements: perception, planning, or execution?

Ähnliche Videos