Loading video...

Video Failed to Load

Go Home

tested Astra’s wiring manipulation capabilities in simulation i asked it to untangle a pair of headphones with 2+1 entanglements this seemed to be its limit: with more entanglements added, it couldn’t find a workable strategy

10,350 views • 19 days ago •via X (Twitter)

29 Comments

underscore advait patel's profile picture
underscore advait patel19 days ago

it’s ok i can’t either

Dmytro Hrybov's profile picture
Dmytro Hrybov19 days ago

“achieved human-level capabilities on untangle earpods bench”

Dmytro Hrybov's profile picture
Dmytro Hrybov19 days ago

this rope-threading experiment inspired me to test wiring capabilities further

Jiawei Yang's profile picture
Jiawei Yang19 days ago

Any open source plan for the sim env?

Dmytro Hrybov's profile picture
Dmytro Hrybov19 days ago

here :)

Cereal's profile picture
Cereal19 days ago

impressive none the least. I'm curious is the 2+ knots a limitation of astra or the hardware?

Dmytro Hrybov's profile picture
Dmytro Hrybov19 days ago

i tried complex scenarios with more knots in sim but astra didn't manage to untangle them

Cereal's profile picture
Cereal19 days ago

Right was that because of the limitations of the arms or astra?

Dmytro Hrybov's profile picture
Dmytro Hrybov19 days ago

definitely astra, it was tractable to do with this hardware but trajectories didn’t make sene

walf's profile picture
walf19 days ago

Could you elaborate? What is Astra actually doing in this demo? Is astra generating a trajectory for both arms then executing it open loop? Is it generating end effector positions for each step and the playback is significantly sped up?

Dmytro Hrybov's profile picture
Dmytro Hrybov19 days ago

it wrote the controller that translates gripper targets into joint commands and the task code that chooses those targets for every step it wasn’t making model calls every frame, playback is 1× speed

walf's profile picture
walf19 days ago

Ahh I see. So is the model called at all during the simulation or did it just write the code the accomplish the task?

Dmytro Hrybov's profile picture
Dmytro Hrybov19 days ago

no it basically prepared it all in advance, which would be useful as rl/imitation learning data, to be tested yet how it'll perform this as a policy

walf's profile picture
walf19 days ago

Thanks for the quick responses!

Miquel Muñoz García-Ramos's profile picture
Miquel Muñoz García-Ramos19 days ago

you cant blame him

Paolo AI's profile picture
Paolo AI19 days ago

@SpinworksTech need cables

H's profile picture
H19 days ago

Interesting, could be used in data centres

Djahit Gench's profile picture
Djahit Gench19 days ago

@26pablo7 cracked

Jakie PLA's profile picture
Jakie PLA19 days ago

ONE OF US. 2+1 is solid. I need a physical rig. EarPods will hate me.

Srinath Mahankali's profile picture
Srinath Mahankali19 days ago

Which simulator is this?

Dmytro Hrybov's profile picture
Dmytro Hrybov19 days ago

MuJoCo

Srinath Mahankali's profile picture
Srinath Mahankali19 days ago

whoa, the wire simulation seems pretty good here, esp for mujoco.

Alain's profile picture
Alain19 days ago

ok now do the drawer with all the old chargers

Dmytro Hrybov's profile picture
Dmytro Hrybov19 days ago

that's ASI-level capabilities

sophs j.'s profile picture
sophs j.18 days ago

Thanks for sharing this

Imhoxbt's profile picture
Imhoxbt19 days ago

Headphones with one extra knot is still a fair limit

Techniahqrobot | humanoid robots's profile picture
Techniahqrobot | humanoid robots19 days ago

The 2+1 limit is a useful result. One wrong pull can tighten another crossing and invalidate the whole plan. I’d like to see Astra reobserve the headphones after each move and plan the next pull from the updated state.

Yi Yang's profile picture
Yi Yang19 days ago

What kind of simulator is this? It simulates the cables so well!

James Camarota's profile picture
James Camarota19 days ago

Finding a clean limit is valuable. What failure mode showed up first with extra entanglements: perception, planning, or execution?

Related Videos