正在加载视频...

视频加载失败

tested Astra’s wiring manipulation capabilities in simulation i asked it to untangle a pair of headphones with 2+1 entanglements this seemed to be its limit: with more entanglements added, it couldn’t find a workable strategy

10,350 次观看 • 19 天前 •via X (Twitter)

29 条评论

underscore advait patel 的头像
underscore advait patel19 天前

it’s ok i can’t either

Dmytro Hrybov 的头像
Dmytro Hrybov19 天前

“achieved human-level capabilities on untangle earpods bench”

Dmytro Hrybov 的头像
Dmytro Hrybov19 天前

this rope-threading experiment inspired me to test wiring capabilities further

Jiawei Yang 的头像
Jiawei Yang19 天前

Any open source plan for the sim env?

Dmytro Hrybov 的头像
Dmytro Hrybov19 天前

here :)

Cereal 的头像
Cereal19 天前

impressive none the least. I'm curious is the 2+ knots a limitation of astra or the hardware?

Dmytro Hrybov 的头像
Dmytro Hrybov19 天前

i tried complex scenarios with more knots in sim but astra didn't manage to untangle them

Cereal 的头像
Cereal19 天前

Right was that because of the limitations of the arms or astra?

Dmytro Hrybov 的头像
Dmytro Hrybov19 天前

definitely astra, it was tractable to do with this hardware but trajectories didn’t make sene

walf 的头像
walf19 天前

Could you elaborate? What is Astra actually doing in this demo? Is astra generating a trajectory for both arms then executing it open loop? Is it generating end effector positions for each step and the playback is significantly sped up?

Dmytro Hrybov 的头像
Dmytro Hrybov19 天前

it wrote the controller that translates gripper targets into joint commands and the task code that chooses those targets for every step it wasn’t making model calls every frame, playback is 1× speed

walf 的头像
walf19 天前

Ahh I see. So is the model called at all during the simulation or did it just write the code the accomplish the task?

Dmytro Hrybov 的头像
Dmytro Hrybov19 天前

no it basically prepared it all in advance, which would be useful as rl/imitation learning data, to be tested yet how it'll perform this as a policy

walf 的头像
walf19 天前

Thanks for the quick responses!

Miquel Muñoz García-Ramos 的头像
Miquel Muñoz García-Ramos19 天前

you cant blame him

Paolo AI 的头像
Paolo AI19 天前

@SpinworksTech need cables

H 的头像
H19 天前

Interesting, could be used in data centres

Djahit Gench 的头像
Djahit Gench19 天前

@26pablo7 cracked

Jakie PLA 的头像
Jakie PLA19 天前

ONE OF US. 2+1 is solid. I need a physical rig. EarPods will hate me.

Srinath Mahankali 的头像
Srinath Mahankali19 天前

Which simulator is this?

Dmytro Hrybov 的头像
Dmytro Hrybov19 天前

MuJoCo

Srinath Mahankali 的头像
Srinath Mahankali19 天前

whoa, the wire simulation seems pretty good here, esp for mujoco.

Alain 的头像
Alain19 天前

ok now do the drawer with all the old chargers

Dmytro Hrybov 的头像
Dmytro Hrybov19 天前

that's ASI-level capabilities

sophs j. 的头像
sophs j.18 天前

Thanks for sharing this

Imhoxbt 的头像
Imhoxbt19 天前

Headphones with one extra knot is still a fair limit

Techniahqrobot | humanoid robots 的头像
Techniahqrobot | humanoid robots19 天前

The 2+1 limit is a useful result. One wrong pull can tighten another crossing and invalidate the whole plan. I’d like to see Astra reobserve the headphones after each move and plan the next pull from the updated state.

Yi Yang 的头像
Yi Yang19 天前

What kind of simulator is this? It simulates the cables so well!

James Camarota 的头像
James Camarota19 天前

Finding a clean limit is valuable. What failure mode showed up first with extra entanglements: perception, planning, or execution?

相关视频