正在加载视频...

视频加载失败

Two robot arms collaboratively assembling an engine part Had Opus 5.5 figure out the planning and coordination I think this is a promising direction for fully automated robotic systems, even if some steps still require more capable hardware

28,129 次观看 • 1 个月前 •via X (Twitter)

14 条评论

Dilum Sanjaya 的头像
Dilum Sanjaya1 个月前

It does have issues, like the end effectors occasionally clipping through objects, but this is just the result after a couple of hours. Also, this is a kinematic simulation/planner, not a full physics simulation. What I’m interested in is: given a task, how would a model plan and coordinate its execution across multiple robots? To take this into the real world, you’d need to validate those trajectories with a physics simulator like MuJoCo, accounting for dynamics, actuator limits, forces, torque, friction, collisions, and contact behavior.

Dilum Sanjaya 的头像
Dilum Sanjaya1 个月前

I had a series called "Vibe Coding Robotics" This is kind of the next phase, where I’m trying more complicated tasks.

Dilum Sanjaya 的头像
Dilum Sanjaya1 个月前

Another thing I want to try is seeing whether models can use mechanisms like these to design new types of robots. I’ll be posting some experiments related to that too.

Amine Kharrat 的头像
Amine Kharrat1 个月前

Looks great! Umbelievable where this is going! R u render with 3js or something else ?

Dilum Sanjaya 的头像
Dilum Sanjaya1 个月前

thanks, yeah this one is three.js, probably try something similar with MuJoCo

kral şakir 的头像
kral şakir1 个月前

İt seems quite well. Could you give some more details?

Dilum Sanjaya 的头像
Dilum Sanjaya1 个月前

thanks, what details are you interested in? basically I uploaded a robot arm and gave some basic idea of what the engine part needs to be. then asked opus to break that task into steps and make both arms work collaboratively to achieve it.

Austin Armstrong 的头像
Austin Armstrong1 个月前

This is the direction that matters: AI coordinating systems, not just generating snippets. The workflow gets powerful when the model can plan, test, and recover from failures.

Taher tadpari 的头像
Taher tadpari1 个月前

@DilumSanjaya good work any GitHub links.

mike chen 的头像
mike chen1 个月前

I’m also studying these now. If there is a simulation program to do it, driven by opus, the whole agent framework, such as pi, I think it is feasible. But I don‘t have this open-source simulation software now.

ICanAutomateThat 的头像
ICanAutomateThat1 个月前

Looks great in cad, now try it irl

Leo 的头像
Leo1 个月前

The MuJoCo follow-up should be fun. I'm curious whether Opus keeps the same handoff sequence once contact forces couple the two arms.

chener 的头像
chener1 个月前

看起来你的模型一开始就知道物体的准确位置和准确的放置位置信息?所以才能这么丝滑的放到正确的地方?

tower 的头像
tower1 个月前

awesome! is there GitHub link?

相关视频