正在加载视频...
视频加载失败
Two robot arms collaboratively assembling an engine part Had Opus 5.5 figure out the planning and coordination I think this is a promising direction for fully automated robotic systems, even if some steps still require more capable hardware
28,129 次观看 • 1 个月前 •via X (Twitter)
14 条评论

It does have issues, like the end effectors occasionally clipping through objects, but this is just the result after a couple of hours. Also, this is a kinematic simulation/planner, not a full physics simulation. What I’m interested in is: given a task, how would a model plan and coordinate its execution across multiple robots? To take this into the real world, you’d need to validate those trajectories with a physics simulator like MuJoCo, accounting for dynamics, actuator limits, forces, torque, friction, collisions, and contact behavior.

I had a series called "Vibe Coding Robotics" This is kind of the next phase, where I’m trying more complicated tasks.

Another thing I want to try is seeing whether models can use mechanisms like these to design new types of robots. I’ll be posting some experiments related to that too.

Looks great! Umbelievable where this is going! R u render with 3js or something else ?

thanks, yeah this one is three.js, probably try something similar with MuJoCo

İt seems quite well. Could you give some more details?

thanks, what details are you interested in? basically I uploaded a robot arm and gave some basic idea of what the engine part needs to be. then asked opus to break that task into steps and make both arms work collaboratively to achieve it.

This is the direction that matters: AI coordinating systems, not just generating snippets. The workflow gets powerful when the model can plan, test, and recover from failures.

@DilumSanjaya good work any GitHub links.

I’m also studying these now. If there is a simulation program to do it, driven by opus, the whole agent framework, such as pi, I think it is feasible. But I don‘t have this open-source simulation software now.

Looks great in cad, now try it irl

The MuJoCo follow-up should be fun. I'm curious whether Opus keeps the same handoff sequence once contact forces couple the two arms.

看起来你的模型一开始就知道物体的准确位置和准确的放置位置信息?所以才能这么丝滑的放到正确的地方?

awesome! is there GitHub link?
