Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Two robot arms collaboratively assembling an engine part Had Opus 5.5 figure out the planning and coordination I think this is a promising direction for fully automated robotic systems, even if some steps still require more capable hardware

31,148 Aufrufe • vor 1 Monat •via X (Twitter)

14 Kommentare

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 1 Monat

It does have issues, like the end effectors occasionally clipping through objects, but this is just the result after a couple of hours. Also, this is a kinematic simulation/planner, not a full physics simulation. What I’m interested in is: given a task, how would a model plan and coordinate its execution across multiple robots? To take this into the real world, you’d need to validate those trajectories with a physics simulator like MuJoCo, accounting for dynamics, actuator limits, forces, torque, friction, collisions, and contact behavior.

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 1 Monat

I had a series called "Vibe Coding Robotics" This is kind of the next phase, where I’m trying more complicated tasks.

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 1 Monat

Another thing I want to try is seeing whether models can use mechanisms like these to design new types of robots. I’ll be posting some experiments related to that too.

Profilbild von Amine Kharrat
Amine Kharratvor 1 Monat

Looks great! Umbelievable where this is going! R u render with 3js or something else ?

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 1 Monat

thanks, yeah this one is three.js, probably try something similar with MuJoCo

Profilbild von kral şakir
kral şakirvor 1 Monat

İt seems quite well. Could you give some more details?

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 1 Monat

thanks, what details are you interested in? basically I uploaded a robot arm and gave some basic idea of what the engine part needs to be. then asked opus to break that task into steps and make both arms work collaboratively to achieve it.

Profilbild von Austin Armstrong
Austin Armstrongvor 1 Monat

This is the direction that matters: AI coordinating systems, not just generating snippets. The workflow gets powerful when the model can plan, test, and recover from failures.

Profilbild von Taher tadpari
Taher tadparivor 1 Monat

@DilumSanjaya good work any GitHub links.

Profilbild von mike chen
mike chenvor 1 Monat

I’m also studying these now. If there is a simulation program to do it, driven by opus, the whole agent framework, such as pi, I think it is feasible. But I don‘t have this open-source simulation software now.

Profilbild von ICanAutomateThat
ICanAutomateThatvor 1 Monat

Looks great in cad, now try it irl

Profilbild von Leo
Leovor 1 Monat

The MuJoCo follow-up should be fun. I'm curious whether Opus keeps the same handoff sequence once contact forces couple the two arms.

Profilbild von chener
chenervor 1 Monat

看起来你的模型一开始就知道物体的准确位置和准确的放置位置信息?所以才能这么丝滑的放到正确的地方?

Profilbild von tower
towervor 1 Monat

awesome! is there GitHub link?

Ähnliche Videos