Loading video...

Video Failed to Load

Go Home

Vibe Coding Robotics Part 8 Built a hexapod simulator with Claude Opus 4.6 Based on an open source algorithm that works on real hexapod robots. UI design generated with Nano Banana. More details ↓

490,282 views • 8 months ago •via X (Twitter)

59 Comments

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

1. Instead of asking AI to write the algorithm from scratch, I wanted to see if Claude could take an existing hexapod algorithm from GitHub and implement it the way I wanted. I used Gemini in other parts, but from my testing, Claude works really well at transforming code from other repos, so I used Claude for this one.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

2.This is the open source repo I used, created by Mithi Sevilla. (could not find them on X). I made a Next.js and shadcn version of this repo a couple of months ago while trying to understand the algorithm.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

3. I copied code from one of my old robotics demos and from the hexapod repo into a single repo and used that as context for Claude. I asked it to reuse the algorithm from the original repo but build the visualization using techniques from my robotics demo.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

4. The main difference is that the original repo uses Plotly, while I wanted to use three.js. That meant Claude had to write a whole new set of transform functions to convert data meant for Plotly into something usable in three.js.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

5. I also asked Claude to convert everything it used from the original repo to TypeScript and to convert all classes into function based implementations. While I eventually reached a point with no TypeScript errors, I would call it a lazy conversion. React class components were converted to functional components successfully, but it struggled with classes in the core algorithm.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

6. Overall, it did a good job and I got it working. I did have to review the code a few times and explain what went wrong when some fixes were clearly going nowhere.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

7. Next time, I will probably try converting a simulation written in a language other than JS or TS to see what happens.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

8. In case you missed it, here is the last part of the Vibe Coding Robotics series where I built Leonardo da Vinci's ornithopter.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

9. I also have a series where I try to make games with AI. Here is the latest part of that series.

Kayoum's profile picture
Kayoum8 months ago

That's cool! Check what we built, with the same vision as eventually vibe coding robotics!

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

looks awesome!. love seeing more people exploring this space

Kayoum's profile picture
Kayoum8 months ago

Thank you, Same here, keep those awesome demos coming

kitze 🛠️ tinkerer.club's profile picture
kitze 🛠️ tinkerer.club8 months ago

jesus christ this is insane

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

haha, thanks Kitze

Chang's profile picture
Chang8 months ago

Stunning

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks

𝓓ᵉⓥ𝐎ⓝ ǤŕẸєŇ𝔢 🧐's profile picture
𝓓ᵉⓥ𝐎ⓝ ǤŕẸєŇ𝔢 🧐8 months ago

Tachikoma here we come!

AA's profile picture
AA8 months ago

all hail the king of robotic simulators please don’t make a real version of this, it terrifies me

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks 🤖 I may or may not have been eyeing some 3D printers recently 😉

Strongly.AI's profile picture
Strongly.AI8 months ago

This is super cool. Thanks for sharing. UI and animations are becoming more than ever important in distilling complexity.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks

Lucas ➔ decorebator.com's profile picture
Lucas ➔ decorebator.com8 months ago

Amazing. How do you go from the nano banana mock-up to code?

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks. I attach the nano nanana image with the prompts and ask claude to implement it. If it misses parts, I add a screenshot of the specific section so it can focus on that part

Lucas ➔ decorebator.com's profile picture
Lucas ➔ decorebator.com8 months ago

I have been doing the same for mobile apps. I fully describe the UI styling so that all screens generated follow the same esthetics but it’s kinda hard when you have multiple screens and flows. I have to constantly be poking Claude to follow suit and then address somes differences

Albert Latham's profile picture
Albert Latham8 months ago

If you watch a spider's walk cycle you'll see that a limb will enter a state of 'traction seeking', where it will move that limb a few times in order to find a point of traction on a surface. I saw demos from nearly 10 years ago where a guy had done this algorithmically for procedural animation, and it looked really, really good. Talk this through with Claude and see where it gets you.

Arafat's profile picture
Arafat8 months ago

Claude excelled at transforming and implementing code.

Sam's profile picture
Sam8 months ago

i like your projects 🔥

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks

OràKwé's profile picture
OràKwé8 months ago

Everything will be so easy, even hardware..🎉

Henno's profile picture
Henno8 months ago

bruhh. That's insane! Such a fun UI. We need to make software more fun

Will Cheung's profile picture
Will Cheung8 months ago

So cool. Never thought to vibe code the simulator.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks

AI Simplified's profile picture
AI Simplified8 months ago

Wow, this looks awesome

Nilesh Garg's profile picture
Nilesh Garg8 months ago

Developments in this space make me super optimistic

Dumb AI Leaks's profile picture
Dumb AI Leaks8 months ago

Stargate - Replicators .. that's all I'll say

Moken's profile picture
Moken8 months ago

good job

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

@occultist357 thanks

Scarab's profile picture
Scarab8 months ago

Not what Linus was wanting to be vibe coding, but this process may be interesting to @linusgsebastian, Luke, and @BuhDan. Vibe coding an interface for a robotics simulator off #GitHub, complete with UI generated from images. And no #ChatGPT in sight. 😜

Todd Peterson's profile picture
Todd Peterson8 months ago

I love the interface

AI老王's profile picture
AI老王8 months ago

Excellent!

Kate's profile picture
Kate8 months ago

😳Even though I’m not in this field, I couldn’t help but stop and analyze this work. It’s a perfect case study for the 'Bridge between Intent and Execution.' > This sparked a new direction for my upcoming AI Tests: How do we measure the 'reasoning depth' when an AI translates a high-level vibe into a complex kinematic system? 🤖🧠 This is more than coding; it’s a shift in cognitive architecture. Truly inspiring! 🪞🌙

Ammari Ai's profile picture
Ammari Ai8 months ago

Wow. Amazing.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks

Jimmy's profile picture
Jimmy8 months ago

Worth a follow

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks Jimmy

The Gadgets Fan's profile picture
The Gadgets Fan8 months ago

lovely ui

foundrceo's profile picture
foundrceo8 months ago

this is dope man, can i get a hexapod as a pet? 😂

Rishik Tiwari (ऋषिक)'s profile picture
Rishik Tiwari (ऋषिक)8 months ago

Ui is beautiful

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks

Samwise stark's profile picture
Samwise stark8 months ago

Love it, how to get started ?

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks. start with something simple. take an app you use every day and describe its features in prompts, then try to implement it. expect things to break. what you usually see online are the good outcomes, not the many failed tries

EyeFloater's profile picture
EyeFloater8 months ago

Suuuuper clean!

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks

Himanshu Kumar's profile picture
Himanshu Kumar8 months ago

@DilumSanjaya, building a hexapod simulator with Claude Opus is a neat way to test robotics algorithms.

Kseniya Artman's profile picture
Kseniya Artman8 months ago

The IK solver looks incredibly stable. Getting a hexapod gait this smooth usually takes weeks of manual tweaking. Seeing it 'vibe coded' into existence is a massive flex for the workflow.

Helder Perez's profile picture
Helder Perez8 months ago

That's an impressive hexapod simulator! The UI design generated with Nano Banana looks great.

Dilum Sanjaya's profile picture
Dilum Sanjaya8 months ago

thanks Helder

Bautista's profile picture
Bautista8 months ago

Nice

KOR-Blitzer's profile picture
KOR-Blitzer8 months ago

Seen how this ends...

Related Videos