正在加载视频...

视频加载失败

Vibe Coding Robotics Part 8 Built a hexapod simulator with Claude Opus 4.6 Based on an open source algorithm that works on real hexapod robots. UI design generated with Nano Banana. More details ↓

490,282 次观看 • 8 个月前 •via X (Twitter)

59 条评论

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

1. Instead of asking AI to write the algorithm from scratch, I wanted to see if Claude could take an existing hexapod algorithm from GitHub and implement it the way I wanted. I used Gemini in other parts, but from my testing, Claude works really well at transforming code from other repos, so I used Claude for this one.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

2.This is the open source repo I used, created by Mithi Sevilla. (could not find them on X). I made a Next.js and shadcn version of this repo a couple of months ago while trying to understand the algorithm.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

3. I copied code from one of my old robotics demos and from the hexapod repo into a single repo and used that as context for Claude. I asked it to reuse the algorithm from the original repo but build the visualization using techniques from my robotics demo.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

4. The main difference is that the original repo uses Plotly, while I wanted to use three.js. That meant Claude had to write a whole new set of transform functions to convert data meant for Plotly into something usable in three.js.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

5. I also asked Claude to convert everything it used from the original repo to TypeScript and to convert all classes into function based implementations. While I eventually reached a point with no TypeScript errors, I would call it a lazy conversion. React class components were converted to functional components successfully, but it struggled with classes in the core algorithm.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

6. Overall, it did a good job and I got it working. I did have to review the code a few times and explain what went wrong when some fixes were clearly going nowhere.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

7. Next time, I will probably try converting a simulation written in a language other than JS or TS to see what happens.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

8. In case you missed it, here is the last part of the Vibe Coding Robotics series where I built Leonardo da Vinci's ornithopter.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

9. I also have a series where I try to make games with AI. Here is the latest part of that series.

Kayoum 的头像
Kayoum8 个月前

That's cool! Check what we built, with the same vision as eventually vibe coding robotics!

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

looks awesome!. love seeing more people exploring this space

Kayoum 的头像
Kayoum8 个月前

Thank you, Same here, keep those awesome demos coming

kitze 🛠️ tinkerer.club 的头像
kitze 🛠️ tinkerer.club8 个月前

jesus christ this is insane

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

haha, thanks Kitze

Chang 的头像
Chang8 个月前

Stunning

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks

𝓓ᵉⓥ𝐎ⓝ ǤŕẸєŇ𝔢 🧐 的头像
𝓓ᵉⓥ𝐎ⓝ ǤŕẸєŇ𝔢 🧐8 个月前

Tachikoma here we come!

AA 的头像
AA8 个月前

all hail the king of robotic simulators please don’t make a real version of this, it terrifies me

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks 🤖 I may or may not have been eyeing some 3D printers recently 😉

Strongly.AI 的头像
Strongly.AI8 个月前

This is super cool. Thanks for sharing. UI and animations are becoming more than ever important in distilling complexity.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks

Lucas ➔ decorebator.com 的头像
Lucas ➔ decorebator.com8 个月前

Amazing. How do you go from the nano banana mock-up to code?

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks. I attach the nano nanana image with the prompts and ask claude to implement it. If it misses parts, I add a screenshot of the specific section so it can focus on that part

Lucas ➔ decorebator.com 的头像
Lucas ➔ decorebator.com8 个月前

I have been doing the same for mobile apps. I fully describe the UI styling so that all screens generated follow the same esthetics but it’s kinda hard when you have multiple screens and flows. I have to constantly be poking Claude to follow suit and then address somes differences

Albert Latham 的头像
Albert Latham8 个月前

If you watch a spider's walk cycle you'll see that a limb will enter a state of 'traction seeking', where it will move that limb a few times in order to find a point of traction on a surface. I saw demos from nearly 10 years ago where a guy had done this algorithmically for procedural animation, and it looked really, really good. Talk this through with Claude and see where it gets you.

Arafat 的头像
Arafat8 个月前

Claude excelled at transforming and implementing code.

Sam 的头像
Sam8 个月前

i like your projects 🔥

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks

OràKwé 的头像
OràKwé8 个月前

Everything will be so easy, even hardware..🎉

Henno 的头像
Henno8 个月前

bruhh. That's insane! Such a fun UI. We need to make software more fun

Will Cheung 的头像
Will Cheung8 个月前

So cool. Never thought to vibe code the simulator.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks

AI Simplified 的头像
AI Simplified8 个月前

Wow, this looks awesome

Nilesh Garg 的头像
Nilesh Garg8 个月前

Developments in this space make me super optimistic

Dumb AI Leaks 的头像
Dumb AI Leaks8 个月前

Stargate - Replicators .. that's all I'll say

Moken 的头像
Moken8 个月前

good job

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

@occultist357 thanks

Scarab 的头像
Scarab8 个月前

Not what Linus was wanting to be vibe coding, but this process may be interesting to @linusgsebastian, Luke, and @BuhDan. Vibe coding an interface for a robotics simulator off #GitHub, complete with UI generated from images. And no #ChatGPT in sight. 😜

Todd Peterson 的头像
Todd Peterson8 个月前

I love the interface

AI老王 的头像
AI老王8 个月前

Excellent!

Kate 的头像
Kate8 个月前

😳Even though I’m not in this field, I couldn’t help but stop and analyze this work. It’s a perfect case study for the 'Bridge between Intent and Execution.' > This sparked a new direction for my upcoming AI Tests: How do we measure the 'reasoning depth' when an AI translates a high-level vibe into a complex kinematic system? 🤖🧠 This is more than coding; it’s a shift in cognitive architecture. Truly inspiring! 🪞🌙

Ammari Ai 的头像
Ammari Ai8 个月前

Wow. Amazing.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks

Jimmy 的头像
Jimmy8 个月前

Worth a follow

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks Jimmy

The Gadgets Fan 的头像
The Gadgets Fan8 个月前

lovely ui

foundrceo 的头像
foundrceo8 个月前

this is dope man, can i get a hexapod as a pet? 😂

Rishik Tiwari (ऋषिक) 的头像
Rishik Tiwari (ऋषिक)8 个月前

Ui is beautiful

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks

Samwise stark 的头像
Samwise stark8 个月前

Love it, how to get started ?

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks. start with something simple. take an app you use every day and describe its features in prompts, then try to implement it. expect things to break. what you usually see online are the good outcomes, not the many failed tries

EyeFloater 的头像
EyeFloater8 个月前

Suuuuper clean!

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks

Himanshu Kumar 的头像
Himanshu Kumar8 个月前

@DilumSanjaya, building a hexapod simulator with Claude Opus is a neat way to test robotics algorithms.

Kseniya Artman 的头像
Kseniya Artman8 个月前

The IK solver looks incredibly stable. Getting a hexapod gait this smooth usually takes weeks of manual tweaking. Seeing it 'vibe coded' into existence is a massive flex for the workflow.

Helder Perez 的头像
Helder Perez8 个月前

That's an impressive hexapod simulator! The UI design generated with Nano Banana looks great.

Dilum Sanjaya 的头像
Dilum Sanjaya8 个月前

thanks Helder

Bautista 的头像
Bautista8 个月前

Nice

KOR-Blitzer 的头像
KOR-Blitzer8 个月前

Seen how this ends...

相关视频