Loading video...

Video Failed to Load

Go Home

Vibe Coding Robotics Part 9 First demo with Gemini 3.1 Pro Industrial robot arm IK simulation Design generated with Nano Banana

290,385 views • 7 months ago •via X (Twitter)

46 Comments

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

Compared to Gemini 3 Pro, I think 3.1 version has noticeably better than version 3 at understanding how to place items in a 3D space. For the other UI tasks I didn't notice a significant difference.

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

In case you missed it, here is the last part of the Vibe Coding Robotics series where I built a hexapod simulator with Claude Opus

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

I also have a series where I try to make games with AI. Here is the last part of that series. Will try to make something new with new Nano Banana version next.

Reza Sayar's profile picture
Reza Sayar7 months ago

So Is this like a web app or something? Are all of these numbers, controls and values actually tied to / mean something or are they mostly for aesthetics purposes for now? 😁

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

Yeah, it's a web app. The dials for the joint angles represent actual rotation values from the IK solution. The velocity metrics and force readouts are based on a noise function, so those aren't tied to anything

RC's profile picture
RC7 months ago

How much of this is just a video file with no accurate metrics?

yanno's profile picture
yanno7 months ago

How is this made? I would like to learn.

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

more details about my process are in this post

Tekhnelysi's profile picture
Tekhnelysi7 months ago

Looks pretty cool

Barron Roth's profile picture
Barron Roth7 months ago

how do you feel gemini 3.1 performs against opus for 3d?

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

For physics simulations like this, I feel Gemini is better than Opus. I tried building a terrain editor for games and CAD software using both Gemini and Opus. For those tasks, Opus performed better. So I would say that as the codebase becomes larger, Opus tends to perform better overall.

KAI's profile picture
KAI7 months ago

this is where llms get interesting - when they touch the physical world, the failure modes are different and the rewards are bigger. software-only ai wrappers are a crowded space. llms + robotics? still early, big upside.

Zainab Arshad's profile picture
Zainab Arshad7 months ago

AI is becoming a real robotics co-engineer.

Tsung Xu's profile picture
Tsung Xu7 months ago

Neat, what's the physics model?

Christiano 🦾🌱's profile picture
Christiano 🦾🌱7 months ago

🦾🫡

Samurai Jack's profile picture
Samurai Jack7 months ago

@GoogleDeepMind is all about jus simulation thanks to @demishassabis

Dolan's profile picture
Dolan7 months ago

kinda coool

Anant Dadhich's profile picture
Anant Dadhich7 months ago

now ai getting interesting

e.ev's profile picture
e.ev7 months ago

Inverse kinematics is where the spatial reasoning difference actually shows up. Most benchmarks test text generation, not whether the model can hold geometric constraints in mind.

Nirav Bhadradiya's profile picture
Nirav Bhadradiya7 months ago

Gemini 3.1 Pro doing industrial robot IK simulation in one vibe-coding session is wild. The crossover between agentic reasoning and physics sims is exactly where real-world autonomy gets built. this level of integration changes the game for hardware + AI teams

CrazyAI Tech's profile picture
CrazyAI Tech7 months ago

Gemini 3.1 Pro improves a lot at the robotics level.

Max Palmer's profile picture
Max Palmer7 months ago

very cute style

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

thanks

George Merchant's profile picture
George Merchant7 months ago

Welp you earned a follow

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

awesome!

Sylvain Legland 🇪🇺🇫🇷🇺🇦's profile picture
Sylvain Legland 🇪🇺🇫🇷🇺🇦7 months ago

three.js ?

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

yes

Carolina's profile picture
Carolina7 months ago

amazing.

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

thanks

Vamsi Batchu's profile picture
Vamsi Batchu7 months ago

as always !! amazing 🔥

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

thanks Vamsi

Tatyana Waves's profile picture
Tatyana Waves7 months ago

😯

Base Layer Robotics's profile picture
Base Layer Robotics7 months ago

Thats bad ass!

Dilum Sanjaya's profile picture
Dilum Sanjaya7 months ago

thanks

Niko Lee's profile picture
Niko Lee7 months ago

Nano Banana is getting a lot of hype lately, I can see why.

Hands-On PM's profile picture
Hands-On PM7 months ago

@LucienReconq cool

Marcelo Design X's profile picture
Marcelo Design X7 months ago

Wow

Baker's profile picture
Baker7 months ago

As a licensed FANUC robotics operator, I approve of this message

Hannah | atypica.ai's profile picture
Hannah | atypica.ai6 months ago

super cool, especially having everything from design to simulation in one flow, feels like a new kind of builder stack emerging here, would be great to connect

Vish's profile picture
Vish7 months ago

the IK simulation is where this gets really interesting. most vibe coding projects are web apps and dashboards... seeing someone push it into robotics with actual inverse kinematics is a completely different challenge. the spatial reasoning improvement in 3.1 makes sense too, IK solvers need the model to actually understand joint constraints in 3D space not just generate code that compiles

Turk 🇺🇸's profile picture
Turk 🇺🇸7 months ago

seeing this at the top of my feed gives me hop the algo is getting back on track

Endeavor's profile picture
Endeavor7 months ago

I feel like the next step is to take these industrial robots out of industries. We need to see them in stores, malls, and be more indulged in our daily life.

Johnny freedom🇺🇦🇪🇺🇬🇧🇮🇱's profile picture
Johnny freedom🇺🇦🇪🇺🇬🇧🇮🇱7 months ago

Could you please show me the command for this simulation?

Sadi Moodi's profile picture
Sadi Moodi7 months ago

This is wild! Gemini 3.1 Pro crushing the IK simulation. The key insight: for physics-heavy tasks, Gemini's spatial reasoning shines. For larger codebases, Opus still wins. Pro tip: use noise functions for metrics that don't need real data - saves compute and looks legit. 🔥

(noahs arc)'s profile picture
(noahs arc)7 months ago

seems like an inefficient way to move boxes 1 foot

Jacey's profile picture
Jacey7 months ago

This is exactly where AI gets interesting — when you chain models together. Nano Banana for design. Gemini Pro for logic. Next step: add video generation for the full simulation. The future of robotics dev is multi-model pipelines, not single-model magic.

Related Videos