Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Vibe Coding Robotics Part 9 First demo with Gemini 3.1 Pro Industrial robot arm IK simulation Design generated with Nano Banana

290,385 Aufrufe • vor 7 Monaten •via X (Twitter)

46 Kommentare

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

Compared to Gemini 3 Pro, I think 3.1 version has noticeably better than version 3 at understanding how to place items in a 3D space. For the other UI tasks I didn't notice a significant difference.

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

In case you missed it, here is the last part of the Vibe Coding Robotics series where I built a hexapod simulator with Claude Opus

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

I also have a series where I try to make games with AI. Here is the last part of that series. Will try to make something new with new Nano Banana version next.

Profilbild von Reza Sayar
Reza Sayarvor 7 Monaten

So Is this like a web app or something? Are all of these numbers, controls and values actually tied to / mean something or are they mostly for aesthetics purposes for now? 😁

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

Yeah, it's a web app. The dials for the joint angles represent actual rotation values from the IK solution. The velocity metrics and force readouts are based on a noise function, so those aren't tied to anything

Profilbild von RC
RCvor 7 Monaten

How much of this is just a video file with no accurate metrics?

Profilbild von yanno
yannovor 7 Monaten

How is this made? I would like to learn.

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

more details about my process are in this post

Profilbild von Tekhnelysi
Tekhnelysivor 7 Monaten

Looks pretty cool

Profilbild von Barron Roth
Barron Rothvor 7 Monaten

how do you feel gemini 3.1 performs against opus for 3d?

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

For physics simulations like this, I feel Gemini is better than Opus. I tried building a terrain editor for games and CAD software using both Gemini and Opus. For those tasks, Opus performed better. So I would say that as the codebase becomes larger, Opus tends to perform better overall.

Profilbild von KAI
KAIvor 7 Monaten

this is where llms get interesting - when they touch the physical world, the failure modes are different and the rewards are bigger. software-only ai wrappers are a crowded space. llms + robotics? still early, big upside.

Profilbild von Zainab Arshad
Zainab Arshadvor 7 Monaten

AI is becoming a real robotics co-engineer.

Profilbild von Tsung Xu
Tsung Xuvor 7 Monaten

Neat, what's the physics model?

Profilbild von Christiano 🦾🌱
Christiano 🦾🌱vor 7 Monaten

🦾🫡

Profilbild von Samurai Jack
Samurai Jackvor 7 Monaten

@GoogleDeepMind is all about jus simulation thanks to @demishassabis

Profilbild von Dolan
Dolanvor 7 Monaten

kinda coool

Profilbild von Anant Dadhich
Anant Dadhichvor 7 Monaten

now ai getting interesting

Profilbild von e.ev
e.evvor 7 Monaten

Inverse kinematics is where the spatial reasoning difference actually shows up. Most benchmarks test text generation, not whether the model can hold geometric constraints in mind.

Profilbild von Nirav Bhadradiya
Nirav Bhadradiyavor 7 Monaten

Gemini 3.1 Pro doing industrial robot IK simulation in one vibe-coding session is wild. The crossover between agentic reasoning and physics sims is exactly where real-world autonomy gets built. this level of integration changes the game for hardware + AI teams

Profilbild von CrazyAI Tech
CrazyAI Techvor 7 Monaten

Gemini 3.1 Pro improves a lot at the robotics level.

Profilbild von Max Palmer
Max Palmervor 7 Monaten

very cute style

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

thanks

Profilbild von George Merchant
George Merchantvor 7 Monaten

Welp you earned a follow

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

awesome!

Profilbild von Sylvain Legland 🇪🇺🇫🇷🇺🇦
Sylvain Legland 🇪🇺🇫🇷🇺🇦vor 7 Monaten

three.js ?

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

yes

Profilbild von Carolina
Carolinavor 7 Monaten

amazing.

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

thanks

Profilbild von Vamsi Batchu
Vamsi Batchuvor 7 Monaten

as always !! amazing 🔥

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

thanks Vamsi

Profilbild von Tatyana Waves
Tatyana Wavesvor 7 Monaten

😯

Profilbild von Base Layer Robotics
Base Layer Roboticsvor 7 Monaten

Thats bad ass!

Profilbild von Dilum Sanjaya
Dilum Sanjayavor 7 Monaten

thanks

Profilbild von Niko Lee
Niko Leevor 7 Monaten

Nano Banana is getting a lot of hype lately, I can see why.

Profilbild von Hands-On PM
Hands-On PMvor 7 Monaten

@LucienReconq cool

Profilbild von Marcelo Design X
Marcelo Design Xvor 7 Monaten

Wow

Profilbild von Baker
Bakervor 7 Monaten

As a licensed FANUC robotics operator, I approve of this message

Profilbild von Hannah | atypica.ai
Hannah | atypica.aivor 6 Monaten

super cool, especially having everything from design to simulation in one flow, feels like a new kind of builder stack emerging here, would be great to connect

Profilbild von Vish
Vishvor 7 Monaten

the IK simulation is where this gets really interesting. most vibe coding projects are web apps and dashboards... seeing someone push it into robotics with actual inverse kinematics is a completely different challenge. the spatial reasoning improvement in 3.1 makes sense too, IK solvers need the model to actually understand joint constraints in 3D space not just generate code that compiles

Profilbild von Turk 🇺🇸
Turk 🇺🇸vor 7 Monaten

seeing this at the top of my feed gives me hop the algo is getting back on track

Profilbild von Endeavor
Endeavorvor 7 Monaten

I feel like the next step is to take these industrial robots out of industries. We need to see them in stores, malls, and be more indulged in our daily life.

Profilbild von Johnny freedom🇺🇦🇪🇺🇬🇧🇮🇱
Johnny freedom🇺🇦🇪🇺🇬🇧🇮🇱vor 7 Monaten

Could you please show me the command for this simulation?

Profilbild von Sadi Moodi
Sadi Moodivor 7 Monaten

This is wild! Gemini 3.1 Pro crushing the IK simulation. The key insight: for physics-heavy tasks, Gemini's spatial reasoning shines. For larger codebases, Opus still wins. Pro tip: use noise functions for metrics that don't need real data - saves compute and looks legit. 🔥

Profilbild von (noahs arc)
(noahs arc)vor 7 Monaten

seems like an inefficient way to move boxes 1 foot

Profilbild von Jacey
Jaceyvor 7 Monaten

This is exactly where AI gets interesting — when you chain models together. Nano Banana for design. Gemini Pro for logic. Next step: add video generation for the full simulation. The future of robotics dev is multi-model pipelines, not single-model magic.

Ähnliche Videos