正在加载视频...

视频加载失败

Vibe Coding Robotics Part 9 First demo with Gemini 3.1 Pro Industrial robot arm IK simulation Design generated with Nano Banana

290,385 次观看 • 7 个月前 •via X (Twitter)

46 条评论

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

Compared to Gemini 3 Pro, I think 3.1 version has noticeably better than version 3 at understanding how to place items in a 3D space. For the other UI tasks I didn't notice a significant difference.

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

In case you missed it, here is the last part of the Vibe Coding Robotics series where I built a hexapod simulator with Claude Opus

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

I also have a series where I try to make games with AI. Here is the last part of that series. Will try to make something new with new Nano Banana version next.

Reza Sayar 的头像
Reza Sayar7 个月前

So Is this like a web app or something? Are all of these numbers, controls and values actually tied to / mean something or are they mostly for aesthetics purposes for now? 😁

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

Yeah, it's a web app. The dials for the joint angles represent actual rotation values from the IK solution. The velocity metrics and force readouts are based on a noise function, so those aren't tied to anything

RC 的头像
RC7 个月前

How much of this is just a video file with no accurate metrics?

yanno 的头像
yanno7 个月前

How is this made? I would like to learn.

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

more details about my process are in this post

Tekhnelysi 的头像
Tekhnelysi7 个月前

Looks pretty cool

Barron Roth 的头像
Barron Roth7 个月前

how do you feel gemini 3.1 performs against opus for 3d?

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

For physics simulations like this, I feel Gemini is better than Opus. I tried building a terrain editor for games and CAD software using both Gemini and Opus. For those tasks, Opus performed better. So I would say that as the codebase becomes larger, Opus tends to perform better overall.

KAI 的头像
KAI7 个月前

this is where llms get interesting - when they touch the physical world, the failure modes are different and the rewards are bigger. software-only ai wrappers are a crowded space. llms + robotics? still early, big upside.

Zainab Arshad 的头像
Zainab Arshad7 个月前

AI is becoming a real robotics co-engineer.

Tsung Xu 的头像
Tsung Xu7 个月前

Neat, what's the physics model?

Christiano 🦾🌱 的头像
Christiano 🦾🌱7 个月前

🦾🫡

Samurai Jack 的头像
Samurai Jack7 个月前

@GoogleDeepMind is all about jus simulation thanks to @demishassabis

Dolan 的头像
Dolan7 个月前

kinda coool

Anant Dadhich 的头像
Anant Dadhich7 个月前

now ai getting interesting

e.ev 的头像
e.ev7 个月前

Inverse kinematics is where the spatial reasoning difference actually shows up. Most benchmarks test text generation, not whether the model can hold geometric constraints in mind.

Nirav Bhadradiya 的头像
Nirav Bhadradiya7 个月前

Gemini 3.1 Pro doing industrial robot IK simulation in one vibe-coding session is wild. The crossover between agentic reasoning and physics sims is exactly where real-world autonomy gets built. this level of integration changes the game for hardware + AI teams

CrazyAI Tech 的头像
CrazyAI Tech7 个月前

Gemini 3.1 Pro improves a lot at the robotics level.

Max Palmer 的头像
Max Palmer7 个月前

very cute style

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

thanks

George Merchant 的头像
George Merchant7 个月前

Welp you earned a follow

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

awesome!

Sylvain Legland 🇪🇺🇫🇷🇺🇦 的头像
Sylvain Legland 🇪🇺🇫🇷🇺🇦7 个月前

three.js ?

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

yes

Carolina 的头像
Carolina7 个月前

amazing.

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

thanks

Vamsi Batchu 的头像
Vamsi Batchu7 个月前

as always !! amazing 🔥

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

thanks Vamsi

Tatyana Waves 的头像
Tatyana Waves7 个月前

😯

Base Layer Robotics 的头像
Base Layer Robotics7 个月前

Thats bad ass!

Dilum Sanjaya 的头像
Dilum Sanjaya7 个月前

thanks

Niko Lee 的头像
Niko Lee7 个月前

Nano Banana is getting a lot of hype lately, I can see why.

Hands-On PM 的头像
Hands-On PM7 个月前

@LucienReconq cool

Marcelo Design X 的头像
Marcelo Design X7 个月前

Wow

Baker 的头像
Baker7 个月前

As a licensed FANUC robotics operator, I approve of this message

Hannah | atypica.ai 的头像
Hannah | atypica.ai6 个月前

super cool, especially having everything from design to simulation in one flow, feels like a new kind of builder stack emerging here, would be great to connect

Vish 的头像
Vish7 个月前

the IK simulation is where this gets really interesting. most vibe coding projects are web apps and dashboards... seeing someone push it into robotics with actual inverse kinematics is a completely different challenge. the spatial reasoning improvement in 3.1 makes sense too, IK solvers need the model to actually understand joint constraints in 3D space not just generate code that compiles

Turk 🇺🇸 的头像
Turk 🇺🇸7 个月前

seeing this at the top of my feed gives me hop the algo is getting back on track

Endeavor 的头像
Endeavor7 个月前

I feel like the next step is to take these industrial robots out of industries. We need to see them in stores, malls, and be more indulged in our daily life.

Johnny freedom🇺🇦🇪🇺🇬🇧🇮🇱 的头像
Johnny freedom🇺🇦🇪🇺🇬🇧🇮🇱7 个月前

Could you please show me the command for this simulation?

Sadi Moodi 的头像
Sadi Moodi7 个月前

This is wild! Gemini 3.1 Pro crushing the IK simulation. The key insight: for physics-heavy tasks, Gemini's spatial reasoning shines. For larger codebases, Opus still wins. Pro tip: use noise functions for metrics that don't need real data - saves compute and looks legit. 🔥

(noahs arc) 的头像
(noahs arc)7 个月前

seems like an inefficient way to move boxes 1 foot

Jacey 的头像
Jacey7 个月前

This is exactly where AI gets interesting — when you chain models together. Nano Banana for design. Gemini Pro for logic. Next step: add video generation for the full simulation. The future of robotics dev is multi-model pipelines, not single-model magic.

相关视频