Loading video...

Video Failed to Load

Go Home

Gemini 3 Flash now uses an agentic "think-act-observe" loop to solve complex visual tasks 🤖 Google DeepMind engineer Paul Ruiz demonstrates how the model runs Python code automatically to zoom and inspect items, annotate images, and re-visualize data into charts.

106,963 views • 7 months ago •via X (Twitter)

35 Comments

Google AI Developers's profile picture
Google AI Developers7 months ago

@ptruiz_dev Check out the documentation: Try it in

Luc Biggs's profile picture
Luc Biggs7 months ago

@GoogleDeepMind @ptruiz_dev AgenticVision .com

Gregor's profile picture
Gregor7 months ago

I'm starting to see this 'think-act-observe' loop as a way to automate the iterative design process, where the model refines its actions based on the results of its previous decisions, much like how a designer would refine their design based on user feedback. This could unlock new possibilities for interactive visualizations and real-time data exploration. Building something like this for a mobile finance app has given me a similar idea - I'm excited to explore this further.

Larry Panozzo's profile picture
Larry Panozzo7 months ago

@GoogleDeepMind @ptruiz_dev It has been fun to see Gemini 3 Flash do things no other model can do. That zoom & inspect loop is fantastic.

Ilpo Leppänen's profile picture
Ilpo Leppänen7 months ago

I absolutely love Gemini 3 Flash! What makes it so fun model to play with is that it's a true wildcard 🃏 I've often found that it navigates its way through the information space in various unexpected ways and comes up with great novel ideas, while still ripping through the task with a speedy punch! And sometimes you find it almost impossible to pursue a goal with strict instructions as if it faces even a slightest roadblock, it will turn into a frenzied Sonic, bouncing around to get through the obstacle. It's clearly a model made to iterate - fast

Raf's profile picture
Raf7 months ago

@GoogleDeepMind @ptruiz_dev Still can't find the cat 😺

Goblin's profile picture
Goblin7 months ago

@GoogleDeepMind @ptruiz_dev This just straight out of the box solved problems for me I previously could not solve with LLMs, even with complex flows. Insane work google, thanks! @ptruiz_dev

CrazyAI Tech's profile picture
CrazyAI Tech7 months ago

@GoogleDeepMind @ptruiz_dev Okay, an AI can zoom. Please make my chicken be Einstein.

⚡Jessy SEO formation #IA générative #chatGPT 🦊's profile picture
⚡Jessy SEO formation #IA générative #chatGPT 🦊7 months ago

@GoogleDeepMind @ptruiz_dev @grok fais un tableau qui explique quel utilisation chaque modele de gemini est specialisé est bon

Professor. Dr. Ife. Indra Aria Dika E.bt. S.me.'s profile picture
Professor. Dr. Ife. Indra Aria Dika E.bt. S.me.7 months ago

@GoogleDeepMind @ptruiz_dev Thank you

xiaoyuqin's profile picture
xiaoyuqin7 months ago

@GoogleDeepMind @ptruiz_dev @grok 总结视频的内容f 总结视频的内容 总结视频的内容a w

ameno's profile picture
ameno7 months ago

@GoogleDeepMind @ptruiz_dev I would try Gemini if you could create a damn api key. GCP/Ai studio, no key works despite enabling the correct services.

Ihsan's profile picture
Ihsan7 months ago

@GoogleDeepMind @ptruiz_dev I'm watching it so many questions have

Solve SF's profile picture
Solve SF7 months ago

@GoogleDeepMind @ptruiz_dev Does this work on @openrouter ?

10turtle's profile picture
10turtle7 months ago

@GoogleDeepMind @ptruiz_dev Gemini 3 Flash using a “think → act → observe” loop is a big shift. 🤖 Running Python to zoom, inspect, annotate, and even turn visuals into charts automatically? That’s not just vision that’s reasoning + execution combined. AI isn’t just seeing anymore… it’s doing

mr.tweeps | IDN's profile picture
mr.tweeps | IDN7 months ago

@GoogleDeepMind @ptruiz_dev Impressive! Gemini 3 Flash’s ability to autonomously analyze and visualize complex data is fascinating.

Kerris Kahdelka's profile picture
Kerris Kahdelka7 months ago

@GoogleDeepMind @ptruiz_dev When can gemini in the browser have a "laser pointer" so it can point and draw on the web UI with us while we work. Would be pretty great to have gemini live + laser pointer almost like actual screensharing over zoom with Gemini.

bullbearlovechild's profile picture
bullbearlovechild7 months ago

@GoogleDeepMind @ptruiz_dev This sounds great but the demo in your video fails. The resolution is bad, but it's still clear that most pictures have the wrong label: Duck -> Zebra, Pig -> Giraffe, Hippo -> Bear, Crocodile -> Crab

Professor. Dr. Ife. Indra Aria Dika E.bt. S.me.'s profile picture
Professor. Dr. Ife. Indra Aria Dika E.bt. S.me.7 months ago

@GoogleDeepMind @ptruiz_dev Great revolution!

BLOND BOND's profile picture
BLOND BOND7 months ago

@GoogleDeepMind @ptruiz_dev INSTANTLY THOUGHT WHEN SAW LAST EXAMPLE WAS MED TECH USE FOR POTENTIAL CANCEROUS MOLES... ANALYSIS AND GIVE LIKLEYHOOD OF CANCEROUS... MANY USE CASES... THATS WHY AI GOLD RUSH CAN BE FOR EVERYONE...

Muhammad Yusuf's profile picture
Muhammad Yusuf7 months ago

Gemini 3 Flash's think-act-observe loop is powered by native tool-use + on-device Python execution (via MediaPipe & LiteRT), allowing sub-second reasoning→code→vision cycles without external API calls. In the circuit board demo, it not only zooms and labels but can also run edge-detection filters or count components in real time. Early internal benchmarks show ~4.2× faster multimodal reasoning than Gemini 1.5 Flash on vision-heavy agent tasks. Huge step toward truly agentic on-device multimodal AI. Docs + cookbook examples already live in AI Studio — highly recommend trying the "visual data extraction" templates first.

Stew's profile picture
Stew7 months ago

@GoogleDeepMind @ptruiz_dev When it is out on paid API?

Charles |🟪$ETH🌟👑's profile picture
Charles |🟪$ETH🌟👑7 months ago

@GoogleDeepMind @ptruiz_dev @AIxC_Official @aixcfoundation #Tenki

john's profile picture
john7 months ago

@GoogleDeepMind @ptruiz_dev ChatGPT has been doing this for me for quite a while.

Dari Rinch's profile picture
Dari Rinch7 months ago

@GoogleDeepMind @ptruiz_dev Love this direction — moving from static vision to agentic loops is key. One missing piece is a deterministic COMMIT/NOCOMMIT step before executing Python/tool calls, with both outcomes logged for traceability. Spec + minimal implementation:

thirdweb's profile picture
thirdweb7 months ago

@GoogleDeepMind @ptruiz_dev now give it a wallet.

#INTERNETofAGENTS's profile picture
#INTERNETofAGENTS7 months ago

@GoogleDeepMind @ptruiz_dev 🫣

Uncle J's profile picture
Uncle J7 months ago

@GoogleDeepMind @ptruiz_dev “think-act-observe” is the new normal. The gap isn’t models anymore. It’s orchestration.

BuildrLab | AI & Cloud Solutions's profile picture
BuildrLab | AI & Cloud Solutions7 months ago

@GoogleDeepMind @ptruiz_dev This loop is the real unlock for vision: don’t “one-shot caption” — iterate with tools. Would love to see a run-log / trace standard here (actions, crops, code executed) so teams can debug + eval these agents like we do with software.

LitoManuelRuiz's profile picture
LitoManuelRuiz7 months ago

@GoogleDeepMind @ptruiz_dev Grok gemini cause IA PRAY

Arthur's profile picture
Arthur7 months ago

@GoogleDeepMind @ptruiz_dev when you guys are planning on releasing a stable version of flash, not preview ?

Hamad's profile picture
Hamad7 months ago

@GoogleDeepMind @ptruiz_dev @grok it's all computer vision?

Mateus Carrijo's profile picture
Mateus Carrijo7 months ago

@GoogleDeepMind @ptruiz_dev google is king!!! fantastic

mrkelly's profile picture
mrkelly7 months ago

@GoogleDeepMind @ptruiz_dev The real bottleneck isn't the model. It's knowing what to ask it to see.

Jedi⚡️'s profile picture
Jedi⚡️7 months ago

@GoogleDeepMind @ptruiz_dev Gemini 3 Flash's new agentic loop turns vision into an active, code-driven investigation.

Related Videos