正在加载视频...

视频加载失败

Gemini 3 Flash now uses an agentic "think-act-observe" loop to solve complex visual tasks 🤖 Google DeepMind engineer Paul Ruiz demonstrates how the model runs Python code automatically to zoom and inspect items, annotate images, and re-visualize data into charts.

106,963 次观看 • 7 个月前 •via X (Twitter)

35 条评论

Google AI Developers 的头像
Google AI Developers7 个月前

@ptruiz_dev Check out the documentation: Try it in

Luc Biggs 的头像
Luc Biggs7 个月前

@GoogleDeepMind @ptruiz_dev AgenticVision .com

Gregor 的头像
Gregor7 个月前

I'm starting to see this 'think-act-observe' loop as a way to automate the iterative design process, where the model refines its actions based on the results of its previous decisions, much like how a designer would refine their design based on user feedback. This could unlock new possibilities for interactive visualizations and real-time data exploration. Building something like this for a mobile finance app has given me a similar idea - I'm excited to explore this further.

Larry Panozzo 的头像
Larry Panozzo7 个月前

@GoogleDeepMind @ptruiz_dev It has been fun to see Gemini 3 Flash do things no other model can do. That zoom & inspect loop is fantastic.

Ilpo Leppänen 的头像
Ilpo Leppänen7 个月前

I absolutely love Gemini 3 Flash! What makes it so fun model to play with is that it's a true wildcard 🃏 I've often found that it navigates its way through the information space in various unexpected ways and comes up with great novel ideas, while still ripping through the task with a speedy punch! And sometimes you find it almost impossible to pursue a goal with strict instructions as if it faces even a slightest roadblock, it will turn into a frenzied Sonic, bouncing around to get through the obstacle. It's clearly a model made to iterate - fast

Raf 的头像
Raf7 个月前

@GoogleDeepMind @ptruiz_dev Still can't find the cat 😺

Goblin 的头像
Goblin7 个月前

@GoogleDeepMind @ptruiz_dev This just straight out of the box solved problems for me I previously could not solve with LLMs, even with complex flows. Insane work google, thanks! @ptruiz_dev

CrazyAI Tech 的头像
CrazyAI Tech7 个月前

@GoogleDeepMind @ptruiz_dev Okay, an AI can zoom. Please make my chicken be Einstein.

⚡Jessy SEO formation #IA générative #chatGPT 🦊 的头像
⚡Jessy SEO formation #IA générative #chatGPT 🦊7 个月前

@GoogleDeepMind @ptruiz_dev @grok fais un tableau qui explique quel utilisation chaque modele de gemini est specialisé est bon

Professor. Dr. Ife. Indra Aria Dika E.bt. S.me. 的头像
Professor. Dr. Ife. Indra Aria Dika E.bt. S.me.7 个月前

@GoogleDeepMind @ptruiz_dev Thank you

xiaoyuqin 的头像
xiaoyuqin7 个月前

@GoogleDeepMind @ptruiz_dev @grok 总结视频的内容f 总结视频的内容 总结视频的内容a w

ameno 的头像
ameno7 个月前

@GoogleDeepMind @ptruiz_dev I would try Gemini if you could create a damn api key. GCP/Ai studio, no key works despite enabling the correct services.

Ihsan 的头像
Ihsan7 个月前

@GoogleDeepMind @ptruiz_dev I'm watching it so many questions have

Solve SF 的头像
Solve SF7 个月前

@GoogleDeepMind @ptruiz_dev Does this work on @openrouter ?

10turtle 的头像
10turtle7 个月前

@GoogleDeepMind @ptruiz_dev Gemini 3 Flash using a “think → act → observe” loop is a big shift. 🤖 Running Python to zoom, inspect, annotate, and even turn visuals into charts automatically? That’s not just vision that’s reasoning + execution combined. AI isn’t just seeing anymore… it’s doing

mr.tweeps | IDN 的头像
mr.tweeps | IDN7 个月前

@GoogleDeepMind @ptruiz_dev Impressive! Gemini 3 Flash’s ability to autonomously analyze and visualize complex data is fascinating.

Kerris Kahdelka 的头像
Kerris Kahdelka7 个月前

@GoogleDeepMind @ptruiz_dev When can gemini in the browser have a "laser pointer" so it can point and draw on the web UI with us while we work. Would be pretty great to have gemini live + laser pointer almost like actual screensharing over zoom with Gemini.

bullbearlovechild 的头像
bullbearlovechild7 个月前

@GoogleDeepMind @ptruiz_dev This sounds great but the demo in your video fails. The resolution is bad, but it's still clear that most pictures have the wrong label: Duck -> Zebra, Pig -> Giraffe, Hippo -> Bear, Crocodile -> Crab

Professor. Dr. Ife. Indra Aria Dika E.bt. S.me. 的头像
Professor. Dr. Ife. Indra Aria Dika E.bt. S.me.7 个月前

@GoogleDeepMind @ptruiz_dev Great revolution!

BLOND BOND 的头像
BLOND BOND7 个月前

@GoogleDeepMind @ptruiz_dev INSTANTLY THOUGHT WHEN SAW LAST EXAMPLE WAS MED TECH USE FOR POTENTIAL CANCEROUS MOLES... ANALYSIS AND GIVE LIKLEYHOOD OF CANCEROUS... MANY USE CASES... THATS WHY AI GOLD RUSH CAN BE FOR EVERYONE...

Muhammad Yusuf 的头像
Muhammad Yusuf7 个月前

Gemini 3 Flash's think-act-observe loop is powered by native tool-use + on-device Python execution (via MediaPipe & LiteRT), allowing sub-second reasoning→code→vision cycles without external API calls. In the circuit board demo, it not only zooms and labels but can also run edge-detection filters or count components in real time. Early internal benchmarks show ~4.2× faster multimodal reasoning than Gemini 1.5 Flash on vision-heavy agent tasks. Huge step toward truly agentic on-device multimodal AI. Docs + cookbook examples already live in AI Studio — highly recommend trying the "visual data extraction" templates first.

Stew 的头像
Stew7 个月前

@GoogleDeepMind @ptruiz_dev When it is out on paid API?

Charles |🟪$ETH🌟👑 的头像
Charles |🟪$ETH🌟👑7 个月前

@GoogleDeepMind @ptruiz_dev @AIxC_Official @aixcfoundation #Tenki

john 的头像
john7 个月前

@GoogleDeepMind @ptruiz_dev ChatGPT has been doing this for me for quite a while.

Dari Rinch 的头像
Dari Rinch7 个月前

@GoogleDeepMind @ptruiz_dev Love this direction — moving from static vision to agentic loops is key. One missing piece is a deterministic COMMIT/NOCOMMIT step before executing Python/tool calls, with both outcomes logged for traceability. Spec + minimal implementation:

thirdweb 的头像
thirdweb7 个月前

@GoogleDeepMind @ptruiz_dev now give it a wallet.

#INTERNETofAGENTS 的头像
#INTERNETofAGENTS7 个月前

@GoogleDeepMind @ptruiz_dev 🫣

Uncle J 的头像
Uncle J7 个月前

@GoogleDeepMind @ptruiz_dev “think-act-observe” is the new normal. The gap isn’t models anymore. It’s orchestration.

BuildrLab | AI & Cloud Solutions 的头像
BuildrLab | AI & Cloud Solutions7 个月前

@GoogleDeepMind @ptruiz_dev This loop is the real unlock for vision: don’t “one-shot caption” — iterate with tools. Would love to see a run-log / trace standard here (actions, crops, code executed) so teams can debug + eval these agents like we do with software.

LitoManuelRuiz 的头像
LitoManuelRuiz7 个月前

@GoogleDeepMind @ptruiz_dev Grok gemini cause IA PRAY

Arthur 的头像
Arthur7 个月前

@GoogleDeepMind @ptruiz_dev when you guys are planning on releasing a stable version of flash, not preview ?

Hamad 的头像
Hamad7 个月前

@GoogleDeepMind @ptruiz_dev @grok it's all computer vision?

Mateus Carrijo 的头像
Mateus Carrijo7 个月前

@GoogleDeepMind @ptruiz_dev google is king!!! fantastic

mrkelly 的头像
mrkelly7 个月前

@GoogleDeepMind @ptruiz_dev The real bottleneck isn't the model. It's knowing what to ask it to see.

Jedi⚡️ 的头像
Jedi⚡️7 个月前

@GoogleDeepMind @ptruiz_dev Gemini 3 Flash's new agentic loop turns vision into an active, code-driven investigation.

相关视频