Loading video...

Video Failed to Load

Go Home

Active Video Perception Iterative Evidence Seeking for Agentic Long Video Understanding

_akhaliq's profile picture

AK

526,440 subscribers

21,321 views • 10 months ago •via X (Twitter)

Science & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

1 Comments

AK's profile picture
AK10 months ago

discuss:

Related Videos

Mode Seeking meets Mean Seeking for Fast Long Video Generation paper:
0:30

Mode Seeking meets Mean Seeking for Fast Long Video Generation paper:

AK

20,417 views • 7 months ago

We’re introducing a new capability to our latest Gemini models: agentic video understanding. This allows developers to process long-form video content with more accuracy, while using up to 88% less tokens. See how it works 🧵
0:58

We’re introducing a new capability to our latest Gemini models: agentic video understanding. This allows developers to process long-form video content with more accuracy, while using up to 88% less tokens. See how it works 🧵

Google

793,471 views • 1 month ago

Tired of high token costs for video workflows? Agentic video understanding gives Gemini the tools to dynamically search, scan, and inspect target video segments to achieve its goal. Building on agentic vision, Gemini now actively scans visual frames, audio, and transcripts instead of ingesting video at a static 1 FPS. This reduces token consumption by up to 88%, improves accuracy, and unlocks new ways to process long-form video. Tackle complex video workflows like: ▸ Sub-second retrieval: Catch split-second cuts missed at 1 FPS ▸ Long-form search: Query multi-hour videos without overflowing context ▸ Anomaly detection: Resample interesting windows at higher FPS ▸ Counting: Accurately track repeated actions and objects over time See how agentic video understanding transforms token efficiency in Gemini 3.7 Flash when compared with static video processing:
0:58

Tired of high token costs for video workflows? Agentic video understanding gives Gemini the tools to dynamically search, scan, and inspect target video segments to achieve its goal. Building on agentic vision, Gemini now actively scans visual frames, audio, and transcripts instead of ingesting video at a static 1 FPS. This reduces token consumption by up to 88%, improves accuracy, and unlocks new ways to process long-form video. Tackle complex video workflows like: ▸ Sub-second retrieval: Catch split-second cuts missed at 1 FPS ▸ Long-form search: Query multi-hour videos without overflowing context ▸ Anomaly detection: Resample interesting windows at higher FPS ▸ Counting: Accurately track repeated actions and objects over time See how agentic video understanding transforms token efficiency in Gemini 3.7 Flash when compared with static video processing:

Google for Developers

38,369 views • 1 month ago

Agentic video understanding with Gemini 3.7 Flash is HUGE. Just reduced cost, less tokens, and higher accuracy. No biggie.
0:31

Agentic video understanding with Gemini 3.7 Flash is HUGE. Just reduced cost, less tokens, and higher accuracy. No biggie.

Shubham Saboo

79,642 views • 1 month ago

Introducing Long Zhao, a Senior Research Scientist at Google, who worked to build VideoPrism: A Foundational Visual Encoder for Video Understanding. Read the blog to explore innovations in video understanding tasks and more →
1:32

Introducing Long Zhao, a Senior Research Scientist at Google, who worked to build VideoPrism: A Foundational Visual Encoder for Video Understanding. Read the blog to explore innovations in video understanding tasks and more →

Google AI

129,828 views • 2 years ago

This video is only 40s long . It will change your perception about President William Ruto.
0:40

This video is only 40s long . It will change your perception about President William Ruto.

Mr. Kinuthia Pius.

25,147 views • 1 month ago

Excited to share our new blog: Scaling Video Training with Parallelism We discuss how parallelism helps scale long-video training systems, for both understanding and generation.
1:00

Excited to share our new blog: Scaling Video Training with Parallelism We discuss how parallelism helps scale long-video training systems, for both understanding and generation.

Yukang Chen

12,802 views • 4 months ago

Attackers stopped working alone. They coordinate now—through agents. So, we built Project Perception: our new agentic security system. The video explains it better than a caption can.
1:34

Attackers stopped working alone. They coordinate now—through agents. So, we built Project Perception: our new agentic security system. The video explains it better than a caption can.

Microsoft Security

12,236 views • 2 months ago

We’re launching agentic video understanding across our latest models: Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite! This new capability improves accuracy while cutting token consumption up to 88% and reducing costs by up to 66% for video analysis →
0:58

We’re launching agentic video understanding across our latest models: Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite! This new capability improves accuracy while cutting token consumption up to 88% and reducing costs by up to 66% for video analysis →

Google Cloud Tech

45,610 views • 1 month ago

Video world models today have a very limited context length. Mode Seeking meets Mean Seeking (MMM) unlocks long-context, persistent video world models through a unified representation. 1/8 🧵
0:30

Video world models today have a very limited context length. Mode Seeking meets Mean Seeking (MMM) unlocks long-context, persistent video world models through a unified representation. 1/8 🧵

Gordon Wetzstein

43,945 views • 7 months ago

StreamingVLM Real-Time Understanding for Infinite Video Streams
2:26

StreamingVLM Real-Time Understanding for Infinite Video Streams

AK

59,317 views • 1 year ago

Video breakdown: CVPR 2026 oral paper Shattering the efficiency bottleneck of long video understanding. Watch as we deconstruct the core innovations behind SpecTemp.
2:40

Video breakdown: CVPR 2026 oral paper Shattering the efficiency bottleneck of long video understanding. Watch as we deconstruct the core innovations behind SpecTemp.

FutureLivingLab

13,632 views • 5 months ago

1. Breaking down + understanding a long video I uploaded the entire NBA dunk contest from last night and asked which dunk had the highest score. Gemini 1.5 was incredibly able to find the specific perfect 50 dunk and details from just its long context video understanding!
0:38

1. Breaking down + understanding a long video I uploaded the entire NBA dunk contest from last night and asked which dunk had the highest score. Gemini 1.5 was incredibly able to find the specific perfect 50 dunk and details from just its long context video understanding!

Rowan Cheung

101,170 views • 2 years ago

Check out this amazing combo using Gemma4 + Falcon Perception for video tracking! 1️⃣Give Gemma 4 video frames 2️⃣It describes what it sees 3️⃣Falcon Perception takes those descriptions, segments the objects, and tracks them across the video! The best part? All running locally!
1:04

Check out this amazing combo using Gemma4 + Falcon Perception for video tracking! 1️⃣Give Gemma 4 video frames 2️⃣It describes what it sees 3️⃣Falcon Perception takes those descriptions, segments the objects, and tracks them across the video! The best part? All running locally!

Google Gemma

84,378 views • 6 months ago

Muse Spark 1.1 is here! Available today via API and on Of all the agentic use cases, I’m most excited about this one: going from a single video shot straight to task completion. 🚀 We’ve also polished and launched Computer Use and Video-Audio Perception for Muse Spark 1.1. Read more:
1:33

Muse Spark 1.1 is here! Available today via API and on Of all the agentic use cases, I’m most excited about this one: going from a single video shot straight to task completion. 🚀 We’ve also polished and launched Computer Use and Video-Audio Perception for Muse Spark 1.1. Read more:

Jiahui Yu

121,409 views • 3 months ago

Random thoughts. Questions. How long would it take for y’all to get arrested if they had solid video evidence of your crimes?! 🤔🪓
1:04

Random thoughts. Questions. How long would it take for y’all to get arrested if they had solid video evidence of your crimes?! 🤔🪓

Cattleman🪓

37,948 views • 9 months ago

This complete video will change your perception 👇
6:59

This complete video will change your perception 👇

DON “Tobechukwu” Ade 👑

32,451 views • 3 months ago