
Rohan Doshi
@RohanLikesAI • 1,436 subscribers
gemini's multimodal pm @ deepmind. views are my own.
Videos

Today, we’re launching Agentic Video Understanding in Gemini across 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite. 📉 ~88% fewer tokens 💰 ~66% lower cost 📈 ~7% higher accuracy The result: a new Pareto frontier for video understanding across accuracy and cost. Traditional video understanding processes video statically at a fixed sampling rate. With Agentic Video Understanding, Gemini can actively decide what to watch, at what speed, and which signals to use (frames, audio, or transcripts) by using native video tools. This enables split-second retrieval, rapid-motion understanding, and needle-in-a-haystack search across hours of video. Available now via the Gemini API - and coming soon to billions of users through the Gemini App and YouTube’s “Ask YouTube” experience. Learn more (details, demos, and docs): PMing this 0→1 has been a career highlight. Taking it from an idea and helping shape it into a frontier-defining capability we’re now shipping broadly has been incredibly rewarding. Huge thanks to Mario Lucic , Sergi Caelles Ahmet Iscen , Filip Pavetić, Suhas Yogin , JB Alayrac, Ben Caine, Nicole Brichtova, Bibo Xu , Tulsee Doshi, David Thacker, koray kavukcuoglu and the multimodal team at Google DeepMind.
Rohan Doshi20,049 次观看 • 2 天前
没有更多内容可加载