正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

As one example of 1.5 Pro’s sophisticated multimodal understanding and reasoning capabilities with long context, when given a 44-minute silent film, the model can analyze various plot points and events, and even makes sense of small details you might have missed.

Sundar Pichai

10,306,243 subscribers

348,365 次观看 • 2 年前 •via X (Twitter)

艺术教育科学技术

Anya Rossi• Live Now

Private livecam show

10 条评论

Kullar 的头像

Kullar2 年前

Forget that, have you seen openai sora?

Gus 🖖 Ferguson 的头像

Gus 🖖 Ferguson2 年前

So is Gemini 1.5 Pro more or less advanced than Gemini Advanced? Is Gemini [number] the core model generation and Nano, Pro and Ultra are weights? What is Gemini Advanced? Why is Google so, so bad at naming products... I suspect they let devs name their products don't they🤦‍♂️

Kiri 的头像

Kiri2 年前

Excellent Sundar! Gives me goosebumps to see :) can’t wait to explore all of the possibilities with Gemini, wonderful work from you and the team—congrats!! 🔥✨🤘

Siddarth Pai 的头像

Siddarth Pai2 年前

Google has great researchers and foundational technology need to productize better that's where gap was for taking lead in Social, Cloud or even now on AI

EcceAI 的头像

EcceAI2 年前

This is but my mind is already blown mindblowing

Adolfo Asorlin 👨🏼‍🚀 的头像

Adolfo Asorlin 👨🏼‍🚀2 年前

😳😋

Zippy Raj 𝕏 的头像

Zippy Raj 𝕏2 年前

Damn

Dishwasher 的头像

Dishwasher2 年前

I want to be able to edit existing pictures via natural language sooooo bad. please, Google, make it happen!

Gaurav Goyal 的头像

Gaurav Goyal2 年前

@BhandEth will make editing so simple

Types Digital 的头像

Types Digital2 年前

Multimodality era 🧬

相关视频

Start building with Gemini 3 Pro, our most intelligent model with state-of-the-art reasoning and complex multimodal understanding, as well as powerful agentic and vibe coding capabilities. See more below:

Start building with Gemini 3 Pro, our most intelligent model with state-of-the-art reasoning and complex multimodal understanding, as well as powerful agentic and vibe coding capabilities. See more below:

Google AI Developers

104,898 次观看 • 8 个月前

Gemini 3 Pro is the best model in the world for multimodal understanding. One of its most exciting capabilities is document understanding and reasoning. This means you can convert information in any format and into the medium that works best for you. Gemini 3 also has leading multilingual capabilities, enabling it to process, reason and even capture cultural relevance across a variety of languages. For example, here Gemini 3 is translating handwritten recipes in Korean and English to build a digital family cookbook in different languages.

Gemini 3 Pro is the best model in the world for multimodal understanding. One of its most exciting capabilities is document understanding and reasoning. This means you can convert information in any format and into the medium that works best for you. Gemini 3 also has leading multilingual capabilities, enabling it to process, reason and even capture cultural relevance across a variety of languages. For example, here Gemini 3 is translating handwritten recipes in Korean and English to build a digital family cookbook in different languages.

Google AI

36,696 次观看 • 8 个月前

This is Gemini 3: our most intelligent model that helps you learn, build and plan anything. It comes with state-of-the-art reasoning capabilities, world-leading multimodal understanding, and enables new agentic coding experiences. 🧵

This is Gemini 3: our most intelligent model that helps you learn, build and plan anything. It comes with state-of-the-art reasoning capabilities, world-leading multimodal understanding, and enables new agentic coding experiences. 🧵

Google DeepMind

1,694,241 次观看 • 8 个月前

Gemini 1.5 Pro can analyze, classify and summarize huge quantities of information – including documents with thousands of pages. 📄 When given a 402-page transcript from Apollo 11’s mission to the moon, it was able to reason about conversations and events it finds. ↓

Gemini 1.5 Pro can analyze, classify and summarize huge quantities of information – including documents with thousands of pages. 📄 When given a 402-page transcript from Apollo 11’s mission to the moon, it was able to reason about conversations and events it finds. ↓

Google DeepMind

214,569 次观看 • 2 年前

With Gemini 3, you can take an image of anything, like a board game, a floor plan, or a doodle, and make it an interactive experience. This is because of Gemini 3’s deep multimodal understanding. The model is able to analyze the content of the image, distill the most compelling parts, and then translate the image’s details into a functional, interactive experience.

With Gemini 3, you can take an image of anything, like a board game, a floor plan, or a doodle, and make it an interactive experience. This is because of Gemini 3’s deep multimodal understanding. The model is able to analyze the content of the image, distill the most compelling parts, and then translate the image’s details into a functional, interactive experience.

Google AI

98,340 次观看 • 8 个月前

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Google AI

492,973 次观看 • 8 个月前

🚀Introducing LLaVA Lightning: Train a lite, multimodal GPT-4 with just $40 in 3 hours! With our newly introduced datasets and the efficient design of LLaVA, you can now turbocharge your language model with image reasoning capabilities, in an incredibly affordable way.🧵

🚀Introducing LLaVA Lightning: Train a lite, multimodal GPT-4 with just $40 in 3 hours! With our newly introduced datasets and the efficient design of LLaVA, you can now turbocharge your language model with image reasoning capabilities, in an incredibly affordable way.🧵

Haotian Liu

302,319 次观看 • 3 年前

Today we entered the Gemini 3 era, our next step on the path toward AGI. ⚡ Gemini 3 is our most intelligent model that combines capabilities like multimodality, long context and reasoning, so you can bring any idea to life. Explore more of what you can do and build with Gemini 3 🧵⬇️

Today we entered the Gemini 3 era, our next step on the path toward AGI. ⚡ Gemini 3 is our most intelligent model that combines capabilities like multimodality, long context and reasoning, so you can bring any idea to life. Explore more of what you can do and build with Gemini 3 🧵⬇️

Google

90,857 次观看 • 8 个月前

Introducing ambientGPT: an open-source and multimodal MacOS foundation model GUI Run GPT-4o and open-source models with full ambient knowledge of your screen. Foundation models have long been confined to the browser. With ambientGPT, your screen context is directly inferred as part of the query, ensuring you never need to explicitly upload context again! Github:

Introducing ambientGPT: an open-source and multimodal MacOS foundation model GUI Run GPT-4o and open-source models with full ambient knowledge of your screen. Foundation models have long been confined to the browser. With ambientGPT, your screen context is directly inferred as part of the query, ensuring you never need to explicitly upload context again! Github:

Siddharth Sharma

192,913 次观看 • 2 年前

(1/5) Gemini 3, our most intelligent model, is landing in Google Search today – starting with AI Mode. Excited that this is the first time we’re shipping a new Gemini model in Search on day one! 🚀 In Search, Gemini 3 with generative layouts will make it easy to get a rich understanding of anything on your mind. It has state-of-the-art reasoning, deep multimodal understanding and advanced agentic capabilities. That allows the model to shine when you ask it to explain advanced concepts or ideas – it reasons and can code interactive visuals in real-time. It can tackle your toughest questions like advanced science.

(1/5) Gemini 3, our most intelligent model, is landing in Google Search today – starting with AI Mode. Excited that this is the first time we’re shipping a new Gemini model in Search on day one! 🚀 In Search, Gemini 3 with generative layouts will make it easy to get a rich understanding of anything on your mind. It has state-of-the-art reasoning, deep multimodal understanding and advanced agentic capabilities. That allows the model to shine when you ask it to explain advanced concepts or ideas – it reasons and can code interactive visuals in real-time. It can tackle your toughest questions like advanced science.

Robby Stein

94,962 次观看 • 8 个月前

This is a Tremendous Theory About Paulie and Tony and the Sopranos and as Someone with a Complete Understanding of this World this Makes Complete Sense…

This is a Tremendous Theory About Paulie and Tony and the Sopranos and as Someone with a Complete Understanding of this World this Makes Complete Sense…

𝕰𝖒𝕲

263,915 次观看 • 3 个月前

Meet Reka Core, our best and most capable multimodal language model yet. 🔮 It’s been a busy few months training this model and we are glad to finally ship it! 💪 Core has a lot of capabilities, and one of them is understanding video --- let’s see what Core thinks of the 3 body trailer.👇

Meet Reka Core, our best and most capable multimodal language model yet. 🔮 It’s been a busy few months training this model and we are glad to finally ship it! 💪 Core has a lot of capabilities, and one of them is understanding video --- let’s see what Core thinks of the 3 body trailer.👇

Reka

757,979 次观看 • 2 年前

Here’s an example of Muse Code’s multimodal visual coding capabilities. In this demo, the user inputs a fly-through video of a home into the terminal as an mp4 file. Muse Code interprets the video and produces a visually rich website with booking capabilities.

Here’s an example of Muse Code’s multimodal visual coding capabilities. In this demo, the user inputs a fly-through video of a home into the terminal as an mp4 file. Muse Code interprets the video and produces a visually rich website with booking capabilities.

AI at Meta

21,570 次观看 • 9 天前

Gemini-1.5 Pro has its spotlight stolen today, and people are poking fun at Sora vs Google memes. Well, I think it's the biggest boost in LLM capability so far in 2024. v1.5's 10M token context (1) excels at retrieval; (2) generalizes zero-shot to extremely long instructions like full tutorials and codebases; and (3) works across modalities such as text, audio, and video. Here's a stunning example: v1.5 learns to translate from English to Kalamang purely in context, following a full linguistic manual at inference time. Kalamang is a language spoken by fewer than 200 speakers in western New Guinea. Gemini has never seen this language during training and is only provided with 500 pages of linguistic documentation, a dictionary, and ~400 parallel sentences in context. It basically acquires a sophisticated new skill in the neural activations, instead of gradient finetuning. I talked about the Myth of Context Length many times before: don't get too excited by claims of 1M or even 1B context tokens. LSTMs already achieved literally infinite context length 25 yrs ago! What truly matters is how well the model actually uses the context to solve real-world problems, and Gemini-1.5 has surpassed the SOTA with flying colors. The paper is also well-written with lots of solid quantitative analysis on in-context memorization and generalization. Paper: “Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context” Congrats to Jeff Dean Oriol Vinyals Sundar Pichai and team!

Gemini-1.5 Pro has its spotlight stolen today, and people are poking fun at Sora vs Google memes. Well, I think it's the biggest boost in LLM capability so far in 2024. v1.5's 10M token context (1) excels at retrieval; (2) generalizes zero-shot to extremely long instructions like full tutorials and codebases; and (3) works across modalities such as text, audio, and video. Here's a stunning example: v1.5 learns to translate from English to Kalamang purely in context, following a full linguistic manual at inference time. Kalamang is a language spoken by fewer than 200 speakers in western New Guinea. Gemini has never seen this language during training and is only provided with 500 pages of linguistic documentation, a dictionary, and ~400 parallel sentences in context. It basically acquires a sophisticated new skill in the neural activations, instead of gradient finetuning. I talked about the Myth of Context Length many times before: don't get too excited by claims of 1M or even 1B context tokens. LSTMs already achieved literally infinite context length 25 yrs ago! What truly matters is how well the model actually uses the context to solve real-world problems, and Gemini-1.5 has surpassed the SOTA with flying colors. The paper is also well-written with lots of solid quantitative analysis on in-context memorization and generalization. Paper: “Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context” Congrats to Jeff Dean Oriol Vinyals Sundar Pichai and team!

Jim Fan

278,517 次观看 • 2 年前