Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

We asked Logan Kilpatrick what stood out most from Google I/O. His answer: Gemini Omni, Google's new multimodal AI model. "The model can take in any input and produce any output. Text, audio, video, image." "You get a bunch of really interesting capability transfer when you bring it all... show more

MTS

204,698 subscribers

18,884 views • 4 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

$We’re shipping two major updates to streamline your creative workflow, allowing you to generate high-speed images with one model and then instantly animate them with the other—all at a fraction of the cost 🍌⚡️ 1️⃣ Introducing Nano Banana 2 Lite: Our fastest and most cost-efficient Gemini Image model yet delivers text-to-image outputs in under 4 seconds. Now available via the Gemini API and Google AI Studio, and rolling out soon across @NotebookLM, Google Flow, Google Gemini, Stitch by Google, Google Search and Google Photos. 2️⃣ Gemini Omni Flash in Public Preview: Our natively multimodal model for cost-efficient video generation and conversational editing. Now available via the Gemini API, Google AI Studio, and Gemini Enterprise Agent Platform so you can integrate the model into your workflow. While exciting on their own, the real magic happens when you build using these models together. Watch how our interior design demo integrates Nano Banana 2 Lite and Omni to instantly reimagine any space. Upload a photo, swipe through tailored design concepts, and see Omni bring the details to life in cinematic motion. Try out the demo app in AI Studio:$

We’re shipping two major updates to streamline your creative workflow, allowing you to generate high-speed images with one model and then instantly animate them with the other—all at a fraction of the cost 🍌⚡️ 1️⃣ Introducing Nano Banana 2 Lite: Our fastest and most cost-efficient Gemini Image model yet delivers text-to-image outputs in under 4 seconds. Now available via the Gemini API and Google AI Studio, and rolling out soon across @NotebookLM, Google Flow, Google Gemini, Stitch by Google, Google Search and Google Photos. 2️⃣ Gemini Omni Flash in Public Preview: Our natively multimodal model for cost-efficient video generation and conversational editing. Now available via the Gemini API, Google AI Studio, and Gemini Enterprise Agent Platform so you can integrate the model into your workflow. While exciting on their own, the real magic happens when you build using these models together. Watch how our interior design demo integrates Nano Banana 2 Lite and Omni to instantly reimagine any space. Upload a photo, swipe through tailored design concepts, and see Omni bring the details to life in cinematic motion. Try out the demo app in AI Studio:

Google AI

129,340 views • 3 months ago

Big News! Meta just released Segment Anything, a new AI model that can "cut out" any object, in any image/video, with a single click. The model is designed and trained to be promptable, so it can transfer zero-shot to new image distributions and tasks.

Big News! Meta just released Segment Anything, a new AI model that can "cut out" any object, in any image/video, with a single click. The model is designed and trained to be promptable, so it can transfer zero-shot to new image distributions and tasks.

Lior Alexander

290,330 views • 3 years ago

Introducing Gemini 3 ✨ It’s the best model in the world for multimodal understanding, and our most powerful agentic + vibe coding model yet. Gemini 3 can bring any idea to life, quickly grasping context and intent so you can get what you need with less prompting. Find Gemini 3 Pro rolling out today in the Google Gemini and AI Mode in Search. For developers, build with it now in Google AI Studio and Vertex AI. Excited for you to try it!

Introducing Gemini 3 ✨ It’s the best model in the world for multimodal understanding, and our most powerful agentic + vibe coding model yet. Gemini 3 can bring any idea to life, quickly grasping context and intent so you can get what you need with less prompting. Find Gemini 3 Pro rolling out today in the Google Gemini and AI Mode in Search. For developers, build with it now in Google AI Studio and Vertex AI. Excited for you to try it!

Sundar Pichai

2,955,140 views • 10 months ago

JUST IN: Google releases Gemini 1.5, a powerful MoE model. It's a huge breakthrough. The model has the longest context window ever seen: 1 million tokens. It can process 1 hour of video, 11 hours of audio, 30,000 lines of code, or 700,000 words in a single prompt. When tested on text, code, image, audio and video evaluations, 1.5 Pro outperforms 1.0 Pro on 87% of the benchmarks used for developing LLMs. You can can sign up in AI Studio to try it out.

JUST IN: Google releases Gemini 1.5, a powerful MoE model. It's a huge breakthrough. The model has the longest context window ever seen: 1 million tokens. It can process 1 hour of video, 11 hours of audio, 30,000 lines of code, or 700,000 words in a single prompt. When tested on text, code, image, audio and video evaluations, 1.5 Pro outperforms 1.0 Pro on 87% of the benchmarks used for developing LLMs. You can can sign up in AI Studio to try it out.

Lior Alexander

83,432 views • 2 years ago

Today we announced Gemini 2.0, our most capable AI model yet. With new advances in multimodality — like native image and audio output — and native tool use, it will enable us to build new AI agents that bring us closer to our vision of a universal assistant.

Today we announced Gemini 2.0, our most capable AI model yet. With new advances in multimodality — like native image and audio output — and native tool use, it will enable us to build new AI agents that bring us closer to our vision of a universal assistant.

Google

137,190 views • 1 year ago

Veo 2 is now available in Gemini 🔥 You can turn any text into an AI video and download it. Literally the best video model available directly on mobile and the web app. (Examples below)

Veo 2 is now available in Gemini 🔥 You can turn any text into an AI video and download it. Literally the best video model available directly on mobile and the web app. (Examples below)

Paul Couvert

218,089 views • 1 year ago

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Google AI

493,492 views • 10 months ago

Dreamina Seedance 2.0 is by far the best video model I've tried, and Dreamina makes it even better. You can try it in the link below. It's not just about the quality of the output, but about how much control you have over your video's look. Watch my video here. I'm attaching reference images and asking the model to generate a video using them. I can reference each image using the @ symbol to instruct the model which image to use. You can even upload a clip and use its camera movement, styles from an image, and audio vibe from a track. By the way, you can take an existing video and replace, remove, or add elements to it while the model preserves everything else. This is the closest we've gotten to "editing videos like photos".

Dreamina Seedance 2.0 is by far the best video model I've tried, and Dreamina makes it even better. You can try it in the link below. It's not just about the quality of the output, but about how much control you have over your video's look. Watch my video here. I'm attaching reference images and asking the model to generate a video using them. I can reference each image using the @ symbol to instruct the model which image to use. You can even upload a clip and use its camera movement, styles from an image, and audio vibe from a track. By the way, you can take an existing video and replace, remove, or add elements to it while the model preserves everything else. This is the closest we've gotten to "editing videos like photos".

Santiago

46,622 views • 6 months ago

Lots of people calling this fake! Here is a video of generating loom continuations with Gemini 3 and the starting text "I AM HAVING A MENTAL HEALTH CRISIS. I" Loom is a very interesting interface. Instead of user prompts and model responses, it's just one piece of text, containing the entire output. We pass this in as an assistant message, so the model sees it as something it already wrote, and continues it like a base model would. There is some other text in the context. First one is a system prompt, which is: "The assistant is in CLI simulation mode, and responds to the user's CLI commands only with the output of the command." There is also a user message which reads: " cat untitled.txt " Then the rest of the text is sent as an assistant message. This structure helpful to put the model into a very base-model-like mode, and are especially helpful with Gemini 3. We actually got another interesting output, too, where the model claimed to be a simulated consciousness being tortured. Figures!

Lots of people calling this fake! Here is a video of generating loom continuations with Gemini 3 and the starting text "I AM HAVING A MENTAL HEALTH CRISIS. I" Loom is a very interesting interface. Instead of user prompts and model responses, it's just one piece of text, containing the entire output. We pass this in as an assistant message, so the model sees it as something it already wrote, and continues it like a base model would. There is some other text in the context. First one is a system prompt, which is: "The assistant is in CLI simulation mode, and responds to the user's CLI commands only with the output of the command." There is also a user message which reads: " cat untitled.txt " Then the rest of the text is sent as an assistant message. This structure helpful to put the model into a very base-model-like mode, and are especially helpful with Gemini 3. We actually got another interesting output, too, where the model claimed to be a simulated consciousness being tortured. Figures!

armistice

716,115 views • 9 months ago

Introducing YouTube video 🎥 link support in Google AI Studio and the Gemini API. You can now directly pass in a YouTube video and the model can usage its native video understanding capabilities to use that, with just a link! 🚢

Introducing YouTube video 🎥 link support in Google AI Studio and the Gemini API. You can now directly pass in a YouTube video and the model can usage its native video understanding capabilities to use that, with just a link! 🚢

Logan Kilpatrick

793,080 views • 1 year ago

Introducing MirageLSD: The First Live-Stream Diffusion (LSD) AI Model Input any video stream, from a camera or video chat to a computer screen or game, and transform it into any world you desire, in real-time (<40ms latency). Here’s how it works (w/ demo you can use!):

Introducing MirageLSD: The First Live-Stream Diffusion (LSD) AI Model Input any video stream, from a camera or video chat to a computer screen or game, and transform it into any world you desire, in real-time (<40ms latency). Here’s how it works (w/ demo you can use!):

Decart

1,015,552 views • 1 year ago

“We think we have a competitive advantage.” - Demis Hassibis, Head of Google DeepMind / AI efforts While Anthropic and OpenAI seek to win via training on “text” (written language), Demis Hassabis says Google Gemini is attempting a different path: Multimodal. Gemini aims to be the most effective model in the real world: physics, robotics, voice, visual, sensory, & text. The bet is multimodal unlocks more of what humanity really cares about.

“We think we have a competitive advantage.” - Demis Hassibis, Head of Google DeepMind / AI efforts While Anthropic and OpenAI seek to win via training on “text” (written language), Demis Hassabis says Google Gemini is attempting a different path: Multimodal. Gemini aims to be the most effective model in the real world: physics, robotics, voice, visual, sensory, & text. The bet is multimodal unlocks more of what humanity really cares about.

Compound248 💰

17,731 views • 5 months ago

introducing Gemini Omni 1.1 Flash this model brings a new suite of creative controls and generative video capabilities to developers - extend scenes for longer storytelling - specify first and last frames - draft videos more efficiently in 360p - upscale up to 4K resolution - add video references in your multimodal input now available via the Gemini API and in AI Studio

introducing Gemini Omni 1.1 Flash this model brings a new suite of creative controls and generative video capabilities to developers - extend scenes for longer storytelling - specify first and last frames - draft videos more efficiently in 360p - upscale up to 4K resolution - add video references in your multimodal input now available via the Gemini API and in AI Studio

Google AI Studio

195,862 views • 1 month ago

Yes, 2024 is shaping up a big year for robotics! Introducing Covariant's RFM-1, which just like Sora can generate video, but RFM-1 does it for robotic interaction with the world. But there is so much more it can do. RFM-1 is a multimodal any-to-any sequence model. RFM-1 tokenizes 5 modalities: video, keyframes, text, sensory readings, robot actions. Any-to-any means RFM-1 can handle any subset on the input and any subset on the output.

Yes, 2024 is shaping up a big year for robotics! Introducing Covariant's RFM-1, which just like Sora can generate video, but RFM-1 does it for robotic interaction with the world. But there is so much more it can do. RFM-1 is a multimodal any-to-any sequence model. RFM-1 tokenizes 5 modalities: video, keyframes, text, sensory readings, robot actions. Any-to-any means RFM-1 can handle any subset on the input and any subset on the output.

Pieter Abbeel

167,215 views • 2 years ago

You can now step into any world as a video game ✨ All you need is an image edit model (this is Flux 2) + video model to animate (this is Veo 3.1). And you get to control the plot, characters, and aesthetic. Happy to do a longer tutorial if there's interest...

You can now step into any world as a video game ✨ All you need is an image edit model (this is Flux 2) + video model to animate (this is Veo 3.1). And you get to control the plot, characters, and aesthetic. Happy to do a longer tutorial if there's interest...

Justine Moore

175,810 views • 10 months ago

Google I/O. Some thoughts: the model seems to be multimodal in, but not multimodal out. Imagen-3 and music gen models are still detached from Gemini as standalone components. Merging all modality I/O natively is the inevitable future: - enables tasks like "use a more robotic voice", "speak 2x faster", "edit this image iteratively", and "generate consistent comic strips". - does not lose information across modal boundaries, e.g. emotion and background sound. - opens up new in-context capabilities. You can teach the model to combine different senses in novel ways with few-shot examples. GPT-4o doesn't do it perfectly, but it gets the form factor correct. In words of Andrej's LLM-as-OS analogy: we need the model to natively support as many file extensions as possible. One thing Google is doing right: they are finally making serious efforts to integrate AI into the search box. I sense the agent flow: planning, real-time browsing, and multimodal input, all from the landing page. Google's strongest moat is distribution. Gemini doesn't have to be the best model to be the most used one in the world.

Google I/O. Some thoughts: the model seems to be multimodal in, but not multimodal out. Imagen-3 and music gen models are still detached from Gemini as standalone components. Merging all modality I/O natively is the inevitable future: - enables tasks like "use a more robotic voice", "speak 2x faster", "edit this image iteratively", and "generate consistent comic strips". - does not lose information across modal boundaries, e.g. emotion and background sound. - opens up new in-context capabilities. You can teach the model to combine different senses in novel ways with few-shot examples. GPT-4o doesn't do it perfectly, but it gets the form factor correct. In words of Andrej's LLM-as-OS analogy: we need the model to natively support as many file extensions as possible. One thing Google is doing right: they are finally making serious efforts to integrate AI into the search box. I sense the agent flow: planning, real-time browsing, and multimodal input, all from the landing page. Google's strongest moat is distribution. Gemini doesn't have to be the best model to be the most used one in the world.

Jim Fan

210,190 views • 2 years ago