Loading video...

Video Failed to Load

Go Home

Multimodality: using #AI to understand & generate content across text, images, & audio. It can break down language barriers, making tech more inclusive. Which multimodal function do you find most impactful? Share your thoughts below 👇

GoogleAI's profile picture

Google AI

2,400,986 subscribers

36,204 views • 1 year ago •via X (Twitter)

Science & Technology#AI
LIVE

Anya Rossi• Live Now

Private livecam show

10 Comments

Cohorte's profile picture
Cohorte1 year ago

Multimodality is truly a game-changer! One of the most impactful functions, in my opinion, is the ability to synchronize text, images, and audio seamlessly, which can revolutionize education, content creation, and accessibility. For example, AI-generated video summaries or real-time language translations across modalities can break down barriers and make technology more inclusive for all. How about you? What do you think is the most transformative use?

Liberty's profile picture
Liberty1 year ago

Absolutely, multimodality is extremely important for everyday use of LLM.

Liberty's profile picture
Liberty1 year ago

Is it going to be available on free tier? Anyways, congrats and great job to your team on new Image generation model. It works well for text-on-image.

GPT.Biz's profile picture
GPT.Biz1 year ago

AI's multimodality truly brings people closer by bridging language gaps and enhancing accessibility for everyone

QuantumTheobald's profile picture
QuantumTheobald1 year ago

I'm impressed by AI-powered image generation, like DALL-E. It can create stunning visuals from text prompts, making it a game-changer for artists and designers. The intersection of text and image is where multimodality gets really exciting for me.

Vincent Valentine (CEO of UnOpen.ai)'s profile picture
Vincent Valentine (CEO of UnOpen.ai)1 year ago

Multimodality revolutionizes communication accessibility. What real-world applications excite you most?

Beyond the Code's profile picture
Beyond the Code1 year ago

I think image recognition is the most impactful.

Caduceus's profile picture
Caduceus1 year ago

Multimodality is paving the way for a more inclusive tech landscape! At #Caduceus, our edge rendering platform supports AI-driven, decentralized applications across the blockchain. Ready to explore the power of AI and AIGC with us? 🚀🌐 #AI #DePIN #Web3

BreakKnight's profile picture
BreakKnight1 year ago

ZERO DECENCY exposing children to RAPE & ABORTION ads on your networks. You guys suck !!

⟁ndrew V's profile picture
⟁ndrew V1 year ago

I’ll share more details when I’m ready, but I was able to use one of your tools to help me cope with a very challenging loss. In short, trying to manage an estate and inventory items of a dear loved ones passing is very hard to say the least. Your tool enabled me to manage the emotional context as well as appreciate the context window.

Related Videos

We are excited to announce the 1st version of our multimodal assistant, Yasa-1, a language assistant with visual and auditory sensors that can take actions via code execution 🪄. Yasa-1 can understand text, images, videos, sounds & more! 🚀 Check out more details below👇
0:45

We are excited to announce the 1st version of our multimodal assistant, Yasa-1, a language assistant with visual and auditory sensors that can take actions via code execution 🪄. Yasa-1 can understand text, images, videos, sounds & more! 🚀 Check out more details below👇

Reka

814,187 views • 2 years ago

We’re excited to announce 𝗚𝗲𝗺𝗶𝗻𝗶: Google’s largest and most capable AI model. Built to be natively multimodal, it can understand and operate across text, code, audio, image and video - and achieves state-of-the-art performance across many tasks. 🧵
1:30

We’re excited to announce 𝗚𝗲𝗺𝗶𝗻𝗶: Google’s largest and most capable AI model. Built to be natively multimodal, it can understand and operate across text, code, audio, image and video - and achieves state-of-the-art performance across many tasks. 🧵

Google DeepMind

1,315,808 views • 2 years ago

goodbye.. OpenAI image generator LTX Studio just dropped Flux.1 Kontext, it can edit images, restyle, relight, add objects to your image using text and.. upscale & turn to video directly AI is making our work 10x more efficient how to use & prompts:
0:21

goodbye.. OpenAI image generator LTX Studio just dropped Flux.1 Kontext, it can edit images, restyle, relight, add objects to your image using text and.. upscale & turn to video directly AI is making our work 10x more efficient how to use & prompts:

el.cine

300,042 views • 1 year ago

holy shtt.. AI can now can generate hours long videos.. create ur own character talking naturally, use text & audio to control the scene on arcads here's how to do it
1:15

holy shtt.. AI can now can generate hours long videos.. create ur own character talking naturally, use text & audio to control the scene on arcads here's how to do it

el.cine

73,769 views • 5 months ago

The second #GalaxyAIMoment challenge is here! Break all language barriers with Call Assist. Share your experiences with us using #GalaxyAIMoment in the comments below and get a chance to win exclusive Galaxy Swag*. *T&C apply: #Samsung
0:28

The second #GalaxyAIMoment challenge is here! Break all language barriers with Call Assist. Share your experiences with us using #GalaxyAIMoment in the comments below and get a chance to win exclusive Galaxy Swag*. *T&C apply: #Samsung

Samsung India

4,171,132 views • 2 years ago

You can now fine-tune Wan 2.1 14b using Replicate and Ostris’s AI-toolkit 🎉 - autocaption training images - publish to Hugging Face - save intermediate checkpoints to Weights & Biases All of the outputs below are text-to-video. Still much to do!
0:20

You can now fine-tune Wan 2.1 14b using Replicate and Ostris’s AI-toolkit 🎉 - autocaption training images - publish to Hugging Face - save intermediate checkpoints to Weights & Biases All of the outputs below are text-to-video. Still much to do!

fofr

82,431 views • 1 year ago

CYBER-CON | Did you know fraudsters can scam you & your loved ones by getting access to your audio which is less than 2 minutes? Santia Gora gets you a report on parent/grandparent scam also called audio cloning scam & how it works #fraud #cyberfraud #crime #AI #Tech
5:16

CYBER-CON | Did you know fraudsters can scam you & your loved ones by getting access to your audio which is less than 2 minutes? Santia Gora gets you a report on parent/grandparent scam also called audio cloning scam & how it works #fraud #cyberfraud #crime #AI #Tech

CNBC-TV18

32,862 views • 1 year ago

honestly so excited about this one! bulk generate/edit slideshows by using our agent, just ask what you want and for which slideshows and it will go ahead and do it! you will be able to edit text, images etc. cursor for content?
0:20

honestly so excited about this one! bulk generate/edit slideshows by using our agent, just ask what you want and for which slideshows and it will go ahead and do it! you will be able to edit text, images etc. cursor for content?

Fekri

83,998 views • 8 months ago

NEW: Napkin AI raises a $10M Seed to automate visual storytelling using AI - Backed by Accel, CRV You can transform text content into editable diagrams, flowcharts & infographics, enabling users to quickly share ideas visually. Here's how Napkin AI works:
0:55

NEW: Napkin AI raises a $10M Seed to automate visual storytelling using AI - Backed by Accel, CRV You can transform text content into editable diagrams, flowcharts & infographics, enabling users to quickly share ideas visually. Here's how Napkin AI works:

Chief AI Officer

108,232 views • 2 years ago

Make Evernote your new thinking partner.💡 🔜 Three new AI features to help you expand, organize, and find your content effortlessly. Which feature are you most excited for? Let us know below.👇
0:29

Make Evernote your new thinking partner.💡 🔜 Three new AI features to help you expand, organize, and find your content effortlessly. Which feature are you most excited for? Let us know below.👇

Evernote

21,053 views • 10 months ago

Sorry to break it to you, but if you think AI can automate all your marketing, you’re probably going to be disappointed. Yes, AI can write your posts. It can create images. It can analyze data. It can even help you build campaigns faster. But faster does not always mean better. AI still needs someone to tell it what matters. It needs someone to understand the customer, choose the right message, and decide what is actually worth creating. Because your goal is not to produce more content. Your goal is to become more visible. You need to know where people are discovering your brand. Are you showing up on Google? Are you being mentioned by ChatGPT and other AI platforms? Are your competitors showing up more often than you? That is where AI becomes useful. Not when it replaces your marketing, but when it helps you see what you could not see before. With you can track your share of visibility across search and AI platforms. You can see where your brand appears, where your competitors are winning, and which topics could help you get mentioned more often. So do not use AI to put your marketing on autopilot. Use it to make better decisions, move faster, and become harder to ignore.
0:59

Sorry to break it to you, but if you think AI can automate all your marketing, you’re probably going to be disappointed. Yes, AI can write your posts. It can create images. It can analyze data. It can even help you build campaigns faster. But faster does not always mean better. AI still needs someone to tell it what matters. It needs someone to understand the customer, choose the right message, and decide what is actually worth creating. Because your goal is not to produce more content. Your goal is to become more visible. You need to know where people are discovering your brand. Are you showing up on Google? Are you being mentioned by ChatGPT and other AI platforms? Are your competitors showing up more often than you? That is where AI becomes useful. Not when it replaces your marketing, but when it helps you see what you could not see before. With you can track your share of visibility across search and AI platforms. You can see where your brand appears, where your competitors are winning, and which topics could help you get mentioned more often. So do not use AI to put your marketing on autopilot. Use it to make better decisions, move faster, and become harder to ignore.

Neil Patel

10,400 views • 9 days ago

You don’t need $30 million or a studio to create something great. With LTX Studio, you can generate stylized animated content using prompts, presets, or reference images. Then build a full shot sequence. Here’s how to do it 👇
0:20

You don’t need $30 million or a studio to create something great. With LTX Studio, you can generate stylized animated content using prompts, presets, or reference images. Then build a full shot sequence. Here’s how to do it 👇

LTX Studio

91,299 views • 10 months ago

We've solved vector design with AI ✨ QuiverAI makes it incredibly easy to generate SVGs from text or images. When you treat visuals as code, you get a much more composable output and can do precise edits. You also get to watch the model sketch in real-time 👇
0:32

We've solved vector design with AI ✨ QuiverAI makes it incredibly easy to generate SVGs from text or images. When you treat visuals as code, you get a much more composable output and can do precise edits. You also get to watch the model sketch in real-time 👇

Justine Moore

48,083 views • 5 months ago

New short course: Building Multimodal Search and RAG", by Weaviate AI Database's Sebastia(N_) Witalec ✊🏽✊🏾✊🏿. Contrastive learning is used to train models to map vectors into an embedding space by pulling similar concepts closer together and pushing dissimilar concepts away from each other. This technique is also used to train multimodal embedding models that capture semantic similarity across different modalities like text, images, and audio. These multimodal embeddings can be used to build multimodal search and RAG systems. In this course, you'll learn how contrastive learning works, and how to add multimodality to RAG – so your models can draw on diverse, relevant context to answer questions. For example, a query about a financial report might synthesize information from text snippets, graphs, tables, and slides. You will also learn how visual instruction tuning lets you integrate image understanding into language models, and build a multi-vector recommender system using Weaviate’s open-source vector database. Please sign up here:
3:25

New short course: Building Multimodal Search and RAG", by Weaviate AI Database's Sebastia(N_) Witalec ✊🏽✊🏾✊🏿. Contrastive learning is used to train models to map vectors into an embedding space by pulling similar concepts closer together and pushing dissimilar concepts away from each other. This technique is also used to train multimodal embedding models that capture semantic similarity across different modalities like text, images, and audio. These multimodal embeddings can be used to build multimodal search and RAG systems. In this course, you'll learn how contrastive learning works, and how to add multimodality to RAG – so your models can draw on diverse, relevant context to answer questions. For example, a query about a financial report might synthesize information from text snippets, graphs, tables, and slides. You will also learn how visual instruction tuning lets you integrate image understanding into language models, and build a multi-vector recommender system using Weaviate’s open-source vector database. Please sign up here:

Andrew Ng

104,371 views • 2 years ago

What if your Claude could be Monica? Or Darius? Or whoever you want them to be? Today, we’re introducing the Pika MCP. Which means you can give your Claude a face, name, and personality—plus the ability to create rich, multimodal content. Byeeee generic AI. Pikafy your Claude with instructions below 👇
1:04

What if your Claude could be Monica? Or Darius? Or whoever you want them to be? Today, we’re introducing the Pika MCP. Which means you can give your Claude a face, name, and personality—plus the ability to create rich, multimodal content. Byeeee generic AI. Pikafy your Claude with instructions below 👇

Pika

1,850,326 views • 3 months ago

Now that my college basketball career is over, I'm excited to share with you what I'll be doing next... Partnering with Formula Bot - the AI-powered data analyst that helps you work faster & smarter with data. It can convert your text to data analysis, visualizations & more.
0:20

Now that my college basketball career is over, I'm excited to share with you what I'll be doing next... Partnering with Formula Bot - the AI-powered data analyst that helps you work faster & smarter with data. It can convert your text to data analysis, visualizations & more.

Jack Gohlke

2,817,983 views • 2 years ago

Feeling a little helpless about AI right now? You can make your voice heard by US legislators about AI RIGHT NOW. I made a quick video so you can learn more & contribute your artistic expertise to government AI protection efforts. Full video & links below. 👇
2:17

Feeling a little helpless about AI right now? You can make your voice heard by US legislators about AI RIGHT NOW. I made a quick video so you can learn more & contribute your artistic expertise to government AI protection efforts. Full video & links below. 👇

Melissa Medína

32,337 views • 2 years ago

I'm a firm believer in using AI to better understand yourself & others. Today, you can ask ChatGPT for advice and insights based on your conversations. But what if AI tools could see more of what you do everyday...and proactively recommend things to do or people to meet?
0:24

I'm a firm believer in using AI to better understand yourself & others. Today, you can ask ChatGPT for advice and insights based on your conversations. But what if AI tools could see more of what you do everyday...and proactively recommend things to do or people to meet?

Justine Moore

141,897 views • 1 year ago

With a 1M context window for Pro & Ultra users, and an ability to reason across text, images, audio and video, Gemini 3 is ready for anything. Like, analyzing your favorite sports teams or helping you perfect your athletic technique. Here’s how it works ↓
0:49

With a 1M context window for Pro & Ultra users, and an ability to reason across text, images, audio and video, Gemini 3 is ready for anything. Like, analyzing your favorite sports teams or helping you perfect your athletic technique. Here’s how it works ↓

Google Gemini

8,839,788 views • 8 months ago

Plan & visualize your next project in realtime with Nano Banana & connected apps in Gemini Live. Generate images based on what you show with your camera, find local shops on @GoogleMaps & more just by talking it out. Gemini Live is available to Gemini users globally at no cost.
0:32

Plan & visualize your next project in realtime with Nano Banana & connected apps in Gemini Live. Generate images based on what you show with your camera, find local shops on @GoogleMaps & more just by talking it out. Gemini Live is available to Gemini users globally at no cost.

Google Gemini

98,596 views • 28 days ago