Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

SIMA 2 is our most capable AI agent for virtual 3D worlds. 👾🌐 Powered by Gemini, it goes beyond following basic instructions to think, understand, and take actions in interactive environments – meaning you can talk to it through text, voice, or even images. Here’s how 🧵

Google DeepMind

1,498,855 subscribers

1,922,295 views • 9 months ago •via X (Twitter)

Arts Education Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing SIMA: the first generalist AI agent to follow natural-language instructions in a broad range of 3D virtual environments and video games. 🕹️ It can complete tasks similar to a human, and outperforms an agent trained in just one setting. 🧵

Introducing SIMA: the first generalist AI agent to follow natural-language instructions in a broad range of 3D virtual environments and video games. 🕹️ It can complete tasks similar to a human, and outperforms an agent trained in just one setting. 🧵

Google DeepMind

1,061,956 views • 2 years ago

🎬 Storyblocker V2 is here! 🚀 Visualize anything. 🔥 Your own World Engine , Text-to-3D + VID2VID let you create virtual worlds, mockup ideas, & build stunning virtual production environments—all powered by AI. No big-budget needed. Try it now: 🧵👇 Let’s break it down:

🎬 Storyblocker V2 is here! 🚀 Visualize anything. 🔥 Your own World Engine , Text-to-3D + VID2VID let you create virtual worlds, mockup ideas, & build stunning virtual production environments—all powered by AI. No big-budget needed. Try it now: 🧵👇 Let’s break it down:

storyblocker

69,935 views • 1 year ago

Super excited to announce SIMA 2! It’s a general agent that can understand & reason about complex instructions and complete tasks in simulated game worlds, even ones it has never seen before. Incredible to see how it can learn just from self-play… a crucial step towards AGI

Super excited to announce SIMA 2! It’s a general agent that can understand & reason about complex instructions and complete tasks in simulated game worlds, even ones it has never seen before. Incredible to see how it can learn just from self-play… a crucial step towards AGI

Demis Hassabis

154,038 views • 9 months ago

Quickly create real-time dance content that you can choose to use directly for virtual live streaming or interactive experiences in VR. All it takes is capturing with a webcam, powered by an AI-generated 3D motion solution. 3D models from Warudo @ Hakuya Labs

Quickly create real-time dance content that you can choose to use directly for virtual live streaming or interactive experiences in VR. All it takes is capturing with a webcam, powered by an AI-generated 3D motion solution. 3D models from Warudo @ Hakuya Labs

CYANPUPPETS

16,462 views • 2 years ago

Personalizing images in the Google Gemini just got easier — and you’re in total control. ✨ We’re introducing new ways for Personal Intelligence and Nano Banana 2 to generate images that can reflect your life, interests, and the things you care about most. Here’s how it works 🧵

Personalizing images in the Google Gemini just got easier — and you’re in total control. ✨ We’re introducing new ways for Personal Intelligence and Nano Banana 2 to generate images that can reflect your life, interests, and the things you care about most. Here’s how it works 🧵

Google

114,279 views • 4 months ago

Damn. DeepMind's generalist AI agent SIMA 2 evolved from basic instruction-following to actual reasoning companion. Uses vision and keyboard/mouse like a human player, works across dozens of games without touching game code. The robotics angle is obvious - if you can generalize across virtual 3D worlds, physical embodiment is next. Limited research preview for now, probably because the self-improvement stuff needs more safety work.

Damn. DeepMind's generalist AI agent SIMA 2 evolved from basic instruction-following to actual reasoning companion. Uses vision and keyboard/mouse like a human player, works across dozens of games without touching game code. The robotics angle is obvious - if you can generalize across virtual 3D worlds, physical embodiment is next. Limited research preview for now, probably because the self-improvement stuff needs more safety work.

Bilawal Sidhu

48,638 views • 9 months ago

Create compositions like a PRO by combining 3D with AI! I'll show how to take full control of your scene and generate images in any style you want. Breaking it all down for you in this thread. 🧵👇

Create compositions like a PRO by combining 3D with AI! I'll show how to take full control of your scene and generate images in any style you want. Breaking it all down for you in this thread. 🧵👇

TechHalla

158,091 views • 1 year ago

Gemini skills in Chrome are insanely powerful?! You can just write instructions and Gemini will be able to take any action over and over. 1. Create by typing "/" in the Gemini panel 2. Write your instructions 3. Type "/[skill-name]" And Gemini will automatically work for you by using the skill. So you can leverage it to - Scrap information - Take action in a specific web app - Anything you can perform in a browser basically Keep in mind that you can even use your emails or your Google account as a context... Which can be VERY useful.

Gemini skills in Chrome are insanely powerful?! You can just write instructions and Gemini will be able to take any action over and over. 1. Create by typing "/" in the Gemini panel 2. Write your instructions 3. Type "/[skill-name]" And Gemini will automatically work for you by using the skill. So you can leverage it to - Scrap information - Take action in a specific web app - Anything you can perform in a browser basically Keep in mind that you can even use your emails or your Google account as a context... Which can be VERY useful.

Paul Couvert

70,226 views • 3 months ago

This is dope update for Gemini macOS app 🔥 You can now long press the Fn key and simply talk to Gemini from anywhere on your Mac. By default, it works as an intelligent dictation tool that: - Removes "ums" and "ahs" - Cleans up mid sentence corrections - Formats your text automatically - Pastes polished text directly where your cursor is Enable Gemini Reasoning, and it can do even more by understanding what's on your screen. For example, you can: - Summarize documents, PDFs, and images - Rewrite highlighted text in any tone - Turn notes into polished emails or executive summaries - Generate and edit images using voice commands Instead of switching between apps, you can just speak naturally and Gemini handles the rest. This update is rolling out globally in English for the Gemini app on macOS, with more languages coming soon. Video credit: Google Blog

This is dope update for Gemini macOS app 🔥 You can now long press the Fn key and simply talk to Gemini from anywhere on your Mac. By default, it works as an intelligent dictation tool that: - Removes "ums" and "ahs" - Cleans up mid sentence corrections - Formats your text automatically - Pastes polished text directly where your cursor is Enable Gemini Reasoning, and it can do even more by understanding what's on your screen. For example, you can: - Summarize documents, PDFs, and images - Rewrite highlighted text in any tone - Turn notes into polished emails or executive summaries - Generate and edit images using voice commands Instead of switching between apps, you can just speak naturally and Gemini handles the rest. This update is rolling out globally in English for the Gemini app on macOS, with more languages coming soon. Video credit: Google Blog

AshutoshShrivastava

14,630 views • 22 days ago

I created a real-time Voice RAG Agent, powered by Gemma 3. - It lets you to talk to you docs in a voice you prefer - You can also clone your voice in just 5 seconds The code is open-source, and here's a step-by-step guide:

I created a real-time Voice RAG Agent, powered by Gemma 3. - It lets you to talk to you docs in a voice you prefer - You can also clone your voice in just 5 seconds The code is open-source, and here's a step-by-step guide:

Akshay 🚀

152,586 views • 1 year ago

Today, we’re excited to announce AI Actions! AI Actions turn your chatbot into an AI Agent that can take actions by calling any API. This lets the agent do things like upgrade_subscription, track_shipment, book_appointment, and more. Here’s how it works: 1. Set up your API in Chatbase or select from prebuilt actions like Cal.com get_available_slots and Matt Slack send_message. 2. Provide a prompt to guide the Agent on when and how to use the action. 3. Your AI Agent takes care of the rest, executing actions for your customers, giving them a mind-blowing experience. These actions can be internal APIs for app-specific tasks or it can be APIs for external tools your business uses like a ticketing system, a CRM, e-commerce platform, or really anything else. We're raising the bar for customer experience.

Today, we’re excited to announce AI Actions! AI Actions turn your chatbot into an AI Agent that can take actions by calling any API. This lets the agent do things like upgrade_subscription, track_shipment, book_appointment, and more. Here’s how it works: 1. Set up your API in Chatbase or select from prebuilt actions like Cal.com get_available_slots and Matt Slack send_message. 2. Provide a prompt to guide the Agent on when and how to use the action. 3. Your AI Agent takes care of the rest, executing actions for your customers, giving them a mind-blowing experience. These actions can be internal APIs for app-specific tasks or it can be APIs for external tools your business uses like a ticketing system, a CRM, e-commerce platform, or really anything else. We're raising the bar for customer experience.

Chatbase

410,699 views • 1 year ago

AI agents are becoming increasingly capable of taking actions beyond the chat window and interacting with tools in the real world, such as web browsers. We explored this capability by having an AI agent present one of our interactive web-based demos. In this video, it's presenting our election interference demo. This agent is a Cursor coding agent and is equipped with tools to read and interact with the browser (using Playwright) and perform text-to-speech (with ElevenLabs), in addition to the standard Cursor tools.

AI agents are becoming increasingly capable of taking actions beyond the chat window and interacting with tools in the real world, such as web browsers. We explored this capability by having an AI agent present one of our interactive web-based demos. In this video, it's presenting our election interference demo. This agent is a Cursor coding agent and is equipped with tools to read and interact with the browser (using Playwright) and perform text-to-speech (with ElevenLabs), in addition to the standard Cursor tools.

CivAI

18,428 views • 8 months ago

Exploring 3D Generation Capabilities in Alchemist AI🔮 Alchemist AI now enables users to create basic 3D assets, including models, objects, environments, and simulations, expanding its capabilities beyond 2D asset generation. What Does This Mean for You? • 3D Environment Creation: Generate virtual worlds, such as game environments or fantasy landscapes. Define parameters like terrain or structures to create dynamic and adaptable spaces tailored to your needs. • Customizable 3D Models and Objects: Design and modify 3D assets by adjusting dimensions, materials, and textures. Whether crafting prototypes or characters, users maintain full creative control. • Interactive Simulations: Build physics-based simulations or animated scenes. With upcoming support for sprite libraries and animation rigs, fine-tune object behaviors and interactions to suit your projects. With future API updates, Alchemist AI’s 3D generation capabilities will further expand, enhancing tools for creating models, environments, and simulations. AI-assisted text-to-3D will also be introduced—just describe your vision, such as 'space station' or 'orange sports car' and the system will generate customizable base assets.

Exploring 3D Generation Capabilities in Alchemist AI🔮 Alchemist AI now enables users to create basic 3D assets, including models, objects, environments, and simulations, expanding its capabilities beyond 2D asset generation. What Does This Mean for You? • 3D Environment Creation: Generate virtual worlds, such as game environments or fantasy landscapes. Define parameters like terrain or structures to create dynamic and adaptable spaces tailored to your needs. • Customizable 3D Models and Objects: Design and modify 3D assets by adjusting dimensions, materials, and textures. Whether crafting prototypes or characters, users maintain full creative control. • Interactive Simulations: Build physics-based simulations or animated scenes. With upcoming support for sprite libraries and animation rigs, fine-tune object behaviors and interactions to suit your projects. With future API updates, Alchemist AI’s 3D generation capabilities will further expand, enhancing tools for creating models, environments, and simulations. AI-assisted text-to-3D will also be introduced—just describe your vision, such as 'space station' or 'orange sports car' and the system will generate customizable base assets.

ALCHEMIST AI 🔮

35,673 views • 1 year ago

This is so cool! 🙀 I built a voice agent for a Stripe store. You talk to it through a phone call powered by twilio, inference on OpenAI's 4o, and the agent runs on Cloudflare Developers btw 😎

This is so cool! 🙀 I built a voice agent for a Stripe store. You talk to it through a phone call powered by twilio, inference on OpenAI's 4o, and the agent runs on Cloudflare Developers btw 😎

Confidence

11,990 views • 1 year ago

⚡️ Digital content creation often requires expensive equipment and expertise, making it inaccessible for many. AI Nexus solves this by offering an AI-powered platform that simplifies the process, integrating multiple creative tools in a single mobile app. Creators can design virtual worlds, digital avatars, and 3D objects, while monetizing their work through the A1X token and Web3 features. Ready to bring your ideas to life with ease? What worlds would you create with AI Nexus? [Brought to you by AI Nexus]

⚡️ Digital content creation often requires expensive equipment and expertise, making it inaccessible for many. AI Nexus solves this by offering an AI-powered platform that simplifies the process, integrating multiple creative tools in a single mobile app. Creators can design virtual worlds, digital avatars, and 3D objects, while monetizing their work through the A1X token and Web3 features. Ready to bring your ideas to life with ease? What worlds would you create with AI Nexus? [Brought to you by AI Nexus]

Cointelegraph

45,352 views • 1 year ago

🚀 Exciting news! The GeoAI Python package just got a major upgrade. It now supports interactive geospatial data visualization powered by AI Agents. 🌍✨ GitHub: Full tutorial: 🌍 In this tutorial, you’ll learn how to build interactive maps powered by AI agents that respond to natural language queries. Watch how you can fly to any city, add raster or vector layers, visualize 3D buildings, and explore geospatial data—all without writing code. Perfect for developers, researchers, and anyone curious about AI, GIS, and interactive mapping. #geospatial #mapping #python #GeoAI #AI

🚀 Exciting news! The GeoAI Python package just got a major upgrade. It now supports interactive geospatial data visualization powered by AI Agents. 🌍✨ GitHub: Full tutorial: 🌍 In this tutorial, you’ll learn how to build interactive maps powered by AI agents that respond to natural language queries. Watch how you can fly to any city, add raster or vector layers, visualize 3D buildings, and explore geospatial data—all without writing code. Perfect for developers, researchers, and anyone curious about AI, GIS, and interactive mapping. #geospatial #mapping #python #GeoAI #AI

Qiusheng Wu

12,831 views • 10 months ago

Foundation Agent: a roadmap to build generally capable embodied AI that acts skillfully across many worlds, virtual or real. Project GR00T, the Humanoid robot foundation model, is a cornerstone for Foundation Agent. It's the North Star, the next grand challenge in our quest for AGI. My full talk and Q&A for those who missed GTC:

Foundation Agent: a roadmap to build generally capable embodied AI that acts skillfully across many worlds, virtual or real. Project GR00T, the Humanoid robot foundation model, is a cornerstone for Foundation Agent. It's the North Star, the next grand challenge in our quest for AGI. My full talk and Q&A for those who missed GTC:

Jim Fan

178,125 views • 2 years ago

Most AI video tools generate clips. This one generates worlds. Alibaba Group and HappyOyster are taking it a step further, they generate worlds. Create interactive, explorable experiences where viewers can move through scenes, choose directions, and uncover stories in real time. The line between video games and AI video is starting to disappear. 🧵👇

Most AI video tools generate clips. This one generates worlds. Alibaba Group and HappyOyster are taking it a step further, they generate worlds. Create interactive, explorable experiences where viewers can move through scenes, choose directions, and uncover stories in real time. The line between video games and AI video is starting to disappear. 🧵👇

Parul Gautam

81,553 views • 2 months ago

something I’ve wanted for a while: an AI that isn’t just a text box so I built it lets you create a 3D AI character on-chain that lives in your browser it can talk, remember you, show emotions, and use different skills. you can even mint it onchain, so it actually belongs to you it gets its own identity, history, and reputation that no one can take away most AI today can disappear if the app shuts down this one is permanent and yours the future is AI you can see, interact with, and actually own

something I’ve wanted for a while: an AI that isn’t just a text box so I built it lets you create a 3D AI character on-chain that lives in your browser it can talk, remember you, show emotions, and use different skills. you can even mint it onchain, so it actually belongs to you it gets its own identity, history, and reputation that no one can take away most AI today can disappear if the app shuts down this one is permanent and yours the future is AI you can see, interact with, and actually own

nich

285,544 views • 3 months ago

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

Santiago

65,446 views • 4 months ago