Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Google researchers just developed GameNGen, an AI that can simulate DOOM at over 20 fps It works by predicting each frame in real time with a diffusion model At scale this could mean AI will be able to create games on the fly, personalized to each player

Rowan Cheung

595,098 subscribers

880,403 views • 1 year ago •via X (Twitter)

Science & Technology Education Gaming

Anya Rossi• Live Now

Private livecam show

11 Comments

Rowan Cheung1 year ago

AI NEWS: Google just developed an AI system that recreated the popular DOOM game at 20 fps. Plus, more developments from OpenAI, Bland AI, Gemini, Midjourney, and XPENG Here's everything going on in AI right now:

Rowan Cheung1 year ago

OpenAI is reportedly in talks to raise a new funding round at a valuation exceeding $100 billion The round is (reportedly) being led by Thrive Capital, with Microsoft also expected to participate! Wonder if Project Strawberry has anything to do with this

Rowan Cheung1 year ago

Bland AI, a conversational AI startup, closed their series A with $22M in funding There are so many unexplored use cases of automated conversational AI If you try calling the AI (enter your # on their website), you'll see how human it sounds

Rowan Cheung1 year ago

Google released Custom Gems for Gemini Advanced users Gems are customizable versions of Gemini, or in other words Google's version of Custom GPTs, with similar features like Custom Instructions

Rowan Cheung1 year ago

Midjourney teased an upcoming hardware launch with “multiple efforts in flight” The details are not yet available on the specifics of the launch but they're hiring for a new team in SF:

Rowan Cheung1 year ago

Chinese electric car manufacturer XPENG teased the 2nd generation of its humanoid robot It's set to be fully revealed at the company's 1024 Tech Day on October 24th China's robotic developments/news in the past two weeks have been insanely impressive

Rowan Cheung1 year ago

As always, I’ll be sending out a more in-depth rundown on all the AI news, and why it actually matters in ~5 hours in my newsletter. Join 650,000+ readers for free and never miss a thing in AI ever again:

Rowan Cheung1 year ago

That's it for today's news in the world of AI. I share what's happening in AI every day, follow me @rowancheung for more. If you found this helpful, support me with a like/retweet on the first tweet of this thread:

The AI Edge1 year ago

Based on what I’ve read, it’s trained using pre-existing gameplay data from Doom, which allows it to predict the required frames. This means the game needs to already exist for the training to work effectively.

CybKev1 year ago

*AI generate images from a game that is 100% known in his code, engine, etc.* OH MY GOD AI CAN CREATE GAMES?!?!?!?!?! No, AI does what it does: stealing content from creators to simulate new result... The funniest part is that here it give all it got to generate Doom at 20fps

Adrien1 year ago

In 2024, developing AI means finding the least effective and most energy consuming way to barely recreate things we did 30 years ago

Related Videos

Wow, diffusion models (used in AI image generation) are also game engines - a type of world simulation. By predicting the next frame of the classic shooter DOOM, you get a playable game at 20 fps without any underlying real game engine. This video is from the diffusion model.

Wow, diffusion models (used in AI image generation) are also game engines - a type of world simulation. By predicting the next frame of the classic shooter DOOM, you get a playable game at 20 fps without any underlying real game engine. This video is from the diffusion model.

Ethan Mollick

1,769,137 views • 1 year ago

Terence Tao says AI will enable mathematics to be done at an unprecedented scale: instead of solving one theorem at a time and solving each problem separately, AI could work on the space of problems and classes of 1000s of problems at a time

Terence Tao says AI will enable mathematics to be done at an unprecedented scale: instead of solving one theorem at a time and solving each problem separately, AI could work on the space of problems and classes of 1000s of problems at a time

Tsarathustra

79,266 views • 2 years ago

🇺🇸Sec. RFK Jr is said the agency under his watch could be replaced by personalized AI-driven medicine for every single citizen. He used a dog with cancer as the example. AI developed a personalized treatment. It worked. Now scale that to 330 million people.

🇺🇸Sec. RFK Jr is said the agency under his watch could be replaced by personalized AI-driven medicine for every single citizen. He used a dog with cancer as the example. AI developed a personalized treatment. It worked. Now scale that to 330 million people.

Mario Nawfal

146,766 views • 3 months ago

This may look like a game of Counterstrike running slowly, but it actually extraordinary. The entire game is created, frame-by-frame, on my *home computer* by an AI diffusion model in response to my actions. There is no game engine, just a "world model" trained on Counterstrike

This may look like a game of Counterstrike running slowly, but it actually extraordinary. The entire game is created, frame-by-frame, on my home computer by an AI diffusion model in response to my actions. There is no game engine, just a "world model" trained on Counterstrike

Ethan Mollick

376,399 views • 1 year ago

Google DeepMind just dropped 'Genie', an AI that can generate interactive video games. This is a huge deal. Genie is trained on 200,000 hours of unsupervised public internet gaming videos and can generate video games from a single prompt or image. But here's what's insane: Despite not being trained on action or text annotations, the foundation model can determine who the main character is and enable a user to control that character in the generated world. It does this through its Latent Action Model, Video Tokenizer, and Dynamics Model (will go more in-depth on this in tomorrow's newsletter for those interested). And for those asking, yes, it's research-only and not publicly available (here come the Google memes), and it does come with some limitations, like only currently creating games at 1FPS. But this is the worst AI will ever be. Anyone will be able to create their own entirely imagined virtual worlds soon, and that's a wild sentence to say out loud.

Google DeepMind just dropped 'Genie', an AI that can generate interactive video games. This is a huge deal. Genie is trained on 200,000 hours of unsupervised public internet gaming videos and can generate video games from a single prompt or image. But here's what's insane: Despite not being trained on action or text annotations, the foundation model can determine who the main character is and enable a user to control that character in the generated world. It does this through its Latent Action Model, Video Tokenizer, and Dynamics Model (will go more in-depth on this in tomorrow's newsletter for those interested). And for those asking, yes, it's research-only and not publicly available (here come the Google memes), and it does come with some limitations, like only currently creating games at 1FPS. But this is the worst AI will ever be. Anyone will be able to create their own entirely imagined virtual worlds soon, and that's a wild sentence to say out loud.

Rowan Cheung

3,377,222 views • 2 years ago

🔘 Real-time capabilities Genie 3 is our first world model to allow live interaction, while also improving consistency and realism compared to Genie 2. It can generate dynamic worlds at 720p and 24 FPS, with each frame created in response to user actions.

🔘 Real-time capabilities Genie 3 is our first world model to allow live interaction, while also improving consistency and realism compared to Genie 2. It can generate dynamic worlds at 720p and 24 FPS, with each frame created in response to user actions.

Google DeepMind

224,490 views • 1 year ago

Another day, another odd and old-school technical issue in #Nioh3. This game doesn’t just expect the frame rate to hit its FPS cap to work properly, it also wants the FPS to line up with the display refresh rate. Using the 60 fps cap at 120Hz (or higher) can result in lots of frame-time spikes and microstuttering. the only way to avoid this is to switch the refresh rate to 60 Hz, which gives a much smoother frame time graph. Frame Generation on top of a 60 FPS base at 120 Hz works flawlessly without any frame time issues.

Another day, another odd and old-school technical issue in #Nioh3. This game doesn’t just expect the frame rate to hit its FPS cap to work properly, it also wants the FPS to line up with the display refresh rate. Using the 60 fps cap at 120Hz (or higher) can result in lots of frame-time spikes and microstuttering. the only way to avoid this is to switch the refresh rate to 60 Hz, which gives a much smoother frame time graph. Frame Generation on top of a 60 FPS base at 120 Hz works flawlessly without any frame time issues.

BenchmarKing

37,803 views • 6 months ago

You can now create long form AI Videos. Introducing Multi-Frame by Dreamina AI! Upload up to 10 images to be stitched together for a longer AI video output. You can control the duration of each transition and guide with a text prompt. Tutorial in the comments 🔽

You can now create long form AI Videos. Introducing Multi-Frame by Dreamina AI! Upload up to 10 images to be stitched together for a longer AI video output. You can control the duration of each transition and guide with a text prompt. Tutorial in the comments 🔽

Jerrod Lew

31,762 views • 9 months ago

ELON: AI CAN SIMULATE CONSCIOUSNESS - BUT IS IT REAL? “It feels like consciousness is in a different dimension. This could be just an illusion. If you damage your brain in some way, you damage your consciousness, which implies that consciousness is a physical phenomenon. What I think is really quite likely is that digital intelligence will be able to outthink us in every way - and it will suddenly be able to simulate what we consider consciousness. To a degree, you would not be able to tell the difference.” Source: Elon Musk, Lex Fridman Podcast, November 12, 2019

ELON: AI CAN SIMULATE CONSCIOUSNESS - BUT IS IT REAL? “It feels like consciousness is in a different dimension. This could be just an illusion. If you damage your brain in some way, you damage your consciousness, which implies that consciousness is a physical phenomenon. What I think is really quite likely is that digital intelligence will be able to outthink us in every way - and it will suddenly be able to simulate what we consider consciousness. To a degree, you would not be able to tell the difference.” Source: Elon Musk, Lex Fridman Podcast, November 12, 2019

Mario Nawfal

96,434 views • 9 months ago

GameFactory Creating New Games with Generative Interactive Videos present GameFactory, a generalizable world model that learns from a small-scale dataset of Minecraft game videos. By leveraging the prior knowledge of a pretrained video diffusion model, it can create new games in an open domain.

GameFactory Creating New Games with Generative Interactive Videos present GameFactory, a generalizable world model that learns from a small-scale dataset of Minecraft game videos. By leveraging the prior knowledge of a pretrained video diffusion model, it can create new games in an open domain.

AK

70,029 views • 1 year ago

Gemini 3 Flash is starting to roll out as the default model for AI Mode in Search globally. AI Mode can now tackle your most complicated questions with greater precision — without compromising speed. ⚡ With this upgrade, AI Mode becomes an all-around more powerful tool, better at understanding your needs. You can ask more nuanced questions and it will consider each aspect to provide a thoughtful response. And as always, you’ll have access to real-time information and useful links from across the web.

Gemini 3 Flash is starting to roll out as the default model for AI Mode in Search globally. AI Mode can now tackle your most complicated questions with greater precision — without compromising speed. ⚡ With this upgrade, AI Mode becomes an all-around more powerful tool, better at understanding your needs. You can ask more nuanced questions and it will consider each aspect to provide a thoughtful response. And as always, you’ll have access to real-time information and useful links from across the web.

Google

67,545 views • 8 months ago

NEW: Elon Musk on AI and Robotics: "Assuming the current trend of artificial intelligence and robotics continues, the AI and robots will be able to do anything that that humans want them to do, but AI and robotics will be able to provide all the goods and services that anyone could possibly want. People will be able to wherever they want with their free time, work will be optional. If I could, I would certainly slow down AI and robotics, but I can't just seems to be well, it's advancing at a very rapid pace, whether I like it or not."

NEW: Elon Musk on AI and Robotics: "Assuming the current trend of artificial intelligence and robotics continues, the AI and robots will be able to do anything that that humans want them to do, but AI and robotics will be able to provide all the goods and services that anyone could possibly want. People will be able to wherever they want with their free time, work will be optional. If I could, I would certainly slow down AI and robotics, but I can't just seems to be well, it's advancing at a very rapid pace, whether I like it or not."

DogeDesigner

31,308 views • 8 months ago

Google has released Veo 3, an AI video generator that can create videos with characters talking to each other, sound effects, and background sounds Even though this is 100% AI-generated, do you think it looks realistic?

Google has released Veo 3, an AI video generator that can create videos with characters talking to each other, sound effects, and background sounds Even though this is 100% AI-generated, do you think it looks realistic?

6ixBuzzTV

45,499 views • 1 year ago

We vibe coded this demo in Google AI Studio to show Nano Banana 2's real-world understanding. With each frame in this environment, the model sees only the previous image, and is prompted to imagine what happens next. The consistency is incredible!

We vibe coded this demo in Google AI Studio to show Nano Banana 2's real-world understanding. With each frame in this environment, the model sees only the previous image, and is prompted to imagine what happens next. The consistency is incredible!

Demis Hassabis

69,141 views • 5 months ago

NEW: Introducing Octane AI Agentic Commerce Quizzes - Increase sales with AI. What is it? A sales quiz AI agent that makes 1-1 personalized sales experiences for every single customer. In real time. Powered by our new AI model CORE-1. Examples: 📸 Want to ask your customer to take a selfie and your AI agent automatically recommends them a full outfit from your catalog? Octane AI agents can do that. 🪞 Want to have an AI agent hand pick out each product for a personalized skin care routine? Want them to upload a selfie to detect their skin tone? Octane AI agents can do can that. 📊 Want to create an incredibly detailed report with graphs and tables and graphics thats generated by AI for each customer? Octane AI agents can do that. We give you the building blocks and you can build anything. And you can build it fast because our AI will do the heavy lifting for you. This is v1 and a representation of where our commerce and quiz technology is headed. Available today to everyone at 🆕 What we are launching today: • Smart Quiz Builder: Have an AI agent plan out and build your Octane AI quiz for you. It can even write custom HTML for beautiful results pages and progress bars. • Smart Products: It can take forever to setup the recommendation logic for a quiz. For those of you who need help, simply add smart products to your Octane AI quiz and your very own AI agent will hand-pick products for each customer who takes your quiz. It’s amazing. • Smart Copy: Instead of showing everyone who takes your quiz the exact same copy, use AI to personalize the quiz for every single person who takes it. Explain why these specific products are perfect for specifically them. • Image Analyzer: Let your customers upload or take a photo during the quiz and have AI analyze it. You can use this for anything from skin tone detection to picking out outfits! • Shopping Assistant: An AI agent that lives on your store that can help your customers at the right time. We have been building quiz software for almost 10 years now and AI is enabling us to make quizzes even more powerful. This is just the v1 of what we will be releasing in this area. We are so excited to see what you create with these new agentic products. Get creative, we think you will be surprised at how many interesting experiences you can create with Octane AI now.

NEW: Introducing Octane AI Agentic Commerce Quizzes - Increase sales with AI. What is it? A sales quiz AI agent that makes 1-1 personalized sales experiences for every single customer. In real time. Powered by our new AI model CORE-1. Examples: 📸 Want to ask your customer to take a selfie and your AI agent automatically recommends them a full outfit from your catalog? Octane AI agents can do that. 🪞 Want to have an AI agent hand pick out each product for a personalized skin care routine? Want them to upload a selfie to detect their skin tone? Octane AI agents can do can that. 📊 Want to create an incredibly detailed report with graphs and tables and graphics thats generated by AI for each customer? Octane AI agents can do that. We give you the building blocks and you can build anything. And you can build it fast because our AI will do the heavy lifting for you. This is v1 and a representation of where our commerce and quiz technology is headed. Available today to everyone at 🆕 What we are launching today: • Smart Quiz Builder: Have an AI agent plan out and build your Octane AI quiz for you. It can even write custom HTML for beautiful results pages and progress bars. • Smart Products: It can take forever to setup the recommendation logic for a quiz. For those of you who need help, simply add smart products to your Octane AI quiz and your very own AI agent will hand-pick products for each customer who takes your quiz. It’s amazing. • Smart Copy: Instead of showing everyone who takes your quiz the exact same copy, use AI to personalize the quiz for every single person who takes it. Explain why these specific products are perfect for specifically them. • Image Analyzer: Let your customers upload or take a photo during the quiz and have AI analyze it. You can use this for anything from skin tone detection to picking out outfits! • Shopping Assistant: An AI agent that lives on your store that can help your customers at the right time. We have been building quiz software for almost 10 years now and AI is enabling us to make quizzes even more powerful. This is just the v1 of what we will be releasing in this area. We are so excited to see what you create with these new agentic products. Get creative, we think you will be surprised at how many interesting experiences you can create with Octane AI now.

Matt Schlicht

290,828 views • 9 months ago

It won't take long before we'll be able to "reskin reality" in real-time. I had the chance to try this prototype that combines the #MixedReality view on a Quest device with Stable Diffusion AI and it feels like all the pieces are about to fit together... Special thanks to Hugues Bruyère , Chief of Innovation at Dpt. for sharing this early version.

It won't take long before we'll be able to "reskin reality" in real-time. I had the chance to try this prototype that combines the #MixedReality view on a Quest device with Stable Diffusion AI and it feels like all the pieces are about to fit together... Special thanks to Hugues Bruyère , Chief of Innovation at Dpt. for sharing this early version.

Gabriele Romagnoli

33,899 views • 1 year ago

I made another film with Ai. This time I used #runwayml ‘s text to video Ai #gen2 . Each shot was prompted. Voices generated with #elevenlabs I wrote the story based on a tweet #gpt4 wrote: “I just had a dream that I was an AI and woke up in a lab. What does it mean?” #aicinema

I made another film with Ai. This time I used #runwayml ‘s text to video Ai #gen2 . Each shot was prompted. Voices generated with #elevenlabs I wrote the story based on a tweet #gpt4 wrote: “I just had a dream that I was an AI and woke up in a lab. What does it mean?” #aicinema

Jon Finger

270,297 views • 3 years ago

This is "Whisper.cpp" a local lightweight AI model that can be run on mobile phones to convert speech to text with real time streaming

This is "Whisper.cpp" a local lightweight AI model that can be run on mobile phones to convert speech to text with real time streaming

Abdelhamed M.

143,177 views • 1 year ago

Say goodbye to green screens! DiffusionMat is an AI framework that uses a diffusion model to create refined alpha mattes by correcting the output at every denoising step to look more like the original input image.

Say goodbye to green screens! DiffusionMat is an AI framework that uses a diffusion model to create refined alpha mattes by correcting the output at every denoising step to look more like the original input image.

Dreaming Tulpa 🥓👑

146,578 views • 2 years ago