Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

This changes everything.. literally! Made a small game on my PS5 in Dreams.. and added a bit of AI. Now, do I think every game should be made by this.. of course not. But I can see this as being a very useful way to ensure visual consistency across... show more

Martin Nebelong

33,619 subscribers

51,143 views • 1 year ago •via X (Twitter)

Gaming Science & Technology

Anya Rossi• Live Now

Private livecam show

10 Comments

Martin Nebelong1 year ago

Here's the original.. (this is still my favorite of them all but don't tell anyone) ;-) Made this in 1 hour of sculpting and painting on my PS5. The character is from the Dreamiverse.. 🧵

Martin Nebelong1 year ago

Love the miniature look of this one.. 🧵

Martin Nebelong1 year ago

Or the bright colors and surface textures of this one. The way the shape of the objects are changed to fit the claymation style is very nice too.. 🧵

Martin Nebelong1 year ago

The semi-realistic look of this generation, clashes a bit with the loose placement of the models in my Dreams original, but apart from that it's very cool I think. 🧵

Martin Nebelong1 year ago

This is probably one of my favorites of the whole bunch.. very lovely style here. Imagine once we're able to bake these things into actual 3d.. and/or see it happen in real-time. 🧵

Martin Nebelong1 year ago

Interesting to see how it's possible to change both style, but also atmosphere.. 🧵

Martin Nebelong1 year ago

Another semi-realstic one.. notice the light interacting with the hair of the character. Crazy stuff😱 🧵

Martin Nebelong1 year ago

Here's the last one.. love the fall-colors on this one (I prompted for that). What do you think of tech like this? Part of me hate it, but another side of me is very curious to see what kind of new creativity it will unlock, what kind of projects talented creators will make with it. More expansive worlds, more coherent style, less rigid project process from initial idea to finished game.. there's so much to consider here. What's your take? Good, bad, undecided? #art #ai

Matteo Spinelli1 year ago

spoiler alert. nothing actually changed

Mike Kirby1 year ago

Needs just one or two more generations of releases to better improve consistency/coherence. But yeah I’d love for Sony to release TVs with inbuilt ai chips that let you play with any content that is displayed. Instant remastering of old games, turns breaking bad into an anime etc

Related Videos

I think I should not focus so much on the development of the game and focus more into drawing again, but anyhow, here is a bit of the progress ive made

I think I should not focus so much on the development of the game and focus more into drawing again, but anyhow, here is a bit of the progress ive made

🔞ScalieCrocs🔞

20,679 views • 6 months ago

done. I made this game entirely on my own, but I received quite a bit of help along the way so the credits ended up being longer than I expected. Of course, it's still nothing compared to most other games.

done. I made this game entirely on my own, but I received quite a bit of help along the way so the credits ended up being longer than I expected. Of course, it's still nothing compared to most other games.

Danbi

10,179 views • 1 year ago

So the title might be a bit bombastic, but if this isn't one of the most incredible glimpses of a future way of creating and rendering 3D.. I don't know what is. This was sculpted on my PS5 in mere minutes and transformed as I was sculpting, through a "Real-time Latent Consistency Model". Sony, you should reconsidder your plans for Dreams and make a Dreams V2 with generative AI or sell it to someone that will.. just saying ♥️ No other 3D tool would allow me to sculpt this freely which turns out to be a super-power in the land of AI. #madeindreams #ai

So the title might be a bit bombastic, but if this isn't one of the most incredible glimpses of a future way of creating and rendering 3D.. I don't know what is. This was sculpted on my PS5 in mere minutes and transformed as I was sculpting, through a "Real-time Latent Consistency Model". Sony, you should reconsidder your plans for Dreams and make a Dreams V2 with generative AI or sell it to someone that will.. just saying ♥️ No other 3D tool would allow me to sculpt this freely which turns out to be a super-power in the land of AI. #madeindreams #ai

Martin Nebelong

241,310 views • 2 years ago

Apples, Donut and more apples. Sculpted in Dreams on my PS5 with a layer of AI on top, applied as I'm sculpting in close to real time.. this is the future of 3D sculpting. #madeindreams #ai

Apples, Donut and more apples. Sculpted in Dreams on my PS5 with a layer of AI on top, applied as I'm sculpting in close to real time.. this is the future of 3D sculpting. #madeindreams #ai

Martin Nebelong

218,794 views • 2 years ago

Building virtual sets on top of reality, moving around in them and seeing them transformed entirely with Gen AI. Is this the future? :D This was quite simple to make actually: Figmin XR running on my Quest 3, using some models from sketchfab and some custom creations to set-dress my hallway. Filming a small performance of walking through the set and then using Runway Gen 3 to transform that. I'm still missing a lot of control with the AI process, like uploading style frames along the duration of the video.. but overall this is pretty incredible! Can't help but think about how insane it would have been to be able to use Dreams for stuff like this! What do you think? #art #ai

Building virtual sets on top of reality, moving around in them and seeing them transformed entirely with Gen AI. Is this the future? :D This was quite simple to make actually: Figmin XR running on my Quest 3, using some models from sketchfab and some custom creations to set-dress my hallway. Filming a small performance of walking through the set and then using Runway Gen 3 to transform that. I'm still missing a lot of control with the AI process, like uploading style frames along the duration of the video.. but overall this is pretty incredible! Can't help but think about how insane it would have been to be able to use Dreams for stuff like this! What do you think? #art #ai

Martin Nebelong

81,989 views • 1 year ago

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai

Martin Nebelong

48,200 views • 1 year ago

I had to do this of course - test out the new Google Omni Flash model with my favorite 3d art sandbox - Dreams. Just a quick test for now.. I'll be sharing more examples and techniques soon but wanted to show you this one. There's something very fitting about combining "handmade" 3d models and animations sculpted from scratch in software that runs on 2013 hardware, with some of the most advanced AI technology in the world. As part of my work for Google, I've used Google V2V models on a few different projects now - Ancestra, Dear Upstairs Neighbors and most recently one of the IO films (I'll share more about that project soon) 🥰 - and video continues to be my favorite form of input for Generative Ai workflows. If an image says more than a thousand words, a video says more than a million. And knowing that these capabilities are now in the hands of all of you, makes me very excited to see the new workflows and projects that will come out of it. What do you think of Omni so far?

I had to do this of course - test out the new Google Omni Flash model with my favorite 3d art sandbox - Dreams. Just a quick test for now.. I'll be sharing more examples and techniques soon but wanted to show you this one. There's something very fitting about combining "handmade" 3d models and animations sculpted from scratch in software that runs on 2013 hardware, with some of the most advanced AI technology in the world. As part of my work for Google, I've used Google V2V models on a few different projects now - Ancestra, Dear Upstairs Neighbors and most recently one of the IO films (I'll share more about that project soon) 🥰 - and video continues to be my favorite form of input for Generative Ai workflows. If an image says more than a thousand words, a video says more than a million. And knowing that these capabilities are now in the hands of all of you, makes me very excited to see the new workflows and projects that will come out of it. What do you think of Omni so far?

Martin Nebelong

38,200 views • 1 month ago

Four years ago on this day, I released the first small build of my visual novel. Fast-forward to today, the novel is complete with a definitive edition on the way and a trilogy in the works. Not much to share as of now, but I wanted to acknowledge today. 🧵(1/?)

Four years ago on this day, I released the first small build of my visual novel. Fast-forward to today, the novel is complete with a definitive edition on the way and a trilogy in the works. Not much to share as of now, but I wanted to acknowledge today. 🧵(1/?)

🦦Atmac🔜MP

37,785 views • 1 year ago

A lot of improvements with enemy AI and overall gameplay flow, still some issues to iron out but I think the next mechanical update should be a big step forward for the game #gamedev | #indiedev | #unrealengine

A lot of improvements with enemy AI and overall gameplay flow, still some issues to iron out but I think the next mechanical update should be a big step forward for the game #gamedev | #indiedev | #unrealengine

Crimson

134,422 views • 2 years ago

I've received a LOT of requests to play the game. Thanks! So, I am working on it but it will be *limited* as the AI Gen is not free! Follow-me and comment so I can PM you the link! P.S. yes this game is 100% coded by AI! I am also taking prompt requests! It's limitless lol:

I've received a LOT of requests to play the game. Thanks! So, I am working on it but it will be limited as the AI Gen is not free! Follow-me and comment so I can PM you the link! P.S. yes this game is 100% coded by AI! I am also taking prompt requests! It's limitless lol:

Nicolas Zullo

14,067 views • 1 year ago

✨My Gamedev Journey of 2024 This year, I learned a lot! Although I couldn’t focus on a major personal project as much as I’d hoped, my skills improved, and I feel more confident in all areas of game development. Hope I can double down in the future! #GameDev #UE5 #b3d

✨My Gamedev Journey of 2024 This year, I learned a lot! Although I couldn’t focus on a major personal project as much as I’d hoped, my skills improved, and I feel more confident in all areas of game development. Hope I can double down in the future! #GameDev #UE5 #b3d

MortMort

81,436 views • 1 year ago

Beginning work on my next port. This is the original game, just doing some research/documentation. But man, I really don't want to do this area. Wait, i'm infidelity. 😎 Oh, and for all those memes I see of "if you can beat this stage, i'll buy you a PS5" I'll take a PS5 now, heh.

Beginning work on my next port. This is the original game, just doing some research/documentation. But man, I really don't want to do this area. Wait, i'm infidelity. 😎 Oh, and for all those memes I see of "if you can beat this stage, i'll buy you a PS5" I'll take a PS5 now, heh.

infidelity

14,686 views • 10 months ago

HOW IS HE MAKING ME LOVE MY FAVORITE GAME EVEN MORE??? I’ve played this like 6 times and I always just perceived this as wow that silly girl we met in the forest was actually so different & turned out to be a princess I never even considered that it was literally a parallel of Shulk from the beginning of the game. My mind is actually being blown man oh my godddd — I truly did not think this game had more left for me to love 😭

HOW IS HE MAKING ME LOVE MY FAVORITE GAME EVEN MORE??? I’ve played this like 6 times and I always just perceived this as wow that silly girl we met in the forest was actually so different & turned out to be a princess I never even considered that it was literally a parallel of Shulk from the beginning of the game. My mind is actually being blown man oh my godddd — I truly did not think this game had more left for me to love 😭

Aero

64,605 views • 1 year ago

I can now play against my AI in my tennis game on HYTOPIA $TOPIA If everything goes well the game should be done in a few days and published for everyone to play. I will also introduce a leaderboard 🎾

I can now play against my AI in my tennis game on HYTOPIA $TOPIA If everything goes well the game should be done in a few days and published for everyone to play. I will also introduce a leaderboard 🎾

cagy.ron | youtube/cagyjan

11,322 views • 1 year ago

I've built a multiplayer survival game for the browser in 30 days and I didnt write a single line of code 🤯 So I'd like to write my notes about it once the deadline is done now. The last 20% of a project is indeed the hardest part of it all. In the last 2 days i've been working on the final version of Hollowlands for @levelsio's 2026 #vibejam I worked a lot! I fixed a lot of bugs, tested a lot playing with my wife. Fixed more bugs... But now, thank God, I have the final result! The game looks good, yes. I've spent half of the jam just tweaking every single detail of the procedural world generation. And It was worth it! The game still runs well on most devices and still has less than 20MB in size. Which is pretty impressive to me. The process of building was very straighforward: 1. I used Three.js + React to create the game. Before I started I created a huge document defining every rule i'd like the codebase to be implemented upon. It had clean code rules, archtecture decisions, ECS principles (good for games), and so on. This helped a lot constrain the AI to maintain the code maintainable and separated into clear domains (systems). This document was made partially by me given my previous experience building web games (I've made a lot of mistakes in the past and made sure they will not repeat again) and partially AI suggesting best practices. 2. For every feature I prompted the AI, I was very specific on details that I'd like implemented. If I knew what I was doing, I was more specific on the "how" I wanted to be done. If I didnt know what was doing I first asked the AI to brainstorm possibilities with me, based on industry standards, pros and cons, and so on. Then I would decide what path to go. 3. Every single feature I used Leva for tweaking the values. So for example, the size of the trees, colors, distance between objects, animation speed, etc. Everything I have a slider that I can adjust. 4. To make the game look good I used Tripo to create the models. To be honest it's not 100% perfect. If you check the character in game you can notice a few issues here and there (the arms lol), but I believe that it will keep getting better over time. 1 Year ago I tried and it wasnt even close to what it's now. Then I used a few post-processing + shaders + particles techniques to bring the "wow" factor. 5. I did only 1 feature at a time. And every change it was a commit with a clear message of what was done. This helped the AI fetch previous commit to understand what changed and know exactly what happened in the past. If I opened multiple terminals at once and blasted prompts the code and commit history would be a mess in a few days. And for every change the AI did, I asked it to do a Code Review of everything that was changed and look for violations on the document I wrote in the beggining defining the codebase guidelines. I realized that I pretty much applied software engineer principles using AI: Code, review and merge, code, review and merge... 6. On the last week I implemented the multiplayer using Colyseus ⚔️ which was pretty nice. I used AI to fetch the whole documentation and create a skill.md file that helped a lot. The creator of the framework Endel also did a extensive research on how real multiplayer games are implemented. It's open source and it was a gold mine for the AI to come up with the implementation for my game. You can ask him the link :) And that was it I think. I'm extremely tired now. The last 2 days was insane. The game's final version is not what I had in mind in the beginning of the jam. I had to cut a lot of cool features. But given the 30 days deadline I think it was a huge success. Hands down my best game ever made. Now I'll take a few days to rest and come back with more updates on the game. Maybe it can become a big deal in the future with more updates. Who knows. And in the event I win first place in this game jam, I'll use the money to fund my own game studio + cover the expenses of my child that is going to be born in September :) Cheers guys! If you have any question, feel free to reach out. I'll answer every non-bot comment in here haha Note: The link to play is in my profile

André → andreelias.dev

17,839 views • 1 month ago

Might of found a way to use this mechanic in comp. I've seen people do this on the floor a couple times but not really on the wall in this way. I do think this could be used in comp because of the sharp change in trajectory of the ball and it could seriously bait out players. Not to mention it can be done on any part of the wall so even off the ceiling. I'm already getting fairly consistent at it on one side and I've practiced it for a day. It feels like doing the breezi flick for the first time but this could be a more practical mechanic. If it can be done on command consistently it has ridiculous potential for passes and other stuff Not saying this is a new mechanic btw nor is it guaranteed to become meta but I love the idea of seeing innovation and new things in the game because there isn't much of it these days so I hope people aren't closed minded about it. Would love to hear opinions on it

Might of found a way to use this mechanic in comp. I've seen people do this on the floor a couple times but not really on the wall in this way. I do think this could be used in comp because of the sharp change in trajectory of the ball and it could seriously bait out players. Not to mention it can be done on any part of the wall so even off the ceiling. I'm already getting fairly consistent at it on one side and I've practiced it for a day. It feels like doing the breezi flick for the first time but this could be a more practical mechanic. If it can be done on command consistently it has ridiculous potential for passes and other stuff Not saying this is a new mechanic btw nor is it guaranteed to become meta but I love the idea of seeing innovation and new things in the game because there isn't much of it these days so I hope people aren't closed minded about it. Would love to hear opinions on it

Breezi

372,865 views • 2 years ago

After 15 days of hard work, I'm happy to share my game for @levelsio's 2026 #vibejam The game is called Hollowlands and I'm trying my best on it. Learning a lot of new stuff in the process. My previous game development experience + AI is a powerful combination that I honestly think it's underexplored by many. What used to take weeks of development now is being done in days, allowing me to focus more on the creative part of the process. Next step: Integrating multiplayer using Colyseus ⚔️ by Endel who's also a fellow brazilian 🇧🇷

After 15 days of hard work, I'm happy to share my game for @levelsio's 2026 #vibejam The game is called Hollowlands and I'm trying my best on it. Learning a lot of new stuff in the process. My previous game development experience + AI is a powerful combination that I honestly think it's underexplored by many. What used to take weeks of development now is being done in days, allowing me to focus more on the creative part of the process. Next step: Integrating multiplayer using Colyseus ⚔️ by Endel who's also a fellow brazilian 🇧🇷

André → andreelias.dev

79,359 views • 2 months ago

Quick print of the figure I am working on. The final design will be made out of vinyl but for now I’m testing a few things by quickly printing out of PLA. Should be printing a resin version next to test some paint patterns. For now enjoy this work in progress 🦊

Quick print of the figure I am working on. The final design will be made out of vinyl but for now I’m testing a few things by quickly printing out of PLA. Should be printing a resin version next to test some paint patterns. For now enjoy this work in progress 🦊

Val / LatinVixen

14,879 views • 1 year ago

PabloReports: What do you make of this reflecting pool controversy? Amo: The pool of scum? I think it’s a terrible waste of taxpayer money, a waste of resources, and a waste of time we should be using to focus on finally ending a war in Iran and, of course, dealing with the cost challenges people are facing. Trump is always fixated on the project of the day. He doesn’t know anything more about fixing that pool than I do. Huge waste of time.

PabloReports: What do you make of this reflecting pool controversy? Amo: The pool of scum? I think it’s a terrible waste of taxpayer money, a waste of resources, and a waste of time we should be using to focus on finally ending a war in Iran and, of course, dealing with the cost challenges people are facing. Trump is always fixated on the project of the day. He doesn’t know anything more about fixing that pool than I do. Huge waste of time.

Acyn

61,784 views • 2 days ago