Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Stress testing Metropolis 1998! - Population: 53,500 - CPU FPS: 80 - GPU FPS: 10-80 - RAM: 3,100 MB So: At the moment, the game is GPU bound. I know why and there's a lot of room for improvement. It will involve developing or customizing an existing GPU framework.... show more

Yesbox - Metropolis 1998

9,816 subscribers

84,873 Aufrufe • vor 1 Jahr •via X (Twitter)

Gaming Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von John Heritage

John Heritagevor 1 Jahr

This looks fantastic! Is it a .. "if you liked the original Simcity you'll like this"?

Profilbild von Yesbox - Metropolis 1998

Yesbox - Metropolis 1998vor 1 Jahr

It's a mix of SimCity, Cities Skylines, and Rollercoaster Tycoon. So yes!

Profilbild von NetMind.AI

NetMind.AIvor 2 Jahren

Get access to a wide range of GPUs like H100, A100, 4090, 3090 and save over 90% at NetMind Power. Rent Now!

Profilbild von Ben Throop

Ben Throopvor 1 Jahr

Ooo curious what the bottleneck is. Is it purely the people? Or just the size of city that comes along with that population

Profilbild von Yesbox - Metropolis 1998

Yesbox - Metropolis 1998vor 1 Jahr

Its the number of draw calls, inability to do a depth pass, and prob. other things I'm not aware of due to my inexperience with all things GPU. <not sure if GPU terms are correct> Every object in the game is separated into parts (so each part can be custom colored). I have to draw each part individually since I am not able to expand the buffer stride. e.g. GPUs allow 16 additional vec4 fields that I could store all this information in. So essentially every tile/object in the game is being drawn 5 times >_< Im forced to use OpenGL 1.0 or 2.0 (not sure which) functions CPU side.

Profilbild von Bewildered Beast

Bewildered Beastvor 1 Jahr

This is very much near the top of my wishlist

Profilbild von Carson

Carsonvor 1 Jahr

holy moly this is incredible

Profilbild von Thomas Fossgard

Thomas Fossgardvor 1 Jahr

That’s awesome..

Profilbild von Zsky

Zskyvor 1 Jahr

Keep improving, I wanna play that piece of gold 😝

Profilbild von Ritik

Ritikvor 1 Jahr

very cool!

Profilbild von Marcelo Correia

Marcelo Correiavor 1 Jahr

OMG! Looks like a Transport Tycoon Deluxe with city construction!

Ähnliche Videos

GTA V's splash screen at 60 FPS in a PS5 emulator?! SharpEMU can now boot GTA V to its splash screen at a smooth 60 FPS, marking another exciting milestone for PS5 emulation. Current stats: • 60.1 FPS • 16.7 ms frame time • ~731 MB RAM • ~393 MB buffer • ~3% CPU usage • 1+ minute runtime There's still plenty of work ahead, but the progress is undeniable. Credit: Discord/marcelmedia

GTA V's splash screen at 60 FPS in a PS5 emulator?! SharpEMU can now boot GTA V to its splash screen at a smooth 60 FPS, marking another exciting milestone for PS5 emulation. Current stats: • 60.1 FPS • 16.7 ms frame time • ~731 MB RAM • ~393 MB buffer • ~3% CPU usage • 1+ minute runtime There's still plenty of work ahead, but the progress is undeniable. Credit: Discord/marcelmedia

Techjunkie Aman

674,689 Aufrufe • vor 19 Tagen

PowerInfer - a high-speed inference engine for deploying LLMs locally. Just came across this super interesting project on speeding up inference. It's not MoE but it's a simple approach that exploits the high locality in LLM inference to design a GPU-CPU hybrid inference engine. Hot-activated neurons are preloaded onto the GPU for fast access, while cold-activated neurons (the majority) are computed on the CPU. This approach significantly reduces GPU memory demands and CPU-GPU data transfer. It achieves an average token generation rate of 13.20 tokens/s, with a peak of 29.08 tokens/s, across various LLMs on a single NVIDIA RTX 4090 GPU. It's on only 18% lower than that achieved by a top-tier server-grade A100 GPU. It also significantly outperforms llama.cpp by up to 11.69x while retaining model accuracy. There is a lot more innovation around inference that's coming fast. Really encouraged by the study on sparse computation to enhance the computational efficiency of LLMs. It's now possible to use PowerInfer with Llama 2 and Faclon 40B. Mistral-7B support is coming soon!

PowerInfer - a high-speed inference engine for deploying LLMs locally. Just came across this super interesting project on speeding up inference. It's not MoE but it's a simple approach that exploits the high locality in LLM inference to design a GPU-CPU hybrid inference engine. Hot-activated neurons are preloaded onto the GPU for fast access, while cold-activated neurons (the majority) are computed on the CPU. This approach significantly reduces GPU memory demands and CPU-GPU data transfer. It achieves an average token generation rate of 13.20 tokens/s, with a peak of 29.08 tokens/s, across various LLMs on a single NVIDIA RTX 4090 GPU. It's on only 18% lower than that achieved by a top-tier server-grade A100 GPU. It also significantly outperforms llama.cpp by up to 11.69x while retaining model accuracy. There is a lot more innovation around inference that's coming fast. Really encouraged by the study on sparse computation to enhance the computational efficiency of LLMs. It's now possible to use PowerInfer with Llama 2 and Faclon 40B. Mistral-7B support is coming soon!

elvis

261,622 Aufrufe • vor 2 Jahren

Final take for the #boids ! Testing a flock of 16k boids, entirely computed in GPU. No more CPU boilerplate, thx to the precious help of Jason Knight . The code is available at The Godot Barn . #gamedev #GodotEngine Godot Engine Indieverse | Indie Game Community ❤️

Final take for the #boids ! Testing a flock of 16k boids, entirely computed in GPU. No more CPU boilerplate, thx to the precious help of Jason Knight . The code is available at The Godot Barn . #gamedev #GodotEngine Godot Engine Indieverse | Indie Game Community ❤️

Casual Garage Coder

14,683 Aufrufe • vor 1 Jahr

Monad Testnet Visualized (Pt 3) I think Claude and I have fixed the freeze/pause issue. Works a lot smoother and most of the jitter is now just due to my GPU/CPU begging for mercy trying to handle the data visualization

Monad Testnet Visualized (Pt 3) I think Claude and I have fixed the freeze/pause issue. Works a lot smoother and most of the jitter is now just due to my GPU/CPU begging for mercy trying to handle the data visualization

Ray J

18,673 Aufrufe • vor 1 Jahr

The fact that it starts up *immediately* when tabbing into the game feels like useful info. Not a thing that ramps up or down. I capped the FPS so stop asking about it. GPU is at well under 80% load. I'm only drawing 50% of the power my PSU can handle.

The fact that it starts up immediately when tabbing into the game feels like useful info. Not a thing that ramps up or down. I capped the FPS so stop asking about it. GPU is at well under 80% load. I'm only drawing 50% of the power my PSU can handle.

Theo - t3.gg

52,664 Aufrufe • vor 1 Jahr

GPU by hand ✍️ I drew 42 frames to show how a GPU speeds up an array operation of 8 elements in parallel over 4 threads in 2 clock cycles. Below is an overview: CPU • It has one core. • Its global memory has 120 locations (0-119). • To use the GPU, it needs to copy data from the global memory to the GPU. • After GPU is done, it will copy the results back. GPU • It has four cores to run four threads (0-3). • It has a register file of 28 locations (0-27) • This register file has four banks (0-3). • All threads share the same register file. • But they must read/write using the four banks. • Each bank allows 2 reads (Read 0, Read 1) and 1 write in a single clock cycle.

GPU by hand ✍️ I drew 42 frames to show how a GPU speeds up an array operation of 8 elements in parallel over 4 threads in 2 clock cycles. Below is an overview: CPU • It has one core. • Its global memory has 120 locations (0-119). • To use the GPU, it needs to copy data from the global memory to the GPU. • After GPU is done, it will copy the results back. GPU • It has four cores to run four threads (0-3). • It has a register file of 28 locations (0-27) • This register file has four banks (0-3). • All threads share the same register file. • But they must read/write using the four banks. • Each bank allows 2 reads (Read 0, Read 1) and 1 write in a single clock cycle.

Tom Yeh

101,788 Aufrufe • vor 1 Jahr

Crazy how Action Quake 2 and The Specialists still inspire a lot of FPS games. I grew up with those. I still don't know what the subgenre is called, there's so little FPS games in that category, I doubt there is even a name for them I need to make a list

Crazy how Action Quake 2 and The Specialists still inspire a lot of FPS games. I grew up with those. I still don't know what the subgenre is called, there's so little FPS games in that category, I doubt there is even a name for them I need to make a list

ZooL

32,611 Aufrufe • vor 3 Monaten

My take on Searle's Chinese Room: It's just milking a misleading visual metaphor. If you *actually* visualize what's going on in that room, the guy is using the book to process information at lightspeed, much like the operation of an H100 GPU or a brain.

My take on Searle's Chinese Room: It's just milking a misleading visual metaphor. If you actually visualize what's going on in that room, the guy is using the book to process information at lightspeed, much like the operation of an H100 GPU or a brain.

Liron Shapira

14,986 Aufrufe • vor 1 Jahr

Palette Pmonday Palette: Memory's Journey This kind of palette is an xbit classic, so of course I had to include it! Also I know I record in this room a lot. It's a good room okay? Wishlist Silent Santicado on Steam! Link in bio #metroidvania #indiegame #pixelart #ドット絵

Palette Pmonday Palette: Memory's Journey This kind of palette is an xbit classic, so of course I had to include it! Also I know I record in this room a lot. It's a good room okay? Wishlist Silent Santicado on Steam! Link in bio #metroidvania #indiegame #pixelart #ドット絵

Nix Pix 🐰 Wishlist Silent Santicado Now!

17,930 Aufrufe • vor 2 Jahren

Dylan Patel of SemiAnalysis says a worse GPU with better storage and memory now beats the best chip without them, so buying the newest GPU alone no longer wins inference. So, an AMD GPU with more memory can outperform Nvidia in some cases. "So what we have is we have over $80 million of compute, GPUs from Nvidia, AMD, TPUs from Google, Trainium from Amazon, and we run this benchmark constantly on the newest inference engine, newest drivers, newest PyTorch version, whatever it is." "Every day it runs on an automated CI, and we run it on all the latest Chinese models, from GLM, Zhipu, Moonshot, Kimi, Alibaba, all these models we run." "Initially, when we were benchmarking the difference between these chips and different engines, different schemes for parallelism, we were just running it fixed context length." "But now with Agent X, we've analyzed over $5 million worth of Claude Code traces. This is real production traffic that people have donated to us as well as internally generated. Now we know what the actual agent workload looks like." "And then as we implement that and run those benchmarks, it turns out yes, the chip you're using is very important, but now even more important is how are you handling this memory offload?" "And so while an Nvidia GPU is faster than an AMD GPU in most cases, because AMD GPUs have more memory, they actually end up outperforming in some cases." "Or you can have a worse GPU, but a much better storage solution, and now you can outperform what the best GPU can do without those solutions. So just buying the newest and latest GPU alone doesn't get you the best inference economics." "Actually, you need to layer in all these other innovations including storage and memory." [ Who's the top player on your chart? ] "That really is a difficult multivariable problem. And generally that means you need to have, yes, you need to have the best GPU, a GB300, but you also need to have the best storage solutions. And so I won't spoil who's the best right here, but I will say that storage solutions matter a lot and memory solutions matter a lot, as does your front-end networking. That matters a lot."

Dylan Patel of SemiAnalysis says a worse GPU with better storage and memory now beats the best chip without them, so buying the newest GPU alone no longer wins inference. So, an AMD GPU with more memory can outperform Nvidia in some cases. "So what we have is we have over $80 million of compute, GPUs from Nvidia, AMD, TPUs from Google, Trainium from Amazon, and we run this benchmark constantly on the newest inference engine, newest drivers, newest PyTorch version, whatever it is." "Every day it runs on an automated CI, and we run it on all the latest Chinese models, from GLM, Zhipu, Moonshot, Kimi, Alibaba, all these models we run." "Initially, when we were benchmarking the difference between these chips and different engines, different schemes for parallelism, we were just running it fixed context length." "But now with Agent X, we've analyzed over $5 million worth of Claude Code traces. This is real production traffic that people have donated to us as well as internally generated. Now we know what the actual agent workload looks like." "And then as we implement that and run those benchmarks, it turns out yes, the chip you're using is very important, but now even more important is how are you handling this memory offload?" "And so while an Nvidia GPU is faster than an AMD GPU in most cases, because AMD GPUs have more memory, they actually end up outperforming in some cases." "Or you can have a worse GPU, but a much better storage solution, and now you can outperform what the best GPU can do without those solutions. So just buying the newest and latest GPU alone doesn't get you the best inference economics." "Actually, you need to layer in all these other innovations including storage and memory." [ Who's the top player on your chart? ] "That really is a difficult multivariable problem. And generally that means you need to have, yes, you need to have the best GPU, a GB300, but you also need to have the best storage solutions. And so I won't spoil who's the best right here, but I will say that storage solutions matter a lot and memory solutions matter a lot, as does your front-end networking. That matters a lot."

Fireside Alpha

175,490 Aufrufe • vor 16 Tagen

Every year I use ZERO "Run plays" for the CPU in #NBA2K26 and a lot of people ask why. People think it causes the CPU to never run plays, but as you can see if you can balance the individual player tendencies correctly the result is a smooth authentic CPU offensive experience.

Every year I use ZERO "Run plays" for the CPU in #NBA2K26 and a lot of people ask why. People think it causes the CPU to never run plays, but as you can see if you can balance the individual player tendencies correctly the result is a smooth authentic CPU offensive experience.

Shady 🧊

184,692 Aufrufe • vor 5 Monaten

Gavin Baker (Gavin Baker) says the disaggregation of inference can extend GPU useful lives from 3-4 years to 10-15. That may single-handedly save private credit and reduce the financing rates for GPUs, which will drive demand and help finance the build-out. "The disaggregation of prefill and inference is going to be amazing for the useful lives of GPU and may single-handedly save private credit. Private credit is in pain from these SaaS loans. But there's a lot of private credit in GPUs too. They were underwriting that to 3-4. The disaggregation of inference means that these GPUs are going to have 10 or 15-year lives. The AI skeptics are like, "Oh, these companies are all cooking their books. The useful life of a GPU is only a year or two. The useful life of a CPU is only four years because the rapid technological change." No. What rapid technological change has done with the disaggregation of prefill and inference is you can put a Cerebras system or Groq LPUs effectively in front of a Hopper or even an Ampere, use that Hopper and Ampere for prefill, and extend the useful life of that GPU until it melts. This is going to be really good for the whole private credit industry. It's gonna help finance the AI build-out. Because if you can start to finance GPUs at 5% or 6% instead of – I think CoreWeave's lowest financing was low sevens – that actually mathematically changes the cost to finance this build-out."

Gavin Baker (Gavin Baker) says the disaggregation of inference can extend GPU useful lives from 3-4 years to 10-15. That may single-handedly save private credit and reduce the financing rates for GPUs, which will drive demand and help finance the build-out. "The disaggregation of prefill and inference is going to be amazing for the useful lives of GPU and may single-handedly save private credit. Private credit is in pain from these SaaS loans. But there's a lot of private credit in GPUs too. They were underwriting that to 3-4. The disaggregation of inference means that these GPUs are going to have 10 or 15-year lives. The AI skeptics are like, "Oh, these companies are all cooking their books. The useful life of a GPU is only a year or two. The useful life of a CPU is only four years because the rapid technological change." No. What rapid technological change has done with the disaggregation of prefill and inference is you can put a Cerebras system or Groq LPUs effectively in front of a Hopper or even an Ampere, use that Hopper and Ampere for prefill, and extend the useful life of that GPU until it melts. This is going to be really good for the whole private credit industry. It's gonna help finance the AI build-out. Because if you can start to finance GPUs at 5% or 6% instead of – I think CoreWeave's lowest financing was low sevens – that actually mathematically changes the cost to finance this build-out."

Invest Like the Best

211,336 Aufrufe • vor 2 Monaten

Dylan Patel on the importance of memory and storage Two key quotes: "An $NVDA GPU is faster than an $AMD GPU in most cases, but because AMD GPUs have more memory, they can outperform Nvidia in certain workloads." “It is a difficult, multivariable problem. Generally, you need the best GPU, such as a GB300, but you also need the best storage solutions. I will not spoil who comes out on top, but storage solutions matter a lot, memory solutions matter a lot, and frontend networking also matters significantly" Full Quote: “We have over $80 million of compute: GPUs from $NVDA and $AMD, TPUs from Google, and Trainium from Amazon. We constantly run this benchmark using the newest inference engines, drivers, PyTorch versions, and other software. It runs every day through automated CI across the latest Chinese models from GLM, Zhipu, Moonshot, Kimi, Alibaba, and others. Initially, when we were benchmarking the differences between these chips, inference engines, and parallelism schemes, we used fixed context lengths. But with Agent X, we have now analyzed more than $5 million worth of Claude Code traces. This is real production traffic that users have donated to us, combined with internally generated data, so we now understand what an actual agent workload looks like. When we implement those workloads and run the benchmarks, it turns out that the chip you are using is very important, but how you handle memory offload can be even more important. An Nvidia GPU is faster than an AMD GPU in most cases, but because AMD GPUs have more memory, they can outperform Nvidia in certain workloads. Similarly, you can use a less powerful GPU with a much better storage solution and outperform the best GPU when it lacks those solutions. Simply buying the newest GPU does not necessarily give you the best inference economics. You need to layer in other innovations, including storage and memory.” Interviewer: “Who is the top player on your chart? Can you tell us?” Dylan Patel: “It is a difficult, multivariable problem. Generally, you need the best GPU, such as a GB300, but you also need the best storage solutions. I will not spoil who comes out on top, but storage solutions matter a lot, memory solutions matter a lot, and frontend networking also matters significantly.”

Dylan Patel on the importance of memory and storage Two key quotes: "An $NVDA GPU is faster than an $AMD GPU in most cases, but because AMD GPUs have more memory, they can outperform Nvidia in certain workloads." “It is a difficult, multivariable problem. Generally, you need the best GPU, such as a GB300, but you also need the best storage solutions. I will not spoil who comes out on top, but storage solutions matter a lot, memory solutions matter a lot, and frontend networking also matters significantly" Full Quote: “We have over $80 million of compute: GPUs from $NVDA and $AMD, TPUs from Google, and Trainium from Amazon. We constantly run this benchmark using the newest inference engines, drivers, PyTorch versions, and other software. It runs every day through automated CI across the latest Chinese models from GLM, Zhipu, Moonshot, Kimi, Alibaba, and others. Initially, when we were benchmarking the differences between these chips, inference engines, and parallelism schemes, we used fixed context lengths. But with Agent X, we have now analyzed more than $5 million worth of Claude Code traces. This is real production traffic that users have donated to us, combined with internally generated data, so we now understand what an actual agent workload looks like. When we implement those workloads and run the benchmarks, it turns out that the chip you are using is very important, but how you handle memory offload can be even more important. An Nvidia GPU is faster than an AMD GPU in most cases, but because AMD GPUs have more memory, they can outperform Nvidia in certain workloads. Similarly, you can use a less powerful GPU with a much better storage solution and outperform the best GPU when it lacks those solutions. Simply buying the newest GPU does not necessarily give you the best inference economics. You need to layer in other innovations, including storage and memory.” Interviewer: “Who is the top player on your chart? Can you tell us?” Dylan Patel: “It is a difficult, multivariable problem. Generally, you need the best GPU, such as a GB300, but you also need the best storage solutions. I will not spoil who comes out on top, but storage solutions matter a lot, memory solutions matter a lot, and frontend networking also matters significantly.”

Daniel Romero

38,220 Aufrufe • vor 1 Monat

"As of right now, it's a little emotional in there and there's a lot of try hard." Tony Vitello blames himself for the lack of offensive production over two games, citing a need for the locker room to loosen up.

"As of right now, it's a little emotional in there and there's a lot of try hard." Tony Vitello blames himself for the lack of offensive production over two games, citing a need for the locker room to loosen up.

KNBR

1,188,648 Aufrufe • vor 4 Monaten

First I optimized CPU, then memory, now I'm onto the renderers (Metal first). Scrolling Neovim now sustains ~175fps easily (vsync off of course). More room for improvement, but this is already best-in-class (I can't find a terminal at the moment that does better on macOS). The road to get here was long. To quote Thorsten Ball I've been "moving the chess pieces into place over the past few months." I'll write about it in a devlog, eventually. And, people will inevitably say "high fps doesn't matter for a terminal." And yeah, maybe, but what's the fun in that. My answer to "why" is "because I can!" (Disclaimer: I use the Japanese bible as a sort of stress test for certain IO tests. I'm not religious and there isn't meant to be any sort of hidden message in this.)

First I optimized CPU, then memory, now I'm onto the renderers (Metal first). Scrolling Neovim now sustains ~175fps easily (vsync off of course). More room for improvement, but this is already best-in-class (I can't find a terminal at the moment that does better on macOS). The road to get here was long. To quote Thorsten Ball I've been "moving the chess pieces into place over the past few months." I'll write about it in a devlog, eventually. And, people will inevitably say "high fps doesn't matter for a terminal." And yeah, maybe, but what's the fun in that. My answer to "why" is "because I can!" (Disclaimer: I use the Japanese bible as a sort of stress test for certain IO tests. I'm not religious and there isn't meant to be any sort of hidden message in this.)

Mitchell Hashimoto

374,114 Aufrufe • vor 2 Jahren

I've made this animation a few months ago. The city and the cars assets come from Epic Ganes Market Place. All the rest is my stuff. It runs in realtime with an rtx 2070...Lots of room for improvement but i had a lot of fun making it..

I've made this animation a few months ago. The city and the cars assets come from Epic Ganes Market Place. All the rest is my stuff. It runs in realtime with an rtx 2070...Lots of room for improvement but i had a lot of fun making it..

Alvizello

33,408 Aufrufe • vor 1 Jahr

Jane Street engineers, in an internal tech talk on training performance: "GPUs are really slow at doing one floating point operation. It's around a microsecond. CPUs are 1,000 times faster than GPUs." Not a podcast. A talk given inside the firm that trades billions a day, to a room of engineers who already train models. The whole industry sells you the GPU as the fast thing. On a single operation it is a thousand times slower than the CPU sitting in your laptop. The GPU was never fast. It was wide. If your training loop feeds it one thing at a time, you are paying rack prices for the slowest chip in the building.

Jane Street engineers, in an internal tech talk on training performance: "GPUs are really slow at doing one floating point operation. It's around a microsecond. CPUs are 1,000 times faster than GPUs." Not a podcast. A talk given inside the firm that trades billions a day, to a room of engineers who already train models. The whole industry sells you the GPU as the fast thing. On a single operation it is a thousand times slower than the CPU sitting in your laptop. The GPU was never fast. It was wide. If your training loop feeds it one thing at a time, you are paying rack prices for the slowest chip in the building.

zostaff

12,502 Aufrufe • vor 18 Tagen