Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Zero frame drops Loads 10x faster than EXR 95% less GPU memory Look at me clicking through 4k environments in Three.js and Needle like it's nothing Stay tuned for more!

20,887 Aufrufe • vor 10 Monaten •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Dylan Patel on the importance of memory and storage Two key quotes: "An $NVDA GPU is faster than an $AMD GPU in most cases, but because AMD GPUs have more memory, they can outperform Nvidia in certain workloads." “It is a difficult, multivariable problem. Generally, you need the best GPU, such as a GB300, but you also need the best storage solutions. I will not spoil who comes out on top, but storage solutions matter a lot, memory solutions matter a lot, and frontend networking also matters significantly" Full Quote: “We have over $80 million of compute: GPUs from $NVDA and $AMD, TPUs from Google, and Trainium from Amazon. We constantly run this benchmark using the newest inference engines, drivers, PyTorch versions, and other software. It runs every day through automated CI across the latest Chinese models from GLM, Zhipu, Moonshot, Kimi, Alibaba, and others. Initially, when we were benchmarking the differences between these chips, inference engines, and parallelism schemes, we used fixed context lengths. But with Agent X, we have now analyzed more than $5 million worth of Claude Code traces. This is real production traffic that users have donated to us, combined with internally generated data, so we now understand what an actual agent workload looks like. When we implement those workloads and run the benchmarks, it turns out that the chip you are using is very important, but how you handle memory offload can be even more important. An Nvidia GPU is faster than an AMD GPU in most cases, but because AMD GPUs have more memory, they can outperform Nvidia in certain workloads. Similarly, you can use a less powerful GPU with a much better storage solution and outperform the best GPU when it lacks those solutions. Simply buying the newest GPU does not necessarily give you the best inference economics. You need to layer in other innovations, including storage and memory.” Interviewer: “Who is the top player on your chart? Can you tell us?” Dylan Patel: “It is a difficult, multivariable problem. Generally, you need the best GPU, such as a GB300, but you also need the best storage solutions. I will not spoil who comes out on top, but storage solutions matter a lot, memory solutions matter a lot, and frontend networking also matters significantly.”

Daniel Romero

38,220 Aufrufe • vor 7 Tagen

Some millennials have been working for 20 years and are still confused by corporate 😂 For those who are still in the dark let me fill you in. Your performance doesn't matter. Your performance review doesn't matter. Your compensation has been set by a budget committee a year ago. You are not "overachieving" anything. Management has a fixed pool of money to pay the people they manage so they can give them raises less than inflation. If they give you more money, they have to give someone else less money. It's a zero-sum game. Managers actually have a larger pool of money to hire new employees because corporations recognize that new hires need to be incentivized to come over. They won't just leave their company for the same money. If you've been at the same company for 5 years you are underpaid. If you've been at the same company for 10 years you are paid less than a new hire at a competitor. Loyalty doesn't matter because there is no reason for a company to voluntarily pay you more money. Corporations already know that over 95% of employees will not go anywhere and will take whatever they get. Even if that's nothing. There's no reason to pay everybody more money when only a tiny percentage of workers will leave. Even if you leave... (remember over 95% of employees will not) ... the corporation will distribute the work you were doing among all your coworkers. And they will take on the extra work. And they will stay. For nothing. Because in addition to a salary, what an employee wants is to not have to look for a new job. That's all the want. They don't want to move anywhere. And companies know it, and they will take advantage of that. Now you know! You're welcome.

Lazy Canadian Investor

66,816 Aufrufe • vor 2 Jahren