Loading video...
Video Failed to Load
SITUATION EXPLAINED: Why is the compute shortage narrative at least partly wrong? We asked mai, founder and CEO of Internet Backyard "You'll be surprised to see if you go inside data centers, the utilization rate of the GPU are extremely low. Capacity rate you can see at 92%, 99%,... show more
42,951 views • 2 months ago •via X (Twitter)
3 Comments

Hot Aisle2 months ago
@omaikasei @netbackyard No monitoring? Lol. This is a fake narrative that people have been pitching for years now over and over. There is certainly a lot of unused and underutilized compute, but it isn’t for these reasons.

Meryem Arik2 months ago
@omaikasei @netbackyard This is part of the reason why batch and async inference is essential for inference providers to maintain high margins.

Andy Guo2 months ago
@omaikasei @netbackyard @grok 哪家公司可以在做这个调度闲置算力的服务
