Загрузка видео...

Не удалось загрузить видео

На главную

NVIDIA might have just declared war on the cloud GPU business For years, AI builders had one option Rent compute Pay every month Watch the bill grow every time usage increased Now NVIDIA is putting serious AI hardware directly on people's desks Small enough to fit next to a...

30,361 просмотров • 1 месяц назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Elon Musk just identified the next crisis in AI. It’s not a shortage. It’s an unusable surplus. Musk: “By the end of this year, chip production will outpace the ability to turn chips on.” For three years the world was starved for silicon. Every lab, every government, every company racing to secure the chips that determine who wins the AI era. That bottleneck is ending. A new one is replacing it. Musk: “The chips are going to be piling up and not be able to be turned on.” Billions of dollars of the most advanced AI hardware ever built. Sitting dark. Not because the chips don’t work. Because there isn’t enough electricity to run them. You can’t print a power plant the way you print a chip. The fabrication plants scaled. The grid didn’t. And now the most valuable hardware in history is about to hit a wall that no amount of capital can instantly solve. Compute is about to become abundant. Electricity is about to become the most valuable commodity on earth. Three years obsessing over silicon yields. Physics doesn’t care about your chip architecture if your data center can’t pull enough megawatts. The war isn’t about who can manufacture the most silicon anymore. It’s about who has the raw power to plug it in. Whoever solves energy first doesn’t just win. They own the infrastructure everyone else needs to compete. The losers stack useless chips in warehouses waiting for power that never arrives. We built a trillion dollar engine and forgot the fuel. That’s the AI race right now.

Dustin

704,921 просмотров • 4 месяцев назад

i spent $26,600 on cloud GPU rentals over 14 months before i found a NVIDIA DGX Spark at $2,999 (founder's edition) or $3,999 (shipping price) it paid for itself in 6 weeks i run 200B parameter models locally now and my old cloud provider keeps sending me loyalty discount emails the math on that $26,600 is embarrassing to type out loud $1,900/month for 14 months, H100 instances on a specialist cloud provider, because anything bigger than a 70B model simply would not fit anywhere else i paid the invoices like they were a utility bill and told myself it was just the cost of doing serious AI work it took me over a year to find out it wasn't 14 months, broken down: → months 1-4: $1,400-1,600/month - felt like manageable infrastructure overhead → months 5-9: crept to $1,900-2,100 as i started running DeepSeek-class experiments, costs tracking directly with model size → months 10-12: one agent loop ran for 36 hours against a 130B model while i slept, that month hit $2,400 → month 13: ran the cumulative total for the first time, saw $23,800, felt physically sick → month 14: another $2,800 month while i waited for the hardware to ship the box is the NVIDIA DGX Spark - roughly the footprint of a large mac mini, powered by a GB10 Grace Blackwell chip with 128GB of unified LPDDR5X memory that unified memory is the whole thing an RTX 4090 has 24GB of VRAM, which means a 70B model in full BF16 precision physically does not fit, you're quantizing down or you're renting cloud, those are your options this box loads a 200B parameter model quantized and serves it through vLLM over localhost, same API interface the cloud endpoint used the migration took one line of code - i changed the base URL from the provider's endpoint to 127.0.0.1:8000 and everything just worked electricity to run continuous 200B inference locally comes out to about $12/month the payback arithmetic is almost too clean: $2,999 hardware cost against $1,900/month saved, the box paid for itself before i'd owned it two months what i didn't account for was how completely the cost model changes your behavior when there's no hourly meter running, you greenlight experiments you'd never approve on cloud - agent loops that churn for hours, running 10,000 documents through a reasoning pass at 3am, speculative fine-tuning jobs you'd normally skip because the cost felt unjustifiable i ran more experiments in the first 30 days after the box arrived than in the four months before it the loyalty discount email landed about 8 weeks after i cancelled the cloud subscription 15% off my next three months, valued customer, we'd love to have you back i didn't reply the box was already running

Argona

22,099 просмотров • 1 месяц назад

The companies racing Elon Musk to build AI are paying him more than 2 billion dollars a month to do it. Anthropic pays SpaceX 1.25 billion dollars a month. Google pays 920 million. They are not buying rockets. They are renting compute, the scarce Nvidia chips that train frontier models, from a data center in Memphis called Colossus that Musk's rocket company now owns. SpaceX folded xAI into itself in February, and with it the 220,000 chips built to train Grok. Then it rented them to Grok's rivals. Anthropic took the entire first building. Google leased 110,000 more. The contracts signed so far run past 80 billion dollars. SpaceX is no longer a rocket company that dabbles in AI. It is one of the largest AI compute landlords on Earth, and its biggest tenants are the rivals it is trying to beat. Musk is not choosing between building AI on the ground and building it in space. He is using one to fund the other. The 80 billion in ground contracts is the cash engine. Starmind, the million-satellite constellation built to leave the ground behind, is what the cash builds. So the rivals are financing his exit from the planet. Every dollar Anthropic and Google pay for compute in Memphis helps fund the orbital network designed to strand them on the surface. They are paying the toll on the road they are trying to win, and the toll is building Musk a road no one else can reach. The piece works out who is really renting from whom.

Shanaka Anslem Perera ⚡

97,451 просмотров • 18 дней назад