Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

This guy installed a personal Nvidia AI data center on his desk and now runs 7 agents 24/7 for $0/month DGX Spark on a desk = $0 per token, forever. The 7 agents now running on it: → Morning brief agent - reads every source, drops 400 words at...

37,445 Aufrufe • vor 2 Monaten •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

People made fun of Alex Finn for buying three Mac Studios to run AI at home. Then Fable got banned for a week, GLM 5.2 dropped, and those exact Mac Studios started reselling for 4x what he paid. He showed me how he built his home AI lab from scratch. Here's the playbook: 1) The hardware. three 512GB Mac Studios, an NVIDIA DGX Spark, a custom RTX 5090 build, and a few Mac Minis. ~$30k all in. 2) The buying framework... - Mac Studio: huge memory, runs GLM 5.2 (open weights, near Opus 4.8 on benchmarks), but slow. - DGX Spark ($4,800): the sweet spot for most people. - RTX 5090: smaller models at blazing speed (Qwen's 29B now hits Sonnet 4 level). 3) Tailscale networks every machine into one private network with root access to each other. Only one machine is plugged into a monitor. 4) A Nous Research Hermes agent is his IT guy. New model drops? It SSHs into the right box, loads 5 candidates, runs evals overnight, and reports back which task belongs on which machine. Alex has literally never loaded a model himself. 5) The whole point: achieving "ambient intelligence." Always-on jobs that would bankrupt you on per-token billing. A security sweep of his API endpoints every hour. Code optimization every 20 minutes. Database anomaly & churn detection. Hourly scraping of X, Reddit & Hacker News for business opportunities. 6) Running those workloads on frontier models would cost thousands a month. His actual cost: ~$60 more in electricity. 7) Btw he's not anti-frontier. He still maxes out his Claude plan. The way he sees it: frontier is for hard thinking, local is for the foot soldiers that never sleep. 8) "We own everything except for the intelligence. Why can't we own the intelligence?" 9) He thinks frontier-level intelligence runs on consumer hardware within 6 months.

Alex Lieberman

57,764 Aufrufe • vor 1 Monat

NVIDIA quietly built two desktop boxes that delete a $25,000/year AI subscription bill You don't rewrite your stack, you don't rent another data center, you just plug both into the wall and switch one line of code One looks like a deck of cards, the other like a hardback novel, together they replace ChatGPT Plus, Claude Pro, Cursor Pro, the OpenAI API meter, and every cloud GPU you were renting for fine-tunes It's built on the same CUDA stack the data center runs, which means once you migrate one workflow the rest follow on the same code path The reason NVIDIA shipped this is simple The bigger you scale on cloud AI, the harder you get taxed, and a one-person operator paying $2,100/month is producing exactly $0 of asset value at the end of every month And their solution is to skip the rental meter entirely, push inference back onto your desk, and let you loop agents overnight without watching a number tick on someone else's invoice This is much cheaper, faster, and pays itself back in 6 weeks for anyone already running AI for work But there is still a question nobody has answered yet, what happens when the next frontier model drops and your local 70B falls 6 months behind mid-quarter Also, technically a stack of four of the big box runs a 1.6 trillion parameter model on a desk for under $12,000 Even a fraction of that compute is more than most people will ever need in a year Bookmark this, it's worth coming back to when you have time 👇

ZEUS⚡️

65,369 Aufrufe • vor 2 Monaten