Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

THIS AI DEVELOPER RUNS 120B PARAMETER MODELS LOCALLY AND HIS MACBOOK PRO CAN’T EVEN OPEN THEM he bought a DGX Spark, gave it the model, went back to his desk by end of day the inference was done, tested, committed his team is still waiting for the cloud GPU... show more

leopardracer

9,856 subscribers

85,470 Aufrufe • vor 1 Monat •via X (Twitter)

Bildung Nachrichten & Politik Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

JENSEN HUANG UNVEILED A $3,000 SUPERCOMPUTER THAT REPLACES $1,900/MONTH IN CLOUD GPUS WITH $2 IN ELECTRICITY. IT FITS ON YOUR DESK a developer was paying $1,900 a month renting a100 and h100 cloud gpus. he bought the dgx spark, set it up in an afternoon, and his monthly bill dropped from $1,900 to $2 in electricity the box runs 128gb of unified memory and 1 petaflop of ai compute. a 4090 gives you 24gb of vram and taps out at 30b models. the spark loads 70b at full precision and stretches to 200b without breaking a sweat break-even hit in 6 weeks. after that the $1,890 he used to wire to a rental company every month stayed in his business. first year that's $22,000 back install ollama, change one line in your code, point it at localhost instead of the cloud. nothing else changes. nothing leaves your machine and nothing costs money per request cloud gpu costs aren't getting cheaper and rate limits keep getting tighter. the people who pulled their ai workloads onto a box on their desk in 2026 are going to look very far ahead in 2028 bookmark this and read the article below

JENSEN HUANG UNVEILED A $3,000 SUPERCOMPUTER THAT REPLACES $1,900/MONTH IN CLOUD GPUS WITH $2 IN ELECTRICITY. IT FITS ON YOUR DESK a developer was paying $1,900 a month renting a100 and h100 cloud gpus. he bought the dgx spark, set it up in an afternoon, and his monthly bill dropped from $1,900 to $2 in electricity the box runs 128gb of unified memory and 1 petaflop of ai compute. a 4090 gives you 24gb of vram and taps out at 30b models. the spark loads 70b at full precision and stretches to 200b without breaking a sweat break-even hit in 6 weeks. after that the $1,890 he used to wire to a rental company every month stayed in his business. first year that's $22,000 back install ollama, change one line in your code, point it at localhost instead of the cloud. nothing else changes. nothing leaves your machine and nothing costs money per request cloud gpu costs aren't getting cheaper and rate limits keep getting tighter. the people who pulled their ai workloads onto a box on their desk in 2026 are going to look very far ahead in 2028 bookmark this and read the article below

starmex

141,376 Aufrufe • vor 1 Monat

NVIDIA will refund your cloud bill if you let them put a $250,000 supercomputer on your desk for $2,999 The $2,999 DGX Spark puts a 128GB AI supercomputer on your desk the same 70B models you rented in the cloud, but nothing goes over the network and no ToS governs the machine you own $22,000 in annual savings is the big number everyone posts The quiet number is even bigger it’s the contracts you’ve stopped losing due to data residency Owning your own compute is no longer just budget optimization it’s a way to sell to customers who can’t send their data to the cloud

NVIDIA will refund your cloud bill if you let them put a $250,000 supercomputer on your desk for $2,999 The $2,999 DGX Spark puts a 128GB AI supercomputer on your desk the same 70B models you rented in the cloud, but nothing goes over the network and no ToS governs the machine you own $22,000 in annual savings is the big number everyone posts The quiet number is even bigger it’s the contracts you’ve stopped losing due to data residency Owning your own compute is no longer just budget optimization it’s a way to sell to customers who can’t send their data to the cloud

Asteri

143,336 Aufrufe • vor 28 Tagen

people burn $1,900 a month on cloud, this $2,999 NVIDIA box runs 5 AI models at once and costs $10 to power 128GB of unified memory, stack two together and you double it, enough to run models a $2,000 graphics card cannot even open in the demo it ran Qwen3 Vision, Nemotron, a voice model, text to speech and speech to text all at once, and only used half the box here is the math that makes people switch: > cloud GPUs were costing $1,900 every single month, billed forever > the box is $2,999 one time, then about $10 of electricity a month > it paid for itself in two months, $22,000 stayed in the business in year one > zero data ever leaves your desk, no rental, no rate limits most people are still renting what this owns outright the full breakdown of the box and the exact math is in the article below

people burn $1,900 a month on cloud, this $2,999 NVIDIA box runs 5 AI models at once and costs $10 to power 128GB of unified memory, stack two together and you double it, enough to run models a $2,000 graphics card cannot even open in the demo it ran Qwen3 Vision, Nemotron, a voice model, text to speech and speech to text all at once, and only used half the box here is the math that makes people switch: > cloud GPUs were costing $1,900 every single month, billed forever > the box is $2,999 one time, then about $10 of electricity a month > it paid for itself in two months, $22,000 stayed in the business in year one > zero data ever leaves your desk, no rental, no rate limits most people are still renting what this owns outright the full breakdown of the box and the exact math is in the article below

John Doe

38,106 Aufrufe • vor 1 Monat

TWO BOXES THE SIZE OF A MAC MINI JUST RAN A 235 BILLION PARAMETER MODEL ON A DESK It is two NVIDIA DGX Spark units linked by a single cable. A year ago a model this size meant renting a GPU cluster by the hour. Now it sits next to your monitor for around $8,000. Here is the twist most people miss. Linking them does not create one shared 256GB memory pool. The model is split across both boxes, and that is the only reason a 235B model fits at all. It answers at roughly 10 tokens per second, and both chips sit at just 74 degrees while sipping around 50 watts. Every token stays on the desk. Nothing touches a cloud, and nothing leaves the room. The ceiling for what you can run at home just jumped from 70B to 235B. Bookmark this & Watch it run ↓

TWO BOXES THE SIZE OF A MAC MINI JUST RAN A 235 BILLION PARAMETER MODEL ON A DESK It is two NVIDIA DGX Spark units linked by a single cable. A year ago a model this size meant renting a GPU cluster by the hour. Now it sits next to your monitor for around $8,000. Here is the twist most people miss. Linking them does not create one shared 256GB memory pool. The model is split across both boxes, and that is the only reason a 235B model fits at all. It answers at roughly 10 tokens per second, and both chips sit at just 74 degrees while sipping around 50 watts. Every token stays on the desk. Nothing touches a cloud, and nothing leaves the room. The ceiling for what you can run at home just jumped from 70B to 235B. Bookmark this & Watch it run ↓

slash1s

100,849 Aufrufe • vor 16 Tagen

NVIDIA will refund your cloud GPU bill if you let them bolt a $250,000 AI supercomputer to your desk for $2,999. NVIDIA's $2,999 DGX Spark puts a 128GB AI supercomputer on your desk runs the same 70B models you've been renting in the cloud, but nothing crosses your network and no ToS governs a machine you own. the $22K/year savings everyone's posting is the loud number. the quiet one is bigger: the contracts you stopped losing on data residency. own-compute isn't a budget optimization anymore. it's a sales motion. ↓ builder benchmark from the week the box shipped. real numbers, not marketing.

NVIDIA will refund your cloud GPU bill if you let them bolt a $250,000 AI supercomputer to your desk for $2,999. NVIDIA's $2,999 DGX Spark puts a 128GB AI supercomputer on your desk runs the same 70B models you've been renting in the cloud, but nothing crosses your network and no ToS governs a machine you own. the $22K/year savings everyone's posting is the loud number. the quiet one is bigger: the contracts you stopped losing on data residency. own-compute isn't a budget optimization anymore. it's a sales motion. ↓ builder benchmark from the week the box shipped. real numbers, not marketing.

dunik

819,240 Aufrufe • vor 1 Monat

AMD on local AI: "this is the smallest AI development system in the world, capable of running models up to 200 billion parameters locally, not connected to anything" 128GB of unified memory shared by CPU, GPU, and NPU fits in your hand. Runs a model larger than GPT-3 with no internet $3,999 once. roughly $16 a month in power Cloud equivalent: up to $750 a month The question was never whether local AI could compete on power It was whether it could compete on price. Now it does

AMD on local AI: "this is the smallest AI development system in the world, capable of running models up to 200 billion parameters locally, not connected to anything" 128GB of unified memory shared by CPU, GPU, and NPU fits in your hand. Runs a model larger than GPT-3 with no internet $3,999 once. roughly $16 a month in power Cloud equivalent: up to $750 a month The question was never whether local AI could compete on power It was whether it could compete on price. Now it does

plutos

151,966 Aufrufe • vor 16 Tagen

NVIDIA WILL PAY YOU $150/MONTH TO BOLT 16 BLACKWELL GPUS TO YOUR HOUSE - OR YOU BUY THE BOX AND MAKE $22,000 A YEAR same NVIDIA chips. the contract is where it gets interesting. they attach a $1,000,000 data center to your house and pay you for it - you get free internet, battery backup and cheaper electricity while they run an asset serving Amazon, Microsoft and Google 24/7 on your property or you spend $2,999 on a DGX Spark the size of a paperback - 128GB memory, runs a 70B model locally, $10/month in electricity if you were paying $1,900/month on cloud GPU rentals it pays for itself in 6 weeks and puts $22,000 back in year one one contract you are the infrastructure. the other one you own it.

NVIDIA WILL PAY YOU $150/MONTH TO BOLT 16 BLACKWELL GPUS TO YOUR HOUSE - OR YOU BUY THE BOX AND MAKE $22,000 A YEAR same NVIDIA chips. the contract is where it gets interesting. they attach a $1,000,000 data center to your house and pay you for it - you get free internet, battery backup and cheaper electricity while they run an asset serving Amazon, Microsoft and Google 24/7 on your property or you spend $2,999 on a DGX Spark the size of a paperback - 128GB memory, runs a 70B model locally, $10/month in electricity if you were paying $1,900/month on cloud GPU rentals it pays for itself in 6 weeks and puts $22,000 back in year one one contract you are the infrastructure. the other one you own it.

Sprytix

26,208 Aufrufe • vor 1 Monat

I tested Gemma 4 12b on my Macbook Pro M5 Max with 128GB of unified memory. It runs VERY slow for a 12b parameter model. 44 tokens/second. The lava lamp that it produced was also terrible. I would stick to Qwen 3.6 27b or Qwen 3.6 35b. Google is still way behind, even with their local models.

I tested Gemma 4 12b on my Macbook Pro M5 Max with 128GB of unified memory. It runs VERY slow for a 12b parameter model. 44 tokens/second. The lava lamp that it produced was also terrible. I would stick to Qwen 3.6 27b or Qwen 3.6 35b. Google is still way behind, even with their local models.

BridgeMind

70,094 Aufrufe • vor 25 Tagen

✨ Personal AI is the next computing platform. AI is shifting from something you access to something you build with, locally, at the edge, and across systems. We’re unlocking new possibilities for developers: • AMD Ryzen AI Halo, a local-first developer system, preorder starting in June, develop AI without limits on your desk • Gorgon Halo with up to 192GB unified memory, supporting 300B+ parameter models locally, run massive models locally We’re excited to partner with clem 🤗🤗, Co-founder and CEO of Hugging Face, to advance open-source AI for Ryzen AI. Our focus is seamless AI, from model to deployment. Cloud, edge, device. One continuum. Multi-agent systems, local inference at scale, open models as infrastructure. This is the next computing era 🚀

✨ Personal AI is the next computing platform. AI is shifting from something you access to something you build with, locally, at the edge, and across systems. We’re unlocking new possibilities for developers: • AMD Ryzen AI Halo, a local-first developer system, preorder starting in June, develop AI without limits on your desk • Gorgon Halo with up to 192GB unified memory, supporting 300B+ parameter models locally, run massive models locally We’re excited to partner with clem 🤗🤗, Co-founder and CEO of Hugging Face, to advance open-source AI for Ryzen AI. Our focus is seamless AI, from model to deployment. Cloud, edge, device. One continuum. Multi-agent systems, local inference at scale, open models as infrastructure. This is the next computing era 🚀

Jack Huynh

47,611 Aufrufe • vor 1 Monat

THEY RAN A LOCAL AI MODEL ON A RASPBERRY PI THAT COSTS LESS THAN $300 no cloud no subscription no data center device smaller than your wallet output on a 27 year old iMac I tested local ai this week on a macbook and a phone the hardware keeps getting cheaper and the models keep getting smarter bookmark this if you’re still paying $20 a month for something your $300 raspberry pi can do

THEY RAN A LOCAL AI MODEL ON A RASPBERRY PI THAT COSTS LESS THAN $300 no cloud no subscription no data center device smaller than your wallet output on a 27 year old iMac I tested local ai this week on a macbook and a phone the hardware keeps getting cheaper and the models keep getting smarter bookmark this if you’re still paying $20 a month for something your $300 raspberry pi can do

leopardracer

73,534 Aufrufe • vor 1 Monat

This 27 year old ex-crypto miner pointed a $4,000 mini PC at Polymarket and turned it into $1,000,000 - in under three months. U.S. export-controlled Claude Fable 5 last week and cut every cloud trader off overnight. This guy didn't even notice. No cloud. No subscription. No model anyone can ban. Just a box on his desk, trading Bitcoin while he sleeps. His bot wallet: It's an AMD Ryzen AI Max+ 395 - 16 cores, a 50-TOPS neural engine, 128GB of unified memory. His AI never touches the internet. That memory is the whole trick. A normal gaming GPU holds 24GB - a toy. 128GB unified holds a 200-billion-parameter model whole, nothing offloaded. A frontier brain, running offline, in his apartment. It doesn't predict price. It runs the full probability map of every 5-minute market, thousands of times a minute, and hunts the bets the crowd prices at zero. When its math says a 0.2¢ longshot is really worth 1.6%, it buys the "impossible" for pennies. One paid x32. No data center. No leased GPU. No off-switch but his. They can pull a model from the cloud in one night. They can't raid a box on a guy's desk. $4,000 of hardware. $1,000 of stake. $1,000,000 out - still running tonight. You don't need the box. You need the wallet it trades. Copy in two clicks:

This 27 year old ex-crypto miner pointed a $4,000 mini PC at Polymarket and turned it into $1,000,000 - in under three months. U.S. export-controlled Claude Fable 5 last week and cut every cloud trader off overnight. This guy didn't even notice. No cloud. No subscription. No model anyone can ban. Just a box on his desk, trading Bitcoin while he sleeps. His bot wallet: It's an AMD Ryzen AI Max+ 395 - 16 cores, a 50-TOPS neural engine, 128GB of unified memory. His AI never touches the internet. That memory is the whole trick. A normal gaming GPU holds 24GB - a toy. 128GB unified holds a 200-billion-parameter model whole, nothing offloaded. A frontier brain, running offline, in his apartment. It doesn't predict price. It runs the full probability map of every 5-minute market, thousands of times a minute, and hunts the bets the crowd prices at zero. When its math says a 0.2¢ longshot is really worth 1.6%, it buys the "impossible" for pennies. One paid x32. No data center. No leased GPU. No off-switch but his. They can pull a model from the cloud in one night. They can't raid a box on a guy's desk. $4,000 of hardware. $1,000 of stake. $1,000,000 out - still running tonight. You don't need the box. You need the wallet it trades. Copy in two clicks:

cvxv666

145,192 Aufrufe • vor 15 Tagen

This Chinese developer linked two $2,999 NVIDIA DGX Sparks into one box and runs the full Qwen3-235B at home, after dropping his $1,999-a-month cloud bill to zero. He wired 2 small boxes into a single computer, split a giant 235-billion-parameter model in half between them, and serves it across his own network at about 10 tokens a second, with no internet, no cloud, right there on the desk. No data center, no thousand-dollar graphics cards, no monthly cloud bill. Just him, 2 gold boxes the size of a sandwich, one cable between them, and 1 power strip. And here is the whole payoff. He used to pay the cloud $1,999 a month for the same model, and the meter ticked on every request. Now he paid $5,998 once for 2 boxes, they covered their cost in 3 months, and after that he sends as many requests as he wants for free, only electricity. The two Sparks talk over one fast cable, each holds 128GB of memory, and together they carry the whole model, about 73GB loaded per box, with the chip inside pinned near the limit at 96%. Both boxes work as one and keep trading data over the cable, with no cloud in the loop and no single word leaking out. The ready model sits on one local address, and any app on his network calls it as easily as ChatGPT. And here is how he described, in plain words, what this pair of boxes does: "this is a pair of boxes that holds the huge Qwen3-235B model and serves it to one network. the model is split in half, and each box owns its half. parts: // Box 1 (holds the first half of the model and starts the answer fast, the first word appears in under a second) // Box 2 (holds the second half and writes out the rest, about 10 tokens a second) // Cable (connects the 2 boxes and moves data between them on every step, with no lag) // Address (one local address where any app sends its request, like to a cloud model) // Test (a script that runs big prompts through and measures speed and delays) // Monitor (checks temperature, power draw, and load on both boxes every 2 seconds). the model never goes to the cloud. he only steps in when a box runs hotter than 80 degrees or the cable between them starts dropping data." So the system knows exactly what it is, what it is for, and where its limits are. It knows it has to hold the whole huge model across 2 boxes on its own. It knows it has to answer every request locally, with no meter, no limits, and no internet. It knows the human is only needed when a box overheats or the link between them stalls. → The setup runs around the clock on 2 boxes, each pulling under 60 watts → However many requests he sends, the monthly bill is $0, only electricity → The first box starts the answer in under a second → The second writes text at about 10 tokens a second → One request at a time: 838 tokens in 85 seconds, first word in 0.8s → Two requests at once: 697 tokens in 108 seconds, first word in 0.7s → Both boxes sit at 96% load and warm up to 76-78 degrees And only when a chip in a box runs hotter than 80 degrees or the cable between the 2 Sparks drops data does the system call the owner. And when he himself is out on a run or in a coffee shop, he still reaches his own model at home from his phone: sends a big prompt to the local Qwen3-235B, gets the full answer back in under a minute and a half, with no token meter ticking and no limit to hit. Here is what the test shows on his screen during one of the night runs: "one request at a time: 838 tokens in 84.9 seconds, first word in 0.8s, then 0.1s per token." "two requests at once: 697 tokens in 107.6 seconds, first word in 0.7s, then 0.15s per token." "Box 1: chip at 96% load, 76 degrees, 56 watts, 73GB used in memory." "Box 2: chip at 96% load, 78 degrees, 56 watts, the Qwen3-235B model fully loaded." And while everyone around is paying for AI by the month and bumping into limits, his top-tier model just sits on the desk and works as much as he wants: his own little power plant instead of a forever meter. He has no server rack of his own and no cloud account behind it. Just 2 DGX Spark boxes on a desk, one model split in half between them, one local address, and a folder of prompts next to it. Out of everything I have seen this year, this is the cleanest way to stop paying for AI: $5,998 of hardware on the desk once, $0 a month to the cloud, unlimited forever, and between them 2 gold boxes, 1 cable, and the full Qwen3-235B answering at home with no internet.

This Chinese developer linked two $2,999 NVIDIA DGX Sparks into one box and runs the full Qwen3-235B at home, after dropping his $1,999-a-month cloud bill to zero. He wired 2 small boxes into a single computer, split a giant 235-billion-parameter model in half between them, and serves it across his own network at about 10 tokens a second, with no internet, no cloud, right there on the desk. No data center, no thousand-dollar graphics cards, no monthly cloud bill. Just him, 2 gold boxes the size of a sandwich, one cable between them, and 1 power strip. And here is the whole payoff. He used to pay the cloud $1,999 a month for the same model, and the meter ticked on every request. Now he paid $5,998 once for 2 boxes, they covered their cost in 3 months, and after that he sends as many requests as he wants for free, only electricity. The two Sparks talk over one fast cable, each holds 128GB of memory, and together they carry the whole model, about 73GB loaded per box, with the chip inside pinned near the limit at 96%. Both boxes work as one and keep trading data over the cable, with no cloud in the loop and no single word leaking out. The ready model sits on one local address, and any app on his network calls it as easily as ChatGPT. And here is how he described, in plain words, what this pair of boxes does: "this is a pair of boxes that holds the huge Qwen3-235B model and serves it to one network. the model is split in half, and each box owns its half. parts: // Box 1 (holds the first half of the model and starts the answer fast, the first word appears in under a second) // Box 2 (holds the second half and writes out the rest, about 10 tokens a second) // Cable (connects the 2 boxes and moves data between them on every step, with no lag) // Address (one local address where any app sends its request, like to a cloud model) // Test (a script that runs big prompts through and measures speed and delays) // Monitor (checks temperature, power draw, and load on both boxes every 2 seconds). the model never goes to the cloud. he only steps in when a box runs hotter than 80 degrees or the cable between them starts dropping data." So the system knows exactly what it is, what it is for, and where its limits are. It knows it has to hold the whole huge model across 2 boxes on its own. It knows it has to answer every request locally, with no meter, no limits, and no internet. It knows the human is only needed when a box overheats or the link between them stalls. → The setup runs around the clock on 2 boxes, each pulling under 60 watts → However many requests he sends, the monthly bill is $0, only electricity → The first box starts the answer in under a second → The second writes text at about 10 tokens a second → One request at a time: 838 tokens in 85 seconds, first word in 0.8s → Two requests at once: 697 tokens in 108 seconds, first word in 0.7s → Both boxes sit at 96% load and warm up to 76-78 degrees And only when a chip in a box runs hotter than 80 degrees or the cable between the 2 Sparks drops data does the system call the owner. And when he himself is out on a run or in a coffee shop, he still reaches his own model at home from his phone: sends a big prompt to the local Qwen3-235B, gets the full answer back in under a minute and a half, with no token meter ticking and no limit to hit. Here is what the test shows on his screen during one of the night runs: "one request at a time: 838 tokens in 84.9 seconds, first word in 0.8s, then 0.1s per token." "two requests at once: 697 tokens in 107.6 seconds, first word in 0.7s, then 0.15s per token." "Box 1: chip at 96% load, 76 degrees, 56 watts, 73GB used in memory." "Box 2: chip at 96% load, 78 degrees, 56 watts, the Qwen3-235B model fully loaded." And while everyone around is paying for AI by the month and bumping into limits, his top-tier model just sits on the desk and works as much as he wants: his own little power plant instead of a forever meter. He has no server rack of his own and no cloud account behind it. Just 2 DGX Spark boxes on a desk, one model split in half between them, one local address, and a folder of prompts next to it. Out of everything I have seen this year, this is the cleanest way to stop paying for AI: $5,998 of hardware on the desk once, $0 a month to the cloud, unlimited forever, and between them 2 gold boxes, 1 cable, and the full Qwen3-235B answering at home with no internet.

Blaze

93,219 Aufrufe • vor 1 Monat

THIS DEVELOPER HASN’T PAID AN API BILL IN 3 MONTHS. HIS AGENTS RAN 10,000 TIMES FOR FREE he built a local AI lab under his desk two GPUs 32GB VRAM zero rate limits his agents loop 400 times if they want to his coworkers are still watching the usage dashboard the only thing separating them: llama.cpp + llama-swap every prompt stays on his machine every experiment costs $0 zero invoices bookmark & like this before your next API bill hits

THIS DEVELOPER HASN’T PAID AN API BILL IN 3 MONTHS. HIS AGENTS RAN 10,000 TIMES FOR FREE he built a local AI lab under his desk two GPUs 32GB VRAM zero rate limits his agents loop 400 times if they want to his coworkers are still watching the usage dashboard the only thing separating them: llama.cpp + llama-swap every prompt stays on his machine every experiment costs $0 zero invoices bookmark & like this before your next API bill hits

leopardracer

541,914 Aufrufe • vor 1 Monat

NVIDIA CEO JENSEN HUANG: THE AI APOCALYPSE NARRATIVE IS COMPLETE NONSENSE "it's computer and software. we make it better every year because we know exactly how it works" the real disruption is developers deploying local setups to out-produce entire teams: > hardware scale - from a $249 Jetson Orin Nano Super to a $2,999 DGX Spark with 128GB of unified memory > local inference - DGX Spark runs 70B-200B models on 1 PFLOP of throughput with zero cloud GPU rental costs > database privacy - redirecting Python API clients to Ollama takes one line of code to bypass subscription bills the people who configure local AI today are going to look very far ahead of the curve by 2027 read the setup guide below 👇

NVIDIA CEO JENSEN HUANG: THE AI APOCALYPSE NARRATIVE IS COMPLETE NONSENSE "it's computer and software. we make it better every year because we know exactly how it works" the real disruption is developers deploying local setups to out-produce entire teams: > hardware scale - from a $249 Jetson Orin Nano Super to a $2,999 DGX Spark with 128GB of unified memory > local inference - DGX Spark runs 70B-200B models on 1 PFLOP of throughput with zero cloud GPU rental costs > database privacy - redirecting Python API clients to Ollama takes one line of code to bypass subscription bills the people who configure local AI today are going to look very far ahead of the curve by 2027 read the setup guide below 👇

Mr. Buzzoni

15,201 Aufrufe • vor 11 Tagen

A guy got tired of renting intelligence from the cloud, so he put a 120-billion-parameter model in his closet for $0 a month. One mini PC. The Minisforum MS-S1 MAX. 128GB of unified memory, and a trick that hands 96GB of it straight to the GPU. Here's how it breaks: That 96GB is the whole game. Enough to run GPT-OSS-120B fully local, and still keep the agent and dashboard on the same box. 120 billion parameters. 56.6 tokens a second. A 5,000-word essay in one pass at 110W and 68°C. Quiet. Cool. Local. Then Hermes Agent goes on top, pointed at localhost. No API key, because there's nothing to phone home to. It drafts, researches, runs tool calls, manages sub-agents. None of it leaves the network. The cloud version cost $10 to $20 a day, keys and customer data routed through machines he didn't own. Now it's a box in a closet. $0 a month. The chip is real. The build is brilliant. And somewhere in the first few minutes, the AI stopped being a bill he paid every morning and became a machine he owns, humming in a closet, working for free.

A guy got tired of renting intelligence from the cloud, so he put a 120-billion-parameter model in his closet for $0 a month. One mini PC. The Minisforum MS-S1 MAX. 128GB of unified memory, and a trick that hands 96GB of it straight to the GPU. Here's how it breaks: That 96GB is the whole game. Enough to run GPT-OSS-120B fully local, and still keep the agent and dashboard on the same box. 120 billion parameters. 56.6 tokens a second. A 5,000-word essay in one pass at 110W and 68°C. Quiet. Cool. Local. Then Hermes Agent goes on top, pointed at localhost. No API key, because there's nothing to phone home to. It drafts, researches, runs tool calls, manages sub-agents. None of it leaves the network. The cloud version cost $10 to $20 a day, keys and customer data routed through machines he didn't own. Now it's a box in a closet. $0 a month. The chip is real. The build is brilliant. And somewhere in the first few minutes, the AI stopped being a bill he paid every morning and became a machine he owns, humming in a closet, working for free.

shmidt

245,022 Aufrufe • vor 12 Tagen

This guy plugged a DGX Spark (the $3K Nvidia box) and a Mac Mini M4 together to run AI and what happened next surprised everyone > the Nvidia box handles the hard part - processing your prompt in milliseconds > Mac Mini M4 handles the fast part - generating the response at memory bandwidth speeds nothing else can match > together they hit 84 tokens per second on Llama - 6x faster than the Spark alone > running compute agents locally on this setup means your data never leaves your hardware > two boxes. two different architectures. one AI system that Deepseek runs at data center scale he ran it on his desk save this. the way we build local AI is about to change

This guy plugged a DGX Spark (the $3K Nvidia box) and a Mac Mini M4 together to run AI and what happened next surprised everyone > the Nvidia box handles the hard part - processing your prompt in milliseconds > Mac Mini M4 handles the fast part - generating the response at memory bandwidth speeds nothing else can match > together they hit 84 tokens per second on Llama - 6x faster than the Spark alone > running compute agents locally on this setup means your data never leaves your hardware > two boxes. two different architectures. one AI system that Deepseek runs at data center scale he ran it on his desk save this. the way we build local AI is about to change

Mr. Buzzoni

153,102 Aufrufe • vor 1 Monat

8. DGX Spark = personal AI supercomputer Imagine training your own LLM at your desk. DGX Spark is the dev-friendly AI rig built for workstation scale. → Shipping via ASUS, Dell, MSI → Trains large models locally → No server farm needed

8. DGX Spark = personal AI supercomputer Imagine training your own LLM at your desk. DGX Spark is the dev-friendly AI rig built for workstation scale. → Shipping via ASUS, Dell, MSI → Trains large models locally → No server farm needed

Shruti

35,907 Aufrufe • vor 1 Jahr

This guy runs an Nvidia Spark from his desk and pulls in $8,000 a month The device is the size of a small speaker and sits right on his desk. Inside is a full Nvidia GPU running AI workloads 24/7. He rents out the compute power to companies that need local AI processing. They pay him a flat monthly fee to use it remotely. $8,000 lands in his account every single month. He just plugged it in and that was it. The $4,000 box paid for itself in two weeks. Now it prints $96,000 a year from a device smaller than a coffee machine. Companies are desperate for local compute and regular people are quietly supplying it. Save this before everyone figures out what he already knows.

This guy runs an Nvidia Spark from his desk and pulls in $8,000 a month The device is the size of a small speaker and sits right on his desk. Inside is a full Nvidia GPU running AI workloads 24/7. He rents out the compute power to companies that need local AI processing. They pay him a flat monthly fee to use it remotely. $8,000 lands in his account every single month. He just plugged it in and that was it. The $4,000 box paid for itself in two weeks. Now it prints $96,000 a year from a device smaller than a coffee machine. Companies are desperate for local compute and regular people are quietly supplying it. Save this before everyone figures out what he already knows.

winkle.

57,793 Aufrufe • vor 1 Monat

What Lisa Su actually held on stage: A mini PC the size of a lunchbox running Qwen3-235B locally, with no cloud and no discrete GPU Inside: the Ryzen AI Max+ 395, 128GB unified memory, 110GB usable as VRAM on Linux The first x86 chip that handles 200+ billion parameters on a single die AMD claims it beats the RTX 5080 by several times on memory-bound models — because the 5080 simply cannot fit them $1,400 to $2,500 once. cloud bills run $200 to $400 a month It pays for itself in a few months, then costs nothing per request This is not a faster GPU. it is the first real argument that your AI does not belong in someone else's data center

What Lisa Su actually held on stage: A mini PC the size of a lunchbox running Qwen3-235B locally, with no cloud and no discrete GPU Inside: the Ryzen AI Max+ 395, 128GB unified memory, 110GB usable as VRAM on Linux The first x86 chip that handles 200+ billion parameters on a single die AMD claims it beats the RTX 5080 by several times on memory-bound models — because the 5080 simply cannot fit them $1,400 to $2,500 once. cloud bills run $200 to $400 a month It pays for itself in a few months, then costs nothing per request This is not a faster GPU. it is the first real argument that your AI does not belong in someone else's data center

plutos

1,229,783 Aufrufe • vor 15 Tagen

NEW: Microsoft just unveiled its most powerful Surface ever. Surface Laptop Ultra is a 15-inch NVIDIA-powered laptop built to run local AI models, creative work, and gaming. • NVIDIA RTX Spark chip with up to 20 Arm CPU cores • Blackwell GPU with 6,144 CUDA cores • Up to 128GB unified memory • Runs up to 120B parameter AI models locally • 15-inch mini-LED display with 2,000 nits peak brightness • Dual-fan cooling with 2.5x the thermal capacity of Surface Laptop 7 This could be a serious AI workstation.

NEW: Microsoft just unveiled its most powerful Surface ever. Surface Laptop Ultra is a 15-inch NVIDIA-powered laptop built to run local AI models, creative work, and gaming. • NVIDIA RTX Spark chip with up to 20 Arm CPU cores • Blackwell GPU with 6,144 CUDA cores • Up to 128GB unified memory • Runs up to 120B parameter AI models locally • 15-inch mini-LED display with 2,000 nits peak brightness • Dual-fan cooling with 2.5x the thermal capacity of Surface Laptop 7 This could be a serious AI workstation.

Ritwik Pavan

93,262 Aufrufe • vor 29 Tagen