Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

🚨 I DON'T KNOW WHAT PEOPLE ARE WAITING FOR! This guy just deployed a full GPU compute farm in a data center Not renting cloud instances, not paying per-token, just racks of consumer GPUs on warehouse shelving doing AI inference 24/7 The setup is wild: open-frame rigs with rows...

0xCristal's profile picture

cristal

8,507 subscribers

16,305 Aufrufe • vor 1 Monat •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Successfully deployed Deepseek R1 Distilled 70B (AWQ) across 8x NVIDIA RTX 3080 10G GPUs, achieving 60 tokens/s with full tensor parallelism via PCIe. Total hardware cost: $6,400 This demonstrates that consumer GPUs can deliver substantial ML inference capabilities at a fraction of the cost of datacenter hardware. For perspective, a single A100 80G costs $17,550, while a H100 80G runs $25,000. Our testing validates an often-overlooked opportunity: millions of idle crypto mining rigs could be repurposed into a powerful, distributed AI infrastructure. The performance-to-cost ratio of consumer GPUs, especially when properly optimized for tensor operations, presents a compelling case for decentralized AI compute. We're excited to share more insights as we continue pushing the boundaries of consumer hardware in AI workloads.
1:20

Successfully deployed Deepseek R1 Distilled 70B (AWQ) across 8x NVIDIA RTX 3080 10G GPUs, achieving 60 tokens/s with full tensor parallelism via PCIe. Total hardware cost: $6,400 This demonstrates that consumer GPUs can deliver substantial ML inference capabilities at a fraction of the cost of datacenter hardware. For perspective, a single A100 80G costs $17,550, while a H100 80G runs $25,000. Our testing validates an often-overlooked opportunity: millions of idle crypto mining rigs could be repurposed into a powerful, distributed AI infrastructure. The performance-to-cost ratio of consumer GPUs, especially when properly optimized for tensor operations, presents a compelling case for decentralized AI compute. We're excited to share more insights as we continue pushing the boundaries of consumer hardware in AI workloads.

TensorBlock

16,219 Aufrufe • vor 1 Jahr

WAREHOUSES THE SIZE OF A WALMART WITH 4,000 GPUS WERE EARNING $320K A MONTH MINING ETH, THE SAME RACKS NOW EARN $4M A MONTH RENTING TO AI STARTUPS ON VAST AI the warehouse in the clip is one of hundreds across the US, the operator at 6'6" tall for scale, electricity contracts and cooling already in place ethereum's merge in september 2022 killed gpu mining for everyone without a power plant, by 2025 alt coin mining was barely covering the electricity bill the same racks now host RTX 3090s and 4090s on vast ai, indie AI developers priced out of AWS rent them by the hour for inference and image generation a 4090 nets $500 to $1,000 a month renting to AI startups, the same card was clearing $80 to $150 mining, 4 to 7 times the revenue with zero new hardware core scientific, hut 8 and riot have all signed multi billion dollar AI hosting deals in 2025, the warehouses you scrolled past on tiktok are quietly becoming the inference backbone of every AI tool you use bookmark this and read the article below
1:19

WAREHOUSES THE SIZE OF A WALMART WITH 4,000 GPUS WERE EARNING $320K A MONTH MINING ETH, THE SAME RACKS NOW EARN $4M A MONTH RENTING TO AI STARTUPS ON VAST AI the warehouse in the clip is one of hundreds across the US, the operator at 6'6" tall for scale, electricity contracts and cooling already in place ethereum's merge in september 2022 killed gpu mining for everyone without a power plant, by 2025 alt coin mining was barely covering the electricity bill the same racks now host RTX 3090s and 4090s on vast ai, indie AI developers priced out of AWS rent them by the hour for inference and image generation a 4090 nets $500 to $1,000 a month renting to AI startups, the same card was clearing $80 to $150 mining, 4 to 7 times the revenue with zero new hardware core scientific, hut 8 and riot have all signed multi billion dollar AI hosting deals in 2025, the warehouses you scrolled past on tiktok are quietly becoming the inference backbone of every AI tool you use bookmark this and read the article below

starmex

427,469 Aufrufe • vor 1 Monat

ONE OPERATOR STACKED 300 GPUS ACROSS TWO APARTMENTS IN THE SAME BUILDING AND RUNS A $48K/MONTH AI INFERENCE FARM ON VAST AI FROM HIS LIVING ROOM 00:17 he walks past stacks of GPU boxes, "and probably another 100 GPU boxes in the second apartment, let me know in the comments if you want to see them" he rents 2 units in the same building, one as his living space with 200 GPUs in the bedroom and hallway, the second is dedicated and climate controlled just for the other 100 cards a 300 RTX 4090 setup pulls 135 kilowatts fully loaded, his power bill runs $9,800 a month at $0.10 per kwh, on vast ai the same fleet clears $48,000 in gross monthly rental income he never built this in a warehouse because residential electricity in his city is cheaper than commercial under 150 kw, the split apartment trick keeps him under that ceiling while doubling his rack space the same hardware would have cleared maybe $9,000 a month mining ethereum classic in 2022, vast ai pays 5 times that for AI inference because nobody can ship enough H100s to meet startup demand bookmark this and read the article below
0:20

ONE OPERATOR STACKED 300 GPUS ACROSS TWO APARTMENTS IN THE SAME BUILDING AND RUNS A $48K/MONTH AI INFERENCE FARM ON VAST AI FROM HIS LIVING ROOM 00:17 he walks past stacks of GPU boxes, "and probably another 100 GPU boxes in the second apartment, let me know in the comments if you want to see them" he rents 2 units in the same building, one as his living space with 200 GPUs in the bedroom and hallway, the second is dedicated and climate controlled just for the other 100 cards a 300 RTX 4090 setup pulls 135 kilowatts fully loaded, his power bill runs $9,800 a month at $0.10 per kwh, on vast ai the same fleet clears $48,000 in gross monthly rental income he never built this in a warehouse because residential electricity in his city is cheaper than commercial under 150 kw, the split apartment trick keeps him under that ceiling while doubling his rack space the same hardware would have cleared maybe $9,000 a month mining ethereum classic in 2022, vast ai pays 5 times that for AI inference because nobody can ship enough H100s to meet startup demand bookmark this and read the article below

starmex

11,545 Aufrufe • vor 1 Monat

THIS FRENCH GUY RUNS OPENCLAW AND HERMES AI AGENTS ON A HOMELAB THAT REPLACED GOOGLE DRIVE AND ICLOUD ENTIRELY ON JUST 10 WATTS The project: host his own local AI agents, OpenClaw and Hermes, ditch cloud storage subscriptions entirely by running his own NAS, and use the whole build to prep for his K8s certification – all running on 4 Raspberry Pis. Today's upgrade: a PoE module. One Ethernet cable now does two jobs – powers the Raspberry Pi AND gives it network access at the same time. No separate power adapters, no cable clutter, no juggling connections during maintenance. Total power draw for all 4 Raspberry Pis combined: max 10 watts. He's not renting cloud storage anymore. He's not paying monthly subscriptions for space he already owns the hardware for. His files, his AI agents, his data – all sitting on hardware in his own home, on a fraction of the power a lightbulb uses. Next up: blocking ads network-wide across his entire home, using one of the automation services running on the same setup. This is what "own your data" actually looks like when someone builds it instead of just talking about it. Bookmark this post. Full build in the video below.
0:45

THIS FRENCH GUY RUNS OPENCLAW AND HERMES AI AGENTS ON A HOMELAB THAT REPLACED GOOGLE DRIVE AND ICLOUD ENTIRELY ON JUST 10 WATTS The project: host his own local AI agents, OpenClaw and Hermes, ditch cloud storage subscriptions entirely by running his own NAS, and use the whole build to prep for his K8s certification – all running on 4 Raspberry Pis. Today's upgrade: a PoE module. One Ethernet cable now does two jobs – powers the Raspberry Pi AND gives it network access at the same time. No separate power adapters, no cable clutter, no juggling connections during maintenance. Total power draw for all 4 Raspberry Pis combined: max 10 watts. He's not renting cloud storage anymore. He's not paying monthly subscriptions for space he already owns the hardware for. His files, his AI agents, his data – all sitting on hardware in his own home, on a fraction of the power a lightbulb uses. Next up: blocking ads network-wide across his entire home, using one of the automation services running on the same setup. This is what "own your data" actually looks like when someone builds it instead of just talking about it. Bookmark this post. Full build in the video below.

SCOTTY BEAM

18,175 Aufrufe • vor 27 Tagen

100 MAC MINIS ON ONE METAL SHELF. IN THE CLOUD, EACH OF THOSE RENTS FOR $120 TO $500 A MONTH. that clip is a homemade rack: wire shelving packed with mac minis, each running macos, wired into one cluster. why macs and not a normal server? two reasons. you can only build, sign, and notarize ios and mac apps on apple hardware. cloud providers know it and charge for it. and apple silicon sips power and runs near-silent, so you can stack a lot of them on a shelf in a room, not a datacenter. the rent they're escaping: a single mac in the cloud runs ~$120 to $500 a month (macstadium up to aws) one engineer documented saving $4,000+ a month by self-hosting mac minis instead of cloud ci runners a used or new mini is a few hundred dollars once, then a few dollars of electricity what a shelf like this actually runs: ios and mac build farms, render jobs, app and device testing automation, and increasingly local ai inference. own the boxes, rent nothing. the uncomfortable part: the cloud was never the only option. it was the convenient one. the people who did the math bought the shelf. the honest caveat: it's real capex up front, real heat and power, and you become the sysadmin. no rented rack means no one to call at 3am. worth it at scale, overkill for one build a week. no rack rental, no per-hour metering, no fleet you don't own. save this before your cloud invoice renews again.
0:25

100 MAC MINIS ON ONE METAL SHELF. IN THE CLOUD, EACH OF THOSE RENTS FOR $120 TO $500 A MONTH. that clip is a homemade rack: wire shelving packed with mac minis, each running macos, wired into one cluster. why macs and not a normal server? two reasons. you can only build, sign, and notarize ios and mac apps on apple hardware. cloud providers know it and charge for it. and apple silicon sips power and runs near-silent, so you can stack a lot of them on a shelf in a room, not a datacenter. the rent they're escaping: a single mac in the cloud runs ~$120 to $500 a month (macstadium up to aws) one engineer documented saving $4,000+ a month by self-hosting mac minis instead of cloud ci runners a used or new mini is a few hundred dollars once, then a few dollars of electricity what a shelf like this actually runs: ios and mac build farms, render jobs, app and device testing automation, and increasingly local ai inference. own the boxes, rent nothing. the uncomfortable part: the cloud was never the only option. it was the convenient one. the people who did the math bought the shelf. the honest caveat: it's real capex up front, real heat and power, and you become the sysadmin. no rented rack means no one to call at 3am. worth it at scale, overkill for one build a week. no rack rental, no per-hour metering, no fleet you don't own. save this before your cloud invoice renews again.

RetroChainer

21,055 Aufrufe • vor 24 Tagen

$0.05 PER KWH IN PARAGUAY VS $0.15 IN THE US, A 5,000 GPU FARM NEAR ASUNCION CLEARS $4.7M/MO ON VAST AI WHILE US OPERATORS NET $1.8M ON THE SAME RACK the warehouse in the clip is somewhere outside asuncion, multi story racks running floor to ceiling, the operator built it next to a hydroelectric dam where electricity costs 5 cents per kilowatt hour a US warehouse running the same 5,000 GPU rack burns through $1.6M a month in electricity at $0.15/kWh, the same rack in paraguay burns $530K, the gap is $1M of pure margin every 30 days the racks host RTX 4090s, A100s and H100s on vast ai and clore ai, indie AI startups and image generation services rent them by the hour because aws is rationing GPU access to fortune 500 a 4090 nets the US operator $500 to $1,000 a month, the paraguay operator clears $850 to $1,400 on the same card because power eats half what it does north of the equator bitfarms, riot and core scientific have all expanded into paraguay since 2024, the next 10,000 GPU AI farm coming online in 2026 is more likely to sit near a paraguayan dam than in texas bookmark this and read the article below
0:41

$0.05 PER KWH IN PARAGUAY VS $0.15 IN THE US, A 5,000 GPU FARM NEAR ASUNCION CLEARS $4.7M/MO ON VAST AI WHILE US OPERATORS NET $1.8M ON THE SAME RACK the warehouse in the clip is somewhere outside asuncion, multi story racks running floor to ceiling, the operator built it next to a hydroelectric dam where electricity costs 5 cents per kilowatt hour a US warehouse running the same 5,000 GPU rack burns through $1.6M a month in electricity at $0.15/kWh, the same rack in paraguay burns $530K, the gap is $1M of pure margin every 30 days the racks host RTX 4090s, A100s and H100s on vast ai and clore ai, indie AI startups and image generation services rent them by the hour because aws is rationing GPU access to fortune 500 a 4090 nets the US operator $500 to $1,000 a month, the paraguay operator clears $850 to $1,400 on the same card because power eats half what it does north of the equator bitfarms, riot and core scientific have all expanded into paraguay since 2024, the next 10,000 GPU AI farm coming online in 2026 is more likely to sit near a paraguayan dam than in texas bookmark this and read the article below

starmex

27,045 Aufrufe • vor 1 Monat

Destra Edge — $DSYNC From Idea to Reality Yesterday, we introduced Destra Edge. Today, we show you what it means. For too long, AI has lived in data centers. Expensive. Centralized. Controlled by a few. Meanwhile, billions of smartphones sit idle. Powerful GPUs. Doing nothing. That doesn’t make sense. So we’re building something different. Destra Edge turns everyday smartphones into a global AI inference network. No servers. No cloud monopolies. Just real compute at the edge. This video shows the system taking shape — how inference is distributed, how it runs on-device, and how results come together without central control. This is not finished. And that’s the point. You’re watching it being built. Layer by layer. In public. The magic is in the scale. More phones means more power. More power means stronger AI. The network grows simply because people join. No passive mining. No fake activity. Only real GPU inference. Measured. Verified. Rewarded. AI shouldn’t live in warehouses. It should live in your pocket. This is edge-level decentralization. This is permissionless inference. This is Destra Network.
2:02

Destra Edge — $DSYNC From Idea to Reality Yesterday, we introduced Destra Edge. Today, we show you what it means. For too long, AI has lived in data centers. Expensive. Centralized. Controlled by a few. Meanwhile, billions of smartphones sit idle. Powerful GPUs. Doing nothing. That doesn’t make sense. So we’re building something different. Destra Edge turns everyday smartphones into a global AI inference network. No servers. No cloud monopolies. Just real compute at the edge. This video shows the system taking shape — how inference is distributed, how it runs on-device, and how results come together without central control. This is not finished. And that’s the point. You’re watching it being built. Layer by layer. In public. The magic is in the scale. More phones means more power. More power means stronger AI. The network grows simply because people join. No passive mining. No fake activity. Only real GPU inference. Measured. Verified. Rewarded. AI shouldn’t live in warehouses. It should live in your pocket. This is edge-level decentralization. This is permissionless inference. This is Destra Network.

Destra Network

20,156 Aufrufe • vor 7 Monaten

$NBIS is becoming one of the biggest winners in the new AI economy because it can deliver compute efficiently at scale. The number that mattered most to me was Nebius seeing four or more customers competing for every GPU it brings online (huge for AI cloud market). Management also said they raised prices again and are still selling out across both old and new GPU generations which is one of the cleanest pricing power signals you can get. This is a $100B company in the making.
0:44

$NBIS is becoming one of the biggest winners in the new AI economy because it can deliver compute efficiently at scale. The number that mattered most to me was Nebius seeing four or more customers competing for every GPU it brings online (huge for AI cloud market). Management also said they raised prices again and are still selling out across both old and new GPU generations which is one of the cleanest pricing power signals you can get. This is a $100B company in the making.

Shay Boloor

589,512 Aufrufe • vor 2 Monaten

ROBA Compute is officially LIVE. This isn't a feature drop. This is ROBA expanding into the AI infrastructure market - hundreds of billions in scale, and we're staking our claim. Rent GPUs on-demand. Enterprise-grade allocation. Transparent USDC pricing. Zero hidden fees and all on-chain. We're already in talks with enterprise clients for compute at scale. 15% of all compute revenue → straight to $ROBA buybacks & burns. GPU capacity is limited at launch. First come, first served. Over the next weeks we will begin accepting new compute partners to provide more power to the marketplace in addition to ROBA's own in-house GPUs and integrated robotics stack. Platform fees are discounted for a limited time only. The infrastructure layer powering physical AI and beyond starts here.
0:41

ROBA Compute is officially LIVE. This isn't a feature drop. This is ROBA expanding into the AI infrastructure market - hundreds of billions in scale, and we're staking our claim. Rent GPUs on-demand. Enterprise-grade allocation. Transparent USDC pricing. Zero hidden fees and all on-chain. We're already in talks with enterprise clients for compute at scale. 15% of all compute revenue → straight to $ROBA buybacks & burns. GPU capacity is limited at launch. First come, first served. Over the next weeks we will begin accepting new compute partners to provide more power to the marketplace in addition to ROBA's own in-house GPUs and integrated robotics stack. Platform fees are discounted for a limited time only. The infrastructure layer powering physical AI and beyond starts here.

Roba Labs

40,281 Aufrufe • vor 24 Tagen

Fred Thiel Fred Thiel runs the largest public bitcoin miner. His number: a mining site costs about $1M per megawatt, all in. An AI site runs $10-15M per megawatt before a single GPU goes in. Same land, same power hookup, 10-15x the build cost. That's why Mara is converting, not mining. It already controls over 4GW after the Long Ridge and HIF deals, against 1.1GW of live mining today. The catch: Mara had no hyperscaler relationships and no build capability, so it's leaning on Starwood at 80% loan-to-value. The megawatts are real. The tenant demand is borrowed. Chase Lochmiller Chase Lochmiller of Crusoe makes the same energy-first case - the AI constraint isn't chips, it's power you can actually plug in. The tell for $MARA isn't hash rate anymore. It's how many of those gigawatts turn into signed AI leases. Thiel said it to Natalie Brunell Natalie Brunell ⚡️ on Coin Stories. How Mara funded the pivot and what breaks it:
0:56

Fred Thiel Fred Thiel runs the largest public bitcoin miner. His number: a mining site costs about $1M per megawatt, all in. An AI site runs $10-15M per megawatt before a single GPU goes in. Same land, same power hookup, 10-15x the build cost. That's why Mara is converting, not mining. It already controls over 4GW after the Long Ridge and HIF deals, against 1.1GW of live mining today. The catch: Mara had no hyperscaler relationships and no build capability, so it's leaning on Starwood at 80% loan-to-value. The megawatts are real. The tenant demand is borrowed. Chase Lochmiller Chase Lochmiller of Crusoe makes the same energy-first case - the AI constraint isn't chips, it's power you can actually plug in. The tell for $MARA isn't hash rate anymore. It's how many of those gigawatts turn into signed AI leases. Thiel said it to Natalie Brunell Natalie Brunell ⚡️ on Coin Stories. How Mara funded the pivot and what breaks it:

Podcast Alpha

35,196 Aufrufe • vor 14 Tagen

Demis Hassabis just explained why the real AI bottleneck has nothing to do with training runs. Most people picture the AI arms race as who can build the biggest model. GPT-4 or Gemini Ultra style training runs, a few hundred million in compute, fired once or twice a year. The constraint sits somewhere else. Every time a researcher has a new algorithmic idea, a new architecture, a new training technique, they can't just test it on a laptop. They have to run it at the scale where it would actually be deployed, because ideas that look promising at small scale fall apart completely when you put them into a real system. Every research hypothesis burns significant compute before a single line of production code gets written. At a lab like DeepMind, hundreds of researchers are running hundreds of ideas simultaneously. The demand for experimental compute is continuous. It never stops. Now layer the hardware reality on top. GPU lead times are currently 36 to 52 weeks for data center hardware. Global AI data centers are already drawing 29.6 gigawatts, equivalent to the peak power demand of the entire state of New York, and they still can't meet demand. Companies willing to pay any price can't just buy more compute. They wait in line. The speed of scientific discovery in AI is now gated by hardware availability. The next breakthrough is sitting in a researcher's head right now. Whether it gets validated fast enough to matter depends entirely on whether the compute is there when they need it. The AI race gets won by whoever can run the most experiments per month.
0:47

Demis Hassabis just explained why the real AI bottleneck has nothing to do with training runs. Most people picture the AI arms race as who can build the biggest model. GPT-4 or Gemini Ultra style training runs, a few hundred million in compute, fired once or twice a year. The constraint sits somewhere else. Every time a researcher has a new algorithmic idea, a new architecture, a new training technique, they can't just test it on a laptop. They have to run it at the scale where it would actually be deployed, because ideas that look promising at small scale fall apart completely when you put them into a real system. Every research hypothesis burns significant compute before a single line of production code gets written. At a lab like DeepMind, hundreds of researchers are running hundreds of ideas simultaneously. The demand for experimental compute is continuous. It never stops. Now layer the hardware reality on top. GPU lead times are currently 36 to 52 weeks for data center hardware. Global AI data centers are already drawing 29.6 gigawatts, equivalent to the peak power demand of the entire state of New York, and they still can't meet demand. Companies willing to pay any price can't just buy more compute. They wait in line. The speed of scientific discovery in AI is now gated by hardware availability. The next breakthrough is sitting in a researcher's head right now. Whether it gets validated fast enough to matter depends entirely on whether the compute is there when they need it. The AI race gets won by whoever can run the most experiments per month.

Aakash Gupta

32,150 Aufrufe • vor 3 Monaten

A FARM OF 90 RTX 3090s BUILT FOR ETHEREUM MINING IN 2021 IS NOW SERVING LOCAL LLM INFERENCE FROM THE SAME GARAGE. THE PART THAT MATTERS ISN'T THE SIZE, IT'S THAT THE OWNER NEVER UNPLUGGED THE RIG, HE JUST CHANGED THE WORKLOAD the camera walks through the room. three custom wood frames stacked floor to ceiling. ninety 3090s breathing rainbow LEDs in unison. a yellow industrial duct ripped through the wall to pull the heat out. each card pulling 250W under load, the whole room drawing 22kW continuous. this is not a hobby setup. it is a small datacenter dressed up as a bedroom do the math. 90 cards times 24GB VRAM is 2,160GB of pooled memory, enough to load every frontier open weight model at once. at $700 used per card, each 3090 pays for itself against a Claude Code Max subscription in about three months. the same RTX 3090 i wrote about last week as the best value per dollar for a local AI rig, stacked 90 times in a garage this is not a crypto relic. it is the new datacenter, built from cards that gamers retired in 2022 and crypto miners gave up on in 2023, now quietly answering prompts that OpenAI charges you $200 a month for
0:33

A FARM OF 90 RTX 3090s BUILT FOR ETHEREUM MINING IN 2021 IS NOW SERVING LOCAL LLM INFERENCE FROM THE SAME GARAGE. THE PART THAT MATTERS ISN'T THE SIZE, IT'S THAT THE OWNER NEVER UNPLUGGED THE RIG, HE JUST CHANGED THE WORKLOAD the camera walks through the room. three custom wood frames stacked floor to ceiling. ninety 3090s breathing rainbow LEDs in unison. a yellow industrial duct ripped through the wall to pull the heat out. each card pulling 250W under load, the whole room drawing 22kW continuous. this is not a hobby setup. it is a small datacenter dressed up as a bedroom do the math. 90 cards times 24GB VRAM is 2,160GB of pooled memory, enough to load every frontier open weight model at once. at $700 used per card, each 3090 pays for itself against a Claude Code Max subscription in about three months. the same RTX 3090 i wrote about last week as the best value per dollar for a local AI rig, stacked 90 times in a garage this is not a crypto relic. it is the new datacenter, built from cards that gamers retired in 2022 and crypto miners gave up on in 2023, now quietly answering prompts that OpenAI charges you $200 a month for

Ridark

64,499 Aufrufe • vor 1 Monat

THE MS-A2 IS THE MINISFORUM BOX HERMES AGENT WAS NEVER MEANT TO RUN ON, AND THAT'S BY DESIGN The MS-S1 MAX earns its spot running Hermes Agent because of one thing. 128GB of unified memory, up to 96GB of it handed straight to the GPU. That's the only reason a 120B model fits and runs locally for $0 a month The MS-A2 solves a different problem. Ryzen 9 9955HX, 16 cores, 32 threads, up to 96GB of regular DDR5-5600, no unified pool Three M.2 PCIe 4.0 slots, one U.2, two 22110. Dual 10Gbps SFP+ LAN plus 2.5G. WiFi 6E. Bluetooth 5.3. A slide-out motherboard for fast upgrades. A real PCIe x16 slot that actually takes a low-profile GPU That last part is where the two machines split for good. The MS-S1 MAX's PCIe slot won't take a GPU at all, every bit of GPU power has to come from the unified chip itself. The MS-A2 trades that unified memory trick for raw expandability instead One box runs a local AI agent. The other runs a home lab that needs storage, networking, and room to grow. Minisforum built both on purpose, not as the same product wearing two names
1:06

THE MS-A2 IS THE MINISFORUM BOX HERMES AGENT WAS NEVER MEANT TO RUN ON, AND THAT'S BY DESIGN The MS-S1 MAX earns its spot running Hermes Agent because of one thing. 128GB of unified memory, up to 96GB of it handed straight to the GPU. That's the only reason a 120B model fits and runs locally for $0 a month The MS-A2 solves a different problem. Ryzen 9 9955HX, 16 cores, 32 threads, up to 96GB of regular DDR5-5600, no unified pool Three M.2 PCIe 4.0 slots, one U.2, two 22110. Dual 10Gbps SFP+ LAN plus 2.5G. WiFi 6E. Bluetooth 5.3. A slide-out motherboard for fast upgrades. A real PCIe x16 slot that actually takes a low-profile GPU That last part is where the two machines split for good. The MS-S1 MAX's PCIe slot won't take a GPU at all, every bit of GPU power has to come from the unified chip itself. The MS-A2 trades that unified memory trick for raw expandability instead One box runs a local AI agent. The other runs a home lab that needs storage, networking, and room to grow. Minisforum built both on purpose, not as the same product wearing two names

NO1ennn

25,645 Aufrufe • vor 1 Monat

Everything in the economy runs on the same input. Compute, AI, robotics, manufacturing, transport... it's all energy underneath. That matters now because of demographics. Fewer workers every year means the economy only grows if output per head grows fast, and the engine for that is the Exponential Age... AI and robotics doing the work people used to. But all of that runs on energy. So the cost of energy is the ceiling on the whole thing. That's why the EU, Japan, China, the US and the UK are all moving at the same time. If we can take the cost of energy to near zero, GDP per capita stops being hostage to the price of a barrel of oil. That's the way out of this mess.
0:50

Everything in the economy runs on the same input. Compute, AI, robotics, manufacturing, transport... it's all energy underneath. That matters now because of demographics. Fewer workers every year means the economy only grows if output per head grows fast, and the engine for that is the Exponential Age... AI and robotics doing the work people used to. But all of that runs on energy. So the cost of energy is the ceiling on the whole thing. That's why the EU, Japan, China, the US and the UK are all moving at the same time. If we can take the cost of energy to near zero, GDP per capita stops being hostage to the price of a barrel of oil. That's the way out of this mess.

Raoul Pal

122,299 Aufrufe • vor 26 Tagen

🎙️ Want a full breakdown on why cost per token is a key metric for AI infrastructure TCO? We’re operating in a power-constrained world. Demand for intelligence is scaling faster than infrastructure can keep up—so metrics like cost per GPU hour or FLOPs per dollar don’t tell the full story. When it comes to TCO, Cost per Token is the metric that captures end-to-end performance across GPUs, CPUs, networking, software, and ecosystem making it the key driver of real profitability and scalability in AI. If you’re not measuring efficiency at the token level, you’re missing what actually drives cost. Watch the deep-dive conversation with Dr. Gerro Prinsloo , Nader Khalil and Carter Abdallah, live on the NVIDIA YouTube channel.
1:05

🎙️ Want a full breakdown on why cost per token is a key metric for AI infrastructure TCO? We’re operating in a power-constrained world. Demand for intelligence is scaling faster than infrastructure can keep up—so metrics like cost per GPU hour or FLOPs per dollar don’t tell the full story. When it comes to TCO, Cost per Token is the metric that captures end-to-end performance across GPUs, CPUs, networking, software, and ecosystem making it the key driver of real profitability and scalability in AI. If you’re not measuring efficiency at the token level, you’re missing what actually drives cost. Watch the deep-dive conversation with Dr. Gerro Prinsloo , Nader Khalil and Carter Abdallah, live on the NVIDIA YouTube channel.

NVIDIA

21,970 Aufrufe • vor 3 Monaten

Hey everyone, today I want to introduce a project that’s aiming to redefine how we access compute for AI — it’s called GPUAI. 🔶 GPUAI: Unlocking Global GPU Power for the AI Era GPUAI isn’t just another GPU marketplace or leasing service. It’s a fully decentralized protocol that connects idle GPU resources around the world — from gaming PCs to data center clusters — and transforms them into a high-performance compute network for AI workloads. 🧠 Why does it matter? Right now, the biggest bottleneck in AI isn’t algorithms — it’s access to compute. Training and running models requires massive GPU power, but it’s locked up in centralized cloud platforms, expensive and hard to access for smaller teams. With GPUAI, anyone can tap into a global GPU pool that’s: ✅ Fully decentralized ✅ Reputation-based and smart contract coordinated ✅ Encrypted and secure ✅ Token-incentivized — meaning contributors get rewarded in $GPUAI 📈 For developers, it’s a flexible way to access GPU compute for training, inference, and more — without cloud lock-in. 💰 For GPU owners, it’s a chance to monetize idle hardware that would otherwise go unused. The protocol is live, the apps are active, and the ecosystem is growing fast. 🌐 Try it yourself at 📖 Learn more on 🎮 Play our community games at This is real infrastructure for the future of AI, not hype. Follow them and explore their mission of decentralized computing at Tell me what you think - if you have a GPU, you can start profiting now. #GPUAI #Web3Infrastructure #AIComputing #DePIN #Decentralization
1:25

Hey everyone, today I want to introduce a project that’s aiming to redefine how we access compute for AI — it’s called GPUAI. 🔶 GPUAI: Unlocking Global GPU Power for the AI Era GPUAI isn’t just another GPU marketplace or leasing service. It’s a fully decentralized protocol that connects idle GPU resources around the world — from gaming PCs to data center clusters — and transforms them into a high-performance compute network for AI workloads. 🧠 Why does it matter? Right now, the biggest bottleneck in AI isn’t algorithms — it’s access to compute. Training and running models requires massive GPU power, but it’s locked up in centralized cloud platforms, expensive and hard to access for smaller teams. With GPUAI, anyone can tap into a global GPU pool that’s: ✅ Fully decentralized ✅ Reputation-based and smart contract coordinated ✅ Encrypted and secure ✅ Token-incentivized — meaning contributors get rewarded in $GPUAI 📈 For developers, it’s a flexible way to access GPU compute for training, inference, and more — without cloud lock-in. 💰 For GPU owners, it’s a chance to monetize idle hardware that would otherwise go unused. The protocol is live, the apps are active, and the ecosystem is growing fast. 🌐 Try it yourself at 📖 Learn more on 🎮 Play our community games at This is real infrastructure for the future of AI, not hype. Follow them and explore their mission of decentralized computing at Tell me what you think - if you have a GPU, you can start profiting now. #GPUAI #Web3Infrastructure #AIComputing #DePIN #Decentralization

The Crypto GEMs

69,984 Aufrufe • vor 1 Jahr

this is what 12 gigs of VRAM built in 2026. a 9 billion parameter model running on a 5 year old RTX 3060 wrote a full space shooter from a single prompt. blank screen on first try. i came back with a bug list and the same model on the same card fixed every issue across 11 files without touching a single line myself. enemies still looked wrong so i pushed another iteration and now the game has pixel art octopi, particle effects, screen shake, projectile physics and a combo system. all running locally on a card that was designed to play fortnite. three iterations. zero cloud. zero API calls. every token generated on hardware sitting under my desk. the model reads its own code, finds what's broken, patches it, validates syntax and restarts the server. i just describe what's wrong and it handles the rest. people are paying monthly subscriptions to type into a browser tab and wait for a server farm to respond. meanwhile a GPU you can find used on ebay is running a full autonomous hermes agent framework with 31 tools, 128K context window and thinking mode generating at 29 tokens per second nonstop. the game still needs work. level upgrades don't trigger and boss fights need tuning. but the fact that i'm iterating on gameplay balance instead of debugging whether the code runs at all tells you where this is headed. every iteration the game gets better on the same hardware. same 12 gigs. same 9 billion parameters. same RTX 3060 from 5 years ago your GPU is not a gaming card anymore. it's a local AI lab that never sends your data anywhere.
0:28

this is what 12 gigs of VRAM built in 2026. a 9 billion parameter model running on a 5 year old RTX 3060 wrote a full space shooter from a single prompt. blank screen on first try. i came back with a bug list and the same model on the same card fixed every issue across 11 files without touching a single line myself. enemies still looked wrong so i pushed another iteration and now the game has pixel art octopi, particle effects, screen shake, projectile physics and a combo system. all running locally on a card that was designed to play fortnite. three iterations. zero cloud. zero API calls. every token generated on hardware sitting under my desk. the model reads its own code, finds what's broken, patches it, validates syntax and restarts the server. i just describe what's wrong and it handles the rest. people are paying monthly subscriptions to type into a browser tab and wait for a server farm to respond. meanwhile a GPU you can find used on ebay is running a full autonomous hermes agent framework with 31 tools, 128K context window and thinking mode generating at 29 tokens per second nonstop. the game still needs work. level upgrades don't trigger and boss fights need tuning. but the fact that i'm iterating on gameplay balance instead of debugging whether the code runs at all tells you where this is headed. every iteration the game gets better on the same hardware. same 12 gigs. same 9 billion parameters. same RTX 3060 from 5 years ago your GPU is not a gaming card anymore. it's a local AI lab that never sends your data anywhere.

Sudo su

170,737 Aufrufe • vor 4 Monaten

Your home is about to become an AI data center and pay off your mortgage This is not a theory. It is already happening. Nvidia partnered with homebuilders to install AI hardware directly into new homes. A white box on the wall. Internet. Power outlet. It processes AI workloads for companies around the world. You do nothing. It just runs 24/7. Homeowners get paid a fixed amount every single month. Estimates put it at $2,000 to $3,000 straight into your account. That is $36,000 a year just for a box on your wall. These guys broke down exactly why this is massive, who is behind it and how regular homeowners get in. Suburbs are quietly becoming the new AI infrastructure. And the people who got in early are already getting paid. Watch the full video. All the alpha and everything you need to know is in there.
13:21

Your home is about to become an AI data center and pay off your mortgage This is not a theory. It is already happening. Nvidia partnered with homebuilders to install AI hardware directly into new homes. A white box on the wall. Internet. Power outlet. It processes AI workloads for companies around the world. You do nothing. It just runs 24/7. Homeowners get paid a fixed amount every single month. Estimates put it at $2,000 to $3,000 straight into your account. That is $36,000 a year just for a box on your wall. These guys broke down exactly why this is massive, who is behind it and how regular homeowners get in. Suburbs are quietly becoming the new AI infrastructure. And the people who got in early are already getting paid. Watch the full video. All the alpha and everything you need to know is in there.

winkle.

315,269 Aufrufe • vor 2 Monaten

CHINESE AI TEACHER STACKED 4 NVIDIA DGX SPARK CHIPS INTO A CLUSTER - AND NOW RUNS A BUSINESS ON IT FROM HIS DESK 4 chips at $2,999 each - one time investment - and now he has a cluster that handles client inference requests around the clock while he does something else he's running a Qwen 32 35B model with 4 concurrent requests at the same time and the speed barely drops compared to a single request what used to require a $10,000+/month cloud setup now sits on his desk and costs him $40-60/month in electricity 4 chips at $2,999 each - one time investment - and now he has a cluster that handles client inference requests around the clock while he does something else the people still paying per token are financing someone else's infrastructure
1:42

CHINESE AI TEACHER STACKED 4 NVIDIA DGX SPARK CHIPS INTO A CLUSTER - AND NOW RUNS A BUSINESS ON IT FROM HIS DESK 4 chips at $2,999 each - one time investment - and now he has a cluster that handles client inference requests around the clock while he does something else he's running a Qwen 32 35B model with 4 concurrent requests at the same time and the speed barely drops compared to a single request what used to require a $10,000+/month cloud setup now sits on his desk and costs him $40-60/month in electricity 4 chips at $2,999 each - one time investment - and now he has a cluster that handles client inference requests around the clock while he does something else the people still paying per token are financing someone else's infrastructure

Sprytix

51,010 Aufrufe • vor 2 Monaten

watch anon! 27 billion parameter model dancing at 42 tokens a second on a used rtx 3060ti, that costs 200 dollars. consuming 159 watts. temp 62 degrees. pushing almost 100% on the gpu. 6.8 of 8 gigs used with a 128k context window loaded. and every one of those spikes is the model reasoning and firing tool calls. the model is bonsai 27b at 1 bit. PrismML took qwen 3.6 27b, and crushed it to 3.9 gigabytes, about a single sign bit per weight. it drops onto an 8gb rtx 3060 ti, an ampere card from 2020, and it doesn't just load, it serves, it holds the full 128k window, it runs a hermes agent for half an hour straight, it hits its own failures and recovers, it never once drops the loop. the absurd part is the power meter. that same 27b, in its normal quant 4, wants a 24gb card and nearly 17 gigs of weights. this is it at 3.9, doing agentic work at 160 watts, on the tier people call budget. the numbers are sitting right there on nvtop, not in a slide, not a claim, the meter reading while it works. so i keep landing on one question. the model is open, apache 2.0. the card is old and cheap. the whole thing runs offline. why is almost nobody actually running this. is it the hardware, the setup, or did nobody tell you a 27b fits on the card already in your closet.
0:26

watch anon! 27 billion parameter model dancing at 42 tokens a second on a used rtx 3060ti, that costs 200 dollars. consuming 159 watts. temp 62 degrees. pushing almost 100% on the gpu. 6.8 of 8 gigs used with a 128k context window loaded. and every one of those spikes is the model reasoning and firing tool calls. the model is bonsai 27b at 1 bit. PrismML took qwen 3.6 27b, and crushed it to 3.9 gigabytes, about a single sign bit per weight. it drops onto an 8gb rtx 3060 ti, an ampere card from 2020, and it doesn't just load, it serves, it holds the full 128k window, it runs a hermes agent for half an hour straight, it hits its own failures and recovers, it never once drops the loop. the absurd part is the power meter. that same 27b, in its normal quant 4, wants a 24gb card and nearly 17 gigs of weights. this is it at 3.9, doing agentic work at 160 watts, on the tier people call budget. the numbers are sitting right there on nvtop, not in a slide, not a claim, the meter reading while it works. so i keep landing on one question. the model is open, apache 2.0. the card is old and cheap. the whole thing runs offline. why is almost nobody actually running this. is it the hardware, the setup, or did nobody tell you a 27b fits on the card already in your closet.

Sudo su

23,225 Aufrufe • vor 15 Tagen