Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Your cloud agent runs $10–20 a day. This box runs OpenAI's 120B model for $0. Same workload. It just sits in a closet on AMD silicon. A Minisforum mini PC, Strix Halo, 128GB unified memory. The model lives entirely on-device. 56 tokens a second. No API key. Nothing leaves... show more

RetroChainer

3,884 subscribers

13,925 görüntüleme • 3 ay önce •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

AMD JUST KILLED THE $200 - A - MONTH AI SUBSCRIPTION - A 65-WATT BOX WITH 128GB OF UNIFIED MEMORY THAT RUNS 70B MODELS LOCALLY. that clip is amd's ryzen ai max+ 395 mini box, held up on stage. the whole pitch is one spec: 128gb of high-speed unified memory. why it matters: cpu, gpu and npu share the same 128gb pool, so a model that used to need a rack of vram just fits. what it actually runs: llama 70b in full precision on the built-in gpu open models up to ~100b parameters, locally, no cloud all of it in a mini pc pulling around 65 watts that's the part that ends the subscription: your prompts, your data, your model, on a box on your desk, not metered by the token. honest line: this runs open models, not gpt-5 or claude opus. for chat, coding help and agents on your own data it's more than enough. for the absolute frontier, the cloud still wins. and it isn't free: the box runs ~$1,500 and up. but that's a few months of a $200 sub, then it's yours forever. no monthly ai bill, no tokens metered, no prompt leaving the room. the uncomfortable part isn't that amd made a fast box. it's that "you need the cloud for ai" was a pricing choice, and unified memory just made it optional. follow RetroChainer for the hardware that turns rent into ownership, and bookmark this before your next ai renewal.

AMD JUST KILLED THE $200 - A - MONTH AI SUBSCRIPTION - A 65-WATT BOX WITH 128GB OF UNIFIED MEMORY THAT RUNS 70B MODELS LOCALLY. that clip is amd's ryzen ai max+ 395 mini box, held up on stage. the whole pitch is one spec: 128gb of high-speed unified memory. why it matters: cpu, gpu and npu share the same 128gb pool, so a model that used to need a rack of vram just fits. what it actually runs: llama 70b in full precision on the built-in gpu open models up to ~100b parameters, locally, no cloud all of it in a mini pc pulling around 65 watts that's the part that ends the subscription: your prompts, your data, your model, on a box on your desk, not metered by the token. honest line: this runs open models, not gpt-5 or claude opus. for chat, coding help and agents on your own data it's more than enough. for the absolute frontier, the cloud still wins. and it isn't free: the box runs ~$1,500 and up. but that's a few months of a $200 sub, then it's yours forever. no monthly ai bill, no tokens metered, no prompt leaving the room. the uncomfortable part isn't that amd made a fast box. it's that "you need the cloud for ai" was a pricing choice, and unified memory just made it optional. follow RetroChainer for the hardware that turns rent into ownership, and bookmark this before your next ai renewal.

RetroChainer

16,995 görüntüleme • 1 ay önce

A guy got tired of renting intelligence from the cloud, so he put a 120-billion-parameter model in his closet for $0 a month. One mini PC. The Minisforum MS-S1 MAX. 128GB of unified memory, and a trick that hands 96GB of it straight to the GPU. Here's how it breaks: That 96GB is the whole game. Enough to run GPT-OSS-120B fully local, and still keep the agent and dashboard on the same box. 120 billion parameters. 56.6 tokens a second. A 5,000-word essay in one pass at 110W and 68°C. Quiet. Cool. Local. Then Hermes Agent goes on top, pointed at localhost. No API key, because there's nothing to phone home to. It drafts, researches, runs tool calls, manages sub-agents. None of it leaves the network. The cloud version cost $10 to $20 a day, keys and customer data routed through machines he didn't own. Now it's a box in a closet. $0 a month. The chip is real. The build is brilliant. And somewhere in the first few minutes, the AI stopped being a bill he paid every morning and became a machine he owns, humming in a closet, working for free.

A guy got tired of renting intelligence from the cloud, so he put a 120-billion-parameter model in his closet for $0 a month. One mini PC. The Minisforum MS-S1 MAX. 128GB of unified memory, and a trick that hands 96GB of it straight to the GPU. Here's how it breaks: That 96GB is the whole game. Enough to run GPT-OSS-120B fully local, and still keep the agent and dashboard on the same box. 120 billion parameters. 56.6 tokens a second. A 5,000-word essay in one pass at 110W and 68°C. Quiet. Cool. Local. Then Hermes Agent goes on top, pointed at localhost. No API key, because there's nothing to phone home to. It drafts, researches, runs tool calls, manages sub-agents. None of it leaves the network. The cloud version cost $10 to $20 a day, keys and customer data routed through machines he didn't own. Now it's a box in a closet. $0 a month. The chip is real. The build is brilliant. And somewhere in the first few minutes, the AI stopped being a bill he paid every morning and became a machine he owns, humming in a closet, working for free.

shmidt

246,301 görüntüleme • 3 ay önce

This guy turned a $250K cloud bill into a $2,999 Nvidia box on his desk. One box. One-time charge. Same size as a Mac mini. Runs the workload AWS was charging him $1,900/month for. He made $22,000 in a year just from the bill he stopped paying. The kicker: it speaks OpenAI-compatible API out of the box. Migrating his existing stack was 1 line of code. - No more cloud GPUs. - No more monthly meter. - No more "let me check the AWS dashboard before I run that." Full build, exact math, and what the box actually runs is in the article below 👇

This guy turned a $250K cloud bill into a $2,999 Nvidia box on his desk. One box. One-time charge. Same size as a Mac mini. Runs the workload AWS was charging him $1,900/month for. He made $22,000 in a year just from the bill he stopped paying. The kicker: it speaks OpenAI-compatible API out of the box. Migrating his existing stack was 1 line of code. - No more cloud GPUs. - No more monthly meter. - No more "let me check the AWS dashboard before I run that." Full build, exact math, and what the box actually runs is in the article below 👇

ZEUS⚡️

14,529 görüntüleme • 4 ay önce

THIS AI DEVELOPER RUNS 120B PARAMETER MODELS LOCALLY AND HIS MACBOOK PRO CAN’T EVEN OPEN THEM he bought a DGX Spark, gave it the model, went back to his desk by end of day the inference was done, tested, committed his team is still waiting for the cloud GPU queue to free up the only thing between them is 128GB of unified memory in a box smaller than your lunch one Spark is a datacenter node, two Sparks is your own cluster bookmark this and send it to whoever is still paying for cloud GPUs

THIS AI DEVELOPER RUNS 120B PARAMETER MODELS LOCALLY AND HIS MACBOOK PRO CAN’T EVEN OPEN THEM he bought a DGX Spark, gave it the model, went back to his desk by end of day the inference was done, tested, committed his team is still waiting for the cloud GPU queue to free up the only thing between them is 128GB of unified memory in a box smaller than your lunch one Spark is a datacenter node, two Sparks is your own cluster bookmark this and send it to whoever is still paying for cloud GPUs

leopardracer

85,838 görüntüleme • 4 ay önce

A $1,800 MINI PC ON YOUR DESK JUST MADE $5,040 A YEAR IN AI SUBSCRIPTIONS POINTLESS Claude Code Max, ChatGPT Pro, Cursor. That's $420 a month just to keep the workflow alive. A GMKtec mini PC with 128GB of unified memory runs the same stack locally for a one time cost. Ollama, Linux, local endpoints, Claude Code pointed at your own machine. Every prompt stays on your desk. Nothing touches the cloud.

A $1,800 MINI PC ON YOUR DESK JUST MADE $5,040 A YEAR IN AI SUBSCRIPTIONS POINTLESS Claude Code Max, ChatGPT Pro, Cursor. That's $420 a month just to keep the workflow alive. A GMKtec mini PC with 128GB of unified memory runs the same stack locally for a one time cost. Ollama, Linux, local endpoints, Claude Code pointed at your own machine. Every prompt stays on your desk. Nothing touches the cloud.

0xMarioNawfal

50,826 görüntüleme • 3 ay önce

100 MAC MINIS ON ONE METAL SHELF. IN THE CLOUD, EACH OF THOSE RENTS FOR $120 TO $500 A MONTH. that clip is a homemade rack: wire shelving packed with mac minis, each running macos, wired into one cluster. why macs and not a normal server? two reasons. you can only build, sign, and notarize ios and mac apps on apple hardware. cloud providers know it and charge for it. and apple silicon sips power and runs near-silent, so you can stack a lot of them on a shelf in a room, not a datacenter. the rent they're escaping: a single mac in the cloud runs ~$120 to $500 a month (macstadium up to aws) one engineer documented saving $4,000+ a month by self-hosting mac minis instead of cloud ci runners a used or new mini is a few hundred dollars once, then a few dollars of electricity what a shelf like this actually runs: ios and mac build farms, render jobs, app and device testing automation, and increasingly local ai inference. own the boxes, rent nothing. the uncomfortable part: the cloud was never the only option. it was the convenient one. the people who did the math bought the shelf. the honest caveat: it's real capex up front, real heat and power, and you become the sysadmin. no rented rack means no one to call at 3am. worth it at scale, overkill for one build a week. no rack rental, no per-hour metering, no fleet you don't own. save this before your cloud invoice renews again.

100 MAC MINIS ON ONE METAL SHELF. IN THE CLOUD, EACH OF THOSE RENTS FOR $120 TO $500 A MONTH. that clip is a homemade rack: wire shelving packed with mac minis, each running macos, wired into one cluster. why macs and not a normal server? two reasons. you can only build, sign, and notarize ios and mac apps on apple hardware. cloud providers know it and charge for it. and apple silicon sips power and runs near-silent, so you can stack a lot of them on a shelf in a room, not a datacenter. the rent they're escaping: a single mac in the cloud runs ~$120 to $500 a month (macstadium up to aws) one engineer documented saving $4,000+ a month by self-hosting mac minis instead of cloud ci runners a used or new mini is a few hundred dollars once, then a few dollars of electricity what a shelf like this actually runs: ios and mac build farms, render jobs, app and device testing automation, and increasingly local ai inference. own the boxes, rent nothing. the uncomfortable part: the cloud was never the only option. it was the convenient one. the people who did the math bought the shelf. the honest caveat: it's real capex up front, real heat and power, and you become the sysadmin. no rented rack means no one to call at 3am. worth it at scale, overkill for one build a week. no rack rental, no per-hour metering, no fleet you don't own. save this before your cloud invoice renews again.

RetroChainer

21,055 görüntüleme • 2 ay önce

HERMES AGENT NOW RUNS ON AN 8GB LAPTOP GPU JUST AS EASILY AS IT RUNS ON A 128GB MINI PC Nous Research shipped the official Hermes Agent Desktop App this week. Someone pointed it at a local llama server running on an RTX 4060 with 16GB system RAM. The integration took two minutes The model behind it: Gemma 4 26B MoE, QAT quantized, running on 8GB of VRAM. A 60k token prompt held a stable 20 tokens a second, flat, no slowdown as context grew. The flags were nothing exotic, just -cmoe -c 248000 on llama.cpp What that 8GB setup does out of the box: reads and patches its own code, runs it in a terminal, debugs errors, manages GitHub repos, spawns sub-agents for parallel work. Browses the web with vision to debug a UI. Schedules cron jobs in plain language. Connects to Notion, Google Workspace, Linear, and Obsidian to manage tasks on its own That's the same agent layer running on a Minisforum MS-S1 MAX with 128GB of unified memory, 96GB of it to the GPU, holding a 120B model at 56 tokens a second instead of a 26B model at 20. Same software, same tool execution, same zero API key. The only thing that changes between an $800 laptop and a $2,000 mini PC is how big a model you can afford to run underneath it The barrier to running a real autonomous agent locally didn't just drop. It dropped all the way down to hardware most people already own

HERMES AGENT NOW RUNS ON AN 8GB LAPTOP GPU JUST AS EASILY AS IT RUNS ON A 128GB MINI PC Nous Research shipped the official Hermes Agent Desktop App this week. Someone pointed it at a local llama server running on an RTX 4060 with 16GB system RAM. The integration took two minutes The model behind it: Gemma 4 26B MoE, QAT quantized, running on 8GB of VRAM. A 60k token prompt held a stable 20 tokens a second, flat, no slowdown as context grew. The flags were nothing exotic, just -cmoe -c 248000 on llama.cpp What that 8GB setup does out of the box: reads and patches its own code, runs it in a terminal, debugs errors, manages GitHub repos, spawns sub-agents for parallel work. Browses the web with vision to debug a UI. Schedules cron jobs in plain language. Connects to Notion, Google Workspace, Linear, and Obsidian to manage tasks on its own That's the same agent layer running on a Minisforum MS-S1 MAX with 128GB of unified memory, 96GB of it to the GPU, holding a 120B model at 56 tokens a second instead of a 26B model at 20. Same software, same tool execution, same zero API key. The only thing that changes between an $800 laptop and a $2,000 mini PC is how big a model you can afford to run underneath it The barrier to running a real autonomous agent locally didn't just drop. It dropped all the way down to hardware most people already own

NO1ennn

40,079 görüntüleme • 3 ay önce

AMD on local AI: "this is the smallest AI development system in the world, capable of running models up to 200 billion parameters locally, not connected to anything" 128GB of unified memory shared by CPU, GPU, and NPU fits in your hand. Runs a model larger than GPT-3 with no internet $3,999 once. roughly $16 a month in power Cloud equivalent: up to $750 a month The question was never whether local AI could compete on power It was whether it could compete on price. Now it does

AMD on local AI: "this is the smallest AI development system in the world, capable of running models up to 200 billion parameters locally, not connected to anything" 128GB of unified memory shared by CPU, GPU, and NPU fits in your hand. Runs a model larger than GPT-3 with no internet $3,999 once. roughly $16 a month in power Cloud equivalent: up to $750 a month The question was never whether local AI could compete on power It was whether it could compete on price. Now it does

plutos

152,392 görüntüleme • 3 ay önce

$5,280 a year on AI subscriptions. Claude Max, ChatGPT Pro, Gemini, Cursor. $440 every month going to the cloud. a mini PC for $1,700 does the same thing on your desk. GMKtec EVO-X2 - a box the size of a hardcover book. inside it the chip that Lisa Su personally brought on stage at CES and signed with her name. 128GB of memory in one pool. runs models that cloud subscriptions behind $200 paywalls throttle during peak hours. here there are no limits - your hardware, your rules. NVIDIA's RTX 5080 at $1,000+ lost to this box by 3x on a real AI workload. a discrete GPU beaten by a mini PC the size of a lunchbox. electricity - $9 a month. pays for itself in 10 months. after that $440 every month stays in your pocket. the cloud made sense when nothing on a desk could compete. now it can.

$5,280 a year on AI subscriptions. Claude Max, ChatGPT Pro, Gemini, Cursor. $440 every month going to the cloud. a mini PC for $1,700 does the same thing on your desk. GMKtec EVO-X2 - a box the size of a hardcover book. inside it the chip that Lisa Su personally brought on stage at CES and signed with her name. 128GB of memory in one pool. runs models that cloud subscriptions behind $200 paywalls throttle during peak hours. here there are no limits - your hardware, your rules. NVIDIA's RTX 5080 at $1,000+ lost to this box by 3x on a real AI workload. a discrete GPU beaten by a mini PC the size of a lunchbox. electricity - $9 a month. pays for itself in 10 months. after that $440 every month stays in your pocket. the cloud made sense when nothing on a desk could compete. now it can.

Ventry

27,360 görüntüleme • 3 ay önce

AMD CEO Lisa Su showcased a mini PC that could replace your entire AI stack what's changed: - 128GB of unified memory on a single chip - the CPU and GPU share the same memory space - a 235-billion-parameter model can be loaded entirely locally - no cloud, no subscriptions, no logs an active AI user spends around $420 a month on subscriptions - that's $5,280 a year the EVO-X2 costs $1,800 nstall ollama, pull the model, point claude code at localhost. same interface, nothing leaves the machine, nothing costs per request bookmark this and read the article below

AMD CEO Lisa Su showcased a mini PC that could replace your entire AI stack what's changed: - 128GB of unified memory on a single chip - the CPU and GPU share the same memory space - a 235-billion-parameter model can be loaded entirely locally - no cloud, no subscriptions, no logs an active AI user spends around $420 a month on subscriptions - that's $5,280 a year the EVO-X2 costs $1,800 nstall ollama, pull the model, point claude code at localhost. same interface, nothing leaves the machine, nothing costs per request bookmark this and read the article below

kepo

15,451 görüntüleme • 3 ay önce

AMD CEO LISA SU HELD A MINI PC ON STAGE THAT RUNS A 235B MODEL AND REPLACES YOUR $440/MONTH AI STACK amd's ryzen ai max+ 395 is the first x86 chip that runs a 200 billion parameter model on one piece of silicon. cpu and gpu share 128gb of unified memory, no separate graphics card needed the gmktec evo-x2 runs qwen3 235b fully, deepseek v3 comfortably and llama 3.3 70b with headroom. on linux you get 110gb of usable vram out of 128gb amd claimed the chip beat an nvidia rtx 5080 by more than 3x on deepseek r1 inference. a lunchbox sized pc outrunning a $1,000 discrete gpu on a real ai workload a heavy ai user pays $200 for claude code max, $200 for chatgpt pro, $20 for cursor and $20 for gemini. that's $5,280 a year and the box pays itself off in 9 to 10 months install ollama, pull the model, point claude code at localhost. same interface, nothing leaves the machine, nothing costs per request bookmark this and read the article below

AMD CEO LISA SU HELD A MINI PC ON STAGE THAT RUNS A 235B MODEL AND REPLACES YOUR $440/MONTH AI STACK amd's ryzen ai max+ 395 is the first x86 chip that runs a 200 billion parameter model on one piece of silicon. cpu and gpu share 128gb of unified memory, no separate graphics card needed the gmktec evo-x2 runs qwen3 235b fully, deepseek v3 comfortably and llama 3.3 70b with headroom. on linux you get 110gb of usable vram out of 128gb amd claimed the chip beat an nvidia rtx 5080 by more than 3x on deepseek r1 inference. a lunchbox sized pc outrunning a $1,000 discrete gpu on a real ai workload a heavy ai user pays $200 for claude code max, $200 for chatgpt pro, $20 for cursor and $20 for gemini. that's $5,280 a year and the box pays itself off in 9 to 10 months install ollama, pull the model, point claude code at localhost. same interface, nothing leaves the machine, nothing costs per request bookmark this and read the article below

starmex

981,873 görüntüleme • 3 ay önce

$THIS IS WHERE "THE CLOUD" ACTUALLY LIVES - A ROOM OF DELL STORAGE ARRAYS YOU RENT A SLIVER OF EVERY MONTH. that clip is a real datacenter aisle, rack after rack of dell powerstore arrays, every hexagon panel packed with drives. this is "the cloud." not a metaphor, this room, plus the power, cooling and staff keeping it alive. when you pay for cloud storage, you rent a few gigabytes of these arrays. forever. the bill grows with every photo. here's the part they'd rather you not connect. these enterprise drives run on a schedule. data centers swap them out long before they fail, by the pallet. those decommissioned drives get tested and resold as recertified, the same 20tb enterprise disk for a fraction of new. so the exact hardware humming in this room ends up in a nas on your desk, minus the monthly rent. no cloud subscription, no data on someone else's array, no bill that grows with your library. the uncomfortable part isn't that the cloud is huge. it's that "the cloud" was always just this room, and you can buy a piece of it once instead of renting it forever. follow RetroChainer for what the cloud doesn't want you to picture, and bookmark this before your next storage renewal.$

THIS IS WHERE "THE CLOUD" ACTUALLY LIVES - A ROOM OF DELL STORAGE ARRAYS YOU RENT A SLIVER OF EVERY MONTH. that clip is a real datacenter aisle, rack after rack of dell powerstore arrays, every hexagon panel packed with drives. this is "the cloud." not a metaphor, this room, plus the power, cooling and staff keeping it alive. when you pay for cloud storage, you rent a few gigabytes of these arrays. forever. the bill grows with every photo. here's the part they'd rather you not connect. these enterprise drives run on a schedule. data centers swap them out long before they fail, by the pallet. those decommissioned drives get tested and resold as recertified, the same 20tb enterprise disk for a fraction of new. so the exact hardware humming in this room ends up in a nas on your desk, minus the monthly rent. no cloud subscription, no data on someone else's array, no bill that grows with your library. the uncomfortable part isn't that the cloud is huge. it's that "the cloud" was always just this room, and you can buy a piece of it once instead of renting it forever. follow RetroChainer for what the cloud doesn't want you to picture, and bookmark this before your next storage renewal.

RetroChainer

34,236 görüntüleme • 2 ay önce

"just buy a bigger gpu" isn't the only answer to a model too big for one machine. mesh-llm turns every device on your network into one openai-compatible api. no cloud bill. no single point of failure. no manual load balancing. the routing is simple: request > mesh checks local vram > free slot? run it : route to peer > model too big for one box? split across peers as layer stages works as a drop-in backend for goose, claude code, opencode, and pi.

"just buy a bigger gpu" isn't the only answer to a model too big for one machine. mesh-llm turns every device on your network into one openai-compatible api. no cloud bill. no single point of failure. no manual load balancing. the routing is simple: request > mesh checks local vram > free slot? run it : route to peer > model too big for one box? split across peers as layer stages works as a drop-in backend for goose, claude code, opencode, and pi.

Oliver Prompts

20,679 görüntüleme • 2 ay önce

THE CHINESE INSTALLED 6 AI AGENTS RUNNING 24/7 FOR $11 A MONTH. THE BOX UNDER ONE DESK REPLACED $1,200 IN CLOUD SUBSCRIPTIONS. The Minisforum MS-S1 Max ships with 128GB of unified memory shared between CPU and GPU. Qwen3-Coder 30B runs at 40 to 50 tokens per second. 6 agents run simultaneously without anyone watching the meter. An inbox sorter drafts replies every 15 minutes. A research monitor watches 30+ feeds and lands a digest by 7 AM, a job that costs $15 to $20 a day on cloud APIs. The same stack on cloud subscriptions ran $800 to $1,200 a month. The hardware costs $3,000 once. Break-even hits month 3 to 4. The real shift is behavior, not savings. A meeting prep agent never would have justified per-token cost. Running it free overnight made it obvious.

THE CHINESE INSTALLED 6 AI AGENTS RUNNING 24/7 FOR $11 A MONTH. THE BOX UNDER ONE DESK REPLACED $1,200 IN CLOUD SUBSCRIPTIONS. The Minisforum MS-S1 Max ships with 128GB of unified memory shared between CPU and GPU. Qwen3-Coder 30B runs at 40 to 50 tokens per second. 6 agents run simultaneously without anyone watching the meter. An inbox sorter drafts replies every 15 minutes. A research monitor watches 30+ feeds and lands a digest by 7 AM, a job that costs $15 to $20 a day on cloud APIs. The same stack on cloud subscriptions ran $800 to $1,200 a month. The hardware costs $3,000 once. Break-even hits month 3 to 4. The real shift is behavior, not savings. A meeting prep agent never would have justified per-token cost. Running it free overnight made it obvious.

Lummox

14,093 görüntüleme • 3 ay önce

We just shipped Roo Code's first Cloud Agent: the PR Reviewer. It runs Roo in the cloud to deliver instant, high-quality code reviews. And it's BYOK, so it never cheaps out on tokens. Follow our co-founder Matt Rubens on a walk to hear more.

We just shipped Roo Code's first Cloud Agent: the PR Reviewer. It runs Roo in the cloud to deliver instant, high-quality code reviews. And it's BYOK, so it never cheaps out on tokens. Follow our co-founder Matt Rubens on a walk to hear more.

Roo Code

104,249 görüntüleme • 11 ay önce

A $170 AI bill in 10 days is not a cloud problem. It is a routing problem. Most devs send every task to the most expensive brain available. summaries small refactors docs scripts log parsing boilerplate That is how the bill gets stupid. The Mac Mini M4 trade is simple: run routine work locally keep private code on your desk pay once for hardware save frontier models for hard calls Local AI does not beat Claude at everything. It does not need to. It only needs to replace the boring prompts that never needed a frontier model in the first place. Cloud AI stays. The default route changes. Full breakdown below ↓

A $170 AI bill in 10 days is not a cloud problem. It is a routing problem. Most devs send every task to the most expensive brain available. summaries small refactors docs scripts log parsing boilerplate That is how the bill gets stupid. The Mac Mini M4 trade is simple: run routine work locally keep private code on your desk pay once for hardware save frontier models for hard calls Local AI does not beat Claude at everything. It does not need to. It only needs to replace the boring prompts that never needed a frontier model in the first place. Cloud AI stays. The default route changes. Full breakdown below ↓

Fluixo

35,295 görüntüleme • 1 ay önce

NVIDIA'S BIGGEST COMPETITOR AMD BUILT A BOX THAT RUNS A 235B MODEL AND KILLS $200 OPENAI AND $200 CLAUDE CODE FOR $9 A MONTH amd's ryzen ai max+ 395 is the first x86 chip that runs a 200 billion parameter model on a single piece of silicon with 128gb of unified memory the gmktec evo-x2 runs qwen3 235b fully, deepseek v3 comfortably and llama 3.3 70b with headroom. on linux you get 110gb of usable vram out of 128gb amd claimed the chip beat an nvidia rtx 5080 by more than 3x on deepseek r1 inference. a lunchbox sized pc outrunning a $1,000 discrete gpu on a real ai workload a heavy ai user pays $200 for claude code max, $200 for chatgpt pro, $20 for cursor and $20 for gemini. that's $5,280 a year and the box pays itself off in 9 to 10 months ollama installs in one command and claude code points at localhost so nothing leaves the machine and nothing costs per request bookmark this and read the article below

NVIDIA'S BIGGEST COMPETITOR AMD BUILT A BOX THAT RUNS A 235B MODEL AND KILLS $200 OPENAI AND $200 CLAUDE CODE FOR $9 A MONTH amd's ryzen ai max+ 395 is the first x86 chip that runs a 200 billion parameter model on a single piece of silicon with 128gb of unified memory the gmktec evo-x2 runs qwen3 235b fully, deepseek v3 comfortably and llama 3.3 70b with headroom. on linux you get 110gb of usable vram out of 128gb amd claimed the chip beat an nvidia rtx 5080 by more than 3x on deepseek r1 inference. a lunchbox sized pc outrunning a $1,000 discrete gpu on a real ai workload a heavy ai user pays $200 for claude code max, $200 for chatgpt pro, $20 for cursor and $20 for gemini. that's $5,280 a year and the box pays itself off in 9 to 10 months ollama installs in one command and claude code points at localhost so nothing leaves the machine and nothing costs per request bookmark this and read the article below

starmex

93,580 görüntüleme • 3 ay önce

TWO BOXES THE SIZE OF A MAC MINI JUST RAN A 235 BILLION PARAMETER MODEL ON A DESK It is two NVIDIA DGX Spark units linked by a single cable. A year ago a model this size meant renting a GPU cluster by the hour. Now it sits next to your monitor for around $8,000. Here is the twist most people miss. Linking them does not create one shared 256GB memory pool. The model is split across both boxes, and that is the only reason a 235B model fits at all. It answers at roughly 10 tokens per second, and both chips sit at just 74 degrees while sipping around 50 watts. Every token stays on the desk. Nothing touches a cloud, and nothing leaves the room. The ceiling for what you can run at home just jumped from 70B to 235B. Bookmark this & Watch it run ↓

TWO BOXES THE SIZE OF A MAC MINI JUST RAN A 235 BILLION PARAMETER MODEL ON A DESK It is two NVIDIA DGX Spark units linked by a single cable. A year ago a model this size meant renting a GPU cluster by the hour. Now it sits next to your monitor for around $8,000. Here is the twist most people miss. Linking them does not create one shared 256GB memory pool. The model is split across both boxes, and that is the only reason a 235B model fits at all. It answers at roughly 10 tokens per second, and both chips sit at just 74 degrees while sipping around 50 watts. Every token stays on the desk. Nothing touches a cloud, and nothing leaves the room. The ceiling for what you can run at home just jumped from 70B to 235B. Bookmark this & Watch it run ↓

slash1s

101,317 görüntüleme • 3 ay önce

What Lisa Su actually held on stage: A mini PC the size of a lunchbox running Qwen3-235B locally, with no cloud and no discrete GPU Inside: the Ryzen AI Max+ 395, 128GB unified memory, 110GB usable as VRAM on Linux The first x86 chip that handles 200+ billion parameters on a single die AMD claims it beats the RTX 5080 by several times on memory-bound models — because the 5080 simply cannot fit them $1,400 to $2,500 once. cloud bills run $200 to $400 a month It pays for itself in a few months, then costs nothing per request This is not a faster GPU. it is the first real argument that your AI does not belong in someone else's data center

What Lisa Su actually held on stage: A mini PC the size of a lunchbox running Qwen3-235B locally, with no cloud and no discrete GPU Inside: the Ryzen AI Max+ 395, 128GB unified memory, 110GB usable as VRAM on Linux The first x86 chip that handles 200+ billion parameters on a single die AMD claims it beats the RTX 5080 by several times on memory-bound models — because the 5080 simply cannot fit them $1,400 to $2,500 once. cloud bills run $200 to $400 a month It pays for itself in a few months, then costs nothing per request This is not a faster GPU. it is the first real argument that your AI does not belong in someone else's data center

plutos

1,239,076 görüntüleme • 3 ay önce

> you pay $5,000 a year for AI > and still ration every request > AMD just broke that math > Ryzen AI Max+ 395. 200B on one die. > EVO-X2. Claude Code. one evening. > one variable and Claude Code points at your room > nothing leaves the network. nothing on the meter. > stop paying per token stop rationing > the edge isn't the cloud. it's the meter being off.

> you pay $5,000 a year for AI > and still ration every request > AMD just broke that math > Ryzen AI Max+ 395. 200B on one die. > EVO-X2. Claude Code. one evening. > one variable and Claude Code points at your room > nothing leaves the network. nothing on the meter. > stop paying per token stop rationing > the edge isn't the cloud. it's the meter being off.

RetroChainer

81,891 görüntüleme • 3 ay önce