Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

THIS BUILDER JUST DROPPED 256GB OF RAM INTO A MONSTER THREADRIPPER WORKSTATION TO RUN UNFILTERED LOCAL AI Imagine trying to fit a computer setup into a chassis that is basically the size of a mini fridge. That is the Corsair 1000D tower. The builder crammed an ASUS Pro WS... WRX80E-SAGE motherboard inside and slapped a 64-core AMD Threadripper PRO 5995WX right into the socket Why go this heavy? Simple. To make sure local open weights models don't instantly choke standard desktop hardware during heavy reasoning tasks Then things get downright ridiculous with the memory configuration. He unboxes eight separate Kingston DDR4 modules, pinning a massive 256 gigabytes of system RAM directly to the board. Having that kind of local memory headroom is an absolute necessity if a team wants to handle massive datasets or run dense training loops without constantly swapping data to the storage drives Speaking of storage, the system relies on two lightning fast 2TB Samsung 990 PRO NVMe drives For the graphics pipeline, he drops in a top-tier ASUS ROG RTX 4090 boasting 24 gigabytes of VRAM. That is pretty much the gold standard right now if you want to run quick local inference cycles and completely stop paying corporate cloud token fees to OpenAI or Anthropic Powering this whole grid requires a monstrous ASUS ROG 1600W Thor Gen 2 power supply. And to prevent the entire workstation from turning into a space heater under full load, the builder went all out with a 360mm AIO liquid cooling setup and an insane cluster of sixteen Lian Li SL-Infinity RGB fans It looks incredibly flashy, probably sounds like a jet engine when the cores push maximum load What to buy for local AI? => my guide below Bookmark this so you don't lose itshow more

beamnxw ./

5,837 subscribers

47,494 views • 2 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Someone put 1TB of RAM and 48GB of VRAM into a workstation just to run AI. This is an HP Z8 G4 with two 24-core Xeons, 96 threads, 1TB of RAM and an NVIDIA RTX A6000. On paper, it looks excessive. But for local AI, there’s a reason this kind of hardware still makes sense. The A6000 has 48GB of VRAM, while the system has another 1TB of RAM behind it. That gives you a lot more room for large models without immediately running into memory limits. The interesting part is that none of this is cutting-edge hardware. It’s an older workstation being reused for a workload that didn’t exist at this scale when the machine was designed. And that’s becoming one of the best things about Local AI: you don't always need new hardware. Sometimes you just need enough memory.

Someone put 1TB of RAM and 48GB of VRAM into a workstation just to run AI. This is an HP Z8 G4 with two 24-core Xeons, 96 threads, 1TB of RAM and an NVIDIA RTX A6000. On paper, it looks excessive. But for local AI, there’s a reason this kind of hardware still makes sense. The A6000 has 48GB of VRAM, while the system has another 1TB of RAM behind it. That gives you a lot more room for large models without immediately running into memory limits. The interesting part is that none of this is cutting-edge hardware. It’s an older workstation being reused for a workload that didn’t exist at this scale when the machine was designed. And that’s becoming one of the best things about Local AI: you don't always need new hardware. Sometimes you just need enough memory.

KyzoroX

69,953 views • 1 month ago

THIS $1,300 CARD HAS THE SAME 32GB OF VRAM AS A $2,000+ RTX 5090 - FOR LOCAL AI, THAT'S THE SPEC THAT DECIDES EVERYTHING. that clip is the gigabyte radeon ai pro r9700 ai top, 32gb of vram, built for local ai. the pitch is simple: the same memory capacity as an rtx 5090, for roughly a third of what a 5090 actually sells for. here's why that matters, and where it doesn't. for ai, vram is the gate. a model either fits in memory or it doesn't. 32gb loads models a 16gb card can't touch, full stop. so for running local llms and image models, this card does the one thing that counts, cheap. honest line: this is not a 5090 for gaming. the 5090 is far faster at raster and ray tracing. they only match on how much vram they carry. if you want frames, buy the 5090. if you want to fit big models locally, you just found the same 32gb for a third of the money. no $2,000+ price tag, no cloud gpu rental, no model too big for 16gb. the uncomfortable part isn't that amd is cheaper. it's that for local ai you were about to overpay for gaming power you'd never use. follow RetroChainer for more on paying for the spec that matters, and bookmark this before your next gpu.

THIS $1,300 CARD HAS THE SAME 32GB OF VRAM AS A $2,000+ RTX 5090 - FOR LOCAL AI, THAT'S THE SPEC THAT DECIDES EVERYTHING. that clip is the gigabyte radeon ai pro r9700 ai top, 32gb of vram, built for local ai. the pitch is simple: the same memory capacity as an rtx 5090, for roughly a third of what a 5090 actually sells for. here's why that matters, and where it doesn't. for ai, vram is the gate. a model either fits in memory or it doesn't. 32gb loads models a 16gb card can't touch, full stop. so for running local llms and image models, this card does the one thing that counts, cheap. honest line: this is not a 5090 for gaming. the 5090 is far faster at raster and ray tracing. they only match on how much vram they carry. if you want frames, buy the 5090. if you want to fit big models locally, you just found the same 32gb for a third of the money. no $2,000+ price tag, no cloud gpu rental, no model too big for 16gb. the uncomfortable part isn't that amd is cheaper. it's that for local ai you were about to overpay for gaming power you'd never use. follow RetroChainer for more on paying for the spec that matters, and bookmark this before your next gpu.

RetroChainer

38,844 views • 1 month ago

We used to buy more VRAM. Now we’re finding ways around the VRAM limit. This little DDR5 SO-DIMM setup is paired with an old NVIDIA Tesla P40 in the video. The P40 is an old datacenter GPU with 24GB of VRAM. By today’s standards, it’s not fast. But combine that with a machine carrying 128GB of system memory, and suddenly you have a very different local AI box. The GPU handles what it’s good at. The system memory gives the model somewhere to go when VRAM runs out. You obviously pay for that with bandwidth and inference speed. But this is the part I find interesting: Local AI is making “how much memory do I have?” almost as important as “how powerful is my GPU?” We’ve spent years chasing faster GPUs. Maybe the next wave of local AI hardware will be about finding smarter ways to use all the memory we already have. More VRAM is still better. But it’s no longer the only way to run a bigger model.

We used to buy more VRAM. Now we’re finding ways around the VRAM limit. This little DDR5 SO-DIMM setup is paired with an old NVIDIA Tesla P40 in the video. The P40 is an old datacenter GPU with 24GB of VRAM. By today’s standards, it’s not fast. But combine that with a machine carrying 128GB of system memory, and suddenly you have a very different local AI box. The GPU handles what it’s good at. The system memory gives the model somewhere to go when VRAM runs out. You obviously pay for that with bandwidth and inference speed. But this is the part I find interesting: Local AI is making “how much memory do I have?” almost as important as “how powerful is my GPU?” We’ve spent years chasing faster GPUs. Maybe the next wave of local AI hardware will be about finding smarter ways to use all the memory we already have. More VRAM is still better. But it’s no longer the only way to run a bigger model.

KyzoroX

35,554 views • 19 days ago

THIS BUILDER JUST LINKED FORTY RTX 3090s IN HIS BEDROOM TO BYPASS THE CLOUD AND RUN 1TB OF LOCAL VRAM. WHY DOES HE HAVE SO MUCH?? Let that number sink in for a minute. Nearly a full terabyte of raw, unadulterated VRAM sitting right next to someone's bed. With forty RTX 3090s linked up in a custom rack, you aren't just running basic local chat models anymore You are essentially operating a localized data center. It completely changes the math on what you can actually execute without a cloud subscription For starters, you can comfortably host giant, fully unquantized open weights models. I'm talking about running massive enterprise reasoning architectures like DeepSeek-R1 671B or dense Llama 405B models at full precision. Most people have to slice these models down, compressing them until they lose their edge. On a rig like this, they run completely uncompressed But it gets weirder. You can launch massive multi-agent autonomous swarms. Imagine spinning up 300 to 400 distinct AI agents simultaneously ➜ each running its own heavy coding or data-scraping loops ➜ and letting them interact in real time + You can build a massive, real-time semantic search engine over your entire digital life. You could feed decades of personal data, code repositories, thousands of books, and full video transcriptions into a localized vector database. The system can keep the entire index permanently hot in the graphics memory. It gives you instant, sub-millisecond semantic search across millions of data points. A true, zero-latency second brain that never phones home and never risks a data leak Bookmark this so you don't lose it

THIS BUILDER JUST LINKED FORTY RTX 3090s IN HIS BEDROOM TO BYPASS THE CLOUD AND RUN 1TB OF LOCAL VRAM. WHY DOES HE HAVE SO MUCH?? Let that number sink in for a minute. Nearly a full terabyte of raw, unadulterated VRAM sitting right next to someone's bed. With forty RTX 3090s linked up in a custom rack, you aren't just running basic local chat models anymore You are essentially operating a localized data center. It completely changes the math on what you can actually execute without a cloud subscription For starters, you can comfortably host giant, fully unquantized open weights models. I'm talking about running massive enterprise reasoning architectures like DeepSeek-R1 671B or dense Llama 405B models at full precision. Most people have to slice these models down, compressing them until they lose their edge. On a rig like this, they run completely uncompressed But it gets weirder. You can launch massive multi-agent autonomous swarms. Imagine spinning up 300 to 400 distinct AI agents simultaneously ➜ each running its own heavy coding or data-scraping loops ➜ and letting them interact in real time + You can build a massive, real-time semantic search engine over your entire digital life. You could feed decades of personal data, code repositories, thousands of books, and full video transcriptions into a localized vector database. The system can keep the entire index permanently hot in the graphics memory. It gives you instant, sub-millisecond semantic search across millions of data points. A true, zero-latency second brain that never phones home and never risks a data leak Bookmark this so you don't lose it

beamnxw ./

28,263 views • 2 months ago

A 2TB HOME AI SUPERCOMPUTER CAN RUN MODELS MOST PEOPLE STILL RENT FROM THE CLOUD The video is not about a clean desk setup. It is a local AI rack: multiple mini-machines stitched together, 2TB of memory, enough compute to run heavyweight models like DeepSeek 671B without asking AWS for permission every hour. That matters because the cloud version of AI looks cheap until you use it like infrastructure. Agents running all day. Private docs. Long context. Local storage. Experiments. Fine-tuning. Automation. Suddenly the bill is not $20/month anymore. This setup is the opposite trade. Pay upfront, own the machine, keep the data local, and stop treating every serious AI workload like a subscription meter. The article is pointing at the same bigger shift: serious builders are moving from "which chatbot is best" to "where does my intelligence actually run." Cloud is convenient. Local compute is control. The next edge is not just better prompts. It is owning the box that keeps thinking when the browser tab is closed.

A 2TB HOME AI SUPERCOMPUTER CAN RUN MODELS MOST PEOPLE STILL RENT FROM THE CLOUD The video is not about a clean desk setup. It is a local AI rack: multiple mini-machines stitched together, 2TB of memory, enough compute to run heavyweight models like DeepSeek 671B without asking AWS for permission every hour. That matters because the cloud version of AI looks cheap until you use it like infrastructure. Agents running all day. Private docs. Long context. Local storage. Experiments. Fine-tuning. Automation. Suddenly the bill is not $20/month anymore. This setup is the opposite trade. Pay upfront, own the machine, keep the data local, and stop treating every serious AI workload like a subscription meter. The article is pointing at the same bigger shift: serious builders are moving from "which chatbot is best" to "where does my intelligence actually run." Cloud is convenient. Local compute is control. The next edge is not just better prompts. It is owning the box that keeps thinking when the browser tab is closed.

Nekt0

54,445 views • 3 months ago

Local AI 101: open models, Hugging Face, and businesses to build (38 min masterclass) I still think cloud AI is the default for most things, and honestly it should be, the frontier models are the strongest and easiest to use. But something shifted in the last 4-5 months. You can now run genuinely good open models directly on your own laptop, or even your phone. And once you actually try it, it changes how you think about what AI is even for. LOCAL AI, CLEARLY EXPLAINED: 1. The model is the brain doing the thinking. Gemma, Llama, Mistral, and Qwen are the main families, and each is better at different things, some at reasoning, some at coding, some small enough to run on a phone. 2. Hugging Face is the warehouse where you find them. You go there to see what each model is good at, check the license, and grab the compressed versions that run on a normal computer. 3. The software is what runs the model on your machine. Start with LM Studio if you're not technical, it feels like a normal app where you search, download, and start chatting. Ollama is the one you reach for when you want to plug a model into your own apps. 4. The workflow is the actual product you build on top of it all. That's what I'm ideating around for some businesses to create. I think local AI just made a specific kind of business way easier to start. Find an industry that: 1. Sits on sensitive data they'd never paste into ChatGPT 2. Does the same review over and over 3. Runs on software from 2003 Then build a local AI tool that does that review on their own machine, so the data never leaves the building! Take home health agencies. Nurses write visit notes all day, and if a note is missing a detail, the billing gets denied or the audit flags it. Here's how I'd start: 1. Find 5 small agencies. Offer to review a batch of their notes for them. 2. Run the notes through Gemma locally (free, private, no cloud). Read every output yourself. 3. Write down the 20 issues that keep showing up: missing vitals, vague med changes, notes that don't support the billed level. 4. That list of 20 is your checklist. The checklist is the product. 5. Turn it into a local desktop app that flags those 20 things before a note gets submitted. You just went from a service anyone could offer to a product nobody else has, and you learned exactly what to build by doing the work by hand first. Same recipe works for restoration contractors (draft the damage report on-site before the tech leaves) and wealth advisors (catch the compliance landmine in a client email before it sends). Basically the framework is sensitive data, repeated review, ancient software. I think there are tons of businesses like this! Almost none of it clicked for me until I actually started using local AI. So if you take one thing from this, go run a model on your own machine once. Also a fun thing to try with your friends. Feel free to send this to a friend. The episode is live for free on The Startup Ideas Podcast (SIP) 🧃 (thanks to Google for sponsoring today's episode and supporting local AI) I feel like local AI one of those things you need to try for it to really click. Run one model on your own machine and you'll see what I mean! I go way deeper in the full 38 minute masterclass, the models, the setup, and the businesses to build. Link below. LINK TO WATCH: OR WATCH BELOW ON X What do you think of local AI?

Local AI 101: open models, Hugging Face, and businesses to build (38 min masterclass) I still think cloud AI is the default for most things, and honestly it should be, the frontier models are the strongest and easiest to use. But something shifted in the last 4-5 months. You can now run genuinely good open models directly on your own laptop, or even your phone. And once you actually try it, it changes how you think about what AI is even for. LOCAL AI, CLEARLY EXPLAINED: 1. The model is the brain doing the thinking. Gemma, Llama, Mistral, and Qwen are the main families, and each is better at different things, some at reasoning, some at coding, some small enough to run on a phone. 2. Hugging Face is the warehouse where you find them. You go there to see what each model is good at, check the license, and grab the compressed versions that run on a normal computer. 3. The software is what runs the model on your machine. Start with LM Studio if you're not technical, it feels like a normal app where you search, download, and start chatting. Ollama is the one you reach for when you want to plug a model into your own apps. 4. The workflow is the actual product you build on top of it all. That's what I'm ideating around for some businesses to create. I think local AI just made a specific kind of business way easier to start. Find an industry that: 1. Sits on sensitive data they'd never paste into ChatGPT 2. Does the same review over and over 3. Runs on software from 2003 Then build a local AI tool that does that review on their own machine, so the data never leaves the building! Take home health agencies. Nurses write visit notes all day, and if a note is missing a detail, the billing gets denied or the audit flags it. Here's how I'd start: 1. Find 5 small agencies. Offer to review a batch of their notes for them. 2. Run the notes through Gemma locally (free, private, no cloud). Read every output yourself. 3. Write down the 20 issues that keep showing up: missing vitals, vague med changes, notes that don't support the billed level. 4. That list of 20 is your checklist. The checklist is the product. 5. Turn it into a local desktop app that flags those 20 things before a note gets submitted. You just went from a service anyone could offer to a product nobody else has, and you learned exactly what to build by doing the work by hand first. Same recipe works for restoration contractors (draft the damage report on-site before the tech leaves) and wealth advisors (catch the compliance landmine in a client email before it sends). Basically the framework is sensitive data, repeated review, ancient software. I think there are tons of businesses like this! Almost none of it clicked for me until I actually started using local AI. So if you take one thing from this, go run a model on your own machine once. Also a fun thing to try with your friends. Feel free to send this to a friend. The episode is live for free on The Startup Ideas Podcast (SIP) 🧃 (thanks to Google for sponsoring today's episode and supporting local AI) I feel like local AI one of those things you need to try for it to really click. Run one model on your own machine and you'll see what I mean! I go way deeper in the full 38 minute masterclass, the models, the setup, and the businesses to build. Link below. LINK TO WATCH: OR WATCH BELOW ON X What do you think of local AI?

GREG ISENBERG

32,410 views • 20 days ago

THIS GUY WIRED GMKTEC EVO-X2 BOXES, A $40 USB-C BRICK AND AN RTX 3090 INTO A $6,800/MONTH OFFLINE AI FARM it looks like a messy rack with purple cables, mini pcs and a gpu lying on the desk. but the real point is brutal: one $1,800 gmktec evo-x2 can replace a $440/month ai stack, then the rack turns it into a local backend. the evo-x2 runs amd’s ryzen ai max+ 395 with 128gb of unified memory shared between cpu, gpu and npu. on linux, that gives up to 110gb of usable vram for local models without renting cloud compute. that is why the setup gets weird. qwen3-coder 30b, llama 3.3 70b, deepseek v3 and 200b-class models can run from boxes smaller than consoles. the rtx 3090 becomes a 24gb side node, not the whole system. the $40 anker nano ii 65w brick is the funny part. cheap power, tiny machines, one old gpu and local inference. the whole stack starts looking less like a workstation and more like a private ai grid. the subscription math is ugly. claude code max is $200/month, chatgpt pro is $200/month, cursor is $20/month and gemini adds another $20. that is $5,280/year before api usage even starts. point claude code at localhost, pull models through ollama and run agents all day: code reviews, scraping, transcription, research reports and client automations. 3 clients at $2,200/month turns this into a $6,800/month backend. bookmark this and read the article below

THIS GUY WIRED GMKTEC EVO-X2 BOXES, A $40 USB-C BRICK AND AN RTX 3090 INTO A $6,800/MONTH OFFLINE AI FARM it looks like a messy rack with purple cables, mini pcs and a gpu lying on the desk. but the real point is brutal: one $1,800 gmktec evo-x2 can replace a $440/month ai stack, then the rack turns it into a local backend. the evo-x2 runs amd’s ryzen ai max+ 395 with 128gb of unified memory shared between cpu, gpu and npu. on linux, that gives up to 110gb of usable vram for local models without renting cloud compute. that is why the setup gets weird. qwen3-coder 30b, llama 3.3 70b, deepseek v3 and 200b-class models can run from boxes smaller than consoles. the rtx 3090 becomes a 24gb side node, not the whole system. the $40 anker nano ii 65w brick is the funny part. cheap power, tiny machines, one old gpu and local inference. the whole stack starts looking less like a workstation and more like a private ai grid. the subscription math is ugly. claude code max is $200/month, chatgpt pro is $200/month, cursor is $20/month and gemini adds another $20. that is $5,280/year before api usage even starts. point claude code at localhost, pull models through ollama and run agents all day: code reviews, scraping, transcription, research reports and client automations. 3 clients at $2,200/month turns this into a $6,800/month backend. bookmark this and read the article below

Gipp 🦅

20,031 views • 3 months ago

Don't Buy a Mac Mini for Clawdbot: The Secret $10,000 Architecture That Costs You Nothing clawdbot might be the reason you feel like you need a ten thousand dollar computer right now but i am about to show you why that fomo is going to leave you broke. if you have been watching everyone rush out to buy mac minis and mac studios just to run open claw or some local models you are witnessing a massive transfer of wealth from your pocket to apple for no reason. there is a specific setup i use that costs almost nothing and keeps my main machine safe from whatever these autonomous agents are doing. if you stick with me i will walk you through the exact architecture of a professional trading system that handles the heavy lifting without you needing to drop a single rack on hardware most people are scared of running these bots on their main computer because they don't want an agent messing with their personal files or browser sessions. instead of buying a second mac mini for six hundred dollars you can just go to the top left of your screen and create a brand new user profile. this acts like a completely isolated sandbox where you can install all your trading tools and agents without them ever seeing your main data. it is essentially like getting a free computer for the price of five minutes of clicking around your settings but what if you aren't on a mac or you need to access your system while you are traveling without carrying three laptops in your backpack. this is where the first loop of professional automation starts to close because i use something called chrome remote desktop to bridge the gap. this allows me to leave a dedicated machine running in a safe place while i access the full desktop environment from a tablet or a cheap laptop anywhere in the world. it solves the mobility issue but it still doesn't solve the problem of those massive ten thousand dollar price tags for high end mac pros if you are a pc user or just someone who doesn't want to own physical hardware yet you should look into a windows vps through a provider like contabo. most developers will tell you to use a linux terminal but if you aren't a coder yet you need a visual interface you can actually see. getting a windows server allows you to log in and see a desktop just like your home computer for about fifteen dollars a month. i usually recommend at least twelve gigabytes of ram to keep things from getting janky when you are running multiple browser windows and agents at once now you might be thinking that the whole point of the big hardware was to run local models like kimi or glm to save on api costs. i spent years thinking i had to own the machines myself and i even spent hundreds of thousands on developers before i realized i could just do this myself. the secret to running those massive open source models without the ten thousand dollar investment is renting gpu power by the hour. sites like lambda labs let you spin up a monster machine that can run any model in existence for just a couple dollars an hour this is the ultimate pivot because it allows you to test if your strategy actually prints money before you commit to the hardware. you can turn the server on when you are iterating and turn it off the second you are done which keeps your overhead near zero. if you haven't proven that your bot can pay for itself yet then buying a mac studio is just an expensive hobby rather than a business move. there is a much bigger loophole involving the anthropic subscriptions that most people are completely overlooking right now right now i am using a specific plan with claude code that costs about two hundred dollars a month but it lets me run open claw all day without hitting api limits. if i were paying for those same tokens through the standard api i would probably be spending hundreds of dollars every single day. it is a massive cost savings that allows you to iterate and fail until you find a winning strategy without draining your bank account. even if they eventually close this loophole or snitch on the usage patterns it serves as the perfect training ground for a data dog the goal is to find a system that works with a smaller or cheaper model like haiku before you ever try to scale up to the heavy weights. if you can make a strategy profitable using a less intelligent and cheaper model then you know you have found real alpha. once you have that foundation you can decide if it finally makes sense to build your own custom pc rig which will always be half the price of an apple machine. i am an apple guy so i usually pay the tax anyway but i only do it once the system is already generating enough to cover the cost ten times over i believe that code is the great equalizer because it took me from losing money and getting liquidated to having fully automated systems doing the work for me. i had to learn to live with the iterations and the failures on youtube to get to this point of clarity. the universe tends to get out of your way once you make a non negotiable contract with yourself to see the process through to the end. you don't need the flashy hardware or the most expensive setup to start winning in this game stay focused on the logic and the data rather than the hype and the fomo that everyone else is falling for. if you can master the bridge between renting power and owning your logic you will be ahead of ninety nine percent of the people in this space. the path to a fully automated life isn't paved with expensive gadgets but with the discipline to iterate until the system finally prints

Moon Dev

17,382 views • 7 months ago

The easiest way to run your agent harnesses using local models: Whether you're using Claude Code, Codex, OpenCode, or Pi, the local setup itself isn't really the hard part. The harder problem is figuring out which local model your machine can actually handle well. You have to think about RAM, model size, quantization, context length, KV cache, speed, accuracy, and a bunch of other trade-offs before you even start. Magnitude is an open-source solution that removes all of that guesswork for you. It profiles your machine, benchmarks what it can realistically run, recommends the best models for your hardware, and then lets you connect them to your preferred agent harness. The entire setup takes just two commands. In this video, I walk through the full process from hardware profiling to running a harness on a local model. Chapters: 00:00 Intro 00:17 What Magnitude is 00:45 Setup in two commands 01:29 Why picking a local model gets confusing fast 02:11 Hardware profiling + model recommendations 02:59 Choosing your harness 03:22 Connecting a harness that's already running 04:18 Outro Get started: (don't forget to star 🌟)

The easiest way to run your agent harnesses using local models: Whether you're using Claude Code, Codex, OpenCode, or Pi, the local setup itself isn't really the hard part. The harder problem is figuring out which local model your machine can actually handle well. You have to think about RAM, model size, quantization, context length, KV cache, speed, accuracy, and a bunch of other trade-offs before you even start. Magnitude is an open-source solution that removes all of that guesswork for you. It profiles your machine, benchmarks what it can realistically run, recommends the best models for your hardware, and then lets you connect them to your preferred agent harness. The entire setup takes just two commands. In this video, I walk through the full process from hardware profiling to running a harness on a local model. Chapters: 00:00 Intro 00:17 What Magnitude is 00:45 Setup in two commands 01:29 Why picking a local model gets confusing fast 02:11 Hardware profiling + model recommendations 02:59 Choosing your harness 03:22 Connecting a harness that's already running 04:18 Outro Get started: (don't forget to star 🌟)

Akshay 🚀

18,722 views • 13 days ago

THIS DEVELOPER TURNED A $599 MAC MINI AND $110 OF EXTRA HARDWARE INTO A PRIVATE AI COMPUTER THAT FITS IN A BACKPACK 00:49 he takes the complete setup out of the bag, connects it to a nearby screen and restores the same desktop, files and running tools in less than a minute. instead of syncing a new laptop every time he moves, the mac mini carries the original obsidian vault, claude code sessions, local models and unfinished agent tasks between every desk. the 10,000mah battery can keep the machine running for roughly 2 to 4 hours during writing, research and file organization, or around 60 to 90 minutes under heavier transcription and local ai workloads. the full build costs close to $710 if a screen is already available. that includes the mac mini, a 55w battery, the side mount and the cables needed to connect it to an ipad, hotel tv or office monitor. one box can carry 12,000 notes, 300gb of private files and several active agents without sending the data to another cloud account or rebuilding the workspace every time he changes locations.

THIS DEVELOPER TURNED A $599 MAC MINI AND $110 OF EXTRA HARDWARE INTO A PRIVATE AI COMPUTER THAT FITS IN A BACKPACK 00:49 he takes the complete setup out of the bag, connects it to a nearby screen and restores the same desktop, files and running tools in less than a minute. instead of syncing a new laptop every time he moves, the mac mini carries the original obsidian vault, claude code sessions, local models and unfinished agent tasks between every desk. the 10,000mah battery can keep the machine running for roughly 2 to 4 hours during writing, research and file organization, or around 60 to 90 minutes under heavier transcription and local ai workloads. the full build costs close to $710 if a screen is already available. that includes the mac mini, a 55w battery, the side mount and the cables needed to connect it to an ipad, hotel tv or office monitor. one box can carry 12,000 notes, 300gb of private files and several active agents without sending the data to another cloud account or rebuilding the workspace every time he changes locations.

Gipp 🦅

30,550 views • 3 months ago

$THIS IS WHERE "THE CLOUD" ACTUALLY LIVES - A ROOM OF DELL STORAGE ARRAYS YOU RENT A SLIVER OF EVERY MONTH. that clip is a real datacenter aisle, rack after rack of dell powerstore arrays, every hexagon panel packed with drives. this is "the cloud." not a metaphor, this room, plus the power, cooling and staff keeping it alive. when you pay for cloud storage, you rent a few gigabytes of these arrays. forever. the bill grows with every photo. here's the part they'd rather you not connect. these enterprise drives run on a schedule. data centers swap them out long before they fail, by the pallet. those decommissioned drives get tested and resold as recertified, the same 20tb enterprise disk for a fraction of new. so the exact hardware humming in this room ends up in a nas on your desk, minus the monthly rent. no cloud subscription, no data on someone else's array, no bill that grows with your library. the uncomfortable part isn't that the cloud is huge. it's that "the cloud" was always just this room, and you can buy a piece of it once instead of renting it forever. follow RetroChainer for what the cloud doesn't want you to picture, and bookmark this before your next storage renewal.$

THIS IS WHERE "THE CLOUD" ACTUALLY LIVES - A ROOM OF DELL STORAGE ARRAYS YOU RENT A SLIVER OF EVERY MONTH. that clip is a real datacenter aisle, rack after rack of dell powerstore arrays, every hexagon panel packed with drives. this is "the cloud." not a metaphor, this room, plus the power, cooling and staff keeping it alive. when you pay for cloud storage, you rent a few gigabytes of these arrays. forever. the bill grows with every photo. here's the part they'd rather you not connect. these enterprise drives run on a schedule. data centers swap them out long before they fail, by the pallet. those decommissioned drives get tested and resold as recertified, the same 20tb enterprise disk for a fraction of new. so the exact hardware humming in this room ends up in a nas on your desk, minus the monthly rent. no cloud subscription, no data on someone else's array, no bill that grows with your library. the uncomfortable part isn't that the cloud is huge. it's that "the cloud" was always just this room, and you can buy a piece of it once instead of renting it forever. follow RetroChainer for what the cloud doesn't want you to picture, and bookmark this before your next storage renewal.

RetroChainer

34,236 views • 1 month ago

ELON MUSK: The only way to reach 1,000 terawatts of AI power is a mass driver on the Moon. "In order to get to 1,000x from a terawatt per year. The only way that we can really achieve that is on the moon with a mass driver, essentially where you do local production of photovoltaics and radiators on the moon, maybe you bring the chips from Earth, or you could conceivably make the chips on the moon, and but you need most of the mass to be made on the moon, so you don't have to transport it to the moon from Earth, and then because the moon has no atmosphere and only 1/6 Earth's gravity, you can accelerate the AI satellites into deep space without a rocket, so you can basically shoot them into space using an electromagnetic gun, like a, like a rail gun type. I mean, just, it's basically a linear electric motor, as a way to think about it."

ELON MUSK: The only way to reach 1,000 terawatts of AI power is a mass driver on the Moon. "In order to get to 1,000x from a terawatt per year. The only way that we can really achieve that is on the moon with a mass driver, essentially where you do local production of photovoltaics and radiators on the moon, maybe you bring the chips from Earth, or you could conceivably make the chips on the moon, and but you need most of the mass to be made on the moon, so you don't have to transport it to the moon from Earth, and then because the moon has no atmosphere and only 1/6 Earth's gravity, you can accelerate the AI satellites into deep space without a rocket, so you can basically shoot them into space using an electromagnetic gun, like a, like a rail gun type. I mean, just, it's basically a linear electric motor, as a way to think about it."

DogeDesigner

122,518 views • 3 months ago

Just found an open-source tool that lets you see how well an AI can actually use a computer. it’s called OSWorld 2.0. you give the AI a real task on a computer, then watch to see if it can figure everything out and finish it. it gives you: → real computer tasks, not simple questions → tasks that can take many steps to finish → the same computer setup for every AI → websites made for testing → all the files and tasks for free this is also the environment used to test computer-use systems from OpenAI and Anthropic. so if you’re building AI agents, researching computer use, or just want to see what these models can actually do, you can run the same tests yourself instead of relying only on benchmark scores. the labs publish the scores. this repo is where the actual tests come from. bookmark this.

Just found an open-source tool that lets you see how well an AI can actually use a computer. it’s called OSWorld 2.0. you give the AI a real task on a computer, then watch to see if it can figure everything out and finish it. it gives you: → real computer tasks, not simple questions → tasks that can take many steps to finish → the same computer setup for every AI → websites made for testing → all the files and tasks for free this is also the environment used to test computer-use systems from OpenAI and Anthropic. so if you’re building AI agents, researching computer use, or just want to see what these models can actually do, you can run the same tests yourself instead of relying only on benchmark scores. the labs publish the scores. this repo is where the actual tests come from. bookmark this.

MIKE

14,387 views • 16 days ago

This is Serious 🚨 US Government voting on new regulations this November that are so expensive they will force small ranchers out of business Mandating new equipment that will cost up to $2.3 million plus $500k to install and regulate each year “This is an attack on our food system” “So this November, the EPA is gonna be voting on a bill to implement new water treatment programs into all local butcher shops all the way up to the big packers. Now these new water treatment programs are gonna be costing up to $2,300,000 just for all the new equipment and an additional $500,000 to get them installed and regulated into each year. This is an attack on our food system if you were trying to buy locally or from your local producers or from the local butcher shops. They simply do not have the money or the revenue to support this. So in a roundabout way, they're taking away your freedom and your right and our right to sell meat directly to the consumer. They're taking away our rights to buy what we want and consume and put in our bodies what we would like. They're forcing us into a box and forcing you guys to buy from the big packers that control 85% of the industry right now. I'm curious to see what y'all think about this. And as always, guys, buy American and buy local.”

This is Serious 🚨 US Government voting on new regulations this November that are so expensive they will force small ranchers out of business Mandating new equipment that will cost up to $2.3 million plus $500k to install and regulate each year “This is an attack on our food system” “So this November, the EPA is gonna be voting on a bill to implement new water treatment programs into all local butcher shops all the way up to the big packers. Now these new water treatment programs are gonna be costing up to $2,300,000 just for all the new equipment and an additional $500,000 to get them installed and regulated into each year. This is an attack on our food system if you were trying to buy locally or from your local producers or from the local butcher shops. They simply do not have the money or the revenue to support this. So in a roundabout way, they're taking away your freedom and your right and our right to sell meat directly to the consumer. They're taking away our rights to buy what we want and consume and put in our bodies what we would like. They're forcing us into a box and forcing you guys to buy from the big packers that control 85% of the industry right now. I'm curious to see what y'all think about this. And as always, guys, buy American and buy local.”

Wall Street Apes

495,978 views • 2 years ago

THIS GUY IS WALKING INTO LOCAL SHOPS WITH A MAC MINI IN A HARD CASE AND WALKING OUT WITH $1,200 CHECKS FOR INSTALLING AI THAT RUNS WITHOUT THE INTERNET I had to rewatch this twice because the business model is so stupidly simple my brain kept looking for the catch. He shows up. Plugs in a Mac Mini. Installs a private AI network running entirely on Ollama. The whole thing is done in under an hour. Zero cloud dependency. No API bills. No monthly charges bleeding the client dry. The shop owner gets a local AI system that works even if the WiFi dies, and this guy walks out with $1,200 for an installation that takes less time than a long lunch. The hardware costs $1,300. One deployment and the machine is paid for. Then he locks in a $149 monthly retainer for support, which means every client after the first is pure margin stacking on top of recurring revenue that compounds every single month. Most people hear "AI business" and think they need to build a SaaS platform or learn to code or raise funding from someone. This guy skipped all of that and went straight to walking into physical stores with a box under his arm. This is not going to scale to a billion dollar company. Obviously. But a solo operator clearing $5-10K a month from local installs while everyone else is still arguing about which LLM is best on Twitter is the kind of quiet hustle that does not make headlines until someone does a breakdown of their year-end numbers. The surface area of what AI can do right now is expanding faster than anyone can map it. One guy is doing local hardware installs. Another is generating AI personas that pull five figures a month. Someone else is running AI video pipelines off a laptop. Same wave of tools. None of them competing with each other. Hit play. Watch him unbox the setup and walk through the numbers. Then tell me you could not do this in your city by next Friday.

THIS GUY IS WALKING INTO LOCAL SHOPS WITH A MAC MINI IN A HARD CASE AND WALKING OUT WITH $1,200 CHECKS FOR INSTALLING AI THAT RUNS WITHOUT THE INTERNET I had to rewatch this twice because the business model is so stupidly simple my brain kept looking for the catch. He shows up. Plugs in a Mac Mini. Installs a private AI network running entirely on Ollama. The whole thing is done in under an hour. Zero cloud dependency. No API bills. No monthly charges bleeding the client dry. The shop owner gets a local AI system that works even if the WiFi dies, and this guy walks out with $1,200 for an installation that takes less time than a long lunch. The hardware costs $1,300. One deployment and the machine is paid for. Then he locks in a $149 monthly retainer for support, which means every client after the first is pure margin stacking on top of recurring revenue that compounds every single month. Most people hear "AI business" and think they need to build a SaaS platform or learn to code or raise funding from someone. This guy skipped all of that and went straight to walking into physical stores with a box under his arm. This is not going to scale to a billion dollar company. Obviously. But a solo operator clearing $5-10K a month from local installs while everyone else is still arguing about which LLM is best on Twitter is the kind of quiet hustle that does not make headlines until someone does a breakdown of their year-end numbers. The surface area of what AI can do right now is expanding faster than anyone can map it. One guy is doing local hardware installs. Another is generating AI personas that pull five figures a month. Someone else is running AI video pipelines off a laptop. Same wave of tools. None of them competing with each other. Hit play. Watch him unbox the setup and walk through the numbers. Then tell me you could not do this in your city by next Friday.

Framez

932,332 views • 2 months ago

Someone finds a local business online and reaches out to book an appointment, request a quote, or ask a question. If nobody responds, they may move on to a competitor. That missed lead is a problem you can get paid to solve. In this video, I build the entire system from scratch: how to find the right market, build a website with AI, capture leads, follow up automatically, and track what is working, all in one place. Then I show you what to charge for it. This is the setup I would build if I were starting a marketing agency today. I’m a partner with HighLevel, and I’m using their platform to build it. Whether you want to work with dentists, gyms, salons, home service companies, or other local businesses, you can adapt this system to help them turn more inquiries into customers. Get the snapshot, the free course, and a 30-day trial through my HighLevel partner link:

Someone finds a local business online and reaches out to book an appointment, request a quote, or ask a question. If nobody responds, they may move on to a competitor. That missed lead is a problem you can get paid to solve. In this video, I build the entire system from scratch: how to find the right market, build a website with AI, capture leads, follow up automatically, and track what is working, all in one place. Then I show you what to charge for it. This is the setup I would build if I were starting a marketing agency today. I’m a partner with HighLevel, and I’m using their platform to build it. Whether you want to work with dentists, gyms, salons, home service companies, or other local businesses, you can adapt this system to help them turn more inquiries into customers. Get the snapshot, the free course, and a 30-day trial through my HighLevel partner link:

Neil Patel

11,415 views • 17 days ago

Qwen3.8-Flash-Next just got a massive speed boost on my old hardware. This guy started with roughly 11 tok/s. After tuning the inference stack, I’m now getting around 24–28 tok/s. That’s roughly a 2× speedup without changing the GPU. The setup: → RTX 3090 24GB → 64GB DDR4 system RAM → Qwen3.8-Flash-Next → Cafe-llama.cpp The interesting part is that Cafe-llama.cpp isn’t just another llama.cpp fork. The optimizations are making a real difference for this particular architecture, especially when you’re dealing with a model that relies heavily on system memory and offloading. Going from 11 tok/s to nearly 30 tok/s completely changes how practical the model feels for local use. And now I’m curious what happens with DDR5. If memory bandwidth becomes another bottleneck, a faster RAM subsystem could squeeze even more performance out of the same 3090. This is why local AI optimization is getting so interesting. Sometimes you don’t need a new GPU. You just need a better inference stack. 11 tok/s → 24–28 tok/s.

Qwen3.8-Flash-Next just got a massive speed boost on my old hardware. This guy started with roughly 11 tok/s. After tuning the inference stack, I’m now getting around 24–28 tok/s. That’s roughly a 2× speedup without changing the GPU. The setup: → RTX 3090 24GB → 64GB DDR4 system RAM → Qwen3.8-Flash-Next → Cafe-llama.cpp The interesting part is that Cafe-llama.cpp isn’t just another llama.cpp fork. The optimizations are making a real difference for this particular architecture, especially when you’re dealing with a model that relies heavily on system memory and offloading. Going from 11 tok/s to nearly 30 tok/s completely changes how practical the model feels for local use. And now I’m curious what happens with DDR5. If memory bandwidth becomes another bottleneck, a faster RAM subsystem could squeeze even more performance out of the same 3090. This is why local AI optimization is getting so interesting. Sometimes you don’t need a new GPU. You just need a better inference stack. 11 tok/s → 24–28 tok/s.

FHILY👑

23,243 views • 28 days ago

Just so everyone is aware... At this present-time in America, if you want to set up a protest against the data center construction in your town, and call out your local representative while doing so that is now an ARRESTABLE OFFENSE. It doesn't matter what you actually say on social media, it is apparently up to the state DA, and local police. Arrested...WITHOUT a warrant, or probable cause because they don't like what you said online and twisted it to turn it into a "threat". If you protest your enslavement by the Technocratic NWO, and especially if you get others to join you, you will be treated like a CRIMINAL. This is what we all have to look forward to in the "land of the free" and why I cannot bring myself to celebrate our 250 years of "freedom".

Just so everyone is aware... At this present-time in America, if you want to set up a protest against the data center construction in your town, and call out your local representative while doing so that is now an ARRESTABLE OFFENSE. It doesn't matter what you actually say on social media, it is apparently up to the state DA, and local police. Arrested...WITHOUT a warrant, or probable cause because they don't like what you said online and twisted it to turn it into a "threat". If you protest your enslavement by the Technocratic NWO, and especially if you get others to join you, you will be treated like a CRIMINAL. This is what we all have to look forward to in the "land of the free" and why I cannot bring myself to celebrate our 250 years of "freedom".

The Patriot Voice

65,551 views • 3 months ago

$Extropic founder Beff (e/acc) on why running probabilistic AI on deterministic hardware is quietly the biggest local optimum in computing "You have Landauer's principle. Essentially you have a minimum cost of erasing a bit." "Every time you reset a bit in a classical computer, your bit is actually random. You don't know what state it is, and then you have to reset it to a deterministic state. So you have a Maxwell's demon for every bit, for every clock cycle. I'm tired of paying the demon tax." "If you go with fractional bits, you don't need to do full bit operations. Running hardware probabilistically is just much more power efficient." "All the algorithms we want to run these days, whether it's PageRank, whether it's recommender systems, whether it's diffusion models, whether it's transformers, they're all probabilistic algorithms." "Why are we paying the Maxwell's demon tax to run probabilistic algorithms on deterministic hardware? It just makes zero sense, and we've just been caught in a local optima." "It takes a true set of autists that are like, screw the whole stack, we're going to start from scratch. This has the bones to eat the world." Extropic$

Extropic founder Beff (e/acc) on why running probabilistic AI on deterministic hardware is quietly the biggest local optimum in computing "You have Landauer's principle. Essentially you have a minimum cost of erasing a bit." "Every time you reset a bit in a classical computer, your bit is actually random. You don't know what state it is, and then you have to reset it to a deterministic state. So you have a Maxwell's demon for every bit, for every clock cycle. I'm tired of paying the demon tax." "If you go with fractional bits, you don't need to do full bit operations. Running hardware probabilistically is just much more power efficient." "All the algorithms we want to run these days, whether it's PageRank, whether it's recommender systems, whether it's diffusion models, whether it's transformers, they're all probabilistic algorithms." "Why are we paying the Maxwell's demon tax to run probabilistic algorithms on deterministic hardware? It just makes zero sense, and we've just been caught in a local optima." "It takes a true set of autists that are like, screw the whole stack, we're going to start from scratch. This has the bones to eat the world." Extropic

MTS

33,856 views • 1 month ago

A USED $700 RTX 3090 HAS MORE MEMORY AND FAR MORE SPEED THAN THE ~$1,000 A2 GOING INTO THIS SERVER. THE A2 STILL WINS - FOR ONE REASON THAT ISN'T PERFORMANCE. that clip is a dell poweredge r760 - a 2u rack server - getting an nvidia a2 dropped in through a riser. this is the enterprise route to local ai. the rung the desktop ladder skips entirely. the a2, verified: 16gb of memory, single-slot, low-profile, and just 40 to 60 watts it's an inference card, built to sit in a server that has no room or spare power for a real gpu so why not a 3090? a used rtx 3090 gives you 24gb and many times the compute for around $700. the a2 gives 16gb, much slower, for roughly a thousand. on raw local-llm value, the desktop card wins, and it isn't close. the a2's whole reason to exist is the thing you can't see on a spec sheet: it fits. a 2u server has no spare gpu power and no room for a triple-slot furnace. the a2 slips into one low-profile slot on 60 watts and lets an existing server do inference without a rebuild. the honest caveats: the r760 is not a desk machine. loaded, it idles at hundreds of watts, and its fans sound like a hair dryer that never turns off. it belongs in a rack or a closet 16gb is still 16gb. the same 7b-to-32b ceiling as the cheap cards. the enterprise badge doesn't buy you a bigger model what it does buy: ecc memory, redundant power, remote management, hot-swap everything. reliability, not speed so who this is for: someone who already runs a rack and wants to add private inference without touching the power or cooling budget. for anyone starting from a desk, the mac mini or the 3090 wins on every axis that matters. the real point: the "best" local ai box depends entirely on what you already own. on a desk, efficiency wins. in a rack, fit and reliability win. the a2 isn't a bad card - it's a card for a constraint the ladder never mentions. no fastest gpu here, no desk-friendly box, no bigger model than the cheap cards already run. save this before you buy enterprise gear for a desktop job.

Grimmer

24,287 views • 2 months ago