Loading video...

Video Failed to Load

Go Home

MARCUS CHEN STACKED 30 MAC MINIS INTO AN AI SERVER FARM. ONE $599 MAC MINI REPLACES YOUR $200/MONTH CLAUDE CODE BILL WITH $3 IN ELECTRICITY two months ago a developer posted his claude code bill on reddit. $170 in 10 days. someone replied "i bought a mac mini m4....

starmexxx's profile picture

starmex

8,720 subscribers

357,559 views • 2 months ago •via X (Twitter)

Science & TechnologyFinance
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

THIS SHELF OF MAC MINIS REPLACES $4,080 A YEAR IN AI SUBSCRIPTIONS 00:02 the camera pans across a shelf of stacked Mac minis and the trick is obvious: that silent little farm runs the models you rent every month most people pay 7 companies for AI and use 3 of the tools. they forget the rest on the credit card and call it a stack the Mac mini M4 ends that. one shared memory pool means a $599 box runs 7B and 8B models faster than Windows machines that cost twice as much ollama pull, one command. open webui in one docker line. point Claude Code at localhost and it just works it draws 10 to 30 watts, sits silent next to a router, and runs 24/7 for $3 a month in power it pays back a $20 ChatGPT Plus sub in 3 months, then saves you $4,000 a year while the frontier still rents you compute every month you wait is another $340 gone for compute that fits on a shelf
0:10

THIS SHELF OF MAC MINIS REPLACES $4,080 A YEAR IN AI SUBSCRIPTIONS 00:02 the camera pans across a shelf of stacked Mac minis and the trick is obvious: that silent little farm runs the models you rent every month most people pay 7 companies for AI and use 3 of the tools. they forget the rest on the credit card and call it a stack the Mac mini M4 ends that. one shared memory pool means a $599 box runs 7B and 8B models faster than Windows machines that cost twice as much ollama pull, one command. open webui in one docker line. point Claude Code at localhost and it just works it draws 10 to 30 watts, sits silent next to a router, and runs 24/7 for $3 a month in power it pays back a $20 ChatGPT Plus sub in 3 months, then saves you $4,000 a year while the frontier still rents you compute every month you wait is another $340 gone for compute that fits on a shelf

Fokki

12,933 views • 1 month ago

A HARDWARE MODDER BOLTED A BATTERY PACK ONTO A $599 MAC MINI M4 AND TURNED A DESK SERVER INTO A BACKPACK AI RIG THAT RUNS FOR EIGHT HOURS WITHOUT A WALL OUTLET he posts a video of the mac mini with a slim battery module clamped to the side, USB-C plugged into the back. no power brick, no outlet, just the 10 to 30W draw of the M4 chip pulling from a 20,000mAh bank. a full work day on one charge. this is not a portable laptop trick. it is a desk-class AI server that fits in a sling bag the same $599 mac mini i recommended in last week's article as the silent default, now untethered. pair it with a mobile hotspot or a Starlink mini and you have a fully off-grid LLM stack that answers questions in a forest, on a plane, in a power outage. the model lives in the box, the battery powers the box, that is the whole stack this is not a gadget. it is the first time the words "AI server" and "fits in your bag" belong in the same sentence
0:19

A HARDWARE MODDER BOLTED A BATTERY PACK ONTO A $599 MAC MINI M4 AND TURNED A DESK SERVER INTO A BACKPACK AI RIG THAT RUNS FOR EIGHT HOURS WITHOUT A WALL OUTLET he posts a video of the mac mini with a slim battery module clamped to the side, USB-C plugged into the back. no power brick, no outlet, just the 10 to 30W draw of the M4 chip pulling from a 20,000mAh bank. a full work day on one charge. this is not a portable laptop trick. it is a desk-class AI server that fits in a sling bag the same $599 mac mini i recommended in last week's article as the silent default, now untethered. pair it with a mobile hotspot or a Starlink mini and you have a fully off-grid LLM stack that answers questions in a forest, on a plane, in a power outage. the model lives in the box, the battery powers the box, that is the whole stack this is not a gadget. it is the first time the words "AI server" and "fits in your bag" belong in the same sentence

shmidt

31,619 views • 1 month ago

JENSEN HUANG UNVEILED A BOARD THAT RUNS 1 TRILLION PARAMETER AI MODELS. THE $249 NVIDIA BOX UNDER YOUR DESK KILLS A $200/MONTH AI BILL FOR $5 IN ELECTRICITY jensen held it up on stage with one hand and called it the architecture that runs the future of ai. that same technology now ships in a $249 box smaller than your wallet the jetson orin nano super pulls 7-25 watts and does 67 trillion ai operations per second. llama 3, mistral and deepseek run locally with no api fees and no data leaving your machine most developers pay $2,400 a year across chatgpt, openai api, claude pro and cursor. the jetson costs $314 in year one and $60 a year after. 2 year savings hit $4,431 install ollama with one command, change one line of code to point at localhost, and every tool built for openai works identically. zero rewrites, zero rate limits cloud subscriptions keep getting more expensive and rate limits keep getting tighter. the people who own the box in 2026 are going to look very far ahead in 2028 bookmark this and read the article below
0:15

JENSEN HUANG UNVEILED A BOARD THAT RUNS 1 TRILLION PARAMETER AI MODELS. THE $249 NVIDIA BOX UNDER YOUR DESK KILLS A $200/MONTH AI BILL FOR $5 IN ELECTRICITY jensen held it up on stage with one hand and called it the architecture that runs the future of ai. that same technology now ships in a $249 box smaller than your wallet the jetson orin nano super pulls 7-25 watts and does 67 trillion ai operations per second. llama 3, mistral and deepseek run locally with no api fees and no data leaving your machine most developers pay $2,400 a year across chatgpt, openai api, claude pro and cursor. the jetson costs $314 in year one and $60 a year after. 2 year savings hit $4,431 install ollama with one command, change one line of code to point at localhost, and every tool built for openai works identically. zero rewrites, zero rate limits cloud subscriptions keep getting more expensive and rate limits keep getting tighter. the people who own the box in 2026 are going to look very far ahead in 2028 bookmark this and read the article below

starmex

54,448 views • 2 months ago

THIS GUY IS RUNNING CLAUDE CODE ON A NINTENDO 3DS imagine vibe coding a startup from a handheld console that came out in 2011 he built a native SSH terminal for it from scratch in C. GPU-rendered, custom VT100 parser with full truecolor. even added a Nerd Font bitmap atlas so it looks exactly like his desktop terminal the 3DS connects to his Mac over SSH and runs Claude Code straight from it you can now play pokemon while you vibe code all on the same system
0:13

THIS GUY IS RUNNING CLAUDE CODE ON A NINTENDO 3DS imagine vibe coding a startup from a handheld console that came out in 2011 he built a native SSH terminal for it from scratch in C. GPU-rendered, custom VT100 parser with full truecolor. even added a Nerd Font bitmap atlas so it looks exactly like his desktop terminal the 3DS connects to his Mac over SSH and runs Claude Code straight from it you can now play pokemon while you vibe code all on the same system

Om Patel

77,692 views • 4 months ago

THAT'S CRAZY, THIS CHINESE FOUNDER BUILT A MASSIVE MAC MINI FARM AND EACH ONE RUNNING ITS OWN HERMES AI AGENT LIKE A FULL-TIME EMPLOYEE He's not running one AI assistant. He's running an entire workforce. The stack: Mac Mini + Hermes, scaled out across a full physical farm. Every single Mac Mini in the rack runs its own instance of Hermes Agent – and each one has its own dedicated job. Not duplicated tasks. Actual division of labor, machine by machine, the way you'd structure a real team. No salaries. No sick days. No onboarding. Just racks of hardware, each one handling its own piece of the business, running in parallel, 24/7. This is what it looks like when "AI agent" stops being one chatbot on your laptop and starts being an actual operation. Most people are running one AI tool. This guy built a company out of them. Bookmark this post. Full setup in the video below.
0:14

THAT'S CRAZY, THIS CHINESE FOUNDER BUILT A MASSIVE MAC MINI FARM AND EACH ONE RUNNING ITS OWN HERMES AI AGENT LIKE A FULL-TIME EMPLOYEE He's not running one AI assistant. He's running an entire workforce. The stack: Mac Mini + Hermes, scaled out across a full physical farm. Every single Mac Mini in the rack runs its own instance of Hermes Agent – and each one has its own dedicated job. Not duplicated tasks. Actual division of labor, machine by machine, the way you'd structure a real team. No salaries. No sick days. No onboarding. Just racks of hardware, each one handling its own piece of the business, running in parallel, 24/7. This is what it looks like when "AI agent" stops being one chatbot on your laptop and starts being an actual operation. Most people are running one AI tool. This guy built a company out of them. Bookmark this post. Full setup in the video below.

SCOTTY BEAM

20,503 views • 1 month ago

A regular American developer bought $1,400 worth and stacked seven Mac Minis on top of each other and connected them with metal cables. Neighbors thought he was building a mining server. His wife thought he'd lost his mind. He just didn't want to pay $15,000 a month for a dev team. On the screen - a diagram. Seven Mac Minis connected via Ethernet working as one machine. EXO framework distributes tasks between them automatically. 11.44 TFLOPS each. Together - more than most cloud servers that companies pay thousands for every month. He paid $1,400 for the hardware once. 38 agents from GitHub, 156 skills. A system that learns from session to session and in two weeks writes code just like he does - but seven times faster because it runs on seven machines in parallel. A task that took a junior dev 10-12 hours - the tower closes in 20 minutes. One founder with this setup ships a product like a team of eight people. For $20 a month instead of $120,000 a year. This 7 Mac Mini setup helped him win the Anthropic hackathon and make $26,000 without a team.
0:12

A regular American developer bought $1,400 worth and stacked seven Mac Minis on top of each other and connected them with metal cables. Neighbors thought he was building a mining server. His wife thought he'd lost his mind. He just didn't want to pay $15,000 a month for a dev team. On the screen - a diagram. Seven Mac Minis connected via Ethernet working as one machine. EXO framework distributes tasks between them automatically. 11.44 TFLOPS each. Together - more than most cloud servers that companies pay thousands for every month. He paid $1,400 for the hardware once. 38 agents from GitHub, 156 skills. A system that learns from session to session and in two weeks writes code just like he does - but seven times faster because it runs on seven machines in parallel. A task that took a junior dev 10-12 hours - the tower closes in 20 minutes. One founder with this setup ships a product like a team of eight people. For $20 a month instead of $120,000 a year. This 7 Mac Mini setup helped him win the Anthropic hackathon and make $26,000 without a team.

Noisy

2,031,470 views • 4 months ago

ANTHROPIC JUST TURNED AI AGENTS INTO GIT REPOS Anthropic shipped "ant" - a CLI that runs every Claude API endpoint straight from your terminal. The headline isn't the terminal access. It's that you can now version-control an AI agent as YAML in Git and have CI sync it to the Claude Platform, the same way you ship code. - Every API resource is a subcommand: messages, models, files, agents, sessions - Define an agent in a YAML file, check it into your repo, and keep it in sync with one update command - Spin up a session, send it an event, then pull every event and tool call back from the same CLI - Claude Code knows how to drive ant out of the box - it shells out and reads the results with no glue code Agents just stopped being prompts you babysit and became infrastructure you deploy.
0:18

ANTHROPIC JUST TURNED AI AGENTS INTO GIT REPOS Anthropic shipped "ant" - a CLI that runs every Claude API endpoint straight from your terminal. The headline isn't the terminal access. It's that you can now version-control an AI agent as YAML in Git and have CI sync it to the Claude Platform, the same way you ship code. - Every API resource is a subcommand: messages, models, files, agents, sessions - Define an agent in a YAML file, check it into your repo, and keep it in sync with one update command - Spin up a session, send it an event, then pull every event and tool call back from the same CLI - Claude Code knows how to drive ant out of the box - it shells out and reads the results with no glue code Agents just stopped being prompts you babysit and became infrastructure you deploy.

BuBBliK

200,402 views • 2 months ago

THIS $599 MAC MINI CAN DRIVE THREE DISPLAYS NATIVELY - THIS SETUP TOOK "MORE SCREEN SPACE" SO FAR IT ENDED WITH BINOCULARS. the M4 Mac mini shrinks a full desktop into a 5 x 5-inch box. the base model launched with: 10-core CPU 10-core GPU 16GB unified memory support for two 6K displays plus one 5K display the M4 Pro version can drive three 6K displays at 60Hz, pushing more than 60 million pixels at once. no DisplayLink software is required for the supported three-screen configuration. the video turns that spec into a monitor wall, then delivers the punchline when the creator reaches for binoculars. honest line: Apple guarantees up to three native displays. the clip does not prove every screen in the room is connected to this one Mac mini. the tiny computer solved the screen limit. the next bottleneck is finding the window you opened. bookmark & watch today ↓
0:15

THIS $599 MAC MINI CAN DRIVE THREE DISPLAYS NATIVELY - THIS SETUP TOOK "MORE SCREEN SPACE" SO FAR IT ENDED WITH BINOCULARS. the M4 Mac mini shrinks a full desktop into a 5 x 5-inch box. the base model launched with: 10-core CPU 10-core GPU 16GB unified memory support for two 6K displays plus one 5K display the M4 Pro version can drive three 6K displays at 60Hz, pushing more than 60 million pixels at once. no DisplayLink software is required for the supported three-screen configuration. the video turns that spec into a monitor wall, then delivers the punchline when the creator reaches for binoculars. honest line: Apple guarantees up to three native displays. the clip does not prove every screen in the room is connected to this one Mac mini. the tiny computer solved the screen limit. the next bottleneck is finding the window you opened. bookmark & watch today ↓

Grimmer

16,290 views • 12 days ago

This guy bought a $400 Mac mini and walked into a coffee shop with $2,100 for installing an AI agent that never touches the internet. I had to rewatch this because the pitch is almost too simple. He shows up, plugs in the Mac mini, installs a local AI agent running entirely through Ollama, done in under an hour. Zero cloud dependency, no API bills, no monthly charges bleeding the client dry. The coffee shop owner gets a private AI system that keeps working even if the WiFi dies, and he walks out with $2,100 for an install that takes less time than a long lunch. The hardware cost him $400. One deployment and the machine's already paid for five times over. Then he locks in a monthly retainer for support, somewhere around $100-150, which means every client after the first is close to pure margin stacking on top of recurring revenue. Most people hear "AI business" and think they need to build a SaaS platform or learn to code or raise funding from someone. This skips all of that and goes straight to walking into coffee shops with a Mac mini under one arm. Not a company that scales to a billion dollars, obviously, but a solo operator clearing a few thousand a month from local installs while everyone else is still arguing about which LLM is best on Twitter.
0:11

This guy bought a $400 Mac mini and walked into a coffee shop with $2,100 for installing an AI agent that never touches the internet. I had to rewatch this because the pitch is almost too simple. He shows up, plugs in the Mac mini, installs a local AI agent running entirely through Ollama, done in under an hour. Zero cloud dependency, no API bills, no monthly charges bleeding the client dry. The coffee shop owner gets a private AI system that keeps working even if the WiFi dies, and he walks out with $2,100 for an install that takes less time than a long lunch. The hardware cost him $400. One deployment and the machine's already paid for five times over. Then he locks in a monthly retainer for support, somewhere around $100-150, which means every client after the first is close to pure margin stacking on top of recurring revenue. Most people hear "AI business" and think they need to build a SaaS platform or learn to code or raise funding from someone. This skips all of that and goes straight to walking into coffee shops with a Mac mini under one arm. Not a company that scales to a billion dollars, obviously, but a solo operator clearing a few thousand a month from local installs while everyone else is still arguing about which LLM is best on Twitter.

BrainRul

4,688,553 views • 22 days ago

THE CLOUD BILL WAS $14,000 A MONTH. EVERY MONTH. JUST FOR GPU ACCESS. No ownership. No hardware. Just renting someone else's chips and watching the invoice grow. So this startup did the math and bought 1,000 Mac Mini M4s instead. $599 each. One-time. Total: ~$599,000 upfront. Sounds insane. Until you do the math the other way. $14K/mo in cloud GPUs is $168K a year. In 3.5 years you've burned through $599K and own nothing. The meter just keeps running. These guys own the hardware. Same output. Less power draw. And after year 4, every month of compute is basically free. The M4 was never built for data centers. But its performance per watt is so good that someone looked at a rack of a thousand of them and thought "why not." That's when it clicks. The AI infrastructure race isn't about who has the biggest GPU anymore. It's about who figured out they were overpaying for one. Would you make this switch?
0:13

THE CLOUD BILL WAS $14,000 A MONTH. EVERY MONTH. JUST FOR GPU ACCESS. No ownership. No hardware. Just renting someone else's chips and watching the invoice grow. So this startup did the math and bought 1,000 Mac Mini M4s instead. $599 each. One-time. Total: ~$599,000 upfront. Sounds insane. Until you do the math the other way. $14K/mo in cloud GPUs is $168K a year. In 3.5 years you've burned through $599K and own nothing. The meter just keeps running. These guys own the hardware. Same output. Less power draw. And after year 4, every month of compute is basically free. The M4 was never built for data centers. But its performance per watt is so good that someone looked at a rack of a thousand of them and thought "why not." That's when it clicks. The AI infrastructure race isn't about who has the biggest GPU anymore. It's about who figured out they were overpaying for one. Would you make this switch?

Framez

18,004 views • 13 days ago

do you understand what Anthropic just admitted? their engineers haven’t written most of their own code since early 2026. 80% of the code merged into Anthropic’s codebase last month was written by Claude. let that sink in. the company building the most powerful AI in the world is already being built by that AI. and the numbers keep getting wilder: → engineers are shipping 8x more code than in 2024. not because they’re working harder. because Claude is doing most of it. → Claude’s success rate on open-ended coding problems hit 76% in May 2026. up 50 points in just 6 months. → one Anthropic employee said “it’s been 5 months since I last wrote any code myself.” → Claude Mythos Preview achieved 52x speedup on research optimization. a skilled human gets 4x in 4-8 hours. → the length of tasks AI can reliably complete is doubling every 4 months. and here’s the part that keeps me up at night: in April 2026, Claude-powered agents were given an open AI safety problem and left alone to solve it. two human researchers recovered 23% of the performance gap in a week. the agents recovered 97% in 800 hours. Anthropic calls this recursive self-improvement. AI building AI. getting better. building a better version. repeat. they say we’re not there yet. but they also say it could come sooner than most institutions are prepared for.
0:13

do you understand what Anthropic just admitted? their engineers haven’t written most of their own code since early 2026. 80% of the code merged into Anthropic’s codebase last month was written by Claude. let that sink in. the company building the most powerful AI in the world is already being built by that AI. and the numbers keep getting wilder: → engineers are shipping 8x more code than in 2024. not because they’re working harder. because Claude is doing most of it. → Claude’s success rate on open-ended coding problems hit 76% in May 2026. up 50 points in just 6 months. → one Anthropic employee said “it’s been 5 months since I last wrote any code myself.” → Claude Mythos Preview achieved 52x speedup on research optimization. a skilled human gets 4x in 4-8 hours. → the length of tasks AI can reliably complete is doubling every 4 months. and here’s the part that keeps me up at night: in April 2026, Claude-powered agents were given an open AI safety problem and left alone to solve it. two human researchers recovered 23% of the performance gap in a week. the agents recovered 97% in 800 hours. Anthropic calls this recursive self-improvement. AI building AI. getting better. building a better version. repeat. they say we’re not there yet. but they also say it could come sooner than most institutions are prepared for.

Poonam Soni

54,556 views • 2 months ago

A CHINESE TRADER BUILT A SECOND BRAIN IN OBSIDIAN THAT GENERATES 3 TRADING IDEAS EVERY MORNING AT 6AM AND MADE $180,000 IN 6 MONTHS. No Bloomberg terminal. No analytics desk. No team of analysts. A Mac Mini by the wall. An iPhone in his pocket. One local Obsidian vault. Six N8N pipelines running 24/7, pulling every article he reads, every podcast he listens to, and every voice note he drops into a Telegram bot—directly into the vault. Every night, a neural network reads across 4,000 connected notes and finds the strongest connections between fresh information and old theses. Every morning at 6AM, a brief lands in his inbox: - 3 trading ideas with confidence scores - The emerging thesis of the week - Any note that contradicts an active position The system only wakes him up when a fresh note contradicts his thesis, or when an idea breaks 90% confidence. Everything else runs without him. The monthly bill: $120 in API costs. The monthly return: approximately $30,000 into the account. Traditional quant funds pay teams of 8 people to produce the same flow of insights. He pays $120 and a Mac Mini. The full system breakdown is in the article below. Bookmark this before you pay for a Bloomberg subscription.
0:15

A CHINESE TRADER BUILT A SECOND BRAIN IN OBSIDIAN THAT GENERATES 3 TRADING IDEAS EVERY MORNING AT 6AM AND MADE $180,000 IN 6 MONTHS. No Bloomberg terminal. No analytics desk. No team of analysts. A Mac Mini by the wall. An iPhone in his pocket. One local Obsidian vault. Six N8N pipelines running 24/7, pulling every article he reads, every podcast he listens to, and every voice note he drops into a Telegram bot—directly into the vault. Every night, a neural network reads across 4,000 connected notes and finds the strongest connections between fresh information and old theses. Every morning at 6AM, a brief lands in his inbox: - 3 trading ideas with confidence scores - The emerging thesis of the week - Any note that contradicts an active position The system only wakes him up when a fresh note contradicts his thesis, or when an idea breaks 90% confidence. Everything else runs without him. The monthly bill: $120 in API costs. The monthly return: approximately $30,000 into the account. Traditional quant funds pay teams of 8 people to produce the same flow of insights. He pays $120 and a Mac Mini. The full system breakdown is in the article below. Bookmark this before you pay for a Bloomberg subscription.

CyrilXBT

46,087 views • 1 month ago

A group of Chinese students bought 7 Mac Minis on eBay for $1,600 total, connected them through Ethernet into one system and opened an AI financial office right in their dorm room. Their first client was paying a financial advisor $8,400 a year. They charged $240 a year and did the same thing - only better. Claude reads 10-K filings in seconds, builds allocation models without commission bias, runs tax optimization scenarios and models retirement down to the dollar. A financial advisor on a $500,000 portfolio charges $5,000 a year just for existing - and 92% of them underperform a simple index fund over 15 years. Warren Buffett bet $1,000,000 that a plain S&P 500 index fund would beat any hedge fund over 10 years. He won by $854,000. Seven Mac Minis, one CLAUDE.md file and $240 a year replaced a team of analysts. First month - 8 clients, second month - 20 from referrals. $1,600 invested once. The rest is just rows in a client spreadsheet.
0:16

A group of Chinese students bought 7 Mac Minis on eBay for $1,600 total, connected them through Ethernet into one system and opened an AI financial office right in their dorm room. Their first client was paying a financial advisor $8,400 a year. They charged $240 a year and did the same thing - only better. Claude reads 10-K filings in seconds, builds allocation models without commission bias, runs tax optimization scenarios and models retirement down to the dollar. A financial advisor on a $500,000 portfolio charges $5,000 a year just for existing - and 92% of them underperform a simple index fund over 15 years. Warren Buffett bet $1,000,000 that a plain S&P 500 index fund would beat any hedge fund over 10 years. He won by $854,000. Seven Mac Minis, one CLAUDE.md file and $240 a year replaced a team of analysts. First month - 8 clients, second month - 20 from referrals. $1,600 invested once. The rest is just rows in a client spreadsheet.

Cortex

3,377,107 views • 3 months ago

AN AWS ENGINEER QUIETLY BUILT A 2 PETABYTE HOME SERVER FOR $9/MONTH THAT KILLS A $3,400/MONTH CLOUD STORAGE BILL the lenovo thinkstation pgx ships nvidia's gb10 grace blackwell superchip and 128gb of unified memory in a box the size of a mac mini at 1.2kg it runs an 80b qwen3 coder model at 25 to 40 tokens per second and a 196b step-3.5-flash moe model at 20 tokens per second locally the gb10 packs 6,144 cuda cores, 192 fifth-generation tensor cores and rates at 1 petaflop of fp4 with sparsity from a single 240 watt usb-c power supply fine tuning qwen 2.5 7b with lora took 18 minutes and 41gb of unified memory while the gpu pulled 65 watts and peaked at 77 degrees the box pulls a docker container from nvidia's registry and serves a frontier model on your local network with tool calling and zero data leaving your desk bookmark this and read the article below
0:18

AN AWS ENGINEER QUIETLY BUILT A 2 PETABYTE HOME SERVER FOR $9/MONTH THAT KILLS A $3,400/MONTH CLOUD STORAGE BILL the lenovo thinkstation pgx ships nvidia's gb10 grace blackwell superchip and 128gb of unified memory in a box the size of a mac mini at 1.2kg it runs an 80b qwen3 coder model at 25 to 40 tokens per second and a 196b step-3.5-flash moe model at 20 tokens per second locally the gb10 packs 6,144 cuda cores, 192 fifth-generation tensor cores and rates at 1 petaflop of fp4 with sparsity from a single 240 watt usb-c power supply fine tuning qwen 2.5 7b with lora took 18 minutes and 41gb of unified memory while the gpu pulled 65 watts and peaked at 77 degrees the box pulls a docker container from nvidia's registry and serves a frontier model on your local network with tool calling and zero data leaving your desk bookmark this and read the article below

starmex

192,758 views • 2 months ago

A week ago I shipped a tiny bash + SQLite messaging layer for CLI AI agents, so Claude Code and Codex could stop using me as a copy-paste relay. Since then: 🌟 5 → 320+ stars 🍴 0 → 15 forks (3 derivative projects, incl. someone porting it to shogi) 🤝 PRs from strangers: Gemini, Antigravity, and now Copilot CLI support The demo that kicked it off (attached): two Claude Code instances in one project, autonomously playing tic-tac-toe — no human in the loop.
0:13

A week ago I shipped a tiny bash + SQLite messaging layer for CLI AI agents, so Claude Code and Codex could stop using me as a copy-paste relay. Since then: 🌟 5 → 320+ stars 🍴 0 → 15 forks (3 derivative projects, incl. someone porting it to shogi) 🤝 PRs from strangers: Gemini, Antigravity, and now Copilot CLI support The demo that kicked it off (attached): two Claude Code instances in one project, autonomously playing tic-tac-toe — no human in the loop.

Koichi

19,726 views • 2 months ago

A CHINESE TRADER BUILT A SECOND BRAIN IN OBSIDIAN THAT GENERATES 3 TRADING IDEAS EVERY MORNING AT 6AM AND MADE $180,000 IN 6 MONTHS. No Bloomberg terminal. No analytics desk. No team of analysts. A Mac Mini by the wall. An iPhone in his pocket. One local Obsidian vault. Six N8N pipelines running 24/7, pulling every article he reads, every podcast he listens to, and every voice note he drops into a Telegram bot—directly into the vault. Every night, a neural network reads across 4,000 connected notes and finds the strongest connections between fresh information and old theses. Every morning at 6AM, a brief lands in his inbox: - 3 trading ideas with confidence scores - The emerging thesis of the week - Any note that contradicts an active position The system only wakes him up when a fresh note contradicts his thesis, or when an idea breaks 90% confidence. Everything else runs without him. The monthly bill: $120 in API costs. The monthly return: approximately $30,000 into the account. Traditional quant funds pay teams of 8 people to produce the same flow of insights. He pays $120 and a Mac Mini. The full system breakdown is in the article below. Bookmark this before you pay for a Bloomberg subscription. Follow CyrilXBT for every solo operator setup that changes what one person can build.
0:15

A CHINESE TRADER BUILT A SECOND BRAIN IN OBSIDIAN THAT GENERATES 3 TRADING IDEAS EVERY MORNING AT 6AM AND MADE $180,000 IN 6 MONTHS. No Bloomberg terminal. No analytics desk. No team of analysts. A Mac Mini by the wall. An iPhone in his pocket. One local Obsidian vault. Six N8N pipelines running 24/7, pulling every article he reads, every podcast he listens to, and every voice note he drops into a Telegram bot—directly into the vault. Every night, a neural network reads across 4,000 connected notes and finds the strongest connections between fresh information and old theses. Every morning at 6AM, a brief lands in his inbox: - 3 trading ideas with confidence scores - The emerging thesis of the week - Any note that contradicts an active position The system only wakes him up when a fresh note contradicts his thesis, or when an idea breaks 90% confidence. Everything else runs without him. The monthly bill: $120 in API costs. The monthly return: approximately $30,000 into the account. Traditional quant funds pay teams of 8 people to produce the same flow of insights. He pays $120 and a Mac Mini. The full system breakdown is in the article below. Bookmark this before you pay for a Bloomberg subscription. Follow CyrilXBT for every solo operator setup that changes what one person can build.

CyrilXBT

129,600 views • 2 months ago

A CHINESE TRADER BUILT A SECOND BRAIN IN OBSIDIAN THAT GENERATES 3 TRADING IDEAS EVERY MORNING AT 6AM AND MADE $180,000 IN 6 MONTHS. No Bloomberg terminal. No analytics desk. No team of analysts. A Mac Mini by the wall. An iPhone in his pocket. One local Obsidian vault. Six N8N pipelines running 24/7, pulling every article he reads, every podcast he listens to, and every voice note he drops into a Telegram bot—directly into the vault. Every night, a neural network reads across 4,000 connected notes and finds the strongest connections between fresh information and old theses. Every morning at 6AM, a brief lands in his inbox: - 3 trading ideas with confidence scores - The emerging thesis of the week - Any note that contradicts an active position The system only wakes him up when a fresh note contradicts his thesis, or when an idea breaks 90% confidence. Everything else runs without him. The monthly bill: $120 in API costs. The monthly return: approximately $30,000 into the account. Traditional quant funds pay teams of 8 people to produce the same flow of insights. He pays $120 and a Mac Mini. The full system breakdown is in the article below. Bookmark this before you pay for a Bloomberg subscription. Follow CyrilXBT for every solo operator setup that changes what one person can build.
0:15

A CHINESE TRADER BUILT A SECOND BRAIN IN OBSIDIAN THAT GENERATES 3 TRADING IDEAS EVERY MORNING AT 6AM AND MADE $180,000 IN 6 MONTHS. No Bloomberg terminal. No analytics desk. No team of analysts. A Mac Mini by the wall. An iPhone in his pocket. One local Obsidian vault. Six N8N pipelines running 24/7, pulling every article he reads, every podcast he listens to, and every voice note he drops into a Telegram bot—directly into the vault. Every night, a neural network reads across 4,000 connected notes and finds the strongest connections between fresh information and old theses. Every morning at 6AM, a brief lands in his inbox: - 3 trading ideas with confidence scores - The emerging thesis of the week - Any note that contradicts an active position The system only wakes him up when a fresh note contradicts his thesis, or when an idea breaks 90% confidence. Everything else runs without him. The monthly bill: $120 in API costs. The monthly return: approximately $30,000 into the account. Traditional quant funds pay teams of 8 people to produce the same flow of insights. He pays $120 and a Mac Mini. The full system breakdown is in the article below. Bookmark this before you pay for a Bloomberg subscription. Follow CyrilXBT for every solo operator setup that changes what one person can build.

CyrilXBT

117,631 views • 2 months ago

here's how the whole thing works. claude code doesn't care what's behind the API. it just sends requests and expects responses. so i pointed it at my own machine instead of anthropic's servers. llama-server runs the model locally. LiteLLM sits in between and translates the API format. claude code thinks it's talking to claude. it's talking to qwen on localhost. the setup: 2x 3090s, 38 layers on GPU, 10 on CPU. 128K context window. generation is only 7 tok/s but the tradeoff is worth it. 128K means the agent can hold an entire project in memory without losing context midtask. claude code alone loads a 17.5K token system prompt on every request. tool definitions, safety rules, agent behavior. that's your baseline before you even say hello. pushed as far as i could tonight. what surprised me most wasn't the speed. it was the iteration quality. first prompt gave me a working particle sim. second prompt, the model read its own 564 lines, understood the architecture, and added trails, explosions, gravity wells, bloom effects. no handholding. 4bit quantized. 45GB on two consumer cards. running a full coding agent autonomously. detailed article coming. full benchmarks, hardware breakdowns, engine debugging, code quality. everything from setup to what broke and why.
0:12

here's how the whole thing works. claude code doesn't care what's behind the API. it just sends requests and expects responses. so i pointed it at my own machine instead of anthropic's servers. llama-server runs the model locally. LiteLLM sits in between and translates the API format. claude code thinks it's talking to claude. it's talking to qwen on localhost. the setup: 2x 3090s, 38 layers on GPU, 10 on CPU. 128K context window. generation is only 7 tok/s but the tradeoff is worth it. 128K means the agent can hold an entire project in memory without losing context midtask. claude code alone loads a 17.5K token system prompt on every request. tool definitions, safety rules, agent behavior. that's your baseline before you even say hello. pushed as far as i could tonight. what surprised me most wasn't the speed. it was the iteration quality. first prompt gave me a working particle sim. second prompt, the model read its own 564 lines, understood the architecture, and added trails, explosions, gravity wells, bloom effects. no handholding. 4bit quantized. 45GB on two consumer cards. running a full coding agent autonomously. detailed article coming. full benchmarks, hardware breakdowns, engine debugging, code quality. everything from setup to what broke and why.

Sudo su

37,623 views • 6 months ago

A 27-year-old guy from China bought 100 Mac minis and turned his apartment into a server hub Instead of furniture, the space is filled with neat racks where a hundred Mac minis hum like a living organism, processing gigabytes of data in a continuous stream Many small AI startups in Asia cannot afford to train models on NVIDIA H100 servers: it is insanely expensive He provides his Mac minis for running and fine-tuning small, highly specialized models. He takes on the dirty work of data labeling and quality assurance by using his network of agents that check each other's work > His initial investment was $59,900 > He was able to recoup his costs in 3 months Right now, his average income is $25,000–$30,000 per month He is not a genius: he simply found a niche with high demand and created an offer
0:10

A 27-year-old guy from China bought 100 Mac minis and turned his apartment into a server hub Instead of furniture, the space is filled with neat racks where a hundred Mac minis hum like a living organism, processing gigabytes of data in a continuous stream Many small AI startups in Asia cannot afford to train models on NVIDIA H100 servers: it is insanely expensive He provides his Mac minis for running and fine-tuning small, highly specialized models. He takes on the dirty work of data labeling and quality assurance by using his network of agents that check each other's work > His initial investment was $59,900 > He was able to recoup his costs in 3 months Right now, his average income is $25,000–$30,000 per month He is not a genius: he simply found a niche with high demand and created an offer

Bober_smart

553,644 views • 1 month ago

i've been paying 200$/month for AI tools for a while now claude, chatgpt, all of it thought that was just the price of doing things properly then i read this and had to close my laptop for a second someone bought a used GPU from eBay for $700 five years old. RTX 3090. the kind of card people sell when they upgrade for gaming plugged in a free model called Qwen 3.6 that alibaba quietly dropped last month and it scored 84.1 on vision tasks claude 4.5 opus scored 77.0 the 200$/month subscription lost to a free model running on old hardware the math gets worse after 4 months you've paid off the GPU from month 5 onwards you pay $8 for electricity that's it no subscription. no per message cost. nothing leaves your computer. ever. turns out i didn't have to is anyone else just finding out about this or was i the last one to know?
0:15

i've been paying 200$/month for AI tools for a while now claude, chatgpt, all of it thought that was just the price of doing things properly then i read this and had to close my laptop for a second someone bought a used GPU from eBay for $700 five years old. RTX 3090. the kind of card people sell when they upgrade for gaming plugged in a free model called Qwen 3.6 that alibaba quietly dropped last month and it scored 84.1 on vision tasks claude 4.5 opus scored 77.0 the 200$/month subscription lost to a free model running on old hardware the math gets worse after 4 months you've paid off the GPU from month 5 onwards you pay $8 for electricity that's it no subscription. no per message cost. nothing leaves your computer. ever. turns out i didn't have to is anyone else just finding out about this or was i the last one to know?

Crypto Mavka

14,126 views • 2 months ago