Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B... MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.show more

M4 Mac Mini AI Cluster Uses EXO Labs with... Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).show more

AGI at home Running DeepSeek R1 across my 7... M4 Pro Mac Minis and 1 M4 Max MacBook Pro. Total unified memory = 496GB. Uses EXO Labs distributed inference with 4-bit quantization. Next goal is fp8 (requires >700GB)show more

Distributed training on M4 Mac Mini cluster We implemented... Google DeepMind DiLoCo on Apple Silicon to train large models with 100-1000x less bandwidth compared to DDP baseline. AI is entering a new era where a distributed network of consumer devices can train large models.show more

Running DeepSeek R1 on my desk Uses EXO Labs... with Thunderbolt 5 interconnect (80Gbps) to run the full (671B, 8-bit) DeepSeek R1 distributed across 2 M3 Ultra 512GB Mac Studios (1TB total Unified Memory). Runs at 11 tok/sec. Theoretical max is ~20 tok/sec.show more

The tiny new Mac Mini - M4 and M4... Pro chips - 5 x 5 inch cube footprint - Headphone jack on the front - Starting at $599 with 16GB Memoryshow more

Got continuous batching working with SSMs in mlx-lm. Here's... four OpenCode agents simultaneously running Nvidia's Nemotron Nano on 64GB M4 Max. This is a nice model for smaller machines since it's MoE + hybrid attention (small cache).show more

M4 Mac Mini AI cluster running Llama 3.3 70B... Preliminary results show Gigabit ethernet switch (4 tok/sec) is slower than Thunderbolt-5 with EXO Labs Benchmarks including Thunderbolt-5 coming soonTM.show more

MARCUS CHEN STACKED 30 MAC MINIS INTO AN AI... SERVER FARM. ONE $599 MAC MINI REPLACES YOUR $200/MONTH CLAUDE CODE BILL WITH $3 IN ELECTRICITY two months ago a developer posted his claude code bill on reddit. $170 in 10 days. someone replied "i bought a mac mini m4. haven't paid anthropic since." apple stores ran out of mac minis the same week the m4 chip has 120 gb/s memory bandwidth and unified memory architecture. cpu and gpu share one pool so the model loads once and both read from it. a $599 mac mini runs ai faster than a $1,500 windows pc with a discrete gpu since january 2026 ollama supports the anthropic messages api format. claude code connects directly to your local mac mini with one environment variable. same interface, zero api costs, $0 per request a heavy developer pays $459 a month across claude code max, chatgpt pro, gemini, cursor and copilot. that's $5,508 a year. the mac mini pays off in 3 months and runs on $3 in electricity after that uber rolled out claude code to 5,000 engineers and burned through their $3.4 billion 2026 ai budget in 4 months. the people who own the hardware in 2026 are going to look very far ahead in 2028 bookmark this and read the article belowshow more

Watch Max, our VP of Customer Success, transform his... workspace with Apple Mac mini — with it's compact design and powerful M4 chip, his ordinary desk is now a creative hub.💡How are you stepping up your workspace for 2025? #smallbusinesssaturday #shopsmallsaturdayshow more

THIS $599 MAC MINI CAN DRIVE THREE DISPLAYS NATIVELY... - THIS SETUP TOOK "MORE SCREEN SPACE" SO FAR IT ENDED WITH BINOCULARS. the M4 Mac mini shrinks a full desktop into a 5 x 5-inch box. the base model launched with: 10-core CPU 10-core GPU 16GB unified memory support for two 6K displays plus one 5K display the M4 Pro version can drive three 6K displays at 60Hz, pushing more than 60 million pixels at once. no DisplayLink software is required for the supported three-screen configuration. the video turns that spec into a monitor wall, then delivers the punchline when the creator reaches for binoculars. honest line: Apple guarantees up to three native displays. the clip does not prove every screen in the room is connected to this one Mac mini. the tiny computer solved the screen limit. the next bottleneck is finding the window you opened. bookmark & watch today ↓show more

How much faster is the new MacBook Pro for... AI inference? M4 Max is 27% faster with 72 tok/sec compared to 56 tok/sec of the M3 Max with MLX running Gemma 2 9B (4bit). The 27% speedup is the same with Llama-3.2-1b, Llama-3.2-3b and others. Next up: EXO Labs M4 cluster.show more

NVIDIA just dropped Nemotron-3-Nano:4b — a tiny 2.8GB model.... Guess whose hardware runs it the fastest? - RTX 4090: 226 tok/s - RTX 3090: 187 tok/s - Mac Studio M2 Ultra: 86 tok/s - Mac Mini M4: 25 tok/s Home court advantage is real. Also trying a new layout with live performance charts. Lmk what you think!show more

Want full control over the OpenClaw/Hermes Agent on your... Mac Mini? Looking to build a Mac Mini Cluster with remote physical power control? Try #NanoKVM-Go! A single USB-C connection is all you need for complete remote access and Fingerbot power control!👇show more

Apple just showcased the ultimate setup for running AI... models locally. These are 4 M5 Ultra Mac Studios running Kimi K2.7 Code locally to fix a bug in a 3D rendered scene on XCode. Each has 256GB RAM, so thats 1TB combined memory. Enough to run the biggest open AI models locally like Llama 4, Deepseek v3 and Qwen 3. Perfect for agentic coding when the project codebase is sensitive and you wan to keep it private. This is easily a $50K setup!show more

A HARDWARE MODDER BOLTED A BATTERY PACK ONTO A... $599 MAC MINI M4 AND TURNED A DESK SERVER INTO A BACKPACK AI RIG THAT RUNS FOR EIGHT HOURS WITHOUT A WALL OUTLET he posts a video of the mac mini with a slim battery module clamped to the side, USB-C plugged into the back. no power brick, no outlet, just the 10 to 30W draw of the M4 chip pulling from a 20,000mAh bank. a full work day on one charge. this is not a portable laptop trick. it is a desk-class AI server that fits in a sling bag the same $599 mac mini i recommended in last week's article as the silent default, now untethered. pair it with a mobile hotspot or a Starlink mini and you have a fully off-grid LLM stack that answers questions in a forest, on a plane, in a power outage. the model lives in the box, the battery powers the box, that is the whole stack this is not a gadget. it is the first time the words "AI server" and "fits in your bag" belong in the same sentenceshow more

THIS SHELF OF MAC MINIS REPLACES $4,080 A YEAR... IN AI SUBSCRIPTIONS 00:02 the camera pans across a shelf of stacked Mac minis and the trick is obvious: that silent little farm runs the models you rent every month most people pay 7 companies for AI and use 3 of the tools. they forget the rest on the credit card and call it a stack the Mac mini M4 ends that. one shared memory pool means a $599 box runs 7B and 8B models faster than Windows machines that cost twice as much ollama pull, one command. open webui in one docker line. point Claude Code at localhost and it just works it draws 10 to 30 watts, sits silent next to a router, and runs 24/7 for $3 a month in power it pays back a $20 ChatGPT Plus sub in 3 months, then saves you $4,000 a year while the frontier still rents you compute every month you wait is another $340 gone for compute that fits on a shelfshow more

This guy from China makes $12,500 a month walking... around crypto conferences with a backpack and a Mac Mini inside it. The setup is a Mac Mini running OpenClaw on a CUKTECH 10 Mini battery. Every other creator at these events waits until they're back at the hotel to process and upload. By then the alpha is gone and the thread is late. His portable AI catches keynote audio on the spot, extracts what matters and posts while everyone else is still in the room listening.show more