Loading video...

Video Failed to Load

Go Home

I trained models across MacBooks using Apple's AirDrop protocol. grove is a distributed training library for Apple Silicon. Devices discover each other over AWDL, a direct radio link. If there's a shared WiFi network it upgrades to that for speed, otherwise everything goes over the direct link. No router,...

667,999 views • 4 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Cloud GPU training is a scam. A single M4 MacBook does 2.9 TFLOPS. Seven friends with MacBooks match an NVIDIA A100. Alexander Hayes just open-sourced a tool that makes this work over Wi-Fi. It's called AirTrain. Here's how it works: Traditional distributed training (DDP) syncs gradients after every single step. For a 124M parameter model, that's ~500MB exchanged per step. You need 50 GB/s of sustained bandwidth. Impossible over Wi-Fi. AirTrain uses the DiLoCo algorithm. Each Mac trains independently for 500 steps, then syncs only the difference. One sync per 500 steps instead of one per step. 500x less network communication. Wi-Fi actually works. The entire sync takes ~2 seconds. Here's what makes it wild: → Zero-config discovery. Devices find each other automatically via mDNS/Bonjour. Same protocol as AirDrop. → Fault tolerant. Nodes can join and leave mid-training without killing the run. → Checkpoint relay. Train for a few hours, export a checkpoint, hand it off to someone else to continue. Like a relay race for ML training. → Built on Apple's MLX framework. Native to M1/M2/M3/M4/M5 unified memory. No host-to-device copy overhead. → Local dashboard. Real-time loss curves, peer monitoring, throughput metrics in your browser. Here's the wildest part: An M4 Max with 128GB unified memory can train a 70B parameter model without offloading. An NVIDIA RTX 4090 has 24GB VRAM. Apple Silicon gets ~245-460 GFLOPS per watt. Training on MacBooks costs almost nothing in electricity compared to cloud GPUs. And there are hundreds of millions of Apple Silicon Macs in the world. The math: Traditional DDP: 1 sync per step = 50 GB/s required AirTrain (DiLoCo): 1 sync per 500 steps = 0.1 GB/s required Wi-Fi handles 0.1 GB/s. That's it. That's the breakthrough. They even built a community platform at with live session browsing, checkpoint sharing, and a contributor leaderboard. Training a 124M parameter GPT-2? Instead of renting cloud GPUs at $3/hr, pool three MacBooks in a coffee shop and train for free. MIT licensed. Built in Python. 1 contributor. Early stage but the idea is insane. 100% Open Source. (Link in the comments)

Guri Singh

160,201 views • 3 months ago

Everyone wrote Apple off as the AI loser, but one hardware spec might flip that story upside down (Save this). @jason called Apple a screaming buy on the back of a single chip detail. The rumored M7 Ultra, expected around 2028, is designed to support up to 1.5TB of unified memory, enough to run frontier class trillion parameter AI models locally, with no cloud required. The Street's bear case on Apple is straightforward. Apple has no frontier model of its own, Siri has stumbled for years and the company effectively rents OpenAI's models for its hardest queries. That narrative treats Apple as the one Magnificent Seven name that missed the AI wave entirely but the bull case flips that framing on its head. If frontier AI models keep shrinking and getting cheaper to run, Apple doesn't need the smartest model in the world, it just needs to own the device that model runs on. And unified memory is the mechanism that makes this possible. Unlike traditional systems where the CPU and GPU each need separate memory, Apple's architecture lets the CPU, GPU and Neural Engine draw from one shared pool. A fully specced M7 Ultra could theoretically run something on the scale of a 1.2 trillion parameter model locally and that capability plugs directly into the one advantage Apple has spent over a decade building: privacy. Apple has already shipped Private Cloud Compute, a system designed so even Apple can't access user data processed off device. Apple doubled down on this at WWDC 2026, framing on device privacy as non-negotiable while rivals default to the cloud. If the best AI models get small enough to run on Apple silicon, the moat stops being the model and becomes the hardware it has to sit on. Milk Road Pro remains bullish on Apple and it remains as one of our core positions, if you want the full thesis + our full AI trades, come join us using the link below for just a $1.

Milk Road AI

37,388 views • 22 days ago

What is Apple doing in the AI race? Ever since ChatGPT came out in 2022, every tech company realized that generative AI is the next big thing. So, all these companies dropped everything else and started focusing on it first. Google launches Bard and does a bunch of stuff. Microsoft teams up with OpenAI and rolls out a pilot. Adobe launches Firefly. Elon Musk starts his new company, XI. Meta launches the Llama model. Tons of other AI startups pop up, and investors are throwing money at AI like crazy Apple's AI strategy is fascinating because it's playing a completely different game than Google, Microsoft, and OpenAI. While everyone else rushed to build the most powerful language models, Apple took a fundamentally different approach that aligns with their core business model and strengths Apple Intelligence is comprised of multiple highly capable generative models that are specialized for users' everyday tasks, but unlike competitors, Apple isn't trying to win the raw AI power race. Instead, they're leveraging what they've always done best, creating seamless, integrated experiences The key insight you mentioned about revenue models is crucial. While Microsoft makes 48% from cloud services and Google relies heavily on cloud and subscriptions, Apple's business is 80% hardware driven. This means they don't need to compete on cloud AI services they can focus on making AI work better on the devices people already own Apple's four step strategy you outlined is spot on, The "Invisible Model" approach is brilliant because most users don't want to think about which AI model to use. Tim Cook doubled down on Apple's AI strategy, insisting that generative AI was never off the table and was always about pursuing it in a thoughtful kind of way, they're making AI feel natural rather than technical Ecosystem Integration remains Apple's superpower. At WWDC 2025, Apple announced what it calls the Foundation Models framework, which will let developers tap into its AI models while offline, this is huge because it means third party apps can now leverage Apple's AI without internet dependency, something Google and Microsoft can't easily replicate across their fragmented hardware ecosystem The Distribution Advantage is where Apple really shines. They have direct control over 2 billion devices with powerful Apple Silicon chips that can run AI models locally. Apple is still pushing App Intents, the same system that makes it simpler for Apple Intelligence and Siri to use apps and get things done, which will enable those complex multi app workflows you described Building Trust through privacy focused messaging is classic Apple. They're positioning themselves as the "safe" AI option while competitors deal with data privacy concerns The real genius is that Apple doesn't need to build the world's best AI model, they just need to build the best AI experience. By partnering with OpenAI for complex tasks while handling simple ones locally, they're creating a hybrid approach that prioritizes user experience over technical bragging rights The upcoming Apple Intelligence features slated for 2025 demonstrate Apple's commitment to integrating advanced AI technologies into its devices, enhancing user experience, and promoting productivity, suggesting they're still in the early phases of a longer term strategy This approach could indeed "wipe out" Android and Windows in the AI era not by building better models, but by making AI feel like a natural extension of the devices people already love. It's classic Apple, arrive late, but redefine the entire category

D4rsh🦅

13,266 views • 1 year ago

If you are a SaaS Founder and you want to increase your Domain Authority. To get customers from Google and AI on Autopilot. Let me introduce you to Distribb backlink exchange. We don't just swap links randomly like every other network. Which, by the way, doesn't bring you much power to your website. We built a system that: 1. Connects to your Google Search Console 2. Finds your top 5 direct competitors 3. Calculates your backlink gap 4. Matches you with real websites in your niche 5. Writes articles and listicles that link to you (optimized for Google AND AI answers) 6. Distributes links across your homepage, money pages, and blog with natural anchor diversity 7. Publishes them across the network automatically 8. Spreads everything over months so it looks 100% organic 9. Uses A-B-C linking: no direct swaps, no footprints Bonus: The longer you stay, the more links you get. Month 1: 5 backlinks/mo Month 3: 8 backlinks/mo Month 6: 12 backlinks/mo Month 12: 20 backlinks/mo Month 18: 25 backlinks/mo Month 24: 50 backlinks/mo You start at your current DR level. As your authority grows, you unlock links from stronger sites. You focus on building your product. We handle the SEO. There are already hundreds of websites in the network waiting for you. This is not a marketplace where you pay $500 per link. This is not a PBN that gets you penalized. This is a real network of real SaaS websites exchanging real editorial backlinks. Your first month starts at $9 👇

Florian Darroman

26,669 views • 4 months ago