THIS DEVELOPER RAN THE LARGEST AI MODEL IN THE WORLD ON 5 MAC STUDIOS - AND IT COST 100X LESS THAN…
Noisy
Visit on X@noisyb0y122K followers
21,553 views
THIS DEVELOPER RAN THE LARGEST AI MODEL IN THE WORLD ON 5 MAC STUDIOS - AND IT COST 100X LESS THAN WHAT OPENAI USES
27:47 he says it after hours of setup - Llama 3.1 405B running locally on five Mac Studios - a model that normally requires 42 GPUs at $1,600 each or an entire data center
320GB unified memory combined - every Mac Studio adds its 64GB into one shared pool - and a model that needs 1TB of VRAM just distributes across all five
it launched, it responded and not a single token went to OpenAI or Google - everything local, everything private, everything yours and 100x cheaper
5 Mac Studios, 46 watts for all of them in idle - less than one light bulb per machine
what OpenAI keeps behind a subscription he ran at home with a one-time purchase in a few clicks
Comments
Comments from the original post on X (Twitter)
No comments yet
