Loading video...

Video Failed to Load

Go Home

The world changed this week Governments started banning frontier models. Hardware has become unobtainable The single most important thing you can be doing right now is getting into local AI In this video I cover EVERYTHING local AI. Most important video you'll watch this week:

197,544 views • 3 months ago •via X (Twitter)

35 Comments

leyten's profile picture
leyten3 months ago

The bottleneck of local ai is the ability of running frontier models on affordable consumer hardware. Now imagine connecting all the idle GPU's to one network and running sharded inference. Swarms powering frontier models such as GLM-5.2, that's the goal of @c0mputeAI.

Pau Kuntong's profile picture
Pau Kuntong3 months ago

Too early for local AI. cause the speed is terribly slow!

Alex Finn's profile picture
Alex Finn3 months ago

This is the single biggest problem most people have. All they think about is the present. If you don't open your mind and think into the future, you're going to lose Clearly local AI will become incredible, but at that time hardware will not be obtainable

Fred Krueger's profile picture
Fred Krueger3 months ago

great video.

Alex Finn's profile picture
Alex Finn3 months ago

Thanks chief

Vik Sharɱa - Cake Wallet & Radar Chat 🇺🇸 📡's profile picture
Vik Sharɱa - Cake Wallet & Radar Chat 🇺🇸 📡3 months ago

I just watched this one. Good one.

Robert Scoble's profile picture
Robert Scoble3 months ago

Yes sir:

thornton's profile picture
thornton3 months ago

The only problem with putting a substantial investment into hardware now is that it could be irrelevant in the next 6-12 months, coming from someone who has the money to deploy but is weary with pace of advancements, what if in 6-12 months you can run something like Fable 5 on a fully maxed out MacBook Pro? or an iphone

TomOnTech's profile picture
TomOnTech3 months ago

yes. people need to understand the current cheap claude and chat gpt pricing are not sustainable and they are just subsidizing growth for profit ..,.FOR NOW Once that changes local AI really makes sense

∞ Sunantha ∞'s profile picture
∞ Sunantha ∞3 months ago

Hey Alex, nice AI agentic dev setup there 👍 Have you ever tried to put your pieces of code to the WORLD COMPUTER? Your security efforts will drastically decrease 😉

Farce Force Five's profile picture
Farce Force Five3 months ago

I can't believe I bought 128GB of DDR5 nine months ago for $350. I thought it was overpriced and almost waited. Now it's MSRP is about $1900 but unavailable via normal markets and over $4k to actually get it delivered. This is a huge mind fuck for somebody who has watched RAM grow in size and shrink in price for over 40 years to see this drastic of a change happen so fast. I'm kicking myself for not buying a couple of name brand big NVME sticks back then.

Diam's profile picture
Diam3 months ago

Local AI is not outside politics forever. If downloadable models reach Mythos or GPT-5.6 Sol risk levels, governments will not just shrug at the workaround. They will start caring about chips, weights, mirrors, installers, and who makes one-click deployment possible.

Miguel Sanchez's profile picture
Miguel Sanchez3 months ago

Yes my problem is the math for you to buy a local machine that can run these good models you're talking about at least $10k, let's say. If you even just rent a server to run the local models, it is thousands of hours you can use before paying that. With local models it only makes sense if you're running something 24/7 and I don't know what you can run 24/7, not even code, because you have to check code and give it feedback. If you're just running code all day every day without checking it, that doesn't make sense so the math still doesn't line up for me. Maybe I'm thinking about this wrong though.

Bren's profile picture
Bren3 months ago

the year is 2027. gpt-6 and fable 5.5 just released. you log in to use codex or claude code and first you gotta finish your retinal scan with the us government.

Layton Gott's profile picture
Layton Gott3 months ago

I'm trying to make as much money as possible right now to get compute and be prepared

Ben Pielstick's profile picture
Ben Pielstick3 months ago

We're already past where local AI makes financial sense.

ashen's profile picture
ashen3 months ago

r u using screen studio btw

JASON MCNAB's profile picture
JASON MCNAB3 months ago

DGX Spark is the buy!!! It is on sale at micro center now for $4000

Dustin Burnham's profile picture
Dustin Burnham3 months ago

So as an example, I pay 20 bucks a month for pretty much all of the non-coding tokens I would ever need for Gemini. Are we thinking the cost for this is going to explode soon?

Daniel Leach's profile picture
Daniel Leach3 months ago

Most people are already priced out. Eventually prices will come down but until then most are stuck with what we are allowed to have.

Riddle's profile picture
Riddle3 months ago

Bookmarking. Local ai is real alpha, but what's minimal specs we need to used opus tier models?

Salty's profile picture
Salty3 months ago

They tend to ban what they can't control.

Carter Williamson's profile picture
Carter Williamson3 months ago

I can’t wait until someone can figure out how to train an ai without massive compute, this would be great to feed all of the info you want into it and have personalized answers without having to reference memory or info files.

Ziwen's profile picture
Ziwen3 months ago

Trying to go micro center to get my first DGX

mike's profile picture
mike3 months ago

what's the minimum viable setup you'd actually recommend for someone starting today to run local?

Streetshield's profile picture
Streetshield3 months ago

Without bias, would you build a beast pc or go a mac studio right now? If you could only choose one

King Anubis's profile picture
King Anubis3 months ago

Thank you for being honest. You are right, we can’t enter the next version of the web following blindly paying for inference at the mercy of companies and governments.

Luckey Faraday's profile picture
Luckey Faraday3 months ago

Everyone should downloading local models Even if you don't have the hardware yet They might not be available some day

Rodrigo Benzaquen's profile picture
Rodrigo Benzaquen3 months ago

@_BoulderTech is doing that.

Nigel the Anomaly's profile picture
Nigel the Anomaly3 months ago

Thank you, Alex Finn. I completely agree. Let us pray that governments reverse their bans, and hardware gradually becomes affordable or at least available again. I Sortof predicted this would happen, and why the Nvidia-China ban was more for our benefit, than any military danger

Burning Bridges's profile picture
Burning Bridges3 months ago

EVERYTHING. AMAZING. WORLD CHANGING. GOTTA DO THIS NOW. YOUR LIFE IS DIFFERENT. THIS IS AMAZING. FFS tone down the "awesome". Jesus...

Alex Reeder's profile picture
Alex Reeder3 months ago

Agree, but with the Apple price hike feels like the ROI on the hardware(RAM) is about 3 years to run local. I don’t think many regular users are willing to make that investment.

hacsceo's profile picture
hacsceo3 months ago

Its 1970s and the disco is calling you. the party is in here @AlexFinn . come build the future

Trav 🇨🇦's profile picture
Trav 🇨🇦3 months ago

Another banger video Alex. Bookmarked this and will be going through it with a fine toothed comb this evening. Thank you my friend.

TyinTech's profile picture
TyinTech3 months ago

Decentralized world incoming

Related Videos