正在加载视频...

视频加载失败

The world changed this week Governments started banning frontier models. Hardware has become unobtainable The single most important thing you can be doing right now is getting into local AI In this video I cover EVERYTHING local AI. Most important video you'll watch this week:

197,544 次观看 • 3 个月前 •via X (Twitter)

35 条评论

leyten 的头像
leyten3 个月前

The bottleneck of local ai is the ability of running frontier models on affordable consumer hardware. Now imagine connecting all the idle GPU's to one network and running sharded inference. Swarms powering frontier models such as GLM-5.2, that's the goal of @c0mputeAI.

Pau Kuntong 的头像
Pau Kuntong3 个月前

Too early for local AI. cause the speed is terribly slow!

Alex Finn 的头像
Alex Finn3 个月前

This is the single biggest problem most people have. All they think about is the present. If you don't open your mind and think into the future, you're going to lose Clearly local AI will become incredible, but at that time hardware will not be obtainable

Fred Krueger 的头像
Fred Krueger3 个月前

great video.

Alex Finn 的头像
Alex Finn3 个月前

Thanks chief

Vik Sharɱa - Cake Wallet & Radar Chat 🇺🇸 📡 的头像
Vik Sharɱa - Cake Wallet & Radar Chat 🇺🇸 📡3 个月前

I just watched this one. Good one.

Robert Scoble 的头像
Robert Scoble3 个月前

Yes sir:

thornton 的头像
thornton3 个月前

The only problem with putting a substantial investment into hardware now is that it could be irrelevant in the next 6-12 months, coming from someone who has the money to deploy but is weary with pace of advancements, what if in 6-12 months you can run something like Fable 5 on a fully maxed out MacBook Pro? or an iphone

TomOnTech 的头像
TomOnTech3 个月前

yes. people need to understand the current cheap claude and chat gpt pricing are not sustainable and they are just subsidizing growth for profit ..,.FOR NOW Once that changes local AI really makes sense

∞ Sunantha ∞ 的头像
∞ Sunantha ∞3 个月前

Hey Alex, nice AI agentic dev setup there 👍 Have you ever tried to put your pieces of code to the WORLD COMPUTER? Your security efforts will drastically decrease 😉

Farce Force Five 的头像
Farce Force Five3 个月前

I can't believe I bought 128GB of DDR5 nine months ago for $350. I thought it was overpriced and almost waited. Now it's MSRP is about $1900 but unavailable via normal markets and over $4k to actually get it delivered. This is a huge mind fuck for somebody who has watched RAM grow in size and shrink in price for over 40 years to see this drastic of a change happen so fast. I'm kicking myself for not buying a couple of name brand big NVME sticks back then.

Diam 的头像
Diam3 个月前

Local AI is not outside politics forever. If downloadable models reach Mythos or GPT-5.6 Sol risk levels, governments will not just shrug at the workaround. They will start caring about chips, weights, mirrors, installers, and who makes one-click deployment possible.

Miguel Sanchez 的头像
Miguel Sanchez3 个月前

Yes my problem is the math for you to buy a local machine that can run these good models you're talking about at least $10k, let's say. If you even just rent a server to run the local models, it is thousands of hours you can use before paying that. With local models it only makes sense if you're running something 24/7 and I don't know what you can run 24/7, not even code, because you have to check code and give it feedback. If you're just running code all day every day without checking it, that doesn't make sense so the math still doesn't line up for me. Maybe I'm thinking about this wrong though.

Bren 的头像
Bren3 个月前

the year is 2027. gpt-6 and fable 5.5 just released. you log in to use codex or claude code and first you gotta finish your retinal scan with the us government.

Layton Gott 的头像
Layton Gott3 个月前

I'm trying to make as much money as possible right now to get compute and be prepared

Ben Pielstick 的头像
Ben Pielstick3 个月前

We're already past where local AI makes financial sense.

ashen 的头像
ashen3 个月前

r u using screen studio btw

JASON MCNAB 的头像
JASON MCNAB3 个月前

DGX Spark is the buy!!! It is on sale at micro center now for $4000

Dustin Burnham 的头像
Dustin Burnham3 个月前

So as an example, I pay 20 bucks a month for pretty much all of the non-coding tokens I would ever need for Gemini. Are we thinking the cost for this is going to explode soon?

Daniel Leach 的头像
Daniel Leach3 个月前

Most people are already priced out. Eventually prices will come down but until then most are stuck with what we are allowed to have.

Riddle 的头像
Riddle3 个月前

Bookmarking. Local ai is real alpha, but what's minimal specs we need to used opus tier models?

Salty 的头像
Salty3 个月前

They tend to ban what they can't control.

Carter Williamson 的头像
Carter Williamson3 个月前

I can’t wait until someone can figure out how to train an ai without massive compute, this would be great to feed all of the info you want into it and have personalized answers without having to reference memory or info files.

Ziwen 的头像
Ziwen3 个月前

Trying to go micro center to get my first DGX

mike 的头像
mike3 个月前

what's the minimum viable setup you'd actually recommend for someone starting today to run local?

Streetshield 的头像
Streetshield3 个月前

Without bias, would you build a beast pc or go a mac studio right now? If you could only choose one

King Anubis 的头像
King Anubis3 个月前

Thank you for being honest. You are right, we can’t enter the next version of the web following blindly paying for inference at the mercy of companies and governments.

Luckey Faraday 的头像
Luckey Faraday3 个月前

Everyone should downloading local models Even if you don't have the hardware yet They might not be available some day

Rodrigo Benzaquen 的头像
Rodrigo Benzaquen3 个月前

@_BoulderTech is doing that.

Nigel the Anomaly 的头像
Nigel the Anomaly3 个月前

Thank you, Alex Finn. I completely agree. Let us pray that governments reverse their bans, and hardware gradually becomes affordable or at least available again. I Sortof predicted this would happen, and why the Nvidia-China ban was more for our benefit, than any military danger

Burning Bridges 的头像
Burning Bridges3 个月前

EVERYTHING. AMAZING. WORLD CHANGING. GOTTA DO THIS NOW. YOUR LIFE IS DIFFERENT. THIS IS AMAZING. FFS tone down the "awesome". Jesus...

Alex Reeder 的头像
Alex Reeder3 个月前

Agree, but with the Apple price hike feels like the ROI on the hardware(RAM) is about 3 years to run local. I don’t think many regular users are willing to make that investment.

hacsceo 的头像
hacsceo3 个月前

Its 1970s and the disco is calling you. the party is in here @AlexFinn . come build the future

Trav 🇨🇦 的头像
Trav 🇨🇦3 个月前

Another banger video Alex. Bookmarked this and will be going through it with a fine toothed comb this evening. Thank you my friend.

TyinTech 的头像
TyinTech3 个月前

Decentralized world incoming

相关视频