Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

The world changed this week Governments started banning frontier models. Hardware has become unobtainable The single most important thing you can be doing right now is getting into local AI In this video I cover EVERYTHING local AI. Most important video you'll watch this week:

197,544 görüntüleme • 3 ay önce •via X (Twitter)

35 Yorum

leyten profil fotoğrafı
leyten3 ay önce

The bottleneck of local ai is the ability of running frontier models on affordable consumer hardware. Now imagine connecting all the idle GPU's to one network and running sharded inference. Swarms powering frontier models such as GLM-5.2, that's the goal of @c0mputeAI.

Pau Kuntong profil fotoğrafı
Pau Kuntong3 ay önce

Too early for local AI. cause the speed is terribly slow!

Alex Finn profil fotoğrafı
Alex Finn3 ay önce

This is the single biggest problem most people have. All they think about is the present. If you don't open your mind and think into the future, you're going to lose Clearly local AI will become incredible, but at that time hardware will not be obtainable

Fred Krueger profil fotoğrafı
Fred Krueger3 ay önce

great video.

Alex Finn profil fotoğrafı
Alex Finn3 ay önce

Thanks chief

Vik Sharɱa - Cake Wallet & Radar Chat 🇺🇸 📡 profil fotoğrafı
Vik Sharɱa - Cake Wallet & Radar Chat 🇺🇸 📡3 ay önce

I just watched this one. Good one.

Robert Scoble profil fotoğrafı
Robert Scoble3 ay önce

Yes sir:

thornton profil fotoğrafı
thornton3 ay önce

The only problem with putting a substantial investment into hardware now is that it could be irrelevant in the next 6-12 months, coming from someone who has the money to deploy but is weary with pace of advancements, what if in 6-12 months you can run something like Fable 5 on a fully maxed out MacBook Pro? or an iphone

TomOnTech profil fotoğrafı
TomOnTech3 ay önce

yes. people need to understand the current cheap claude and chat gpt pricing are not sustainable and they are just subsidizing growth for profit ..,.FOR NOW Once that changes local AI really makes sense

∞ Sunantha ∞ profil fotoğrafı
∞ Sunantha ∞3 ay önce

Hey Alex, nice AI agentic dev setup there 👍 Have you ever tried to put your pieces of code to the WORLD COMPUTER? Your security efforts will drastically decrease 😉

Farce Force Five profil fotoğrafı
Farce Force Five3 ay önce

I can't believe I bought 128GB of DDR5 nine months ago for $350. I thought it was overpriced and almost waited. Now it's MSRP is about $1900 but unavailable via normal markets and over $4k to actually get it delivered. This is a huge mind fuck for somebody who has watched RAM grow in size and shrink in price for over 40 years to see this drastic of a change happen so fast. I'm kicking myself for not buying a couple of name brand big NVME sticks back then.

Diam profil fotoğrafı
Diam3 ay önce

Local AI is not outside politics forever. If downloadable models reach Mythos or GPT-5.6 Sol risk levels, governments will not just shrug at the workaround. They will start caring about chips, weights, mirrors, installers, and who makes one-click deployment possible.

Miguel Sanchez profil fotoğrafı
Miguel Sanchez3 ay önce

Yes my problem is the math for you to buy a local machine that can run these good models you're talking about at least $10k, let's say. If you even just rent a server to run the local models, it is thousands of hours you can use before paying that. With local models it only makes sense if you're running something 24/7 and I don't know what you can run 24/7, not even code, because you have to check code and give it feedback. If you're just running code all day every day without checking it, that doesn't make sense so the math still doesn't line up for me. Maybe I'm thinking about this wrong though.

Bren profil fotoğrafı
Bren3 ay önce

the year is 2027. gpt-6 and fable 5.5 just released. you log in to use codex or claude code and first you gotta finish your retinal scan with the us government.

Layton Gott profil fotoğrafı
Layton Gott3 ay önce

I'm trying to make as much money as possible right now to get compute and be prepared

Ben Pielstick profil fotoğrafı
Ben Pielstick3 ay önce

We're already past where local AI makes financial sense.

ashen profil fotoğrafı
ashen3 ay önce

r u using screen studio btw

JASON MCNAB profil fotoğrafı
JASON MCNAB3 ay önce

DGX Spark is the buy!!! It is on sale at micro center now for $4000

Dustin Burnham profil fotoğrafı
Dustin Burnham3 ay önce

So as an example, I pay 20 bucks a month for pretty much all of the non-coding tokens I would ever need for Gemini. Are we thinking the cost for this is going to explode soon?

Daniel Leach profil fotoğrafı
Daniel Leach3 ay önce

Most people are already priced out. Eventually prices will come down but until then most are stuck with what we are allowed to have.

Riddle profil fotoğrafı
Riddle3 ay önce

Bookmarking. Local ai is real alpha, but what's minimal specs we need to used opus tier models?

Salty profil fotoğrafı
Salty3 ay önce

They tend to ban what they can't control.

Carter Williamson profil fotoğrafı
Carter Williamson3 ay önce

I can’t wait until someone can figure out how to train an ai without massive compute, this would be great to feed all of the info you want into it and have personalized answers without having to reference memory or info files.

Ziwen profil fotoğrafı
Ziwen3 ay önce

Trying to go micro center to get my first DGX

mike profil fotoğrafı
mike3 ay önce

what's the minimum viable setup you'd actually recommend for someone starting today to run local?

Streetshield profil fotoğrafı
Streetshield3 ay önce

Without bias, would you build a beast pc or go a mac studio right now? If you could only choose one

King Anubis profil fotoğrafı
King Anubis3 ay önce

Thank you for being honest. You are right, we can’t enter the next version of the web following blindly paying for inference at the mercy of companies and governments.

Luckey Faraday profil fotoğrafı
Luckey Faraday3 ay önce

Everyone should downloading local models Even if you don't have the hardware yet They might not be available some day

Rodrigo Benzaquen profil fotoğrafı
Rodrigo Benzaquen3 ay önce

@_BoulderTech is doing that.

Nigel the Anomaly profil fotoğrafı
Nigel the Anomaly3 ay önce

Thank you, Alex Finn. I completely agree. Let us pray that governments reverse their bans, and hardware gradually becomes affordable or at least available again. I Sortof predicted this would happen, and why the Nvidia-China ban was more for our benefit, than any military danger

Burning Bridges profil fotoğrafı
Burning Bridges3 ay önce

EVERYTHING. AMAZING. WORLD CHANGING. GOTTA DO THIS NOW. YOUR LIFE IS DIFFERENT. THIS IS AMAZING. FFS tone down the "awesome". Jesus...

Alex Reeder profil fotoğrafı
Alex Reeder3 ay önce

Agree, but with the Apple price hike feels like the ROI on the hardware(RAM) is about 3 years to run local. I don’t think many regular users are willing to make that investment.

hacsceo profil fotoğrafı
hacsceo3 ay önce

Its 1970s and the disco is calling you. the party is in here @AlexFinn . come build the future

Trav 🇨🇦 profil fotoğrafı
Trav 🇨🇦3 ay önce

Another banger video Alex. Bookmarked this and will be going through it with a fine toothed comb this evening. Thank you my friend.

TyinTech profil fotoğrafı
TyinTech3 ay önce

Decentralized world incoming

Benzer Videolar