Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

The world changed this week Governments started banning frontier models. Hardware has become unobtainable The single most important thing you can be doing right now is getting into local AI In this video I cover EVERYTHING local AI. Most important video you'll watch this week:

197,544 Aufrufe • vor 3 Monaten •via X (Twitter)

35 Kommentare

Profilbild von leyten
leytenvor 3 Monaten

The bottleneck of local ai is the ability of running frontier models on affordable consumer hardware. Now imagine connecting all the idle GPU's to one network and running sharded inference. Swarms powering frontier models such as GLM-5.2, that's the goal of @c0mputeAI.

Profilbild von Pau Kuntong
Pau Kuntongvor 3 Monaten

Too early for local AI. cause the speed is terribly slow!

Profilbild von Alex Finn
Alex Finnvor 3 Monaten

This is the single biggest problem most people have. All they think about is the present. If you don't open your mind and think into the future, you're going to lose Clearly local AI will become incredible, but at that time hardware will not be obtainable

Profilbild von Fred Krueger
Fred Kruegervor 3 Monaten

great video.

Profilbild von Alex Finn
Alex Finnvor 3 Monaten

Thanks chief

Profilbild von Vik Sharɱa - Cake Wallet & Radar Chat 🇺🇸 📡
Vik Sharɱa - Cake Wallet & Radar Chat 🇺🇸 📡vor 3 Monaten

I just watched this one. Good one.

Profilbild von Robert Scoble
Robert Scoblevor 3 Monaten

Yes sir:

Profilbild von thornton
thorntonvor 3 Monaten

The only problem with putting a substantial investment into hardware now is that it could be irrelevant in the next 6-12 months, coming from someone who has the money to deploy but is weary with pace of advancements, what if in 6-12 months you can run something like Fable 5 on a fully maxed out MacBook Pro? or an iphone

Profilbild von TomOnTech
TomOnTechvor 3 Monaten

yes. people need to understand the current cheap claude and chat gpt pricing are not sustainable and they are just subsidizing growth for profit ..,.FOR NOW Once that changes local AI really makes sense

Profilbild von ∞ Sunantha ∞
∞ Sunantha ∞vor 3 Monaten

Hey Alex, nice AI agentic dev setup there 👍 Have you ever tried to put your pieces of code to the WORLD COMPUTER? Your security efforts will drastically decrease 😉

Profilbild von Farce Force Five
Farce Force Fivevor 3 Monaten

I can't believe I bought 128GB of DDR5 nine months ago for $350. I thought it was overpriced and almost waited. Now it's MSRP is about $1900 but unavailable via normal markets and over $4k to actually get it delivered. This is a huge mind fuck for somebody who has watched RAM grow in size and shrink in price for over 40 years to see this drastic of a change happen so fast. I'm kicking myself for not buying a couple of name brand big NVME sticks back then.

Profilbild von Diam
Diamvor 3 Monaten

Local AI is not outside politics forever. If downloadable models reach Mythos or GPT-5.6 Sol risk levels, governments will not just shrug at the workaround. They will start caring about chips, weights, mirrors, installers, and who makes one-click deployment possible.

Profilbild von Miguel Sanchez
Miguel Sanchezvor 3 Monaten

Yes my problem is the math for you to buy a local machine that can run these good models you're talking about at least $10k, let's say. If you even just rent a server to run the local models, it is thousands of hours you can use before paying that. With local models it only makes sense if you're running something 24/7 and I don't know what you can run 24/7, not even code, because you have to check code and give it feedback. If you're just running code all day every day without checking it, that doesn't make sense so the math still doesn't line up for me. Maybe I'm thinking about this wrong though.

Profilbild von Bren
Brenvor 3 Monaten

the year is 2027. gpt-6 and fable 5.5 just released. you log in to use codex or claude code and first you gotta finish your retinal scan with the us government.

Profilbild von Layton Gott
Layton Gottvor 3 Monaten

I'm trying to make as much money as possible right now to get compute and be prepared

Profilbild von Ben Pielstick
Ben Pielstickvor 3 Monaten

We're already past where local AI makes financial sense.

Profilbild von ashen
ashenvor 3 Monaten

r u using screen studio btw

Profilbild von JASON MCNAB
JASON MCNABvor 3 Monaten

DGX Spark is the buy!!! It is on sale at micro center now for $4000

Profilbild von Dustin Burnham
Dustin Burnhamvor 3 Monaten

So as an example, I pay 20 bucks a month for pretty much all of the non-coding tokens I would ever need for Gemini. Are we thinking the cost for this is going to explode soon?

Profilbild von Daniel Leach
Daniel Leachvor 3 Monaten

Most people are already priced out. Eventually prices will come down but until then most are stuck with what we are allowed to have.

Profilbild von Riddle
Riddlevor 3 Monaten

Bookmarking. Local ai is real alpha, but what's minimal specs we need to used opus tier models?

Profilbild von Salty
Saltyvor 3 Monaten

They tend to ban what they can't control.

Profilbild von Carter Williamson
Carter Williamsonvor 3 Monaten

I can’t wait until someone can figure out how to train an ai without massive compute, this would be great to feed all of the info you want into it and have personalized answers without having to reference memory or info files.

Profilbild von Ziwen
Ziwenvor 3 Monaten

Trying to go micro center to get my first DGX

Profilbild von mike
mikevor 3 Monaten

what's the minimum viable setup you'd actually recommend for someone starting today to run local?

Profilbild von Streetshield
Streetshieldvor 3 Monaten

Without bias, would you build a beast pc or go a mac studio right now? If you could only choose one

Profilbild von King Anubis
King Anubisvor 3 Monaten

Thank you for being honest. You are right, we can’t enter the next version of the web following blindly paying for inference at the mercy of companies and governments.

Profilbild von Luckey Faraday
Luckey Faradayvor 3 Monaten

Everyone should downloading local models Even if you don't have the hardware yet They might not be available some day

Profilbild von Rodrigo Benzaquen
Rodrigo Benzaquenvor 3 Monaten

@_BoulderTech is doing that.

Profilbild von Nigel the Anomaly
Nigel the Anomalyvor 3 Monaten

Thank you, Alex Finn. I completely agree. Let us pray that governments reverse their bans, and hardware gradually becomes affordable or at least available again. I Sortof predicted this would happen, and why the Nvidia-China ban was more for our benefit, than any military danger

Profilbild von Burning Bridges
Burning Bridgesvor 3 Monaten

EVERYTHING. AMAZING. WORLD CHANGING. GOTTA DO THIS NOW. YOUR LIFE IS DIFFERENT. THIS IS AMAZING. FFS tone down the "awesome". Jesus...

Profilbild von Alex Reeder
Alex Reedervor 3 Monaten

Agree, but with the Apple price hike feels like the ROI on the hardware(RAM) is about 3 years to run local. I don’t think many regular users are willing to make that investment.

Profilbild von hacsceo
hacsceovor 3 Monaten

Its 1970s and the disco is calling you. the party is in here @AlexFinn . come build the future

Profilbild von Trav 🇨🇦
Trav 🇨🇦vor 3 Monaten

Another banger video Alex. Bookmarked this and will be going through it with a fine toothed comb this evening. Thank you my friend.

Profilbild von TyinTech
TyinTechvor 3 Monaten

Decentralized world incoming

Ähnliche Videos