Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

THEY RAN A LOCAL AI MODEL ON A RASPBERRY PI THAT COSTS LESS THAN $300 no cloud no subscription no data center device smaller than your wallet output on a 27 year old iMac I tested local ai this week on a macbook and a phone the hardware keeps... show more

leopardracer

8,897 subscribers

73,534 Aufrufe • vor 3 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

THEY RAN STATE OF THE ART AI ON A 26 YEAR OLD IMAC WITH ZERO INTERNET not a demo. not a benchmark a real answer in near instant time on hardware older than most people reading this your subscription money is going to a data center that doesn't need it the future already runs locally on dead hardware from 1999 bookmark this before you pay for another month of cloud AI you don't need

THEY RAN STATE OF THE ART AI ON A 26 YEAR OLD IMAC WITH ZERO INTERNET not a demo. not a benchmark a real answer in near instant time on hardware older than most people reading this your subscription money is going to a data center that doesn't need it the future already runs locally on dead hardware from 1999 bookmark this before you pay for another month of cloud AI you don't need

leopardracer

2,764,696 Aufrufe • vor 3 Monaten

YOUR OLD ANDROID PHONE IS A FREE AI VISION SERVER AND YOU DON’T KNOW IT one dev built an app that turns any android into a local openai-compatible LLM server with vision support, analyzes camera feeds entirely on-device, no cloud, no subscriptions, nothing leaves your network you already own the hardware, it’s just sitting in a drawer full breakdown below ↓

YOUR OLD ANDROID PHONE IS A FREE AI VISION SERVER AND YOU DON’T KNOW IT one dev built an app that turns any android into a local openai-compatible LLM server with vision support, analyzes camera feeds entirely on-device, no cloud, no subscriptions, nothing leaves your network you already own the hardware, it’s just sitting in a drawer full breakdown below ↓

leopardracer

21,844 Aufrufe • vor 2 Monaten

Qwen 3.6 35B running at over 100 tokens per second on my $5,399 MacBook Pro M5 Max. This is the best local AI model I have ever run. 128GB of unified memory. No cloud. No API costs. No rate limits. Just raw local inference at speeds I didn't think were possible on a laptop. This model is more intelligent than GPT 5 on benchmarks. Running locally. On a MacBook. For free after the hardware cost. I said local AI would never compete with frontier. I'm starting to rethink that. The gap is closing faster than anyone expected.

Qwen 3.6 35B running at over 100 tokens per second on my $5,399 MacBook Pro M5 Max. This is the best local AI model I have ever run. 128GB of unified memory. No cloud. No API costs. No rate limits. Just raw local inference at speeds I didn't think were possible on a laptop. This model is more intelligent than GPT 5 on benchmarks. Running locally. On a MacBook. For free after the hardware cost. I said local AI would never compete with frontier. I'm starting to rethink that. The gap is closing faster than anyone expected.

BridgeMind

62,800 Aufrufe • vor 2 Monaten

people think running AI locally requires: → $3,000 MacBook Pro → RTX 4090 → $20/month cloud subscription nvidia just dropped a $249 computer. 67 TOPS. runs llama 3.1-8B locally. no internet. no API. no monthly fee. ever. smaller than your router. costs the same as AirPods. runs the same models you pay $240/year to access via ChatGPT. the local AI era just got a price tag. $249.

people think running AI locally requires: → $3,000 MacBook Pro → RTX 4090 → $20/month cloud subscription nvidia just dropped a $249 computer. 67 TOPS. runs llama 3.1-8B locally. no internet. no API. no monthly fee. ever. smaller than your router. costs the same as AirPods. runs the same models you pay $240/year to access via ChatGPT. the local AI era just got a price tag. $249.

self.dll

321,624 Aufrufe • vor 3 Monaten

THIS DEVELOPER LINES UP EVERY SMALL COMPUTER FROM RASPBERRY PI TO MAC MINI - AND EVERY SINGLE ONE CAN RUN LOCAL AI Raspberry Pi Zero 2W for $15, Odroid, thin client, AMD BC250 - a whole range of computers from credit card size to full desktop replacement AMD BC250 is an entire mid-range gaming computer on one card - they come in boxes of 12 and every single one runs local LLMs Mac Mini, N97 with 16GB RAM, 13th gen i7 - any of them replaces $236/month in subscriptions and costs $3/month in electricity you don't need an expensive server - even a $15 Raspberry Pi can run something useful locally without cloud and without subscriptions $600 once, one evening of setup - and AI that runs 24/7 on hardware that might already be sitting in your house

THIS DEVELOPER LINES UP EVERY SMALL COMPUTER FROM RASPBERRY PI TO MAC MINI - AND EVERY SINGLE ONE CAN RUN LOCAL AI Raspberry Pi Zero 2W for $15, Odroid, thin client, AMD BC250 - a whole range of computers from credit card size to full desktop replacement AMD BC250 is an entire mid-range gaming computer on one card - they come in boxes of 12 and every single one runs local LLMs Mac Mini, N97 with 16GB RAM, 13th gen i7 - any of them replaces $236/month in subscriptions and costs $3/month in electricity you don't need an expensive server - even a $15 Raspberry Pi can run something useful locally without cloud and without subscriptions $600 once, one evening of setup - and AI that runs 24/7 on hardware that might already be sitting in your house

Cortex

20,255 Aufrufe • vor 1 Monat

THIS AI DEVELOPER RUNS 120B PARAMETER MODELS LOCALLY AND HIS MACBOOK PRO CAN’T EVEN OPEN THEM he bought a DGX Spark, gave it the model, went back to his desk by end of day the inference was done, tested, committed his team is still waiting for the cloud GPU queue to free up the only thing between them is 128GB of unified memory in a box smaller than your lunch one Spark is a datacenter node, two Sparks is your own cluster bookmark this and send it to whoever is still paying for cloud GPUs

THIS AI DEVELOPER RUNS 120B PARAMETER MODELS LOCALLY AND HIS MACBOOK PRO CAN’T EVEN OPEN THEM he bought a DGX Spark, gave it the model, went back to his desk by end of day the inference was done, tested, committed his team is still waiting for the cloud GPU queue to free up the only thing between them is 128GB of unified memory in a box smaller than your lunch one Spark is a datacenter node, two Sparks is your own cluster bookmark this and send it to whoever is still paying for cloud GPUs

leopardracer

85,726 Aufrufe • vor 2 Monaten

a guy put a local AI coding stack on an Android phone Termux on the screen Ollama underneath a local model answering from the device that tiny terminal is the shift. two years ago, local LLMs felt like punishment fans screaming bad models one token per second cloud looked inevitable now the same idea runs almost anywhere. - Raspberry Pi for tiny chat - MacBook Air for daily writing - RTX 3090 for serious inference - LM Studio when you want the clean GUI - Ollama when you want apps to connect the point is not replacing GPT-5.1 or Opus 4.8 on the hardest tasks. the point is owning the boring 80%: - drafts - summaries - code help - private docs - offline workflows no token anxiety no rate-limit ceiling no sensitive files leaving the machine cloud AI became the premium layer. local AI became the workbench.

a guy put a local AI coding stack on an Android phone Termux on the screen Ollama underneath a local model answering from the device that tiny terminal is the shift. two years ago, local LLMs felt like punishment fans screaming bad models one token per second cloud looked inevitable now the same idea runs almost anywhere. - Raspberry Pi for tiny chat - MacBook Air for daily writing - RTX 3090 for serious inference - LM Studio when you want the clean GUI - Ollama when you want apps to connect the point is not replacing GPT-5.1 or Opus 4.8 on the hardest tasks. the point is owning the boring 80%: - drafts - summaries - code help - private docs - offline workflows no token anxiety no rate-limit ceiling no sensitive files leaving the machine cloud AI became the premium layer. local AI became the workbench.

Myttle

27,108 Aufrufe • vor 2 Monaten

Today we're announcing that hybrid agentic inference is coming to Perplexity Computer. Computer can split tasks between a local model running on your machine and frontier models in the cloud. This keeps private data on your device and maximizes token efficiency. Coming soon.

Today we're announcing that hybrid agentic inference is coming to Perplexity Computer. Computer can split tasks between a local model running on your machine and frontier models in the cloud. This keeps private data on your device and maximizes token efficiency. Coming soon.

Perplexity

353,429 Aufrufe • vor 2 Monaten

ONE BUILDER WIRED 4 RASPBERRY PI MODULES INTO A €450 AI CLUSTER WITH 64GB OF RAM AND KILLED HIS $200/MONTH CHATGPT SUBSCRIPTION 00:37 he points at the terminal, "loaded, loaded, loaded - 4 nodes synced over gigabit, 64 gigabytes total, llama 3.1 partitioned across the cluster" he stacked 4 raspberry pi CM5 lite modules with 16 gigabytes each onto a sipeed nanocluster board, the whole rig runs off a single 65 watt power supply and a gigabit internal switch distributed llama partitions the model across the nodes with synchronized workloads handled over the internal fabric, no quantization needed, the cluster hits about 30 tokens per second on small models a heavy developer pays $200 a month for chatgpt pro and another $200 for claude code, this rig cost €450 in parts and breaks even on the stack in month 2 most people will keep paying anthropic and openai forever, a few will spend a weekend wiring 4 raspberry pi modules and never see a subscription invoice again the window is open, follow and bookmark before it closes

ONE BUILDER WIRED 4 RASPBERRY PI MODULES INTO A €450 AI CLUSTER WITH 64GB OF RAM AND KILLED HIS $200/MONTH CHATGPT SUBSCRIPTION 00:37 he points at the terminal, "loaded, loaded, loaded - 4 nodes synced over gigabit, 64 gigabytes total, llama 3.1 partitioned across the cluster" he stacked 4 raspberry pi CM5 lite modules with 16 gigabytes each onto a sipeed nanocluster board, the whole rig runs off a single 65 watt power supply and a gigabit internal switch distributed llama partitions the model across the nodes with synchronized workloads handled over the internal fabric, no quantization needed, the cluster hits about 30 tokens per second on small models a heavy developer pays $200 a month for chatgpt pro and another $200 for claude code, this rig cost €450 in parts and breaks even on the stack in month 2 most people will keep paying anthropic and openai forever, a few will spend a weekend wiring 4 raspberry pi modules and never see a subscription invoice again the window is open, follow and bookmark before it closes

Antid

64,291 Aufrufe • vor 2 Monaten

$THIS FRENCH GUY RUNS OPENCLAW AND HERMES AI AGENTS ON A HOMELAB THAT REPLACED GOOGLE DRIVE AND ICLOUD ENTIRELY ON JUST 10 WATTS The project: host his own local AI agents, OpenClaw and Hermes, ditch cloud storage subscriptions entirely by running his own NAS, and use the whole build to prep for his K8s certification – all running on 4 Raspberry Pis. Today's upgrade: a PoE module. One Ethernet cable now does two jobs – powers the Raspberry Pi AND gives it network access at the same time. No separate power adapters, no cable clutter, no juggling connections during maintenance. Total power draw for all 4 Raspberry Pis combined: max 10 watts. He's not renting cloud storage anymore. He's not paying monthly subscriptions for space he already owns the hardware for. His files, his AI agents, his data – all sitting on hardware in his own home, on a fraction of the power a lightbulb uses. Next up: blocking ads network-wide across his entire home, using one of the automation services running on the same setup. This is what "own your data" actually looks like when someone builds it instead of just talking about it. Bookmark this post. Full build in the video below.$

THIS FRENCH GUY RUNS OPENCLAW AND HERMES AI AGENTS ON A HOMELAB THAT REPLACED GOOGLE DRIVE AND ICLOUD ENTIRELY ON JUST 10 WATTS The project: host his own local AI agents, OpenClaw and Hermes, ditch cloud storage subscriptions entirely by running his own NAS, and use the whole build to prep for his K8s certification – all running on 4 Raspberry Pis. Today's upgrade: a PoE module. One Ethernet cable now does two jobs – powers the Raspberry Pi AND gives it network access at the same time. No separate power adapters, no cable clutter, no juggling connections during maintenance. Total power draw for all 4 Raspberry Pis combined: max 10 watts. He's not renting cloud storage anymore. He's not paying monthly subscriptions for space he already owns the hardware for. His files, his AI agents, his data – all sitting on hardware in his own home, on a fraction of the power a lightbulb uses. Next up: blocking ads network-wide across his entire home, using one of the automation services running on the same setup. This is what "own your data" actually looks like when someone builds it instead of just talking about it. Bookmark this post. Full build in the video below.

SCOTTY BEAM

18,175 Aufrufe • vor 1 Monat

i built a full game on a single GPU with a 3B model and this is the worst local AI will ever be. this was supposed to be a benchmark test. load the model, measure tokens per second, write it up, move on. instead i spent 20 minutes playing Octopus Invaders because the game is genuinely fun and i couldn't stop. a model with 3B active parameters built this from a single prompt. it debugged its own collision system when bullets were phasing through enemies. read the error, found the fix, kept building. this is not a frontier API. this is a quantized open source model running on hardware you can buy used for $800-$1200. no cloud. no subscription. no API costs. just a mass produced consumer GPU doing things that would have been absurd 12 months ago. and here's the part that should keep you up at night: every month the models get smaller and smarter. the quants get tighter. the context windows get longer. the tooling gets cleaner. what 3B active parameters does today on 24gb, a 1B model will do on 8gb within a year. you are looking at the floor. not the ceiling.

i built a full game on a single GPU with a 3B model and this is the worst local AI will ever be. this was supposed to be a benchmark test. load the model, measure tokens per second, write it up, move on. instead i spent 20 minutes playing Octopus Invaders because the game is genuinely fun and i couldn't stop. a model with 3B active parameters built this from a single prompt. it debugged its own collision system when bullets were phasing through enemies. read the error, found the fix, kept building. this is not a frontier API. this is a quantized open source model running on hardware you can buy used for $800-$1200. no cloud. no subscription. no API costs. just a mass produced consumer GPU doing things that would have been absurd 12 months ago. and here's the part that should keep you up at night: every month the models get smaller and smarter. the quants get tighter. the context windows get longer. the tooling gets cleaner. what 3B active parameters does today on 24gb, a 1B model will do on 8gb within a year. you are looking at the floor. not the ceiling.

Sudo su

36,251 Aufrufe • vor 5 Monaten

Do you see what's happening? Local AI is getting smarter. It's Opus 4.5 level Hardware that hosts those models are flying off the shelf Your window to host local models is shrinking In this video I cover EVERYTHING local AI models and how to host your own, even on Mac Minis:

Do you see what's happening? Local AI is getting smarter. It's Opus 4.5 level Hardware that hosts those models are flying off the shelf Your window to host local models is shrinking In this video I cover EVERYTHING local AI models and how to host your own, even on Mac Minis:

Alex Finn

55,389 Aufrufe • vor 5 Monaten

Andrej Karpathy (co-founder of OpenAI, Eureka Labs): "The future of AI is not all in the cloud. The most important models will run locally on your hardware under your control." June 2026 is the first time that the future is actually accessible to everyone! Here is what the local LLM landscape looks like right now: → raspberry pi 5: coherent chatbot, no GPU required → macbook air: matches GPT-3.5 quality on most tasks natively → used RTX 3090 at $700: something close to GPT-4 running locally → ollama: one command to an openAI-compatible endpoint, every major toolchain integrates with it → LM studio: best GUI, native MLX acceleration on apple silicon, MCP support in 0.4.0 → llama.cpp: the engine everything else runs on, 90MB footprint, runs on raspberry pi to android → the honest case: 80% of daily work is genuinely good enough locally right now Your prompts never leave your machine. no per-token billing. no rate limits. no refusals. The playbook for every hardware tier, from Raspberry Pi to RTX 5090, is here. Bookmark it so you do not lose it! Follow NeilXbt for more local AI and open source intelligence that tracks the hardware and tooling most people discover six months late.

Andrej Karpathy (co-founder of OpenAI, Eureka Labs): "The future of AI is not all in the cloud. The most important models will run locally on your hardware under your control." June 2026 is the first time that the future is actually accessible to everyone! Here is what the local LLM landscape looks like right now: → raspberry pi 5: coherent chatbot, no GPU required → macbook air: matches GPT-3.5 quality on most tasks natively → used RTX 3090 at $700: something close to GPT-4 running locally → ollama: one command to an openAI-compatible endpoint, every major toolchain integrates with it → LM studio: best GUI, native MLX acceleration on apple silicon, MCP support in 0.4.0 → llama.cpp: the engine everything else runs on, 90MB footprint, runs on raspberry pi to android → the honest case: 80% of daily work is genuinely good enough locally right now Your prompts never leave your machine. no per-token billing. no rate limits. no refusals. The playbook for every hardware tier, from Raspberry Pi to RTX 5090, is here. Bookmark it so you do not lose it! Follow NeilXbt for more local AI and open source intelligence that tracks the hardware and tooling most people discover six months late.

NeilXbt

19,405 Aufrufe • vor 2 Monaten

A self-evolving agent + a 428B model + 3 Macs = ? Your own AI lab. We ran MiniMax (official) M3 locally with Parallax, right on our desk. Then GenericAgent took over to create a 5-stock portfolio and write it to disk. No cloud. No API bills. Nothing left the machine. Wild to see a ~3K-line agent drive all this with a 400B+ model on local hardware. Thanks to the GenericAgent and MiniMax teams for making local AI feel real.

A self-evolving agent + a 428B model + 3 Macs = ? Your own AI lab. We ran MiniMax (official) M3 locally with Parallax, right on our desk. Then GenericAgent took over to create a 5-stock portfolio and write it to disk. No cloud. No API bills. Nothing left the machine. Wild to see a ~3K-line agent drive all this with a 400B+ model on local hardware. Thanks to the GenericAgent and MiniMax teams for making local AI feel real.

Gradient

150,400 Aufrufe • vor 1 Monat

JENSEN HUANG SOLD A $249 AI COMPUTER ON STAGE THAT KILLS YOUR $200/MONTH OPENAI BILL. THE VIDEO HAS 217,000 LIKES the box is called the jetson orin nano super. 70 trillion ai operations per second, 25 watts, smaller than a wallet. it runs llama 3, mistral, gemma and deepseek locally with no api fees and no data leaving your house a developer running automations and coding assistants pays $200 a month to openai. the same workload on this box costs $2 a month in electricity and breaks even on the hardware in 10 weeks you install ollama with one command. change one line in your code. point it at localhost instead of openai. everything else works identically 7 billion parameter models handle 80% of what people use chatgpt for. summarization, drafting, coding, document q&a, automation pipelines. the hard 20% you keep claude or gpt for. total monthly cost drops from $200 to $22 cloud subscriptions keep getting more expensive and rate limits keep getting tighter. the people who set this up in 2025 are going to look very smart in 2027 bookmark this and read the article below

JENSEN HUANG SOLD A $249 AI COMPUTER ON STAGE THAT KILLS YOUR $200/MONTH OPENAI BILL. THE VIDEO HAS 217,000 LIKES the box is called the jetson orin nano super. 70 trillion ai operations per second, 25 watts, smaller than a wallet. it runs llama 3, mistral, gemma and deepseek locally with no api fees and no data leaving your house a developer running automations and coding assistants pays $200 a month to openai. the same workload on this box costs $2 a month in electricity and breaks even on the hardware in 10 weeks you install ollama with one command. change one line in your code. point it at localhost instead of openai. everything else works identically 7 billion parameter models handle 80% of what people use chatgpt for. summarization, drafting, coding, document q&a, automation pipelines. the hard 20% you keep claude or gpt for. total monthly cost drops from $200 to $22 cloud subscriptions keep getting more expensive and rate limits keep getting tighter. the people who set this up in 2025 are going to look very smart in 2027 bookmark this and read the article below

starmex

1,998,810 Aufrufe • vor 2 Monaten

Ads don’t come attached to websites, they are loaded from a different server. So there’s a way to stop them from ever loading onto your network. Using a raspberry pi and some free software, you can stop ads from getting into your home. It’s called a pi hole and it acts as a catch between your home internet and the servers that place ads on websites.

Ads don’t come attached to websites, they are loaded from a different server. So there’s a way to stop them from ever loading onto your network. Using a raspberry pi and some free software, you can stop ads from getting into your home. It’s called a pi hole and it acts as a catch between your home internet and the servers that place ads on websites.

tech.explain

15,805 Aufrufe • vor 2 Monaten

AMD JUST KILLED THE $200 - A - MONTH AI SUBSCRIPTION - A 65-WATT BOX WITH 128GB OF UNIFIED MEMORY THAT RUNS 70B MODELS LOCALLY. that clip is amd's ryzen ai max+ 395 mini box, held up on stage. the whole pitch is one spec: 128gb of high-speed unified memory. why it matters: cpu, gpu and npu share the same 128gb pool, so a model that used to need a rack of vram just fits. what it actually runs: llama 70b in full precision on the built-in gpu open models up to ~100b parameters, locally, no cloud all of it in a mini pc pulling around 65 watts that's the part that ends the subscription: your prompts, your data, your model, on a box on your desk, not metered by the token. honest line: this runs open models, not gpt-5 or claude opus. for chat, coding help and agents on your own data it's more than enough. for the absolute frontier, the cloud still wins. and it isn't free: the box runs ~$1,500 and up. but that's a few months of a $200 sub, then it's yours forever. no monthly ai bill, no tokens metered, no prompt leaving the room. the uncomfortable part isn't that amd made a fast box. it's that "you need the cloud for ai" was a pricing choice, and unified memory just made it optional. follow RetroChainer for the hardware that turns rent into ownership, and bookmark this before your next ai renewal.

AMD JUST KILLED THE $200 - A - MONTH AI SUBSCRIPTION - A 65-WATT BOX WITH 128GB OF UNIFIED MEMORY THAT RUNS 70B MODELS LOCALLY. that clip is amd's ryzen ai max+ 395 mini box, held up on stage. the whole pitch is one spec: 128gb of high-speed unified memory. why it matters: cpu, gpu and npu share the same 128gb pool, so a model that used to need a rack of vram just fits. what it actually runs: llama 70b in full precision on the built-in gpu open models up to ~100b parameters, locally, no cloud all of it in a mini pc pulling around 65 watts that's the part that ends the subscription: your prompts, your data, your model, on a box on your desk, not metered by the token. honest line: this runs open models, not gpt-5 or claude opus. for chat, coding help and agents on your own data it's more than enough. for the absolute frontier, the cloud still wins. and it isn't free: the box runs ~$1,500 and up. but that's a few months of a $200 sub, then it's yours forever. no monthly ai bill, no tokens metered, no prompt leaving the room. the uncomfortable part isn't that amd made a fast box. it's that "you need the cloud for ai" was a pricing choice, and unified memory just made it optional. follow RetroChainer for the hardware that turns rent into ownership, and bookmark this before your next ai renewal.

RetroChainer

16,971 Aufrufe • vor 10 Tagen

Run Cline on Local AI models with Atomic Chat! Cline is a coding agent trusted by 8M+ developers. Write, refactor, ship code securely on your own hardware with local models powered by atomic.chat — no cloud, private, free and open-source

Run Cline on Local AI models with Atomic Chat! Cline is a coding agent trusted by 8M+ developers. Write, refactor, ship code securely on your own hardware with local models powered by atomic.chat — no cloud, private, free and open-source

atomic.chat

44,382 Aufrufe • vor 1 Monat

Perplexity CEO Aravind Srinivas on the biggest threat to the data center industry: It's not competition. It's not regulation. It's decentralisation. "The biggest threat to a data center is if the intelligence can be packed locally on a chip that's running on the device and then there's no need to inference all of it on like one centralized data center." He outlines how this could work in practice. Personalisation doesn't necessarily require on-device model training. Retrieval augmented generation, tool calls, and local data can already tailor AI to individual users. But the real unlock? Test time training. Aravind Srinivas describes a future where AI lives on your device, watches how you work and gradually automates your repetitive tasks. "Imagine we crack test time training where the AI watches tasks you repeatedly do on your local system, adapts to you over time and starts automating a lot of the things you do." The key insight: in this model, the intelligence belongs to you. It's your data, your device, your personalised AI brain. And if that future arrives, the economics of centralised infrastructure start to collapse. "That really disrupts the whole data center industry. It doesn't make sense to spend all this money, 500 billion, 5 trillion, whatever on building all the centralized data centers across the world that do a lot of the intelligence workloads for people." The companies spending trillions on centralised infrastructure may want to rethink where intelligence actually needs to live.

Perplexity CEO Aravind Srinivas on the biggest threat to the data center industry: It's not competition. It's not regulation. It's decentralisation. "The biggest threat to a data center is if the intelligence can be packed locally on a chip that's running on the device and then there's no need to inference all of it on like one centralized data center." He outlines how this could work in practice. Personalisation doesn't necessarily require on-device model training. Retrieval augmented generation, tool calls, and local data can already tailor AI to individual users. But the real unlock? Test time training. Aravind Srinivas describes a future where AI lives on your device, watches how you work and gradually automates your repetitive tasks. "Imagine we crack test time training where the AI watches tasks you repeatedly do on your local system, adapts to you over time and starts automating a lot of the things you do." The key insight: in this model, the intelligence belongs to you. It's your data, your device, your personalised AI brain. And if that future arrives, the economics of centralised infrastructure start to collapse. "That really disrupts the whole data center industry. It doesn't make sense to spend all this money, 500 billion, 5 trillion, whatever on building all the centralized data centers across the world that do a lot of the intelligence workloads for people." The companies spending trillions on centralised infrastructure may want to rethink where intelligence actually needs to live.

Big Brain AI

90,276 Aufrufe • vor 6 Monaten

THIS $1,300 CARD HAS THE SAME 32GB OF VRAM AS A $2,000+ RTX 5090 - FOR LOCAL AI, THAT'S THE SPEC THAT DECIDES EVERYTHING. that clip is the gigabyte radeon ai pro r9700 ai top, 32gb of vram, built for local ai. the pitch is simple: the same memory capacity as an rtx 5090, for roughly a third of what a 5090 actually sells for. here's why that matters, and where it doesn't. for ai, vram is the gate. a model either fits in memory or it doesn't. 32gb loads models a 16gb card can't touch, full stop. so for running local llms and image models, this card does the one thing that counts, cheap. honest line: this is not a 5090 for gaming. the 5090 is far faster at raster and ray tracing. they only match on how much vram they carry. if you want frames, buy the 5090. if you want to fit big models locally, you just found the same 32gb for a third of the money. no $2,000+ price tag, no cloud gpu rental, no model too big for 16gb. the uncomfortable part isn't that amd is cheaper. it's that for local ai you were about to overpay for gaming power you'd never use. follow RetroChainer for more on paying for the spec that matters, and bookmark this before your next gpu.

THIS $1,300 CARD HAS THE SAME 32GB OF VRAM AS A $2,000+ RTX 5090 - FOR LOCAL AI, THAT'S THE SPEC THAT DECIDES EVERYTHING. that clip is the gigabyte radeon ai pro r9700 ai top, 32gb of vram, built for local ai. the pitch is simple: the same memory capacity as an rtx 5090, for roughly a third of what a 5090 actually sells for. here's why that matters, and where it doesn't. for ai, vram is the gate. a model either fits in memory or it doesn't. 32gb loads models a 16gb card can't touch, full stop. so for running local llms and image models, this card does the one thing that counts, cheap. honest line: this is not a 5090 for gaming. the 5090 is far faster at raster and ray tracing. they only match on how much vram they carry. if you want frames, buy the 5090. if you want to fit big models locally, you just found the same 32gb for a third of the money. no $2,000+ price tag, no cloud gpu rental, no model too big for 16gb. the uncomfortable part isn't that amd is cheaper. it's that for local ai you were about to overpay for gaming power you'd never use. follow RetroChainer for more on paying for the spec that matters, and bookmark this before your next gpu.

RetroChainer

38,844 Aufrufe • vor 13 Tagen