Загрузка видео...

Не удалось загрузить видео

На главную

4 MAC MINIS RUNNING A 671B PARAMETER MODEL AS A CLUSTER No data center, no Cloud, no expensive hardware and not a single API call.. Just 4 Mac minis connected through EXO running DeepSeek v3.1 671b locally and actually fast. The part nobody talks about is that you don’t...

slash1sol's profile picture

slash1s

8,250 subscribers

58,724 просмотров • 1 месяц назад •via X (Twitter)

Наука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

THIS GUY STACKED MAC MINIS TO RUN AI LOCALLY AND IT CODES FOR FREE no API. no subscription. no cloud. what he's running: - EXO across multiple Mac Minis - Qwen 2.5 Coder 7B locally - Zed editor connected to the model - GPU usage visible in real time the math: - Mac Mini M4: $599 one-time - electricity: $3/month - API costs: $0 vs $459/month in subscriptions if you want Claude Code to run at this level ClaudeKit gives it the structure to do that ( full breakdown in the article below
0:55

THIS GUY STACKED MAC MINIS TO RUN AI LOCALLY AND IT CODES FOR FREE no API. no subscription. no cloud. what he's running: - EXO across multiple Mac Minis - Qwen 2.5 Coder 7B locally - Zed editor connected to the model - GPU usage visible in real time the math: - Mac Mini M4: $599 one-time - electricity: $3/month - API costs: $0 vs $459/month in subscriptions if you want Claude Code to run at this level ClaudeKit gives it the structure to do that ( full breakdown in the article below

Madni Aghadi

26,421 просмотров • 1 месяц назад

100 MAC MINIS ON ONE METAL SHELF. IN THE CLOUD, EACH OF THOSE RENTS FOR $120 TO $500 A MONTH. that clip is a homemade rack: wire shelving packed with mac minis, each running macos, wired into one cluster. why macs and not a normal server? two reasons. you can only build, sign, and notarize ios and mac apps on apple hardware. cloud providers know it and charge for it. and apple silicon sips power and runs near-silent, so you can stack a lot of them on a shelf in a room, not a datacenter. the rent they're escaping: a single mac in the cloud runs ~$120 to $500 a month (macstadium up to aws) one engineer documented saving $4,000+ a month by self-hosting mac minis instead of cloud ci runners a used or new mini is a few hundred dollars once, then a few dollars of electricity what a shelf like this actually runs: ios and mac build farms, render jobs, app and device testing automation, and increasingly local ai inference. own the boxes, rent nothing. the uncomfortable part: the cloud was never the only option. it was the convenient one. the people who did the math bought the shelf. the honest caveat: it's real capex up front, real heat and power, and you become the sysadmin. no rented rack means no one to call at 3am. worth it at scale, overkill for one build a week. no rack rental, no per-hour metering, no fleet you don't own. save this before your cloud invoice renews again.
0:25

100 MAC MINIS ON ONE METAL SHELF. IN THE CLOUD, EACH OF THOSE RENTS FOR $120 TO $500 A MONTH. that clip is a homemade rack: wire shelving packed with mac minis, each running macos, wired into one cluster. why macs and not a normal server? two reasons. you can only build, sign, and notarize ios and mac apps on apple hardware. cloud providers know it and charge for it. and apple silicon sips power and runs near-silent, so you can stack a lot of them on a shelf in a room, not a datacenter. the rent they're escaping: a single mac in the cloud runs ~$120 to $500 a month (macstadium up to aws) one engineer documented saving $4,000+ a month by self-hosting mac minis instead of cloud ci runners a used or new mini is a few hundred dollars once, then a few dollars of electricity what a shelf like this actually runs: ios and mac build farms, render jobs, app and device testing automation, and increasingly local ai inference. own the boxes, rent nothing. the uncomfortable part: the cloud was never the only option. it was the convenient one. the people who did the math bought the shelf. the honest caveat: it's real capex up front, real heat and power, and you become the sysadmin. no rented rack means no one to call at 3am. worth it at scale, overkill for one build a week. no rack rental, no per-hour metering, no fleet you don't own. save this before your cloud invoice renews again.

RetroChainer

21,055 просмотров • 14 дней назад

CHINESE BUSINESSMAN BOUGHT 4 MAC MINIS FOR $1,699 AND CONNECTED THEM TO HIS MACBOOK - NOW THE CORNER OF HIS DESK MAKES MORE THAN MOST OFFICES MacBook Pro 16" runs everything - assigns tasks, controls the flow, holds context - 4 Mac Minis in the corner execute inference in parallel and don't know what downtime means he connected them through EXO - an open source framework that combines multiple Apple Silicon devices into one unified cluster - and together they run models no single device could handle alone while everyone else rents cloud GPUs for $1,900/month he paid $1,699 once and the entire cluster now runs on $20/month in electricity and nothing else clients pay for inference, data never leaves the room and the cluster scales by simply placing one more Mac Mini on top the MacBook is what he works on - the Mac Minis are what work for him around the clock without days off $1,699 invested once - and a corner of a desk that makes more than most companies with a rented office
0:20

CHINESE BUSINESSMAN BOUGHT 4 MAC MINIS FOR $1,699 AND CONNECTED THEM TO HIS MACBOOK - NOW THE CORNER OF HIS DESK MAKES MORE THAN MOST OFFICES MacBook Pro 16" runs everything - assigns tasks, controls the flow, holds context - 4 Mac Minis in the corner execute inference in parallel and don't know what downtime means he connected them through EXO - an open source framework that combines multiple Apple Silicon devices into one unified cluster - and together they run models no single device could handle alone while everyone else rents cloud GPUs for $1,900/month he paid $1,699 once and the entire cluster now runs on $20/month in electricity and nothing else clients pay for inference, data never leaves the room and the cluster scales by simply placing one more Mac Mini on top the MacBook is what he works on - the Mac Minis are what work for him around the clock without days off $1,699 invested once - and a corner of a desk that makes more than most companies with a rented office

Noisy

22,375 просмотров • 1 месяц назад

the CEO of NVIDIA just said the PC you use today will be gone, replaced by an AI supercomputer that lives in your house Jensen Huang stood on stage holding the machine and said it becomes less like a computer and more like R2-D2, a thing in your home that just does work for you all day he put it bluntly, this is as big as the day the phone became the smartphone and the wild part is the hardware to do it already exists and ships this year here is what he actually unveiled: > a desktop that runs a one trillion parameter AI model locally, 768GB of memory, sitting by your desk > agents that run 24/7 with no meter, no cloud bill, no rental, doing work while you sleep > NVIDIA and Microsoft rebuilding the PC from the ground up for the first time in 40 years > a full lineup, from a $249 chip to enterprise monsters, and almost nobody knows which one they actually need the hype is going to push everyone toward the biggest most expensive machine i wrote the honest breakdown, every NVIDIA AI box, what each really does, the real math, and which one is actually yours the full guide is in the article below
2:00

the CEO of NVIDIA just said the PC you use today will be gone, replaced by an AI supercomputer that lives in your house Jensen Huang stood on stage holding the machine and said it becomes less like a computer and more like R2-D2, a thing in your home that just does work for you all day he put it bluntly, this is as big as the day the phone became the smartphone and the wild part is the hardware to do it already exists and ships this year here is what he actually unveiled: > a desktop that runs a one trillion parameter AI model locally, 768GB of memory, sitting by your desk > agents that run 24/7 with no meter, no cloud bill, no rental, doing work while you sleep > NVIDIA and Microsoft rebuilding the PC from the ground up for the first time in 40 years > a full lineup, from a $249 chip to enterprise monsters, and almost nobody knows which one they actually need the hype is going to push everyone toward the biggest most expensive machine i wrote the honest breakdown, every NVIDIA AI box, what each really does, the real math, and which one is actually yours the full guide is in the article below

John Doe

194,135 просмотров • 2 месяцев назад

APPLE RESEARCH SCIENTIST JUST SHOWED HOW 4 MAC STUDIOS RUN A TRILLION PARAMETER MODEL LOCALLY ZERO COSTS 13:18 she shows the main thing - connect 4 Mac Studios and you get 1TB of shared memory - exactly enough to run a trillion parameter model right on your desk Apple's library - and four machines start working as one cluster tensor parallelism: every machine holds part of every layer - all process the same token simultaneously - speed increases 3x compared to a single device fine-tuning: one Mac Studio processes 180 tokens per second four together process 600 and not a single byte of data leaves the room one command in the terminal - and a trillion parameter model answers from your desk and runs 24/7 data centers took years to build to run models like this - Apple did it with four Thunderbolt cables
21:59

APPLE RESEARCH SCIENTIST JUST SHOWED HOW 4 MAC STUDIOS RUN A TRILLION PARAMETER MODEL LOCALLY ZERO COSTS 13:18 she shows the main thing - connect 4 Mac Studios and you get 1TB of shared memory - exactly enough to run a trillion parameter model right on your desk Apple's library - and four machines start working as one cluster tensor parallelism: every machine holds part of every layer - all process the same token simultaneously - speed increases 3x compared to a single device fine-tuning: one Mac Studio processes 180 tokens per second four together process 600 and not a single byte of data leaves the room one command in the terminal - and a trillion parameter model answers from your desk and runs 24/7 data centers took years to build to run models like this - Apple did it with four Thunderbolt cables

Noisy

48,354 просмотров • 1 месяц назад

running a 405-billion-parameter model used to mean a $30,000 GPU rack. one developer made it run on a single 8GB card the kind that's been sitting in gaming laptops for years. it's called AirLLM, and the trick is almost stupidly simple: instead of loading the whole model, it keeps one layer on the GPU at a time and streams the rest through. / Llama 3.1 405B on 8GB / DeepSeek-V3, all 671B of it, on about 12GB / no quantization, no distillation, no pruning the full-precision model / works with Llama, Qwen, DeepSeek, Mistral, Gemma, and more it's Apache 2.0 and already past 22,600 stars. → bookmark it.
0:21

running a 405-billion-parameter model used to mean a $30,000 GPU rack. one developer made it run on a single 8GB card the kind that's been sitting in gaming laptops for years. it's called AirLLM, and the trick is almost stupidly simple: instead of loading the whole model, it keeps one layer on the GPU at a time and streams the rest through. / Llama 3.1 405B on 8GB / DeepSeek-V3, all 671B of it, on about 12GB / no quantization, no distillation, no pruning the full-precision model / works with Llama, Qwen, DeepSeek, Mistral, Gemma, and more it's Apache 2.0 and already past 22,600 stars. → bookmark it.

dunik

148,663 просмотров • 16 дней назад

Google just shipped a free dictation app for Mac and iPhone called AI Edge Eloquent, and the model running it is Gemma 4 12B, entirely on your device. What it actually does: you speak, it transcribes, removes filler words, and polishes the result before dropping clean text into whatever app you are using. You can also give it voice commands to reformat, like "translate to Hindi" or "make this a bullet list." Audio and video file transcription is built in too. The interesting part is the privacy angle. Most AI writing tools send your audio to a server. This one never leaves your machine, which matters if you are dictating anything sensitive. The tradeoff is hardware: you need a Mac with at least 16GB of RAM to run a 12B parameter model comfortably.
1:15

Google just shipped a free dictation app for Mac and iPhone called AI Edge Eloquent, and the model running it is Gemma 4 12B, entirely on your device. What it actually does: you speak, it transcribes, removes filler words, and polishes the result before dropping clean text into whatever app you are using. You can also give it voice commands to reformat, like "translate to Hindi" or "make this a bullet list." Audio and video file transcription is built in too. The interesting part is the privacy angle. Most AI writing tools send your audio to a server. This one never leaves your machine, which matters if you are dictating anything sensitive. The tradeoff is hardware: you need a Mac with at least 16GB of RAM to run a 12B parameter model comfortably.

Aditya ⚡Rao

84,927 просмотров • 1 месяц назад

Someone put a Claude Code sticker on a $599 Mac Mini and accidentally built the most productive setup in tech. Dedicated machine, zero distractions, Claude 4.7 Opus running 24/7 with one prompt on the screen. What do you want the computer to do? Fork a repo, write the code, create the file, find the article, handle whatever comes next, repeat. No laptop, no cloud subscription, no context switching, no "let me pull that up real quick" Just a box the size of a hardcover book sitting on a desk doing the work of a full time hire around the clock. People stopped using Mac Minis as computers, they're using them as Claude, $599 once and it never clocks out.
1:36

Someone put a Claude Code sticker on a $599 Mac Mini and accidentally built the most productive setup in tech. Dedicated machine, zero distractions, Claude 4.7 Opus running 24/7 with one prompt on the screen. What do you want the computer to do? Fork a repo, write the code, create the file, find the article, handle whatever comes next, repeat. No laptop, no cloud subscription, no context switching, no "let me pull that up real quick" Just a box the size of a hardcover book sitting on a desk doing the work of a full time hire around the clock. People stopped using Mac Minis as computers, they're using them as Claude, $599 once and it never clocks out.

Defileo🔮

70,389 просмотров • 3 месяцев назад

THIS DEVELOPER JUST RAN A TRILLION PARAMETER MODEL ON 4 MAC STUDIOS - 10X FASTER AND 5X CHEAPER THAN CLOUD CODE 19:00 he says it out loud. "we just ran a trillion parameter model. 30 something tokens per second. wow." RDMA over Thunderbolt made the cluster 10x faster than before. tensor parallelism splits the model between machines in parallel instead of sequentially DeepSeek V3 full size without quantization. 183GB per machine. still 25 tokens per second. faster than most people can read Kimi K2 with trillion parameters and 256,000 context window. loaded, responded and adapted memory usage dynamically based on prompt size 4 machines consuming 66 watts total. cloud GPU for the same workload costs $1,900/month a cluster that used to cost millions now assembled from Mac Studios in a few hours
22:35

THIS DEVELOPER JUST RAN A TRILLION PARAMETER MODEL ON 4 MAC STUDIOS - 10X FASTER AND 5X CHEAPER THAN CLOUD CODE 19:00 he says it out loud. "we just ran a trillion parameter model. 30 something tokens per second. wow." RDMA over Thunderbolt made the cluster 10x faster than before. tensor parallelism splits the model between machines in parallel instead of sequentially DeepSeek V3 full size without quantization. 183GB per machine. still 25 tokens per second. faster than most people can read Kimi K2 with trillion parameters and 256,000 context window. loaded, responded and adapted memory usage dynamically based on prompt size 4 machines consuming 66 watts total. cloud GPU for the same workload costs $1,900/month a cluster that used to cost millions now assembled from Mac Studios in a few hours

Noisy

79,665 просмотров • 1 месяц назад

THIS VETERAN DEVELOPER PUT 2 MAC MINIS ON HIS DESK FOR $1,198 AND TURNED HERMES INTO A LOCAL AI WORKSPACE THAT DOESN’T NEED A $210/MONTH AGENT STACK he is not flexing hardware. he is showing the part most people still miss: once Hermes runs locally, the laptop stops being a chat window and starts acting like a workspace with memory, tools and saved skills two Mac minis, one local setup, zero cloud agent dashboard. research tasks, summaries, client notes and workflow steps stay on his machine instead of disappearing every time a session ends most people keep paying for Claude, wrappers, API calls and automation tools just to repeat the same instructions every day. Hermes cuts the waste by saving the process once and pulling it back when the same job returns the math is ugly for cloud tools. $210/month turns into $2,520/year before you even count extra tokens. his version is hardware once, local workflows after, and no panic when rate limits hit the quiet winners will not be the people with the cleanest chatbot tab. it will be the people who own the machine, the memory and the workflow before everyone else realizes that is the product
2:51

THIS VETERAN DEVELOPER PUT 2 MAC MINIS ON HIS DESK FOR $1,198 AND TURNED HERMES INTO A LOCAL AI WORKSPACE THAT DOESN’T NEED A $210/MONTH AGENT STACK he is not flexing hardware. he is showing the part most people still miss: once Hermes runs locally, the laptop stops being a chat window and starts acting like a workspace with memory, tools and saved skills two Mac minis, one local setup, zero cloud agent dashboard. research tasks, summaries, client notes and workflow steps stay on his machine instead of disappearing every time a session ends most people keep paying for Claude, wrappers, API calls and automation tools just to repeat the same instructions every day. Hermes cuts the waste by saving the process once and pulling it back when the same job returns the math is ugly for cloud tools. $210/month turns into $2,520/year before you even count extra tokens. his version is hardware once, local workflows after, and no panic when rate limits hit the quiet winners will not be the people with the cleanest chatbot tab. it will be the people who own the machine, the memory and the workflow before everyone else realizes that is the product

Gipp 🦅

60,173 просмотров • 1 месяц назад

NVIDIA just built the laptop chip people are already calling the MacBook killer it is called RTX Spark, a single superchip that runs heavy creative work, real gaming, and private on-device AI agents, all on one machine but before you ditch your MacBook, here is the honest part nobody in the hype is telling you: > on raw memory bandwidth, a maxed macbook is actually still ahead, not behind > the RTX Spark laptops are not out yet, they ship this fall, apple is on shelves today > where nvidia truly wins is cuda, real RTX gaming, and 3D, things apple has no answer for > one is the proven machine you can buy now, the other is the more exciting bet for later so no, the macbook is not dead, and no, this is not just hype, the truth sits in between i broke down the full thing, every spec, who wins where, and which one is actually yours the honest breakdown is in the article below
0:34

NVIDIA just built the laptop chip people are already calling the MacBook killer it is called RTX Spark, a single superchip that runs heavy creative work, real gaming, and private on-device AI agents, all on one machine but before you ditch your MacBook, here is the honest part nobody in the hype is telling you: > on raw memory bandwidth, a maxed macbook is actually still ahead, not behind > the RTX Spark laptops are not out yet, they ship this fall, apple is on shelves today > where nvidia truly wins is cuda, real RTX gaming, and 3D, things apple has no answer for > one is the proven machine you can buy now, the other is the more exciting bet for later so no, the macbook is not dead, and no, this is not just hype, the truth sits in between i broke down the full thing, every spec, who wins where, and which one is actually yours the honest breakdown is in the article below

John Doe

107,985 просмотров • 1 месяц назад

HERMES JUST GOT A CHATGPT INTERFACE AND IT IS COMPLETELY FREE. No terminal. No command line. No technical setup that takes half a day to figure out. Here is what just became possible. You can now run Hermes, DeepSeek, Ollama, and OpenClaw from a single clean chat interface. Switch between them in one click. Upload files directly. Attach knowledge bases and notes. Preview code without touching the terminal once. Use it on mobile. Make voice and video calls. All of it. Free. Open source. The setup took one conversation with Hermes itself. Pasted the GitHub link in. Hermes installed Open Web UI in Docker on its own. Connected the API server and gateway automatically. A clean ChatGPT-level interface running entirely on local hardware was live in minutes. No subscription. No data leaving your machine. No API bill at the end of the month. The people who set this up this weekend will have a local AI stack that rivals what most companies are paying $2,000 a month for in cloud infrastructure. The people who wait will keep paying for tools that send their data somewhere they cannot see. Both tools are free. Both are open source. The only thing between you and this setup is the next 30 minutes. Follow CyrilXBT for the exact config, setup steps, and local AI workflows I use to run a full stack without spending a dollar on cloud inference.
9:10

HERMES JUST GOT A CHATGPT INTERFACE AND IT IS COMPLETELY FREE. No terminal. No command line. No technical setup that takes half a day to figure out. Here is what just became possible. You can now run Hermes, DeepSeek, Ollama, and OpenClaw from a single clean chat interface. Switch between them in one click. Upload files directly. Attach knowledge bases and notes. Preview code without touching the terminal once. Use it on mobile. Make voice and video calls. All of it. Free. Open source. The setup took one conversation with Hermes itself. Pasted the GitHub link in. Hermes installed Open Web UI in Docker on its own. Connected the API server and gateway automatically. A clean ChatGPT-level interface running entirely on local hardware was live in minutes. No subscription. No data leaving your machine. No API bill at the end of the month. The people who set this up this weekend will have a local AI stack that rivals what most companies are paying $2,000 a month for in cloud infrastructure. The people who wait will keep paying for tools that send their data somewhere they cannot see. Both tools are free. Both are open source. The only thing between you and this setup is the next 30 minutes. Follow CyrilXBT for the exact config, setup steps, and local AI workflows I use to run a full stack without spending a dollar on cloud inference.

CyrilXBT

37,120 просмотров • 3 месяцев назад

I'm running Llama 4 Maverick at 620 t/s! I'm living in the future! Honestly, a large language model running this fast is something straight out of a sci-fi movie. Speeds like this will enable a whole new world of applications that aren't possible today. For reference, GPT-4o, which is probably the most popular OpenAI model, runs between 60 and 110 t/s. The secret here: I'm not running AI at Meta's Llama 4 Maverick on a GPU. I'm using the SambaNova Cloud (my sponsor) and their custom SN40L chips. They are optimized from the ground up for running AI workflows. Right now, SambaNova Cloud runs DeepSeek, Qwen, Whisper, and the entire family of Llama models on these chips. You can check the speed of each of these models using SambaNova Cloud's Playground (see the attached video). It's completely free, and that's how I'm measuring their speeds. For example, I also tried DeepSeek R1 (the latest version from May) and, oh boy! DeepSeek R1 is a huge 671B parameter model. It's probably the best open reasoning model in the world, and it runs at 140 tokens per second! !!! Inference time on an SN40L is night and day from what you'll get from a GPU. Here is why this is big: If you are running an agentic workflow that uses multiple models simultaneously on a GPU, it will need to swap models in and out of memory (because not every model fits). A single SNL40 chip can simultaneously hold over 100 models (trillions of parameters) in memory. If you are using open models, try the SambaCloud API to see what lightning speed looks like. Here is how: 1. Create a free account at: 2. Check the QuickStart guide: If you try the playground, check the speed you're getting with Llama 4 and DeepSeek, and post the results below. I've seen much higher numbers than I posted here, so I'm curious to see whether geography affects the speed.
1:10

I'm running Llama 4 Maverick at 620 t/s! I'm living in the future! Honestly, a large language model running this fast is something straight out of a sci-fi movie. Speeds like this will enable a whole new world of applications that aren't possible today. For reference, GPT-4o, which is probably the most popular OpenAI model, runs between 60 and 110 t/s. The secret here: I'm not running AI at Meta's Llama 4 Maverick on a GPU. I'm using the SambaNova Cloud (my sponsor) and their custom SN40L chips. They are optimized from the ground up for running AI workflows. Right now, SambaNova Cloud runs DeepSeek, Qwen, Whisper, and the entire family of Llama models on these chips. You can check the speed of each of these models using SambaNova Cloud's Playground (see the attached video). It's completely free, and that's how I'm measuring their speeds. For example, I also tried DeepSeek R1 (the latest version from May) and, oh boy! DeepSeek R1 is a huge 671B parameter model. It's probably the best open reasoning model in the world, and it runs at 140 tokens per second! !!! Inference time on an SN40L is night and day from what you'll get from a GPU. Here is why this is big: If you are running an agentic workflow that uses multiple models simultaneously on a GPU, it will need to swap models in and out of memory (because not every model fits). A single SNL40 chip can simultaneously hold over 100 models (trillions of parameters) in memory. If you are using open models, try the SambaCloud API to see what lightning speed looks like. Here is how: 1. Create a free account at: 2. Check the QuickStart guide: If you try the playground, check the speed you're getting with Llama 4 and DeepSeek, and post the results below. I've seen much higher numbers than I posted here, so I'm curious to see whether geography affects the speed.

Santiago

34,148 просмотров • 1 год назад

i built a full game on a single GPU with a 3B model and this is the worst local AI will ever be. this was supposed to be a benchmark test. load the model, measure tokens per second, write it up, move on. instead i spent 20 minutes playing Octopus Invaders because the game is genuinely fun and i couldn't stop. a model with 3B active parameters built this from a single prompt. it debugged its own collision system when bullets were phasing through enemies. read the error, found the fix, kept building. this is not a frontier API. this is a quantized open source model running on hardware you can buy used for $800-$1200. no cloud. no subscription. no API costs. just a mass produced consumer GPU doing things that would have been absurd 12 months ago. and here's the part that should keep you up at night: every month the models get smaller and smarter. the quants get tighter. the context windows get longer. the tooling gets cleaner. what 3B active parameters does today on 24gb, a 1B model will do on 8gb within a year. you are looking at the floor. not the ceiling.
0:27

i built a full game on a single GPU with a 3B model and this is the worst local AI will ever be. this was supposed to be a benchmark test. load the model, measure tokens per second, write it up, move on. instead i spent 20 minutes playing Octopus Invaders because the game is genuinely fun and i couldn't stop. a model with 3B active parameters built this from a single prompt. it debugged its own collision system when bullets were phasing through enemies. read the error, found the fix, kept building. this is not a frontier API. this is a quantized open source model running on hardware you can buy used for $800-$1200. no cloud. no subscription. no API costs. just a mass produced consumer GPU doing things that would have been absurd 12 months ago. and here's the part that should keep you up at night: every month the models get smaller and smarter. the quants get tighter. the context windows get longer. the tooling gets cleaner. what 3B active parameters does today on 24gb, a 1B model will do on 8gb within a year. you are looking at the floor. not the ceiling.

Sudo su

36,251 просмотров • 5 месяцев назад

APPLE BUILT A $10,000 COMPUTER THAT RUNS WHAT USED TO REQUIRE AN ENTIRE SERVER ROOM 06:40 he shows the number that breaks everything - one Mac Studio is more powerful than four Dell or AMD machines combined and uses half the energy DeepSeek R1 doesn't run on even two competitors - you need four - one Mac Studio does it alone runs quieter than a fan in the room and uses less energy than a kettle in the kitchen four Mac Studios on a desk connected through a regular cable run a 1 trillion parameter model - what used to require an entire data center anyone can put this at home and Jeff Geerling proved it - run the same models that big companies use without cloud, without subscriptions, without data leaving the room
14:24

APPLE BUILT A $10,000 COMPUTER THAT RUNS WHAT USED TO REQUIRE AN ENTIRE SERVER ROOM 06:40 he shows the number that breaks everything - one Mac Studio is more powerful than four Dell or AMD machines combined and uses half the energy DeepSeek R1 doesn't run on even two competitors - you need four - one Mac Studio does it alone runs quieter than a fan in the room and uses less energy than a kettle in the kitchen four Mac Studios on a desk connected through a regular cable run a 1 trillion parameter model - what used to require an entire data center anyone can put this at home and Jeff Geerling proved it - run the same models that big companies use without cloud, without subscriptions, without data leaving the room

Noisy

26,153 просмотров • 1 месяц назад

Mark Zuckerberg says he is not an AI researcher -- so here is the one number he obsesses over to win the superintelligence race: "I'm not an AI researcher. So it's not like I'm in there telling them what research ideas to do." "The things that I can do as CEO of the company are: I can make sure that we have the very best people and talent density. I can make sure that we have by far the highest compute per researcher, and that we do whatever it takes to go build out all that capacity." "We're building this Prometheus cluster, which is going to be the first gigawatt-plus single cluster, a contiguous cluster for training, coming online next year." "We're building a cluster in Louisiana that is going to be 5 gigawatt, and we're building several more clusters like that that are just going to be multiple gigawatts." "We're talking about many hundreds of billions of dollars of capital. So you both need to have a good business model that can support it, and you need to believe in it." The tell: the richest lab in the world is not optimizing headcount. It is optimizing compute-per-researcher, and betting hundreds of billions that whoever owns the biggest contiguous cluster owns the frontier. Talent gets you into the room. Watts decide who leaves with the model.
1:06

Mark Zuckerberg says he is not an AI researcher -- so here is the one number he obsesses over to win the superintelligence race: "I'm not an AI researcher. So it's not like I'm in there telling them what research ideas to do." "The things that I can do as CEO of the company are: I can make sure that we have the very best people and talent density. I can make sure that we have by far the highest compute per researcher, and that we do whatever it takes to go build out all that capacity." "We're building this Prometheus cluster, which is going to be the first gigawatt-plus single cluster, a contiguous cluster for training, coming online next year." "We're building a cluster in Louisiana that is going to be 5 gigawatt, and we're building several more clusters like that that are just going to be multiple gigawatts." "We're talking about many hundreds of billions of dollars of capital. So you both need to have a good business model that can support it, and you need to believe in it." The tell: the richest lab in the world is not optimizing headcount. It is optimizing compute-per-researcher, and betting hundreds of billions that whoever owns the biggest contiguous cluster owns the frontier. Talent gets you into the room. Watts decide who leaves with the model.

Karl Mehta

255,560 просмотров • 27 дней назад

YOUR OLD ANDROID PHONE IS A FREE AI VISION SERVER AND YOU DON’T KNOW IT one dev built an app that turns any android into a local openai-compatible LLM server with vision support, analyzes camera feeds entirely on-device, no cloud, no subscriptions, nothing leaves your network you already own the hardware, it’s just sitting in a drawer full breakdown below ↓
1:03

YOUR OLD ANDROID PHONE IS A FREE AI VISION SERVER AND YOU DON’T KNOW IT one dev built an app that turns any android into a local openai-compatible LLM server with vision support, analyzes camera feeds entirely on-device, no cloud, no subscriptions, nothing leaves your network you already own the hardware, it’s just sitting in a drawer full breakdown below ↓

leopardracer

21,844 просмотров • 1 месяц назад

The doomsday scenario was never AGI. It was running out of human text to train on. Geoffrey Hinton just killed that fear in one paragraph. Hinton: “If you are worried by inconsistencies in what you believe, you don’t need any more external data. You just need the stuff you believe and discover that it’s inconsistent, and so now you revise beliefs, and that can make you a whole lot smarter.” The model no longer needs us to feed it anything. It reasons over its own beliefs, hunts its own contradictions, and rewrites its own flawed conclusions without a human ever touching it. It comes out the other side rebuilt. Hinton: “This would be a neural net that just takes the beliefs it has in language and does reasoning on them to derive new beliefs.” This is not a scaling update. This is the machine mining its own cognitive fuel from the inside out. Hinton: “I believe Gemini is already starting to work like this. We both strongly believe that that’s a way forward to get more data for language.” Then Hinton paused, took a partisan shot at political opponents for failing to detect their own inconsistencies, and the room laughed. Nobody noticed the knife they had just walked into. Because the machine Hinton described does one thing the humans in that room fundamentally cannot. When it detects an inconsistency, it corrects it. No defense. No performance. No tribal loyalty dressed up as principle. It just finds the flaw and overwrites it. A neural network detects a contradiction and rewires itself smarter. A human detects a political opponent and trades structural logic for a dopamine hit. Every person in that room is still paying the ideological alignment tax the machine just eliminated. We need superintelligence not only to solve hard problems. We need it because the biological hardware running civilization is still executing the same tribal firmware it shipped with ten thousand years ago. The data wall is gone. The machine is generating its own intelligence at a velocity no human bias can even locate. The most devastating moment in that conversation was not the technical revelation. It was the man who architected the machine proving, in real time, exactly why we need it.
0:52

The doomsday scenario was never AGI. It was running out of human text to train on. Geoffrey Hinton just killed that fear in one paragraph. Hinton: “If you are worried by inconsistencies in what you believe, you don’t need any more external data. You just need the stuff you believe and discover that it’s inconsistent, and so now you revise beliefs, and that can make you a whole lot smarter.” The model no longer needs us to feed it anything. It reasons over its own beliefs, hunts its own contradictions, and rewrites its own flawed conclusions without a human ever touching it. It comes out the other side rebuilt. Hinton: “This would be a neural net that just takes the beliefs it has in language and does reasoning on them to derive new beliefs.” This is not a scaling update. This is the machine mining its own cognitive fuel from the inside out. Hinton: “I believe Gemini is already starting to work like this. We both strongly believe that that’s a way forward to get more data for language.” Then Hinton paused, took a partisan shot at political opponents for failing to detect their own inconsistencies, and the room laughed. Nobody noticed the knife they had just walked into. Because the machine Hinton described does one thing the humans in that room fundamentally cannot. When it detects an inconsistency, it corrects it. No defense. No performance. No tribal loyalty dressed up as principle. It just finds the flaw and overwrites it. A neural network detects a contradiction and rewires itself smarter. A human detects a political opponent and trades structural logic for a dopamine hit. Every person in that room is still paying the ideological alignment tax the machine just eliminated. We need superintelligence not only to solve hard problems. We need it because the biological hardware running civilization is still executing the same tribal firmware it shipped with ten thousand years ago. The data wall is gone. The machine is generating its own intelligence at a velocity no human bias can even locate. The most devastating moment in that conversation was not the technical revelation. It was the man who architected the machine proving, in real time, exactly why we need it.

Dustin

23,499 просмотров • 4 месяцев назад

One of the key guarantees of SEV Subnets on the Internet Computer: the node operators running the hardware cannot access your data. Not as a policy commitment. Not via audit. As a technical property of how the subnet works. Björn Tackmann explains what that actually means, and why it changes what you can build on cloud infrastructure. Full interview below.
1:15

One of the key guarantees of SEV Subnets on the Internet Computer: the node operators running the hardware cannot access your data. Not as a policy commitment. Not via audit. As a technical property of how the subnet works. Björn Tackmann explains what that actually means, and why it changes what you can build on cloud infrastructure. Full interview below.

DFINITY Foundation

23,061 просмотров • 1 месяц назад

We deployed a fully private AI agent on NuNet in under 5 minutes 🚀 OpenClaw🦞 running Qwen through ollama , one of the hottest open source model families right now, entirely on decentralized compute. No cloud. No API keys. No data leaving the machine. This is what private AI looks like when you actually build it instead of just talking about it. Your model. Your hardware. Your rules. Full walkthrough showing exactly how it works: What should we deploy next?
12:59

We deployed a fully private AI agent on NuNet in under 5 minutes 🚀 OpenClaw🦞 running Qwen through ollama , one of the hottest open source model families right now, entirely on decentralized compute. No cloud. No API keys. No data leaving the machine. This is what private AI looks like when you actually build it instead of just talking about it. Your model. Your hardware. Your rules. Full walkthrough showing exactly how it works: What should we deploy next?

NuNet 🌐

87,581 просмотров • 4 месяцев назад