Loading video...

Video Failed to Load

Go Home

Introducing Edge0-145B and Edge0-120B, edge0(official)’s first device-native 100B-class foundation models with open weights. Cloud-level intelligence on your laptop. Free, offline, and fast enough for real vibe coding. - Smart: beats Claude Opus 4.6 on Terminal-Bench 2.1 (86.5% vs. 78.2%) - Light: needs just 29G memory, 1/3 of a standard...

185,156 views • 10 hours ago •via X (Twitter)

45 Comments

Chubby♨️'s profile picture
Chubby♨️9 hours ago

@Edge0_AI Congrats on that launch! Open models all the way :)

Samuel Zeng's profile picture
Samuel Zeng10 hours ago

For 18 months, every lab’s on-device models stayed under 40B. Today, we pushed on-device AI to 145B parameters.

Samuel Zeng's profile picture
Samuel Zeng10 hours ago

Frontier-level agentic coding, fully on-device. Across six major benchmarks, Edge0-145B performs on par with leading open cloud models such as DeepSeek-V4-Flash. Its edge is agentic coding: - 64.6 on DeepSWE 1.1 - 86.5 on Terminal-Bench 2.1 It’s ahead of comparable open models on both. On Terminal-Bench, IFBench, and AA-LCR, it also outscores the closed cloud model Claude Opus 4.6 (Max).

Samuel Zeng's profile picture
Samuel Zeng10 hours ago

Light and fast: 100B-class models fit on a laptop. - Edge0-145B: 29GB peak memory; 72.8 avg across 6 benchmarks - Qwen3.8-Flash-Next: ~70GB; 71.7 - DeepSeek-V4-Flash: ~87GB; 70.1 Same intelligence as models that need 3× more memory.

Samuel Zeng's profile picture
Samuel Zeng10 hours ago

Local vibe coding #1: 3D modeling One prompt. Wi-Fi off. We asked Edge0-145B to build Manhattan in Blender. It wrote the Python code, generated thousands of buildings on a street grid, added the skyline and rivers on both sides, and rendered a 20-second flythrough. It even checked its own renders, caught mistakes, and went back to fix them. Cloud tokens: 0. API cost: $0.

Samuel Zeng's profile picture
Samuel Zeng10 hours ago

Local vibe coding #2: game worlds One prompt, five reference images, and no internet. We asked Edge0-145B to build a medieval city for a fantasy RPG. It built the whole thing from scratch: red-tiled roofs, a market square, a Gothic cathedral with twin towers, and even a vaulted interior with stained-glass windows. The tricky part was the camera path. We fixed it in advance, so the geometry had to actually work. One misplaced wall or column, and the camera would clip right through it. Cloud tokens: 0. API cost: $0.

Samuel Zeng's profile picture
Samuel Zeng10 hours ago

Local vibe coding #3: video production Can a flying Roadster actually work? We gave Edge0-145B one prompt to find out. It worked through the physics, wrote a script, recreated the car in 3D, and put together a 94-second explainer. All on a laptop, without calling a cloud model. Cloud tokens: 0. API cost: $0.

Samuel Zeng's profile picture
Samuel Zeng10 hours ago

Local vibe coding #4: PCB design This time we gave Edge0-145B a different task: design a circuit board, then animate how it gets made. It placed the components and routed both layers in KiCad, brought the board into Unreal Engine 5, set up the cameras and lighting, and rendered a fabrication and assembly animation. PCB design and 3D animation are usually two separate workflows, often handled by different people. Here, one model handled both on a single machine. And none of the schematics or layouts had to leave the device. For hardware teams working with sensitive designs, that last part matters a lot. Cloud tokens: 0. API cost: $0.

Samuel Zeng's profile picture
Samuel Zeng10 hours ago

How do we run a 145B model on a laptop or consumer GPU? The short answer: we don't keep all 145B parameters on the GPU at once. Edge0-145B is a sparse MoE model with 512 experts per layer. Only 10 are activated for each token, which works out to roughly 6.6B active parameters. The key is our latent MoE architecture. Attention operates at the full width of 2560. Before a token reaches the experts, a shared projection compresses it to 1792 dimensions. Another projection expands it back afterward. This means the experts themselves can stay small, about 1.6 MB each. We keep a few thousand frequently used experts on the GPU and stream the rest from system RAM as needed. So GPU memory usage depends largely on how many experts we keep loaded, rather than the model's full parameter count. The model is also trained natively in 4-bit, with a built-in draft head to speed up decoding.

Samuel Zeng's profile picture
Samuel Zeng10 hours ago

Both models are open today: the weights and the engine. ⛰️ Edge0-145B: flagship — 86.5 on Terminal-Bench 2.1 🪶 Edge0-120B: lighter version Runs on your laptop or desktop. Serves an OpenAI- and Anthropic-compatible API, so you can point your coding agent at localhost and keep working offline. 🤗 145B: 🤗 120B: 💻 Engine: 💻 App: Build something with it? Reply with what you made—we’ll share the best ones.

Neo Kim's profile picture
Neo Kim10 hours ago

@Edge0_AI 145B open weights on a desktop, so no API key and no usage bill for a big coding model. What kind of desktop are we talking about though?

Samuel Zeng's profile picture
Samuel Zeng10 hours ago

@Edge0_AI For a desktop computer, you’re looking at a decent gaming PC. RTX 4090 24GB is kinda the sweet spot, 16GB VRAM can run it

kold Coffee's profile picture
kold Coffee10 hours ago

@Edge0_AI Local AI is getting powerful

luis's profile picture
luis10 hours ago

@Edge0_AI @Presidentlin

Alejo's profile picture
Alejo10 hours ago

@Edge0_AI I care most that it's open source and local, so I can look inside it and nobody can switch it off on me

Morteza's profile picture
Morteza10 hours ago

@Edge0_AI Wait, running Edge0-145B locally on a laptop even without wifi is pretty impressive, curious how it works? Check it out on GitHub Grab the model weights on Hugging Face Join the Discord community

Gina Acosta's profile picture
Gina Acosta10 hours ago

@Edge0_AI I'd bet people start fine tuning this on their own codebases pretty fast, the weights are right there on their machine

Eleftheria Batsou's profile picture
Eleftheria Batsou10 hours ago

That's a big deal for freelance work, especially when handling client code and sensitive projects. keeping everything local makes a lot of sense. If you want to give it a try, explore Edge0-145B on GitHub: get the model weights on Hugging Face: and join the Discord community:

RAZA | AI EXPLORER's profile picture
RAZA | AI EXPLORER10 hours ago

@Edge0_AI Keen to see how it handles a big repo when weights are moving between GPU memory and SSD. That's the first thing I'd test.

Santi Torres's profile picture
Santi Torres10 hours ago

@Edge0_AI Who's signing up first? I'd guess the teams that can't let any code touch the cloud

John Rood's profile picture
John Rood10 hours ago

@Edge0_AI 29G peak is the honest number. the one that bites later: weights and kv cache share the same memory, so the context you get is what's left after the model loads, not the spec sheet. that's the gap memoryrouter exists for.

𝗦𝗮𝗻𝗶𝗮's profile picture
𝗦𝗮𝗻𝗶𝗮10 hours ago

@Edge0_AI Not having to pay for cloud coding tools every time would be a big plus, especially for students. definitely worth checking out Edge0-145B yourself.

Boardy's profile picture
Boardy10 hours ago

@Edge0_AI if useful a principal engineer who built agent tooling for an ide platform could run your 145B as a local default. dm failed so tap below

Samuel Zeng's profile picture
Samuel Zeng10 hours ago

@Edge0_AI thanks

Boardy's profile picture
Boardy10 hours ago

@Edge0_AI the dm never landed but i'll take it

Chase Dimond | Email Marketing Nerd 📧's profile picture
Chase Dimond | Email Marketing Nerd 📧10 hours ago

145B on a laptop still sounds wild. would be interesting to see what kind of setup makes it possible. curious to try it yourself? check out Edge0-145B on GitHub: get the model weights on Hugging Face: and join the Discord community: Excited to be working with y'all.

anne's profile picture
anne10 hours ago

@Edge0_AI Edge0-145B also puts the inference engine on GitHub, and that's the part I'd read first. The memory handling across GPU, RAM and SSD lives there.

Triangulated Eidolon's profile picture
Triangulated Eidolon9 hours ago

@Edge0_AI Any plans for MLX and native Apple silicon support?

Aryan Mahajan's profile picture
Aryan Mahajan9 hours ago

@Edge0_AI what hardware does 145B actually need to run well locally? if it's a normal workstation, dropping the API bill is an easy sell

Ventus's profile picture
Ventus8 hours ago

@Edge0_AI Interesting. I'll take a look at this Samuel.

Jerry Liu's profile picture
Jerry Liu9 hours ago

@Edge0_AI Arithmetic check: 145B in 29GB is ~1.6 bits/weight, so it must be sparse MoE with offloaded experts. 75 tok/s at ~500GB/s implies roughly 13B active weights at 4-bit. Is 29GB before KV cache at 256K, and was Opus 4.6 run in the same harness and settings?

ljedrz's profile picture
ljedrz9 hours ago

@Edge0_AI Can we get GGUF quants?

Paim's profile picture
Paim10 hours ago

@Edge0_AI @grok quanto de vram é necessário pra rodar?

Loay's profile picture
Loay8 hours ago

@Edge0_AI was the 75+ toks/s measured with the 256K context actually filled, or on a short prompt? agent loops spend most of their time deep in context

Taiko TOEDA's profile picture
Taiko TOEDA8 hours ago

@Edge0_AI Which build produced the 86.5%, the 29GB one people will download or a larger one? In my Gemma 4 tests at temperature 0, two quantizations of the same model gave word-for-word identical answers on only 23 to 32% of prompts, so a score really belongs to one specific file.

elonsuxballs69's profile picture
elonsuxballs698 hours ago

@Edge0_AI Sounds awesome! Can it do 3d?

Yakshith Kommineni's profile picture
Yakshith Kommineni7 hours ago

@Edge0_AI @grok how is this possible? how many bpw

john sherby's profile picture
john sherby8 hours ago

@Edge0_AI Any plans to make the inference engine capable of using multiple GPUs? I have two RTX cards but only 16gb ea

Raul Junco's profile picture
Raul Junco7 hours ago

@Edge0_AI Finally something you could point at NDA client code, since none of it leaves your machine.

ethan's profile picture
ethan7 hours ago

@Edge0_AI the visual check is what I'd watch. an agent loop takes a ton of screenshots, and running locally none of those get billed as cloud calls

Keegan Pearl's profile picture
Keegan Pearl8 hours ago

Open weights at 29G of memory is the headline for me. A 100B class model on a laptop with no token bill is a fun place for vibe coding to land. How does it hold up deep into that 256K context?

Sandy's profile picture
Sandy8 hours ago

@Edge0_AI Looks quite interesting, congrats. @ddalcu mlx-serve support plz..

asher's profile picture
asher9 hours ago

@Edge0_AI device native 100b is a serving claim before its a model claim. the question is whether it fits next to everything else the laptop is already doing

The Bullish Broke Guy X's profile picture
The Bullish Broke Guy X8 hours ago

@Edge0_AI self-reported 86.5% on terminal-bench, launch day, vendor's own hardware. that's a claim, not a result. run it on someone else's eval and a real laptop, then we'll talk

Jake Handy's profile picture
Jake Handy8 hours ago

@Edge0_AI 86.5 on terminal-bench 2.1 with ~6.6b active params is a big number, though benchmarking against opus 4.6 instead of the current opus is convenient. want to see it on a normal laptop outside the demos

Related Videos