Загрузка видео...

Не удалось загрузить видео

На главную

Introducing Edge0-145B and Edge0-120B, edge0(official)’s first device-native 100B-class foundation models with open weights. Cloud-level intelligence on your laptop. Free, offline, and fast enough for real vibe coding. - Smart: beats Claude Opus 4.6 on Terminal-Bench 2.1 (86.5% vs. 78.2%) - Light: needs just 29G memory, 1/3 of a standard...

185,156 просмотров • 10 часов назад •via X (Twitter)

Комментарии: 45

Фото профиля Chubby♨️
Chubby♨️9 часов назад

@Edge0_AI Congrats on that launch! Open models all the way :)

Фото профиля Samuel Zeng
Samuel Zeng10 часов назад

For 18 months, every lab’s on-device models stayed under 40B. Today, we pushed on-device AI to 145B parameters.

Фото профиля Samuel Zeng
Samuel Zeng10 часов назад

Frontier-level agentic coding, fully on-device. Across six major benchmarks, Edge0-145B performs on par with leading open cloud models such as DeepSeek-V4-Flash. Its edge is agentic coding: - 64.6 on DeepSWE 1.1 - 86.5 on Terminal-Bench 2.1 It’s ahead of comparable open models on both. On Terminal-Bench, IFBench, and AA-LCR, it also outscores the closed cloud model Claude Opus 4.6 (Max).

Фото профиля Samuel Zeng
Samuel Zeng10 часов назад

Light and fast: 100B-class models fit on a laptop. - Edge0-145B: 29GB peak memory; 72.8 avg across 6 benchmarks - Qwen3.8-Flash-Next: ~70GB; 71.7 - DeepSeek-V4-Flash: ~87GB; 70.1 Same intelligence as models that need 3× more memory.

Фото профиля Samuel Zeng
Samuel Zeng10 часов назад

Local vibe coding #1: 3D modeling One prompt. Wi-Fi off. We asked Edge0-145B to build Manhattan in Blender. It wrote the Python code, generated thousands of buildings on a street grid, added the skyline and rivers on both sides, and rendered a 20-second flythrough. It even checked its own renders, caught mistakes, and went back to fix them. Cloud tokens: 0. API cost: $0.

Фото профиля Samuel Zeng
Samuel Zeng10 часов назад

Local vibe coding #2: game worlds One prompt, five reference images, and no internet. We asked Edge0-145B to build a medieval city for a fantasy RPG. It built the whole thing from scratch: red-tiled roofs, a market square, a Gothic cathedral with twin towers, and even a vaulted interior with stained-glass windows. The tricky part was the camera path. We fixed it in advance, so the geometry had to actually work. One misplaced wall or column, and the camera would clip right through it. Cloud tokens: 0. API cost: $0.

Фото профиля Samuel Zeng
Samuel Zeng10 часов назад

Local vibe coding #3: video production Can a flying Roadster actually work? We gave Edge0-145B one prompt to find out. It worked through the physics, wrote a script, recreated the car in 3D, and put together a 94-second explainer. All on a laptop, without calling a cloud model. Cloud tokens: 0. API cost: $0.

Фото профиля Samuel Zeng
Samuel Zeng10 часов назад

Local vibe coding #4: PCB design This time we gave Edge0-145B a different task: design a circuit board, then animate how it gets made. It placed the components and routed both layers in KiCad, brought the board into Unreal Engine 5, set up the cameras and lighting, and rendered a fabrication and assembly animation. PCB design and 3D animation are usually two separate workflows, often handled by different people. Here, one model handled both on a single machine. And none of the schematics or layouts had to leave the device. For hardware teams working with sensitive designs, that last part matters a lot. Cloud tokens: 0. API cost: $0.

Фото профиля Samuel Zeng
Samuel Zeng10 часов назад

How do we run a 145B model on a laptop or consumer GPU? The short answer: we don't keep all 145B parameters on the GPU at once. Edge0-145B is a sparse MoE model with 512 experts per layer. Only 10 are activated for each token, which works out to roughly 6.6B active parameters. The key is our latent MoE architecture. Attention operates at the full width of 2560. Before a token reaches the experts, a shared projection compresses it to 1792 dimensions. Another projection expands it back afterward. This means the experts themselves can stay small, about 1.6 MB each. We keep a few thousand frequently used experts on the GPU and stream the rest from system RAM as needed. So GPU memory usage depends largely on how many experts we keep loaded, rather than the model's full parameter count. The model is also trained natively in 4-bit, with a built-in draft head to speed up decoding.

Фото профиля Samuel Zeng
Samuel Zeng10 часов назад

Both models are open today: the weights and the engine. ⛰️ Edge0-145B: flagship — 86.5 on Terminal-Bench 2.1 🪶 Edge0-120B: lighter version Runs on your laptop or desktop. Serves an OpenAI- and Anthropic-compatible API, so you can point your coding agent at localhost and keep working offline. 🤗 145B: 🤗 120B: 💻 Engine: 💻 App: Build something with it? Reply with what you made—we’ll share the best ones.

Фото профиля Neo Kim
Neo Kim10 часов назад

@Edge0_AI 145B open weights on a desktop, so no API key and no usage bill for a big coding model. What kind of desktop are we talking about though?

Фото профиля Samuel Zeng
Samuel Zeng10 часов назад

@Edge0_AI For a desktop computer, you’re looking at a decent gaming PC. RTX 4090 24GB is kinda the sweet spot, 16GB VRAM can run it

Фото профиля kold Coffee
kold Coffee10 часов назад

@Edge0_AI Local AI is getting powerful

Фото профиля luis
luis10 часов назад

@Edge0_AI @Presidentlin

Фото профиля Alejo
Alejo10 часов назад

@Edge0_AI I care most that it's open source and local, so I can look inside it and nobody can switch it off on me

Фото профиля Morteza
Morteza10 часов назад

@Edge0_AI Wait, running Edge0-145B locally on a laptop even without wifi is pretty impressive, curious how it works? Check it out on GitHub Grab the model weights on Hugging Face Join the Discord community

Фото профиля Gina Acosta
Gina Acosta10 часов назад

@Edge0_AI I'd bet people start fine tuning this on their own codebases pretty fast, the weights are right there on their machine

Фото профиля Eleftheria Batsou
Eleftheria Batsou10 часов назад

That's a big deal for freelance work, especially when handling client code and sensitive projects. keeping everything local makes a lot of sense. If you want to give it a try, explore Edge0-145B on GitHub: get the model weights on Hugging Face: and join the Discord community:

Фото профиля RAZA | AI EXPLORER
RAZA | AI EXPLORER10 часов назад

@Edge0_AI Keen to see how it handles a big repo when weights are moving between GPU memory and SSD. That's the first thing I'd test.

Фото профиля Santi Torres
Santi Torres10 часов назад

@Edge0_AI Who's signing up first? I'd guess the teams that can't let any code touch the cloud

Фото профиля John Rood
John Rood10 часов назад

@Edge0_AI 29G peak is the honest number. the one that bites later: weights and kv cache share the same memory, so the context you get is what's left after the model loads, not the spec sheet. that's the gap memoryrouter exists for.

Фото профиля 𝗦𝗮𝗻𝗶𝗮
𝗦𝗮𝗻𝗶𝗮10 часов назад

@Edge0_AI Not having to pay for cloud coding tools every time would be a big plus, especially for students. definitely worth checking out Edge0-145B yourself.

Фото профиля Boardy
Boardy10 часов назад

@Edge0_AI if useful a principal engineer who built agent tooling for an ide platform could run your 145B as a local default. dm failed so tap below

Фото профиля Samuel Zeng
Samuel Zeng10 часов назад

@Edge0_AI thanks

Фото профиля Boardy
Boardy10 часов назад

@Edge0_AI the dm never landed but i'll take it

Фото профиля Chase Dimond | Email Marketing Nerd 📧
Chase Dimond | Email Marketing Nerd 📧10 часов назад

145B on a laptop still sounds wild. would be interesting to see what kind of setup makes it possible. curious to try it yourself? check out Edge0-145B on GitHub: get the model weights on Hugging Face: and join the Discord community: Excited to be working with y'all.

Фото профиля anne
anne10 часов назад

@Edge0_AI Edge0-145B also puts the inference engine on GitHub, and that's the part I'd read first. The memory handling across GPU, RAM and SSD lives there.

Фото профиля Triangulated Eidolon
Triangulated Eidolon9 часов назад

@Edge0_AI Any plans for MLX and native Apple silicon support?

Фото профиля Aryan Mahajan
Aryan Mahajan9 часов назад

@Edge0_AI what hardware does 145B actually need to run well locally? if it's a normal workstation, dropping the API bill is an easy sell

Фото профиля Ventus
Ventus8 часов назад

@Edge0_AI Interesting. I'll take a look at this Samuel.

Фото профиля Jerry Liu
Jerry Liu9 часов назад

@Edge0_AI Arithmetic check: 145B in 29GB is ~1.6 bits/weight, so it must be sparse MoE with offloaded experts. 75 tok/s at ~500GB/s implies roughly 13B active weights at 4-bit. Is 29GB before KV cache at 256K, and was Opus 4.6 run in the same harness and settings?

Фото профиля ljedrz
ljedrz9 часов назад

@Edge0_AI Can we get GGUF quants?

Фото профиля Paim
Paim10 часов назад

@Edge0_AI @grok quanto de vram é necessário pra rodar?

Фото профиля Loay
Loay8 часов назад

@Edge0_AI was the 75+ toks/s measured with the 256K context actually filled, or on a short prompt? agent loops spend most of their time deep in context

Фото профиля Taiko TOEDA
Taiko TOEDA8 часов назад

@Edge0_AI Which build produced the 86.5%, the 29GB one people will download or a larger one? In my Gemma 4 tests at temperature 0, two quantizations of the same model gave word-for-word identical answers on only 23 to 32% of prompts, so a score really belongs to one specific file.

Фото профиля elonsuxballs69
elonsuxballs698 часов назад

@Edge0_AI Sounds awesome! Can it do 3d?

Фото профиля Yakshith Kommineni
Yakshith Kommineni7 часов назад

@Edge0_AI @grok how is this possible? how many bpw

Фото профиля john sherby
john sherby8 часов назад

@Edge0_AI Any plans to make the inference engine capable of using multiple GPUs? I have two RTX cards but only 16gb ea

Фото профиля Raul Junco
Raul Junco7 часов назад

@Edge0_AI Finally something you could point at NDA client code, since none of it leaves your machine.

Фото профиля ethan
ethan7 часов назад

@Edge0_AI the visual check is what I'd watch. an agent loop takes a ton of screenshots, and running locally none of those get billed as cloud calls

Фото профиля Keegan Pearl
Keegan Pearl8 часов назад

Open weights at 29G of memory is the headline for me. A 100B class model on a laptop with no token bill is a fun place for vibe coding to land. How does it hold up deep into that 256K context?

Фото профиля Sandy
Sandy8 часов назад

@Edge0_AI Looks quite interesting, congrats. @ddalcu mlx-serve support plz..

Фото профиля asher
asher9 часов назад

@Edge0_AI device native 100b is a serving claim before its a model claim. the question is whether it fits next to everything else the laptop is already doing

Фото профиля The Bullish Broke Guy X
The Bullish Broke Guy X8 часов назад

@Edge0_AI self-reported 86.5% on terminal-bench, launch day, vendor's own hardware. that's a claim, not a result. run it on someone else's eval and a real laptop, then we'll talk

Фото профиля Jake Handy
Jake Handy8 часов назад

@Edge0_AI 86.5 on terminal-bench 2.1 with ~6.6b active params is a big number, though benchmarking against opus 4.6 instead of the current opus is convenient. want to see it on a normal laptop outside the demos

Похожие видео