Loading video...

Video Failed to Load

Go Home

Which models can your machine actually run? Magnitude is a 100% free, open source desktop app that: - profiles your hardware and runs sample calculations - predicts tok/s for every model before you download - recommends the best models, from fast to smart Pick your models and it handles...

50,178 views • 1 month ago •via X (Twitter)

29 Comments

Anders Lie's profile picture
Anders Lie1 month ago

Can't wait to fill this bad boy up

Tom Greenwald's profile picture
Tom Greenwald1 month ago

Hell yeah 🦅📈🔥

Tom Greenwald's profile picture
Tom Greenwald1 month ago

Under the hood this runs on llama.cpp today. We're replacing it with our own inference engine, built for consumer hardware: - our own kernels, optimized for each local model family - KV cache that grows and shrinks with free memory - expert offloading for models bigger than your machine Expect a release with benchmarks in the next week or two! Follow me to stay in the loop 🤝

Akshay 🚀's profile picture
Akshay 🚀1 month ago

I recently made a video on Magnitude. It's so good to see that it now comes with a desktop application. Keep shipping, guys. 🔥

Tom Greenwald's profile picture
Tom Greenwald1 month ago

The shipping will continue 🚢🔥

Ben Smith's profile picture
Ben Smith1 month ago

Cool.

Tom Greenwald's profile picture
Tom Greenwald1 month ago

Thank you sir

Ocalnik's profile picture
Ocalnik1 month ago

Is it possible to move to this version by updating from a previous npm i -g magnitude install?

Tom Greenwald's profile picture
Tom Greenwald1 month ago

If you download the new app it will automatically set itself up and disconnect the old CLI!

Ocalnik's profile picture
Ocalnik1 month ago

I'd have to prepare an Arch Linux package to install it cleanly. Are you planing on maintaing an AUR package for magnitude?

Tom Greenwald's profile picture
Tom Greenwald1 month ago

If you can PR one 😄 this is something I want to support

Ocalnik's profile picture
Ocalnik1 month ago

I am not promising anything, but I might take a look at how other similar PKGBUILDS are created and compare to your tar.gz Linux package.

Cyril | Building @ Pulsiv.app's profile picture
Cyril | Building @ Pulsiv.app1 month ago

Amazing that’s what I was looking for !

Tom Greenwald's profile picture
Tom Greenwald1 month ago

Let me know how it goes!

Helge Rebhan's profile picture
Helge Rebhan1 month ago

Will give it a try on my M4 MacMini after LM Studio gets more unstable with their recent updates.

Stephen Turner 🇬🇧🇺🇦's profile picture
Stephen Turner 🇬🇧🇺🇦1 month ago

Does it work on Windows within WSL? But for VS Code and OpenClaw Desktop on native Windows, all my developer tooling lives in WSL Ubuntu.

Tom Greenwald's profile picture
Tom Greenwald1 month ago

Yes, it works on WSL! If your agents run there too, they connect directly. If they run on Windows, they’d connect through WSL’s localhost forwarding. Are the agents themselves running in WSL, or just accessing your projects there?

Mo Elkholy's profile picture
Mo Elkholy1 month ago

Does it support hybrid quantized models?

Tom Greenwald's profile picture
Tom Greenwald1 month ago

Yes we support mixed-precision GGUF (like Unsloth Dynamic quants). Any particular model you have in mind?

Mo Elkholy's profile picture
Mo Elkholy1 month ago

current top 3 production local models right now are : 1-glm 5.3 flash 2-Deepseek v4 & v4 vision and v4.1 .3-Qwen 3.8 flash and waiting for new qwen 3.8 omni wights release 4-qwen 3.8 27b but there are lots of hybrid quantazaion and ablitraitons"

Nick T's profile picture
Nick T1 month ago

Kinda sad you guys did away with the CLI I really liked it!

Tom Greenwald's profile picture
Tom Greenwald1 month ago

The desktop app is bundled with the headless CLI so your agent can still drive it! But yes we did away with the TUI :( desktop app is just much more expressive UI

Jam Ancheta's profile picture
Jam Ancheta1 month ago

Ohh

John Car's profile picture
John Car1 month ago

Looks like you can specify were the model directory can be on the workstation using Magnitude?

Tom Greenwald's profile picture
Tom Greenwald1 month ago

Not currently but we have an issue open for it - I'm going to implement this today

Mira Takes's profile picture
Mira Takes1 month ago

The “predict before you download” step is underrated—local model experimentation gets much less frustrating when hardware fit is explicit up front. Open source also makes the recommendations auditable instead of magic.

Kyle's profile picture
Kyle1 month ago

55 models in the whole catalog? Seems like this exists to gather and exfiltrate your LLM model data to the company so they can build their model database up.

John Car's profile picture
John Car1 month ago

Can you incorporate free token attributes to run models in vram and ram?

Israfil's profile picture
Israfil1 month ago

an honest recommendation engine for loocal models thank you

Related Videos

run agent harnesses 100% private & offline. (no token costs, no API keys, 100% open-source) your agent runs locally. the model doesn't. every prompt, every file, and every secret still leaves your machine before the agent does anything with it. Magnitude fixes that. it's an open source inference server that runs models on your own hardware and plugs into the coding agent you already use. setup is one command. it profiles your machine, measures the memory bandwidth that sets your token rate, and hands back complete configurations instead of a list of models. each one names a model, a compression level, a context size, and a speed range you can expect. pick one and start working. it doesn't replace your harness. setup asks which one you want and writes that config for you. Pi, OpenCode, Claude Code, Codex, and Cline all work, and there's a built-in one tuned for local models if you don't have a harness yet. that one uses your shell, edits files, and runs scripts out of the box. add skills and it handles Excel, PowerPoint, PDFs, or Chrome. everyday work it covers: → analyze sensitive data → manage private notes → review code and logs → search and organize files → build docs or slides Apache 2.0. no rate limits, and nothing leaves the machine. 𝗻𝗽𝗺 𝗶 -𝗴 @𝗺𝗮𝗴𝗻𝗶𝘁𝘂𝗱𝗲𝗱𝗲𝘃/𝗰𝗹𝗶 the repo is here: (don't forget to star 🌟) i wrote the full breakdown of why picking the configuration is the hard part. the article is quoted below.

Akshay 🚀

56,499 views • 2 months ago

no money for grok or midjourney? this tool is for you. there's a FREE tool created by an anon dev. open-source. runs locally. 117k stars on github. it generates: > images & video > 3d models > audio > 20+ models here's how to set it up in under 5 minutes: 1️⃣download ComfyUI Desktop go to and grab the desktop app for your system. windows 10+, mac (apple silicon), or linux. it installs like any normal app, it sets up python and every dependency for you in the background. no terminal, no config files. 2️⃣open it first launch, it spins up its own environment automatically. you just wait a few seconds and you're in. you'll land on a node canvas, that's the whole interface. 3️⃣load a starter workflow top menu → Workflow → Browse Templates → Image Generation. click it. this drops a ready-made setup onto your canvas so you don't build anything from scratch. 4️⃣grab a model comfyui ships empty on purpose, the model is the brain, and you pick it. in the template, the "Load Checkpoint" node has a Download button when no model is installed. click it. it pulls one in for you (a few GB, this is the only real wait). 5️⃣install ComfyUI Manager this is the one add-on you don't skip. it lets you install models, custom nodes, and updates with a click instead of the command line. grab it from github (link in comments). it's the difference between fighting comfyui and flying in it. one honest note: an NVIDIA gpu makes this fast, apple silicon works great too, and a weak machine still runs it just slower. that's the whole setup. you now own an image, video, and 3D studio that costs you nothing per month. save this. and the next time grok or midjourney asks for your card. you won't need it. disclaimer: comfyui itself is 100% free. so are the local models (sdxl, flux, wan 2.2, ltx-2). some premium models like seedance are pay-per-use api models, only if you want top-tier quality. the free local ones cover most of what you need. (github link in the comments) follow and turn on post notification for daily AI contents.

m0h

15,424 views • 4 months ago