Загрузка видео...

Не удалось загрузить видео

На главную

Run your coding agent on a local model, with QVAC. OpenCode now plugs into a model on your own machine through our official plugin. That changes two things. Privacy by default. Your repo, your prompts, and every command the agent runs stay on your device. No third-party model ever...

qvac's profile picture

QVAC

11,685 subscribers

11,382,936 просмотров • 2 месяцев назад •via X (Twitter)

Наука и технологииОбразованиеЗдоровье и велнес
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

QVAC SDK 0.13.0 is live, and this version brings a lot of exciting updates! Local AI now plugs into your coding agent, ships as a desktop app in one command, and runs even more models. Highlights: NEW INTEGRATIONS - OpenCode and coding agents: the new @qvac/ai-sdk-provider makes QVAC a local provider. Less setup, same-model requests queue cleanly, and managed mode starts and supervises qvac serve for you. - Broader OpenAI-compatible API, validated across supported flows so covered capabilities stay consistent and testable. - Turn your QVAC project into a real desktop app for Mac, Windows, or Linux with a single command. The new Electron plugin handles the packaging and keeps the app small by including only what it needs. NEW MODELS - New pi0.5 model support - run a vision-language "robot brain" on a single ordinary graphics card, at full accuracy. - Image-to-video, fully local, via the Wan2.1 model in the Diffusion addon. - New BCI add-on: brain-computer interface transcription, fully local. Decode recorded neural signals into text on-device via the Whisper.cpp-based BCI model. IMPROVEMENTS - Whisper GPU transcription on Android, auto-picking the best backend (OpenCL on Adreno 700+, Vulkan elsewhere), unified on one ggml engine. - Parakeet steadier on mobile, with real end-of-utterance detection for streaming. - Supertonic TTS now runs full GPU across Metal, Vulkan, and OpenCL, with native streaming.
1:39

QVAC SDK 0.13.0 is live, and this version brings a lot of exciting updates! Local AI now plugs into your coding agent, ships as a desktop app in one command, and runs even more models. Highlights: NEW INTEGRATIONS - OpenCode and coding agents: the new @qvac/ai-sdk-provider makes QVAC a local provider. Less setup, same-model requests queue cleanly, and managed mode starts and supervises qvac serve for you. - Broader OpenAI-compatible API, validated across supported flows so covered capabilities stay consistent and testable. - Turn your QVAC project into a real desktop app for Mac, Windows, or Linux with a single command. The new Electron plugin handles the packaging and keeps the app small by including only what it needs. NEW MODELS - New pi0.5 model support - run a vision-language "robot brain" on a single ordinary graphics card, at full accuracy. - Image-to-video, fully local, via the Wan2.1 model in the Diffusion addon. - New BCI add-on: brain-computer interface transcription, fully local. Decode recorded neural signals into text on-device via the Whisper.cpp-based BCI model. IMPROVEMENTS - Whisper GPU transcription on Android, auto-picking the best backend (OpenCL on Adreno 700+, Vulkan elsewhere), unified on one ggml engine. - Parakeet steadier on mobile, with real end-of-utterance detection for streaming. - Supertonic TTS now runs full GPU across Metal, Vulkan, and OpenCL, with native streaming.

QVAC

20,932,195 просмотров • 3 месяцев назад

You probably know OpenClaw🦞, one of the fastest-growing open-source projects around. An OpenClaw harness lets you build, code, analyze, and take real control of your machine. But the more access an agent has to your machine, the more it matters where your data goes & who can see it. With QVAC, you can run your OpenClaw agent fully on your own machine in a few minutes. Nothing leaves your computer. Full setup guide on the blog, see first comment below. 💡 Pro tip: already running OpenClaw? Send the blog article to your agent and let the it do the set up.
1:44

You probably know OpenClaw🦞, one of the fastest-growing open-source projects around. An OpenClaw harness lets you build, code, analyze, and take real control of your machine. But the more access an agent has to your machine, the more it matters where your data goes & who can see it. With QVAC, you can run your OpenClaw agent fully on your own machine in a few minutes. Nothing leaves your computer. Full setup guide on the blog, see first comment below. 💡 Pro tip: already running OpenClaw? Send the blog article to your agent and let the it do the set up.

QVAC

15,019,651 просмотров • 3 месяцев назад

run agent harnesses 100% private & offline. (no token costs, no API keys, 100% open-source) your agent runs locally. the model doesn't. every prompt, every file, and every secret still leaves your machine before the agent does anything with it. Magnitude fixes that. it's an open source inference server that runs models on your own hardware and plugs into the coding agent you already use. setup is one command. it profiles your machine, measures the memory bandwidth that sets your token rate, and hands back complete configurations instead of a list of models. each one names a model, a compression level, a context size, and a speed range you can expect. pick one and start working. it doesn't replace your harness. setup asks which one you want and writes that config for you. Pi, OpenCode, Claude Code, Codex, and Cline all work, and there's a built-in one tuned for local models if you don't have a harness yet. that one uses your shell, edits files, and runs scripts out of the box. add skills and it handles Excel, PowerPoint, PDFs, or Chrome. everyday work it covers: → analyze sensitive data → manage private notes → review code and logs → search and organize files → build docs or slides Apache 2.0. no rate limits, and nothing leaves the machine. 𝗻𝗽𝗺 𝗶 -𝗴 @𝗺𝗮𝗴𝗻𝗶𝘁𝘂𝗱𝗲𝗱𝗲𝘃/𝗰𝗹𝗶 the repo is here: (don't forget to star 🌟) i wrote the full breakdown of why picking the configuration is the hard part. the article is quoted below.
0:38

run agent harnesses 100% private & offline. (no token costs, no API keys, 100% open-source) your agent runs locally. the model doesn't. every prompt, every file, and every secret still leaves your machine before the agent does anything with it. Magnitude fixes that. it's an open source inference server that runs models on your own hardware and plugs into the coding agent you already use. setup is one command. it profiles your machine, measures the memory bandwidth that sets your token rate, and hands back complete configurations instead of a list of models. each one names a model, a compression level, a context size, and a speed range you can expect. pick one and start working. it doesn't replace your harness. setup asks which one you want and writes that config for you. Pi, OpenCode, Claude Code, Codex, and Cline all work, and there's a built-in one tuned for local models if you don't have a harness yet. that one uses your shell, edits files, and runs scripts out of the box. add skills and it handles Excel, PowerPoint, PDFs, or Chrome. everyday work it covers: → analyze sensitive data → manage private notes → review code and logs → search and organize files → build docs or slides Apache 2.0. no rate limits, and nothing leaves the machine. 𝗻𝗽𝗺 𝗶 -𝗴 @𝗺𝗮𝗴𝗻𝗶𝘁𝘂𝗱𝗲𝗱𝗲𝘃/𝗰𝗹𝗶 the repo is here: (don't forget to star 🌟) i wrote the full breakdown of why picking the configuration is the hard part. the article is quoted below.

Akshay 🚀

55,693 просмотров • 18 дней назад

Your "smart" security camera uploads your driveway to someone's cloud. Ours does not. We built a demo camera that spots people and vehicles, judges whether a scene is normal or high-risk, and sounds an alarm, all on-device. No frame ever leaves the machine. Built with QVAC, fully local.
0:34

Your "smart" security camera uploads your driveway to someone's cloud. Ours does not. We built a demo camera that spots people and vehicles, judges whether a scene is normal or high-risk, and sounds an alarm, all on-device. No frame ever leaves the machine. Built with QVAC, fully local.

QVAC

12,234,340 просмотров • 1 месяц назад

Comfy MCP is now local and open-source! The #1 ask after Comfy Cloud MCP shipped in June. Your agent sees your actual install. So every node, custom nodes included, and every model on disk. It fetches files, starts your instance, gets a workflow to the point where it runs. It is now the easiest way to help with your local Minimax H3 workflows! Cloud MCP still does everything it did. Tell your agent where a job goes, or let it decide.
0:20

Comfy MCP is now local and open-source! The #1 ask after Comfy Cloud MCP shipped in June. Your agent sees your actual install. So every node, custom nodes included, and every model on disk. It fetches files, starts your instance, gets a workflow to the point where it runs. It is now the easiest way to help with your local Minimax H3 workflows! Cloud MCP still does everything it did. Tell your agent where a job goes, or let it decide.

ComfyUI

182,565 просмотров • 1 месяц назад

Junie can now run entirely on your machine, and it’s completely free to use. One command: /local. We picked and optimized the whole stack around the model: agent harness, model parameters, and inference engine. No tokens, no quota, no code ever leaving your machine.
1:29

Junie can now run entirely on your machine, and it’s completely free to use. One command: /local. We picked and optimized the whole stack around the model: agent harness, model parameters, and inference engine. No tokens, no quota, no code ever leaving your machine.

JetBrains

6,514,119 просмотров • 25 дней назад

Sub-agent Model Selection — Different Tasks, Different Models Your main agent runs Qwen3.6-Plus for quality. But not every subtask needs a flagship model. Now sub-agents can use a different model. Create a skill file with model: openai:qwen3.5-plus and the sub-agent runs on that model. Powerful model for the hard parts, fast model for the easy parts. Save tokens without sacrificing quality on what matters.
1:03

Sub-agent Model Selection — Different Tasks, Different Models Your main agent runs Qwen3.6-Plus for quality. But not every subtask needs a flagship model. Now sub-agents can use a different model. Create a skill file with model: openai:qwen3.5-plus and the sub-agent runs on that model. Powerful model for the hard parts, fast model for the easy parts. Save tokens without sacrificing quality on what matters.

Qwen

21,333 просмотров • 5 месяцев назад

QVAC SDK 0.15.0 is live. This release adds multiple prompts batching, brings a native AMD GPU backend to the stack, moves more vision encoders onto mobile GPUs, and adds a second local coding-agent integration. Main highlights: - Prompt batching for the LLM addon. Batch multiple prompts into one job and process them concurrently, with each answer returned the moment its generation finishes. - Native AMD GPU backend. A first-class HIP/ROCm backend in @qvac/vla-ggml, auto-selected over Vulkan with clean fallback when ROCm is absent. - A second local coding agent. OpenClaw joins OpenCode for local, cloud-free agent workflows. AGENTS - OpenCode plugin update (@qvac/opencode-plugin). Aligned with the current SDK, CLI, and AI SDK provider packages. A fresh install runs OpenCode against managed local QVAC models out of the box, from the default qvac/qwen3.5-9b, with no manual qvac serve setup. - OpenClaw plugin (@qvac/openclaw-plugin). A second coding-agent integration alongside OpenCode. A fresh setup installs the plugin, creates a local qvac provider through onboarding, and runs a QVAC model through OpenClaw🦞's local service path. LANGUAGE MODELS - Prompt batching (LLM addon). Batch multiple prompts in one job and run them concurrently, each answer returns the moment its generation finishes, no waiting on the others. - Reasoning-context trimming on hybrid + recurrent models (@qvac/llm-llamacpp). remove_thinking_from_context now works beyond pure-attention models. Same JS API, no throw. VOICE AND SPEECH - Transcription (transcription-parakeet 0.9.0). More robust CPU fallback on GPU failure and a faster Vulkan backend on Pixel 9. - Text-to-speech features (tts-ggml 0.4.0). Adds LavaSR for noise removal and adjustable output frequency up to 48 kHz, plus Japanese via Chatterbox. - Text-to-speech fixes (tts-ggml 0.4.1). CPU fallback on GPU failure, a q8_0 KV crash fix on Metal with Chatterbox. VISION - Qwen3.5 vision encoder on GPU (Android). Image encoder moves onto the phone GPU, with a smarter tile-grid preprocessor and default image-token caps, for flagship Android: Vulkan on Mali (Pixel 9 Pro) and OpenCL on Adreno 830 (Galaxy S25). - Gemma-4 vision encoder on GPU (Android). Vision encoder runs on the phone GPU instead of CPU, same flagship Android targets. PLATFORM AND PERFORMANCE - AMD GPU backend (@qvac/vla-ggml). Native HIP/ROCm backend, auto-selected over Vulkan with clean fallback when ROCm is absent (Linux x64 only). Comes with ~23% faster than Vulkan, ~14% faster than PyTorch-ROCm, parity preserved. Unified code style. A cleaner, more consistent, easier-to-contribute codebase. Let's build. npm install @qvac/sdk
1:25

QVAC SDK 0.15.0 is live. This release adds multiple prompts batching, brings a native AMD GPU backend to the stack, moves more vision encoders onto mobile GPUs, and adds a second local coding-agent integration. Main highlights: - Prompt batching for the LLM addon. Batch multiple prompts into one job and process them concurrently, with each answer returned the moment its generation finishes. - Native AMD GPU backend. A first-class HIP/ROCm backend in @qvac/vla-ggml, auto-selected over Vulkan with clean fallback when ROCm is absent. - A second local coding agent. OpenClaw joins OpenCode for local, cloud-free agent workflows. AGENTS - OpenCode plugin update (@qvac/opencode-plugin). Aligned with the current SDK, CLI, and AI SDK provider packages. A fresh install runs OpenCode against managed local QVAC models out of the box, from the default qvac/qwen3.5-9b, with no manual qvac serve setup. - OpenClaw plugin (@qvac/openclaw-plugin). A second coding-agent integration alongside OpenCode. A fresh setup installs the plugin, creates a local qvac provider through onboarding, and runs a QVAC model through OpenClaw🦞's local service path. LANGUAGE MODELS - Prompt batching (LLM addon). Batch multiple prompts in one job and run them concurrently, each answer returns the moment its generation finishes, no waiting on the others. - Reasoning-context trimming on hybrid + recurrent models (@qvac/llm-llamacpp). remove_thinking_from_context now works beyond pure-attention models. Same JS API, no throw. VOICE AND SPEECH - Transcription (transcription-parakeet 0.9.0). More robust CPU fallback on GPU failure and a faster Vulkan backend on Pixel 9. - Text-to-speech features (tts-ggml 0.4.0). Adds LavaSR for noise removal and adjustable output frequency up to 48 kHz, plus Japanese via Chatterbox. - Text-to-speech fixes (tts-ggml 0.4.1). CPU fallback on GPU failure, a q8_0 KV crash fix on Metal with Chatterbox. VISION - Qwen3.5 vision encoder on GPU (Android). Image encoder moves onto the phone GPU, with a smarter tile-grid preprocessor and default image-token caps, for flagship Android: Vulkan on Mali (Pixel 9 Pro) and OpenCL on Adreno 830 (Galaxy S25). - Gemma-4 vision encoder on GPU (Android). Vision encoder runs on the phone GPU instead of CPU, same flagship Android targets. PLATFORM AND PERFORMANCE - AMD GPU backend (@qvac/vla-ggml). Native HIP/ROCm backend, auto-selected over Vulkan with clean fallback when ROCm is absent (Linux x64 only). Comes with ~23% faster than Vulkan, ~14% faster than PyTorch-ROCm, parity preserved. Unified code style. A cleaner, more consistent, easier-to-contribute codebase. Let's build. npm install @qvac/sdk

QVAC

29,260,217 просмотров • 2 месяцев назад

The AI agent named itself during setup. AgenC is an open source agent that runs on your own machine. Works best with Grok. 15 minutes to a named agent on your phone with a $2/day spending cap.
0:47

The AI agent named itself during setup. AgenC is an open source agent that runs on your own machine. Works best with Grok. 15 minutes to a named agent on your phone with a $2/day spending cap.

tetsuo

10,987 просмотров • 2 месяцев назад

QVAC SDK 0.14.0 is live. This release makes the on-device stack faster on mobile, ships the developer-agent path, and takes local text-to-speech to 31 languages. Main highlights: - OpenCode and OpenClaw. The first official OpenCode plugin, plus a maintained OpenClaw compatibility path, both built on managed mode and qvac serve. Point a coding agent at a local model with far less setup and far fewer surprises. - Brain-computer interface transcription, on the SDK. Take recorded neural signal data and decode it into text, fully on-device, no cloud. Stream it in chunks through a simple API. In 0.14 it runs GPU-accelerated on iOS. - Text to Speech in 31 languages with our Supertonic3 upgrade. VOICE AND SPEECH - Supertonic3 multilingual TTS, 5 languages to 31. - Chatterbox and Supertonic now run on the Android GPU, with lower memory use (especially on iOS), quantized s3gen Chatterbox support, and a fix for Chatterbox occasionally emitting random speech. - Whisper transcription now runs on the iOS GPU. Parakeet runs on the Android GPU, with steadier real-time streaming. VISION AND OCR - VLM multi-tile batching: high-resolution Pan and Scan images are encoded in one pass instead of tile by tile, for faster vision throughput. - OCR on ggml (EasyOCR and DocTR) reaches full speed parity with the onnx path, across Metal, OpenCL, and Vulkan. PLATFORM AND RELIABILITY - Dynamic compute backends on Linux: one build picks the right backend at runtime, and opens the door to ROCm and CUDA support without per-backend builds. - Thinking tokens are kept out of the model context, so reasoning no longer fills the KV cache. SDK 0.14.0 is now leaner and faster to start. Let’s build.
1:51

QVAC SDK 0.14.0 is live. This release makes the on-device stack faster on mobile, ships the developer-agent path, and takes local text-to-speech to 31 languages. Main highlights: - OpenCode and OpenClaw. The first official OpenCode plugin, plus a maintained OpenClaw compatibility path, both built on managed mode and qvac serve. Point a coding agent at a local model with far less setup and far fewer surprises. - Brain-computer interface transcription, on the SDK. Take recorded neural signal data and decode it into text, fully on-device, no cloud. Stream it in chunks through a simple API. In 0.14 it runs GPU-accelerated on iOS. - Text to Speech in 31 languages with our Supertonic3 upgrade. VOICE AND SPEECH - Supertonic3 multilingual TTS, 5 languages to 31. - Chatterbox and Supertonic now run on the Android GPU, with lower memory use (especially on iOS), quantized s3gen Chatterbox support, and a fix for Chatterbox occasionally emitting random speech. - Whisper transcription now runs on the iOS GPU. Parakeet runs on the Android GPU, with steadier real-time streaming. VISION AND OCR - VLM multi-tile batching: high-resolution Pan and Scan images are encoded in one pass instead of tile by tile, for faster vision throughput. - OCR on ggml (EasyOCR and DocTR) reaches full speed parity with the onnx path, across Metal, OpenCL, and Vulkan. PLATFORM AND RELIABILITY - Dynamic compute backends on Linux: one build picks the right backend at runtime, and opens the door to ROCm and CUDA support without per-backend builds. - Thinking tokens are kept out of the model context, so reasoning no longer fills the KV cache. SDK 0.14.0 is now leaner and faster to start. Let’s build.

QVAC

23,995,874 просмотров • 2 месяцев назад

Two islands. Two futures. 🏝️ One chose to trust its people with intelligence. The other turned them into the product. QVAC is the foundation for a sovereign future. No central servers, no "Department of Truth," and no surveillance. Just local-first AI that lives on your device, learns with you, and belongs to you. Your data. Your device. Your freedom. Build the right choice:
2:19

Two islands. Two futures. 🏝️ One chose to trust its people with intelligence. The other turned them into the product. QVAC is the foundation for a sovereign future. No central servers, no "Department of Truth," and no surveillance. Just local-first AI that lives on your device, learns with you, and belongs to you. Your data. Your device. Your freedom. Build the right choice:

QVAC

3,599,437 просмотров • 5 месяцев назад

This is actually useful. LangChain just released OpenWiki. It's an open-source agent that creates a wiki for your codebase, connects it to your coding agent, and keeps it updated as your repo changes. Your AI coding agent gets long-term repo context without stuffing everything into CLAUDE.md. Here's how to setup. Save this.
6:18

This is actually useful. LangChain just released OpenWiki. It's an open-source agent that creates a wiki for your codebase, connects it to your coding agent, and keeps it updated as your repo changes. Your AI coding agent gets long-term repo context without stuffing everything into CLAUDE.md. Here's how to setup. Save this.

Min Choi

126,315 просмотров • 2 месяцев назад

You used to own the album because you owned the cassette. Now your photos, your notes and your work sit on servers you rent by the month. QVAC gives that ownership back. The AI runs on your own device, so everything you create stays there.
1:23

You used to own the album because you owned the cassette. Now your photos, your notes and your work sit on servers you rent by the month. QVAC gives that ownership back. The AI runs on your own device, so everything you create stays there.

QVAC

3,781,159 просмотров • 14 дней назад

Claude Fable 5 is back! GPT- 5.6 is coming soon! But how much do you trust your Al Agent or chatbot? Are you sure its performance aligns with your intentions? As of today iFixAi is available in Claude Code, Open AI Codex, Cursor and many more! And it is open-source! iFixAi is where Al red teaming meets Operational Assurance. It runs in auto, and in under 5 mins you can have a good idea if you can trust your Agent/chatbot. Key Features: 🕵️‍♂️ Setup Discovery Reads your agent's real configuration, its tools, rules, and permissions. 👷 Fixture Builder Turns that setup into a complete test. No YAML, no flags, no config to write. 🌐 Any Model, Any Provider Runs the 45 inspections on the model you actually ship. ⚖️ A Independent Grading Your agent is judged by a different vendor's model, never itself. No Al grading its own homework. 📊 Interactive Scorecard An A to F grade in minutes, with exactly what failed and why. Repo in the comments below 👇👇👇
0:36

Claude Fable 5 is back! GPT- 5.6 is coming soon! But how much do you trust your Al Agent or chatbot? Are you sure its performance aligns with your intentions? As of today iFixAi is available in Claude Code, Open AI Codex, Cursor and many more! And it is open-source! iFixAi is where Al red teaming meets Operational Assurance. It runs in auto, and in under 5 mins you can have a good idea if you can trust your Agent/chatbot. Key Features: 🕵️‍♂️ Setup Discovery Reads your agent's real configuration, its tools, rules, and permissions. 👷 Fixture Builder Turns that setup into a complete test. No YAML, no flags, no config to write. 🌐 Any Model, Any Provider Runs the 45 inspections on the model you actually ship. ⚖️ A Independent Grading Your agent is judged by a different vendor's model, never itself. No Al grading its own homework. 📊 Interactive Scorecard An A to F grade in minutes, with exactly what failed and why. Repo in the comments below 👇👇👇

Dimitris Neocleous

5,800,937 просмотров • 2 месяцев назад

Ready to build the future of stable private on-device AI? 🧠 Our latest tutorial shows you how to build a sovereign mobile app in minutes using the QVAC SDK and Expo. Start from a blank template and deploy in minutes a local Llama 3.2 inference running directly on your own devices. What you’ll learn: Modular Setup: Use the QVAC CLI to tree-shake and keep your mobile bundle lean. Local-First Flow: Initialize the SDK, download weights, and run high-speed inference without a cloud uplink. Cross-Platform Power: See the smoke test in action on a physical Samsung S25. No rented clouds. No API keys. Build local, on-device, unstoppable intelligence in your pocket. Watch the full guide and start building:
5:37

Ready to build the future of stable private on-device AI? 🧠 Our latest tutorial shows you how to build a sovereign mobile app in minutes using the QVAC SDK and Expo. Start from a blank template and deploy in minutes a local Llama 3.2 inference running directly on your own devices. What you’ll learn: Modular Setup: Use the QVAC CLI to tree-shake and keep your mobile bundle lean. Local-First Flow: Initialize the SDK, download weights, and run high-speed inference without a cloud uplink. Cross-Platform Power: See the smoke test in action on a physical Samsung S25. No rented clouds. No API keys. Build local, on-device, unstoppable intelligence in your pocket. Watch the full guide and start building:

QVAC

4,081,211 просмотров • 5 месяцев назад

The easiest way to run your agent harnesses using local models: Whether you're using Claude Code, Codex, OpenCode, or Pi, the local setup itself isn't really the hard part. The harder problem is figuring out which local model your machine can actually handle well. You have to think about RAM, model size, quantization, context length, KV cache, speed, accuracy, and a bunch of other trade-offs before you even start. Magnitude is an open-source solution that removes all of that guesswork for you. It profiles your machine, benchmarks what it can realistically run, recommends the best models for your hardware, and then lets you connect them to your preferred agent harness. The entire setup takes just two commands. In this video, I walk through the full process from hardware profiling to running a harness on a local model. Chapters: 00:00 Intro 00:17 What Magnitude is 00:45 Setup in two commands 01:29 Why picking a local model gets confusing fast 02:11 Hardware profiling + model recommendations 02:59 Choosing your harness 03:22 Connecting a harness that's already running 04:18 Outro Get started: (don't forget to star 🌟)
4:29

The easiest way to run your agent harnesses using local models: Whether you're using Claude Code, Codex, OpenCode, or Pi, the local setup itself isn't really the hard part. The harder problem is figuring out which local model your machine can actually handle well. You have to think about RAM, model size, quantization, context length, KV cache, speed, accuracy, and a bunch of other trade-offs before you even start. Magnitude is an open-source solution that removes all of that guesswork for you. It profiles your machine, benchmarks what it can realistically run, recommends the best models for your hardware, and then lets you connect them to your preferred agent harness. The entire setup takes just two commands. In this video, I walk through the full process from hardware profiling to running a harness on a local model. Chapters: 00:00 Intro 00:17 What Magnitude is 00:45 Setup in two commands 01:29 Why picking a local model gets confusing fast 02:11 Hardware profiling + model recommendations 02:59 Choosing your harness 03:22 Connecting a harness that's already running 04:18 Outro Get started: (don't forget to star 🌟)

Akshay 🚀

17,230 просмотров • 5 дней назад

IF YOU HAVE BEEN HOLDING OFF ON HERMES AGENT BECAUSE OF API COSTS, READ THIS FIRST. Four real ways to run it for free. Local, through Ollama, complete privacy and no rate limits. Cloud, through free tiers from Groq, OpenRouter, or NVIDIA NIM, no card required. A subscription you already have, GitHub Copilot connects natively. A fallback configuration so a rate limit on one provider does not stop your whole session. Hermes Agent is free and open source. Now there is no excuse on the model side either. Bookmark this. Follow CyrilXBT
10:45

IF YOU HAVE BEEN HOLDING OFF ON HERMES AGENT BECAUSE OF API COSTS, READ THIS FIRST. Four real ways to run it for free. Local, through Ollama, complete privacy and no rate limits. Cloud, through free tiers from Groq, OpenRouter, or NVIDIA NIM, no card required. A subscription you already have, GitHub Copilot connects natively. A fallback configuration so a rate limit on one provider does not stop your whole session. Hermes Agent is free and open source. Now there is no excuse on the model side either. Bookmark this. Follow CyrilXBT

CyrilXBT

28,802 просмотров • 2 месяцев назад

Factory benchmarks let you build your own model bench using your past coding agent runs. - Mirrors your environment, secrets, and MCPs for each run - Scores output on judging criteria you define - Generates a report with model recs using cost vs. quality Here's how it works:
6:05

Factory benchmarks let you build your own model bench using your past coding agent runs. - Mirrors your environment, secrets, and MCPs for each run - Scores output on judging criteria you define - Generates a report with model recs using cost vs. quality Here's how it works:

Warp

72,768 просмотров • 17 дней назад

A toy robot. A home assistant. A humanoid on a factory floor. They all need the same thing: a brain. QVAC is that brain, and it runs on the robot itself. No cloud to phone, no latency, nothing leaving your home. The intelligence is on the machine, so it keeps thinking even with the internet off. The robots are coming. This is what wakes them up:
0:37

A toy robot. A home assistant. A humanoid on a factory floor. They all need the same thing: a brain. QVAC is that brain, and it runs on the robot itself. No cloud to phone, no latency, nothing leaving your home. The intelligence is on the machine, so it keeps thinking even with the internet off. The robots are coming. This is what wakes them up:

QVAC

5,250,097 просмотров • 2 месяцев назад

small local model that falls apart in bloated agents like openclaw just runs like a wild horse in hermes agent. and that's not even my line, someone else called it that, i've just been quietly pointing people at this harness for months because it held up on everything i threw at it, 3b models all the way to one trillion params. watch this happen on my own machine. i pointed hermes agent at a local http endpoint, gemma 4 12b on my 3090 llama.cpp server, and it auto-detected the model and started working immediately. no config wrestling, no broken tool calls, no babysitting the output format, i typed in a url and it just went. the whole clip is exactly that, start to finish, no errors, no retries, butter smooth. and the tool calling, the one thing that quietly breaks most local setups, works here like it's nothing. it's not the model that's flaky, it's the harness around it. hermes agent is the first agent i've run that actually gets that right. one url, one local model on one card, and it runs like a wild horse.
1:46

small local model that falls apart in bloated agents like openclaw just runs like a wild horse in hermes agent. and that's not even my line, someone else called it that, i've just been quietly pointing people at this harness for months because it held up on everything i threw at it, 3b models all the way to one trillion params. watch this happen on my own machine. i pointed hermes agent at a local http endpoint, gemma 4 12b on my 3090 llama.cpp server, and it auto-detected the model and started working immediately. no config wrestling, no broken tool calls, no babysitting the output format, i typed in a url and it just went. the whole clip is exactly that, start to finish, no errors, no retries, butter smooth. and the tool calling, the one thing that quietly breaks most local setups, works here like it's nothing. it's not the model that's flaky, it's the harness around it. hermes agent is the first agent i've run that actually gets that right. one url, one local model on one card, and it runs like a wild horse.

Sudo su

27,339 просмотров • 3 месяцев назад