QVAC
@qvac • 10,627 subscribers
Infinite intelligence. Local. Any Hardware. Peer-to-Peer Hyper Swarm. No cloud. No compromise. QVAC is the decentralized AI platform for humans and machines.
Shorts
Videos
QVAC SDK 0.15.0 is live. This release adds multiple prompts batching, brings a native AMD GPU backend to the stack, moves more vision encoders onto mobile GPUs, and adds a second local coding-agent integration. Main highlights: - Prompt batching for the LLM addon. Batch multiple prompts into one job and process them concurrently, with each answer returned the moment its generation finishes. - Native AMD GPU backend. A first-class HIP/ROCm backend in @qvac/vla-ggml, auto-selected over Vulkan with clean fallback when ROCm is absent. - A second local coding agent. OpenClaw joins OpenCode for local, cloud-free agent workflows. AGENTS - OpenCode plugin update (@qvac/opencode-plugin). Aligned with the current SDK, CLI, and AI SDK provider packages. A fresh install runs OpenCode against managed local QVAC models out of the box, from the default qvac/qwen3.5-9b, with no manual qvac serve setup. - OpenClaw plugin (@qvac/openclaw-plugin). A second coding-agent integration alongside OpenCode. A fresh setup installs the plugin, creates a local qvac provider through onboarding, and runs a QVAC model through OpenClaw🦞's local service path. LANGUAGE MODELS - Prompt batching (LLM addon). Batch multiple prompts in one job and run them concurrently, each answer returns the moment its generation finishes, no waiting on the others. - Reasoning-context trimming on hybrid + recurrent models (@qvac/llm-llamacpp). remove_thinking_from_context now works beyond pure-attention models. Same JS API, no throw. VOICE AND SPEECH - Transcription (transcription-parakeet 0.9.0). More robust CPU fallback on GPU failure and a faster Vulkan backend on Pixel 9. - Text-to-speech features (tts-ggml 0.4.0). Adds LavaSR for noise removal and adjustable output frequency up to 48 kHz, plus Japanese via Chatterbox. - Text-to-speech fixes (tts-ggml 0.4.1). CPU fallback on GPU failure, a q8_0 KV crash fix on Metal with Chatterbox. VISION - Qwen3.5 vision encoder on GPU (Android). Image encoder moves onto the phone GPU, with a smarter tile-grid preprocessor and default image-token caps, for flagship Android: Vulkan on Mali (Pixel 9 Pro) and OpenCL on Adreno 830 (Galaxy S25). - Gemma-4 vision encoder on GPU (Android). Vision encoder runs on the phone GPU instead of CPU, same flagship Android targets. PLATFORM AND PERFORMANCE - AMD GPU backend (@qvac/vla-ggml). Native HIP/ROCm backend, auto-selected over Vulkan with clean fallback when ROCm is absent (Linux x64 only). Comes with ~23% faster than Vulkan, ~14% faster than PyTorch-ROCm, parity preserved. Unified code style. A cleaner, more consistent, easier-to-contribute codebase. Let's build. npm install @qvac/sdk
QVAC17,700,244 görüntüleme • 8 gün önce
QVAC SDK 0.14.0 is live. This release makes the on-device stack faster on mobile, ships the developer-agent path, and takes local text-to-speech to 31 languages. Main highlights: - OpenCode and OpenClaw. The first official OpenCode plugin, plus a maintained OpenClaw compatibility path, both built on managed mode and qvac serve. Point a coding agent at a local model with far less setup and far fewer surprises. - Brain-computer interface transcription, on the SDK. Take recorded neural signal data and decode it into text, fully on-device, no cloud. Stream it in chunks through a simple API. In 0.14 it runs GPU-accelerated on iOS. - Text to Speech in 31 languages with our Supertonic3 upgrade. VOICE AND SPEECH - Supertonic3 multilingual TTS, 5 languages to 31. - Chatterbox and Supertonic now run on the Android GPU, with lower memory use (especially on iOS), quantized s3gen Chatterbox support, and a fix for Chatterbox occasionally emitting random speech. - Whisper transcription now runs on the iOS GPU. Parakeet runs on the Android GPU, with steadier real-time streaming. VISION AND OCR - VLM multi-tile batching: high-resolution Pan and Scan images are encoded in one pass instead of tile by tile, for faster vision throughput. - OCR on ggml (EasyOCR and DocTR) reaches full speed parity with the onnx path, across Metal, OpenCL, and Vulkan. PLATFORM AND RELIABILITY - Dynamic compute backends on Linux: one build picks the right backend at runtime, and opens the door to ROCm and CUDA support without per-backend builds. - Thinking tokens are kept out of the model context, so reasoning no longer fills the KV cache. SDK 0.14.0 is now leaner and faster to start. Let’s build.
QVAC23,973,950 görüntüleme • 22 gün önce
QVAC SDK 0.13.0 is live, and this version brings a lot of exciting updates! Local AI now plugs into your coding agent, ships as a desktop app in one command, and runs even more models. Highlights: NEW INTEGRATIONS - OpenCode and coding agents: the new @qvac/ai-sdk-provider makes QVAC a local provider. Less setup, same-model requests queue cleanly, and managed mode starts and supervises qvac serve for you. - Broader OpenAI-compatible API, validated across supported flows so covered capabilities stay consistent and testable. - Turn your QVAC project into a real desktop app for Mac, Windows, or Linux with a single command. The new Electron plugin handles the packaging and keeps the app small by including only what it needs. NEW MODELS - New pi0.5 model support - run a vision-language "robot brain" on a single ordinary graphics card, at full accuracy. - Image-to-video, fully local, via the Wan2.1 model in the Diffusion addon. - New BCI add-on: brain-computer interface transcription, fully local. Decode recorded neural signals into text on-device via the Whisper.cpp-based BCI model. IMPROVEMENTS - Whisper GPU transcription on Android, auto-picking the best backend (OpenCL on Adreno 700+, Vulkan elsewhere), unified on one ggml engine. - Parakeet steadier on mobile, with real end-of-utterance detection for streaming. - Supertonic TTS now runs full GPU across Metal, Vulkan, and OpenCL, with native streaming.
QVAC20,922,918 görüntüleme • 1 ay önce
You probably know OpenClaw🦞, one of the fastest-growing open-source projects around. An OpenClaw harness lets you build, code, analyze, and take real control of your machine. But the more access an agent has to your machine, the more it matters where your data goes & who can see it. With QVAC, you can run your OpenClaw agent fully on your own machine in a few minutes. Nothing leaves your computer. Full setup guide on the blog, see first comment below. 💡 Pro tip: already running OpenClaw? Send the blog article to your agent and let the it do the set up.
QVAC15,016,284 görüntüleme • 1 ay önce
Your local AI just got up to 5x more memory. Same model. Same device. Nearly zero accuracy loss. QVAC SDK 0.12.0 integrates TurboQuant - Google Research's latest memory optimisation algorithm. What is TurboQuant? The KV cache is the memory your model uses to track a conversation. As context grows, it fills up fast. 32K tokens. 64K. Game over. TurboQuant compresses it up to 5x with no accuracy loss. What does it unlock for you? Your app had a 16K token ceiling? It's now 96K. On the same device. Just update the QVAC SDK to get up to 5x more efficiency. No code changes. All from one SDK. The TurboQuant integration unlocks sovereign intelligence for more people, on more devices. Learn more →
QVAC15,799,748 görüntüleme • 1 ay önce
Yesterday we announced that the QVAC SDK update unlocked up to 5x more context on your device thanks to TurboQuant. Today, we’ll go through how we got there. TurboQuant (Google Research, ICLR 2026) is a two-stage KV-cache compression algorithm. Stage 1 - PolarQuant: convert KV vectors from Cartesian (x, y, z...) to polar coordinates. Angles compress predictably down to 3-4 bits. Stage 2 - QJL: 1-bit Johnson-Lindenstrauss correction. Cleans up residual error. Total: ~4-5 bits per value. No retraining. No calibration. QVAC ported it to Vulkan inside qvac-fabric-llm.cpp. Currently, TurboQuant is supported only for AMD & NVIDIA GPUs, support for iOS, Android & Apple Silicon coming next. Full algorithm walkthrough + benchmarks + code examples →
QVAC14,472,009 görüntüleme • 1 ay önce
A toy robot. A home assistant. A humanoid on a factory floor. They all need the same thing: a brain. QVAC is that brain, and it runs on the robot itself. No cloud to phone, no latency, nothing leaving your home. The intelligence is on the machine, so it keeps thinking even with the internet off. The robots are coming. This is what wakes them up:
QVAC5,248,713 görüntüleme • 26 gün önce
QVAC SDK 0.12.0 is now live, bringing longer context, increased memory optimisation, new modalities, and broader ecosystem support directly to your device. Key Features and Updates: - TurboQuant KV-Cache Quantization: Fit much longer context in the same memory. TurboQuant, an algorithm from Google Research, compresses the KV cache by up to 5x, near-lossless. - Text-to-Video: Generate video from a text prompt, fully local, with the new wan2.1 model in the Diffusion addon - Apple Metal Performance for Flux2-klein: Diffusion on Apple Silicon now matches MLX performance, the native benchmark for Apple GPUs - Robot Control (new VLA addon): A GGML-based Vision-Language-Action addon brings fast, efficient robot control to edge devices - Coding Assistant / Harness Support: QVAC now works with OpenCode and OpenClaw as a local provider. A new @qvac/ai-sdk-provider package automates model registry and provider integration - Cross-Platform Voice: Text-to-speech and Parakeet transcription moved from ONNX to the GGML engine for better CPU and GPU support on macOS, iOS, Windows, Linux, and Android. Parakeet also adds long-term streaming diarization (tracking who spoke when on live audio) - Faster Lightweight Visual Classification: A new GGML-based Classification addon delivers millisecond-level classification, useful where a vision-language model (VLM) would be unnecessarily slow - Under the Hood: Fabric synced to llama.cpp v8828 (from v8189), plus GPU acceleration added to image-upscale models for faster results Full release notes:
QVAC9,932,369 görüntüleme • 1 ay önce
Intelligence should not be a service you rent; it is a foundational element you possess. At Tether, we see AI as a new element of the periodic table - a raw material that can be embedded into the very fabric of the universe. Today, the QVAC SDK is officially live - the atomic unit for the next era of compute. From your smartphone today to the edge of the galaxy tomorrow, we are building the decentralized mind that doesn't require an uplink to function. Infinite Stable Intelligence: - Local-First: Runs privately on any device without permission or central servers. - Single API: A complete SDK for Vision, RAG, P2P networking, and LLM fine-tuning. - Unstoppable: No central point of failure if the internet breaks, your world keeps thinking. - Decentralized: Evolve through Peer-to-Peer Swarms of Infinite Intelligence. The era of Stable Intelligence has begun. Start building the future at
QVAC13,344,446 görüntüleme • 3 ay önce
The engine of the 21st century is here. 🧠 The QVAC SDK is the "steam engine" of the AI era—decoupling intelligence from the cloud and putting it in your hands. A single API for local-first, modular AI that runs anywhere. - Sovereign: Own your engine, don't rent it. - Local: 0 latency, no cloud dependency. - Modular: Stackable, universal building blocks. The era of Stable Intelligence has begun.
QVAC10,663,540 görüntüleme • 3 ay önce
If your AI needs a wire to work, it isn't yours. QVAC is the local-first engine designed to run anywhere, even where the internet can't reach. Fully autonomous. Fully open source. Fully sovereign. If you can dream it, you can build it. Even in another galaxy. Start building the future of edge AI:
QVAC7,044,078 görüntüleme • 2 ay önce
The QVAC SDK is the "LEGO block" of the next era of computing. It’s a modular, local-first framework designed to turn anything—from a simple robot to an industrial server—into a sovereign, autonomous mind. Why build with QVAC? Atomic Intelligence: AI as a raw material embedded directly into your hardware. No Cloud Dependency: 0 latency and total privacy. If the internet breaks, your world keeps thinking. Infinite Scale: A single API for local AI that runs on any device, anywhere. From a child’s toy to the fabric of the universe, if you can dream it, you can build it. Start building the future: 🚀
QVAC4,707,146 görüntüleme • 3 ay önce
The world of tomorrow cannot run on a rented cloud. 🚫 With 10 billion humans and 10 billion autonomous agents, intelligence must be embedded at the edge - not centralized in a server farm. The QVAC SDK is the invisible engine for this transition. We’ve built the foundational toolkit for the next era: highly efficient, fully modular, and 100% sovereign. From a single light to an industrial grid, the power to build local-first AI is now in your hands. The revolution will not be hosted. It will be local. Learn more:
QVAC2,908,291 görüntüleme • 2 ay önce
Ready to build the future of stable private on-device AI? 🧠 Our latest tutorial shows you how to build a sovereign mobile app in minutes using the QVAC SDK and Expo. Start from a blank template and deploy in minutes a local Llama 3.2 inference running directly on your own devices. What you’ll learn: Modular Setup: Use the QVAC CLI to tree-shake and keep your mobile bundle lean. Local-First Flow: Initialize the SDK, download weights, and run high-speed inference without a cloud uplink. Cross-Platform Power: See the smoke test in action on a physical Samsung S25. No rented clouds. No API keys. Build local, on-device, unstoppable intelligence in your pocket. Watch the full guide and start building:
QVAC4,080,718 görüntüleme • 3 ay önce
Two islands. Two futures. 🏝️ One chose to trust its people with intelligence. The other turned them into the product. QVAC is the foundation for a sovereign future. No central servers, no "Department of Truth," and no surveillance. Just local-first AI that lives on your device, learns with you, and belongs to you. Your data. Your device. Your freedom. Build the right choice:
QVAC3,599,437 görüntüleme • 3 ay önce
QVAC SDK 0.11.0 is live. 🛠️ This release focuses entirely on unlocking next-generation local compute and advanced visual workflows. What’s new: Next-Gen Models: Core engine updated to the latest version of Fabric, unlocking full support for Qwen 3.5, Qwen 3.6, and Gemma 4. Multi-GPU Support: The SDK can now split workloads across multiple graphics cards on the same machine, allowing you to run significantly larger models completely locally. Multi-Image Conditioning: Blend multiple reference images together in a single generation for advanced style mixing and composition control. On-Device Upscaling: Boost your generated images to high-quality resolutions, running securely on your own hardware. More improvements are waiting under the hood. Check the change logs, update your SDK today, and start building with
QVAC2,006,449 görüntüleme • 2 ay önce
Superior methodology beats raw parameter count. 🧠 Introducing QVAC MedPsy: Local-first medical AI that redefines the possible. 1/ Unprecedented Power: MedPsy 1.7B model outperforms Google’s MedGemma 4B by 11 points and our 4B model beats MedGemma 27B on real-world health benchmarks. 2/ Extreme Efficiency: 3.2x fewer tokens means near-instant inference on your phone or wearable. 3/ Absolute Privacy: Expert-level reasoning running 100% locally. No data leaves your device. We aren’t simply shrinking models; we’re anchoring intelligence where it matters most. High-level medical logic is now a sovereign right. The future of healthcare is local. Learn more:
QVAC2,416,342 görüntüleme • 2 ay önce
Big Tech's "safe spaces" are a mirage. When your most private thoughts are routed through a server, they are never truly yours; they are flagged, reviewed, and vulnerable. QVAC is the alternative. It’s not just a chatbot; it’s a sovereign intelligence platform that lives entirely on your devices. Truly Private: Data never leaves your hardware. No Gatekeepers: No "Department of Truth," no central surveillance. Unstoppable: Local AI that works for you, and only you. Take back your privacy. Take back your secrets. The era of Stable Intelligence has begun. Build the future:
QVAC2,967,319 görüntüleme • 3 ay önce
The era of Stable Intelligence is here 🤖 Tether’s QVAC Fabric just released the world’s first cross-platform 1-bit LLM LoRA fine-tuning framework. QVAC Fabric extends Microsoft's ultra-efficient BitNet architecture, allowing fine-tuning and inference of LLMs directly on your smartphone—no NVIDIA GPU/CUDA lock-in or expensive server required. The Breakthrough: - Total Sovereignty: LoRA fine-tune ultra-efficient models locally on any smartphone, including iPhones, Pixel phones, Samsung Galaxy phones and any desktop/laptop operating systems using Vulkan and Metal backends. - Extreme Efficiency: 1-bit architecture uses up to 90% less memory and runs up to 11x faster than traditional models. - Universal Access: What used to require a data center now runs on the chip in your pocket. Own your intelligence. The era of stable, local AI is here. 📱🧠 Read the full details on Hugging Face and grab the binaries to build on your own hardware.
QVAC108,569 görüntüleme • 4 ay önce