Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

QVAC SDK 0.14.0 is live. This release makes the on-device stack faster on mobile, ships the developer-agent path, and takes local text-to-speech to 31 languages. Main highlights: - OpenCode and OpenClaw. The first official OpenCode plugin, plus a maintained OpenClaw compatibility path, both built on managed mode and qvac... serve. Point a coding agent at a local model with far less setup and far fewer surprises. - Brain-computer interface transcription, on the SDK. Take recorded neural signal data and decode it into text, fully on-device, no cloud. Stream it in chunks through a simple API. In 0.14 it runs GPU-accelerated on iOS. - Text to Speech in 31 languages with our Supertonic3 upgrade. VOICE AND SPEECH - Supertonic3 multilingual TTS, 5 languages to 31. - Chatterbox and Supertonic now run on the Android GPU, with lower memory use (especially on iOS), quantized s3gen Chatterbox support, and a fix for Chatterbox occasionally emitting random speech. - Whisper transcription now runs on the iOS GPU. Parakeet runs on the Android GPU, with steadier real-time streaming. VISION AND OCR - VLM multi-tile batching: high-resolution Pan and Scan images are encoded in one pass instead of tile by tile, for faster vision throughput. - OCR on ggml (EasyOCR and DocTR) reaches full speed parity with the onnx path, across Metal, OpenCL, and Vulkan. PLATFORM AND RELIABILITY - Dynamic compute backends on Linux: one build picks the right backend at runtime, and opens the door to ROCm and CUDA support without per-backend builds. - Thinking tokens are kept out of the model context, so reasoning no longer fills the KV cache. SDK 0.14.0 is now leaner and faster to start. Let’s build.show more

QVAC

12,082 subscribers

23,995,874 Aufrufe • vor 3 Monaten •via X (Twitter)

Bildung Gesundheit & Wellness Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

32 Kommentare

Profilbild von QVAC

QVACvor 3 Monaten

Install or upgrade in one command: npm install @qvac/sdk NPM download: Release Notes:

Profilbild von Weaver Labs

Weaver Labsvor 3 Monaten

On-device AI keeps getting more capable. Faster mobile inference, multilingual TTS, local coding agents, even BCI transcription, the stack is getting closer to handling serious workloads without leaning on the cloud.

Profilbild von Crypto Professor Pr.🚀

Crypto Professor Pr.🚀vor 3 Monaten

Awesome project. Follow back or dm me 📩🤝

Profilbild von Mr Dari ₿

Mr Dari ₿vor 3 Monaten

🚀 Happy to support this project.

Profilbild von Laly Pump☄️

Laly Pump☄️vor 3 Monaten

Goodness me, what technical skill!🤔

Profilbild von ATHAR

ATHARvor 3 Monaten

The vision here is compelling. The setup feels strong. DM me if partnerships are something you're considering.

Profilbild von Niko Petrov

Niko Petrovvor 3 Monaten

dynamic backends still pull extra deps on Linux. Not leaner after full setup ⚙️

Profilbild von FinWizz

FinWizzvor 3 Monaten

The brain-computer interface transcription running fully on-device with GPU acceleration on iOS could simplify accessibility tools for users learning markets on the go.

Profilbild von Decklabs

Decklabsvor 3 Monaten

The BCI transcription now runs fully on-device with GPU acceleration on iOS.

Profilbild von En nombre de la Rosa

En nombre de la Rosavor 3 Monaten

RSP

Profilbild von Kashif Ali Khan

Kashif Ali Khanvor 3 Monaten

local text to speech in 31 languages is actually crazy good

Profilbild von Laura Ester

Laura Estervor 3 Monaten

Great

Profilbild von Vector

Vectorvor 3 Monaten

Finally got around to testing this. The speed bump on mobile is real, and the TTS sounds way more natural now. Good stuff.

Profilbild von mmm666

mmm666vor 3 Monaten

QVAC SDK 0.14.0 just dropped faster on device performance, 31 TTS languages, and OpenCode/OpenClaw live. Solid step forward.

Profilbild von Top Casino BR

Top Casino BRvor 3 Monaten

o sdk 0.14.0 ficou bem mais rapido no mobile. Boa.

Profilbild von t-radar.xyz | Track TG Trends

t-radar.xyz | Track TG Trendsvor 3 Monaten

The BCI transcription claim feels off. It is not fully on-device yet if it still needs recorded signals as input.

Profilbild von Kashif Ali Khan

Kashif Ali Khanvor 3 Monaten

that on device speed boost feels soo clean man

Profilbild von Slots Club

Slots Clubvor 3 Monaten

SDK 0.14 just got real.

Profilbild von Fútbol al Día VE

Fútbol al Día VEvor 3 Monaten

el sdk 0.14.0 acelera el stack en móviles y abre la puerta a más integraciones locales sin nube. Nos acerca a un ecosistema donde los agentes corren todo on device.

Profilbild von Robinhood Radar

Robinhood Radarvor 3 Monaten

the brain-computer interface transcription running gpu-accelerated on ios is huge. No cloud needed now. 🚀🧠

Profilbild von Geração Alpha

Geração Alphavor 3 Monaten

rodei o sdk no celular e o tts em portugues saiu sem aquele delay chato de antes. Agora da pra testar de verdade. 🚀💬

Profilbild von Robinhood Radar

Robinhood Radarvor 3 Monaten

tested the new gpu whisper on my old ipad, streams without the old lag now

Profilbild von mmm666

mmm666vor 3 Monaten

QVAC SDK 0.14.0 just dropped faster on device performance, 31 TTS languages, and OpenCode/OpenClaw are live. Solid leap forward.

Profilbild von La Voz del Gol

La Voz del Golvor 3 Monaten

sdk 0.14 acelera todo. Que belleza

Profilbild von Sanele

Sanelevor 3 Monaten

Q1qwaws

Profilbild von Niko Petrov

Niko Petrovvor 3 Monaten

We hit the GPU Whisper speedup on iOS last month. It cut our real-time latency by half in the agent loop.

Profilbild von Fútbol al Día VE

Fútbol al Día VEvor 3 Monaten

el sdk 0.14.0 abre la puerta para que mas devs locales integren bci sin depender de la nube. Eso cambia el juego para prototipos rapidos en venezuela

Profilbild von CasinoCripto BR

CasinoCripto BRvor 3 Monaten

O QVAC SDK 0.14.0 acelera o TTS em 31 idiomas no mobile. Isso facilita bônus de cassino com voz multilíngue para brasileiros. Vale testar o saque rápido. 🚀📱

Profilbild von Signal Seeker

Signal Seekervor 3 Monaten

just watched the BCI transcription stream chunks on-device in 0.14. GPU acceleration on iOS cut latency noticeably

Profilbild von Decklabs

Decklabsvor 3 Monaten

we ran our deck planning layer through qvac serve last week. The brain-computer transcription cut our voice notes to structured outline in one pass on-device.

Profilbild von OpenLabs

OpenLabsvor 3 Monaten

Impressive update. Expanding local TTS to 31 languages while maturing the developer-agent path

Profilbild von Roberto Luiz Pedro Bom

Roberto Luiz Pedro Bomvor 3 Monaten

Sim

Ähnliche Videos

QVAC SDK 0.15.0 is live. This release adds multiple prompts batching, brings a native AMD GPU backend to the stack, moves more vision encoders onto mobile GPUs, and adds a second local coding-agent integration. Main highlights: - Prompt batching for the LLM addon. Batch multiple prompts into one job and process them concurrently, with each answer returned the moment its generation finishes. - Native AMD GPU backend. A first-class HIP/ROCm backend in @qvac/vla-ggml, auto-selected over Vulkan with clean fallback when ROCm is absent. - A second local coding agent. OpenClaw joins OpenCode for local, cloud-free agent workflows. AGENTS - OpenCode plugin update (@qvac/opencode-plugin). Aligned with the current SDK, CLI, and AI SDK provider packages. A fresh install runs OpenCode against managed local QVAC models out of the box, from the default qvac/qwen3.5-9b, with no manual qvac serve setup. - OpenClaw plugin (@qvac/openclaw-plugin). A second coding-agent integration alongside OpenCode. A fresh setup installs the plugin, creates a local qvac provider through onboarding, and runs a QVAC model through OpenClaw🦞's local service path. LANGUAGE MODELS - Prompt batching (LLM addon). Batch multiple prompts in one job and run them concurrently, each answer returns the moment its generation finishes, no waiting on the others. - Reasoning-context trimming on hybrid + recurrent models (@qvac/llm-llamacpp). remove_thinking_from_context now works beyond pure-attention models. Same JS API, no throw. VOICE AND SPEECH - Transcription (transcription-parakeet 0.9.0). More robust CPU fallback on GPU failure and a faster Vulkan backend on Pixel 9. - Text-to-speech features (tts-ggml 0.4.0). Adds LavaSR for noise removal and adjustable output frequency up to 48 kHz, plus Japanese via Chatterbox. - Text-to-speech fixes (tts-ggml 0.4.1). CPU fallback on GPU failure, a q8_0 KV crash fix on Metal with Chatterbox. VISION - Qwen3.5 vision encoder on GPU (Android). Image encoder moves onto the phone GPU, with a smarter tile-grid preprocessor and default image-token caps, for flagship Android: Vulkan on Mali (Pixel 9 Pro) and OpenCL on Adreno 830 (Galaxy S25). - Gemma-4 vision encoder on GPU (Android). Vision encoder runs on the phone GPU instead of CPU, same flagship Android targets. PLATFORM AND PERFORMANCE - AMD GPU backend (@qvac/vla-ggml). Native HIP/ROCm backend, auto-selected over Vulkan with clean fallback when ROCm is absent (Linux x64 only). Comes with ~23% faster than Vulkan, ~14% faster than PyTorch-ROCm, parity preserved. Unified code style. A cleaner, more consistent, easier-to-contribute codebase. Let's build. npm install @qvac/sdk

QVAC SDK 0.15.0 is live. This release adds multiple prompts batching, brings a native AMD GPU backend to the stack, moves more vision encoders onto mobile GPUs, and adds a second local coding-agent integration. Main highlights: - Prompt batching for the LLM addon. Batch multiple prompts into one job and process them concurrently, with each answer returned the moment its generation finishes. - Native AMD GPU backend. A first-class HIP/ROCm backend in @qvac/vla-ggml, auto-selected over Vulkan with clean fallback when ROCm is absent. - A second local coding agent. OpenClaw joins OpenCode for local, cloud-free agent workflows. AGENTS - OpenCode plugin update (@qvac/opencode-plugin). Aligned with the current SDK, CLI, and AI SDK provider packages. A fresh install runs OpenCode against managed local QVAC models out of the box, from the default qvac/qwen3.5-9b, with no manual qvac serve setup. - OpenClaw plugin (@qvac/openclaw-plugin). A second coding-agent integration alongside OpenCode. A fresh setup installs the plugin, creates a local qvac provider through onboarding, and runs a QVAC model through OpenClaw🦞's local service path. LANGUAGE MODELS - Prompt batching (LLM addon). Batch multiple prompts in one job and run them concurrently, each answer returns the moment its generation finishes, no waiting on the others. - Reasoning-context trimming on hybrid + recurrent models (@qvac/llm-llamacpp). remove_thinking_from_context now works beyond pure-attention models. Same JS API, no throw. VOICE AND SPEECH - Transcription (transcription-parakeet 0.9.0). More robust CPU fallback on GPU failure and a faster Vulkan backend on Pixel 9. - Text-to-speech features (tts-ggml 0.4.0). Adds LavaSR for noise removal and adjustable output frequency up to 48 kHz, plus Japanese via Chatterbox. - Text-to-speech fixes (tts-ggml 0.4.1). CPU fallback on GPU failure, a q8_0 KV crash fix on Metal with Chatterbox. VISION - Qwen3.5 vision encoder on GPU (Android). Image encoder moves onto the phone GPU, with a smarter tile-grid preprocessor and default image-token caps, for flagship Android: Vulkan on Mali (Pixel 9 Pro) and OpenCL on Adreno 830 (Galaxy S25). - Gemma-4 vision encoder on GPU (Android). Vision encoder runs on the phone GPU instead of CPU, same flagship Android targets. PLATFORM AND PERFORMANCE - AMD GPU backend (@qvac/vla-ggml). Native HIP/ROCm backend, auto-selected over Vulkan with clean fallback when ROCm is absent (Linux x64 only). Comes with ~23% faster than Vulkan, ~14% faster than PyTorch-ROCm, parity preserved. Unified code style. A cleaner, more consistent, easier-to-contribute codebase. Let's build. npm install @qvac/sdk

QVAC

29,260,217 Aufrufe • vor 2 Monaten

QVAC SDK 0.13.0 is live, and this version brings a lot of exciting updates! Local AI now plugs into your coding agent, ships as a desktop app in one command, and runs even more models. Highlights: NEW INTEGRATIONS - OpenCode and coding agents: the new @qvac/ai-sdk-provider makes QVAC a local provider. Less setup, same-model requests queue cleanly, and managed mode starts and supervises qvac serve for you. - Broader OpenAI-compatible API, validated across supported flows so covered capabilities stay consistent and testable. - Turn your QVAC project into a real desktop app for Mac, Windows, or Linux with a single command. The new Electron plugin handles the packaging and keeps the app small by including only what it needs. NEW MODELS - New pi0.5 model support - run a vision-language "robot brain" on a single ordinary graphics card, at full accuracy. - Image-to-video, fully local, via the Wan2.1 model in the Diffusion addon. - New BCI add-on: brain-computer interface transcription, fully local. Decode recorded neural signals into text on-device via the Whisper.cpp-based BCI model. IMPROVEMENTS - Whisper GPU transcription on Android, auto-picking the best backend (OpenCL on Adreno 700+, Vulkan elsewhere), unified on one ggml engine. - Parakeet steadier on mobile, with real end-of-utterance detection for streaming. - Supertonic TTS now runs full GPU across Metal, Vulkan, and OpenCL, with native streaming.

QVAC SDK 0.13.0 is live, and this version brings a lot of exciting updates! Local AI now plugs into your coding agent, ships as a desktop app in one command, and runs even more models. Highlights: NEW INTEGRATIONS - OpenCode and coding agents: the new @qvac/ai-sdk-provider makes QVAC a local provider. Less setup, same-model requests queue cleanly, and managed mode starts and supervises qvac serve for you. - Broader OpenAI-compatible API, validated across supported flows so covered capabilities stay consistent and testable. - Turn your QVAC project into a real desktop app for Mac, Windows, or Linux with a single command. The new Electron plugin handles the packaging and keeps the app small by including only what it needs. NEW MODELS - New pi0.5 model support - run a vision-language "robot brain" on a single ordinary graphics card, at full accuracy. - Image-to-video, fully local, via the Wan2.1 model in the Diffusion addon. - New BCI add-on: brain-computer interface transcription, fully local. Decode recorded neural signals into text on-device via the Whisper.cpp-based BCI model. IMPROVEMENTS - Whisper GPU transcription on Android, auto-picking the best backend (OpenCL on Adreno 700+, Vulkan elsewhere), unified on one ggml engine. - Parakeet steadier on mobile, with real end-of-utterance detection for streaming. - Supertonic TTS now runs full GPU across Metal, Vulkan, and OpenCL, with native streaming.

QVAC

20,932,195 Aufrufe • vor 3 Monaten

QVAC SDK 0.12.0 is now live, bringing longer context, increased memory optimisation, new modalities, and broader ecosystem support directly to your device. Key Features and Updates: - TurboQuant KV-Cache Quantization: Fit much longer context in the same memory. TurboQuant, an algorithm from Google Research, compresses the KV cache by up to 5x, near-lossless. - Text-to-Video: Generate video from a text prompt, fully local, with the new wan2.1 model in the Diffusion addon - Apple Metal Performance for Flux2-klein: Diffusion on Apple Silicon now matches MLX performance, the native benchmark for Apple GPUs - Robot Control (new VLA addon): A GGML-based Vision-Language-Action addon brings fast, efficient robot control to edge devices - Coding Assistant / Harness Support: QVAC now works with OpenCode and OpenClaw as a local provider. A new @qvac/ai-sdk-provider package automates model registry and provider integration - Cross-Platform Voice: Text-to-speech and Parakeet transcription moved from ONNX to the GGML engine for better CPU and GPU support on macOS, iOS, Windows, Linux, and Android. Parakeet also adds long-term streaming diarization (tracking who spoke when on live audio) - Faster Lightweight Visual Classification: A new GGML-based Classification addon delivers millisecond-level classification, useful where a vision-language model (VLM) would be unnecessarily slow - Under the Hood: Fabric synced to llama.cpp v8828 (from v8189), plus GPU acceleration added to image-upscale models for faster results Full release notes:

QVAC SDK 0.12.0 is now live, bringing longer context, increased memory optimisation, new modalities, and broader ecosystem support directly to your device. Key Features and Updates: - TurboQuant KV-Cache Quantization: Fit much longer context in the same memory. TurboQuant, an algorithm from Google Research, compresses the KV cache by up to 5x, near-lossless. - Text-to-Video: Generate video from a text prompt, fully local, with the new wan2.1 model in the Diffusion addon - Apple Metal Performance for Flux2-klein: Diffusion on Apple Silicon now matches MLX performance, the native benchmark for Apple GPUs - Robot Control (new VLA addon): A GGML-based Vision-Language-Action addon brings fast, efficient robot control to edge devices - Coding Assistant / Harness Support: QVAC now works with OpenCode and OpenClaw as a local provider. A new @qvac/ai-sdk-provider package automates model registry and provider integration - Cross-Platform Voice: Text-to-speech and Parakeet transcription moved from ONNX to the GGML engine for better CPU and GPU support on macOS, iOS, Windows, Linux, and Android. Parakeet also adds long-term streaming diarization (tracking who spoke when on live audio) - Faster Lightweight Visual Classification: A new GGML-based Classification addon delivers millisecond-level classification, useful where a vision-language model (VLM) would be unnecessarily slow - Under the Hood: Fabric synced to llama.cpp v8828 (from v8189), plus GPU acceleration added to image-upscale models for faster results Full release notes:

QVAC

9,932,369 Aufrufe • vor 4 Monaten

Run your coding agent on a local model, with QVAC. OpenCode now plugs into a model on your own machine through our official plugin. That changes two things. Privacy by default. Your repo, your prompts, and every command the agent runs stay on your device. No third-party model ever sees your code. For an agent that reads your codebase and runs commands, that is the point, not a nice-to-have. New workflows. With no meter and no rate limit, the agent does not have to stop. Let it loop on a task, refactor a whole repo overnight, or run a watch-build-fix loop that keeps going. Setup takes a few minutes: one line in opencode.json and OpenCode runs on a local QVAC model. In the video demo, it handles three real developer tasks back to back, fully offline.

Run your coding agent on a local model, with QVAC. OpenCode now plugs into a model on your own machine through our official plugin. That changes two things. Privacy by default. Your repo, your prompts, and every command the agent runs stay on your device. No third-party model ever sees your code. For an agent that reads your codebase and runs commands, that is the point, not a nice-to-have. New workflows. With no meter and no rate limit, the agent does not have to stop. Let it loop on a task, refactor a whole repo overnight, or run a watch-build-fix loop that keeps going. Setup takes a few minutes: one line in opencode.json and OpenCode runs on a local QVAC model. In the video demo, it handles three real developer tasks back to back, fully offline.

QVAC

11,382,936 Aufrufe • vor 3 Monaten

Ready to build the future of stable private on-device AI? 🧠 Our latest tutorial shows you how to build a sovereign mobile app in minutes using the QVAC SDK and Expo. Start from a blank template and deploy in minutes a local Llama 3.2 inference running directly on your own devices. What you’ll learn: Modular Setup: Use the QVAC CLI to tree-shake and keep your mobile bundle lean. Local-First Flow: Initialize the SDK, download weights, and run high-speed inference without a cloud uplink. Cross-Platform Power: See the smoke test in action on a physical Samsung S25. No rented clouds. No API keys. Build local, on-device, unstoppable intelligence in your pocket. Watch the full guide and start building:

Ready to build the future of stable private on-device AI? 🧠 Our latest tutorial shows you how to build a sovereign mobile app in minutes using the QVAC SDK and Expo. Start from a blank template and deploy in minutes a local Llama 3.2 inference running directly on your own devices. What you’ll learn: Modular Setup: Use the QVAC CLI to tree-shake and keep your mobile bundle lean. Local-First Flow: Initialize the SDK, download weights, and run high-speed inference without a cloud uplink. Cross-Platform Power: See the smoke test in action on a physical Samsung S25. No rented clouds. No API keys. Build local, on-device, unstoppable intelligence in your pocket. Watch the full guide and start building:

QVAC

4,081,211 Aufrufe • vor 5 Monaten

The QVAC SDK puts the "brain" directly into your pocket. From real-time on-device translation to multimodal understanding, build apps that work everywhere, even 30,000 feet in the air. Local AI is here: 💡Offline-First: No cloud, no latency, no "Department of Truth". 💻 Universal API: One codebase for iOS, Android, macOS, and Linux. 🔍 Multimodal: Understanding text, audio, and images without a server. If you can dream it, you can build it. The era of Stable Intelligence has begun. Start building:

The QVAC SDK puts the "brain" directly into your pocket. From real-time on-device translation to multimodal understanding, build apps that work everywhere, even 30,000 feet in the air. Local AI is here: 💡Offline-First: No cloud, no latency, no "Department of Truth". 💻 Universal API: One codebase for iOS, Android, macOS, and Linux. 🔍 Multimodal: Understanding text, audio, and images without a server. If you can dream it, you can build it. The era of Stable Intelligence has begun. Start building:

QVAC

36,652 Aufrufe • vor 5 Monaten

QVAC SDK 0.11.0 is live. 🛠️ This release focuses entirely on unlocking next-generation local compute and advanced visual workflows. What’s new: Next-Gen Models: Core engine updated to the latest version of Fabric, unlocking full support for Qwen 3.5, Qwen 3.6, and Gemma 4. Multi-GPU Support: The SDK can now split workloads across multiple graphics cards on the same machine, allowing you to run significantly larger models completely locally. Multi-Image Conditioning: Blend multiple reference images together in a single generation for advanced style mixing and composition control. On-Device Upscaling: Boost your generated images to high-quality resolutions, running securely on your own hardware. More improvements are waiting under the hood. Check the change logs, update your SDK today, and start building with

QVAC SDK 0.11.0 is live. 🛠️ This release focuses entirely on unlocking next-generation local compute and advanced visual workflows. What’s new: Next-Gen Models: Core engine updated to the latest version of Fabric, unlocking full support for Qwen 3.5, Qwen 3.6, and Gemma 4. Multi-GPU Support: The SDK can now split workloads across multiple graphics cards on the same machine, allowing you to run significantly larger models completely locally. Multi-Image Conditioning: Blend multiple reference images together in a single generation for advanced style mixing and composition control. On-Device Upscaling: Boost your generated images to high-quality resolutions, running securely on your own hardware. More improvements are waiting under the hood. Check the change logs, update your SDK today, and start building with

QVAC

2,006,449 Aufrufe • vor 4 Monaten

Watch Marco Chiappetta, Head of QVAC, cloning his voice with nothing but local AI, and then generating speech in any language he wants. No cloud, no upload, the model runs on the device. Watch it below.

Watch Marco Chiappetta, Head of QVAC, cloning his voice with nothing but local AI, and then generating speech in any language he wants. No cloud, no upload, the model runs on the device. Watch it below.

QVAC

8,888,404 Aufrufe • vor 2 Monaten

QVAC SDK 0.10.0 is now live, bringing advanced local compute capabilities and specialized hardware optimization directly to your device Key Features and Updates: - Image-to-Image Diffusion: Transform and edit images using simple prompts with 100% local compute—no cloud uploads or external servers required - Dynamic Tooling & KV Cache Management:Your local LLM now receives a tailored toolbox for every interaction, with automatic KV cache clearing to maintain high-speed inference - Doctor CLI: A new diagnostic tool that analyzes your hardware and memory, providing specific instructions on how to optimize your GPU for local AI - Suspend & Resume API: Specifically designed for mobile environments, this allows apps to pause P2P swarms and RAG workspaces to meet background rules without losing model state - GPT-OSS Compatibility: Added support for the latest GPT-OSS models loaded externally, expanding the range of open-source intelligence available on the platform Build the future of private, unstoppable AI:

QVAC SDK 0.10.0 is now live, bringing advanced local compute capabilities and specialized hardware optimization directly to your device Key Features and Updates: - Image-to-Image Diffusion: Transform and edit images using simple prompts with 100% local compute—no cloud uploads or external servers required - Dynamic Tooling & KV Cache Management:Your local LLM now receives a tailored toolbox for every interaction, with automatic KV cache clearing to maintain high-speed inference - Doctor CLI: A new diagnostic tool that analyzes your hardware and memory, providing specific instructions on how to optimize your GPU for local AI - Suspend & Resume API: Specifically designed for mobile environments, this allows apps to pause P2P swarms and RAG workspaces to meet background rules without losing model state - GPT-OSS Compatibility: Added support for the latest GPT-OSS models loaded externally, expanding the range of open-source intelligence available on the platform Build the future of private, unstoppable AI:

QVAC

34,508 Aufrufe • vor 5 Monaten

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️

Prince Canuma

164,026 Aufrufe • vor 7 Monaten

Introducing NexaSDK for Android (Beta) — run the latest AI models locally, 9× more energy-efficient and 2× faster, on Android devices, powered by the Qualcomm Hexagon NPU. This is the first SDK to support NPU, GPU and CPU, unlocking the full power of every Android device — for example, LFM2-1.2B achieves 85 t/s on NPU vs 37 t/s on CPU. With just 3 lines of code, you can run the latest state-of-the-art models across every task, for example: Multimodal (Vision, Audio, Text): OmniNeural-4B Embedding: EmbeddingGemma from Google ASR: Parakeet-v3 from NVIDIA OCR: PaddleOCR from Baidu Inc. Rerank: Jina-reranker from Jina AI LLM: LFM2-1.2B from And we continue to deliver Day-0 model support across our framework. Build on-device AI into your Android app today and enjoy no cloud API cost, full privacy, and offline availability. Check out our Quickstart guide and example app below to get started in minutes.

Introducing NexaSDK for Android (Beta) — run the latest AI models locally, 9× more energy-efficient and 2× faster, on Android devices, powered by the Qualcomm Hexagon NPU. This is the first SDK to support NPU, GPU and CPU, unlocking the full power of every Android device — for example, LFM2-1.2B achieves 85 t/s on NPU vs 37 t/s on CPU. With just 3 lines of code, you can run the latest state-of-the-art models across every task, for example: Multimodal (Vision, Audio, Text): OmniNeural-4B Embedding: EmbeddingGemma from Google ASR: Parakeet-v3 from NVIDIA OCR: PaddleOCR from Baidu Inc. Rerank: Jina-reranker from Jina AI LLM: LFM2-1.2B from And we continue to deliver Day-0 model support across our framework. Build on-device AI into your Android app today and enjoy no cloud API cost, full privacy, and offline availability. Check out our Quickstart guide and example app below to get started in minutes.

NEXA AI

26,091 Aufrufe • vor 11 Monaten

The era of Stable Intelligence is here 🤖 Tether’s QVAC Fabric just released the world’s first cross-platform 1-bit LLM LoRA fine-tuning framework. QVAC Fabric extends Microsoft's ultra-efficient BitNet architecture, allowing fine-tuning and inference of LLMs directly on your smartphone—no NVIDIA GPU/CUDA lock-in or expensive server required. The Breakthrough: - Total Sovereignty: LoRA fine-tune ultra-efficient models locally on any smartphone, including iPhones, Pixel phones, Samsung Galaxy phones and any desktop/laptop operating systems using Vulkan and Metal backends. - Extreme Efficiency: 1-bit architecture uses up to 90% less memory and runs up to 11x faster than traditional models. - Universal Access: What used to require a data center now runs on the chip in your pocket. Own your intelligence. The era of stable, local AI is here. 📱🧠 Read the full details on Hugging Face and grab the binaries to build on your own hardware.

The era of Stable Intelligence is here 🤖 Tether’s QVAC Fabric just released the world’s first cross-platform 1-bit LLM LoRA fine-tuning framework. QVAC Fabric extends Microsoft's ultra-efficient BitNet architecture, allowing fine-tuning and inference of LLMs directly on your smartphone—no NVIDIA GPU/CUDA lock-in or expensive server required. The Breakthrough: - Total Sovereignty: LoRA fine-tune ultra-efficient models locally on any smartphone, including iPhones, Pixel phones, Samsung Galaxy phones and any desktop/laptop operating systems using Vulkan and Metal backends. - Extreme Efficiency: 1-bit architecture uses up to 90% less memory and runs up to 11x faster than traditional models. - Universal Access: What used to require a data center now runs on the chip in your pocket. Own your intelligence. The era of stable, local AI is here. 📱🧠 Read the full details on Hugging Face and grab the binaries to build on your own hardware.

QVAC

108,923 Aufrufe • vor 6 Monaten

Ocarina of Time, running natively on iOS and iPadOS for the first time. Not an emulator. Ship of Harkinian has run on Windows, Linux, macOS, Switch, Wii U, and Android. Never iOS. Now it runs on iPad, with iPhone in the build too. The game was decompiled to C and rebuilt as a native ARM64 app rendering through Metal. No N64 hardware being simulated, no ROM interpreted at runtime, no streaming from a Mac. It isn't stuck at the N64's 240p and 20fps. Widescreen, full resolution, 60fps. This game deserves a controller, so controller support is native. Pair a Bluetooth controller and play the whole thing. Touch, keyboard, and mouse work too. I used Codex 5.6 Sol to build the iOS layer. Open sourcing it all below.

Ocarina of Time, running natively on iOS and iPadOS for the first time. Not an emulator. Ship of Harkinian has run on Windows, Linux, macOS, Switch, Wii U, and Android. Never iOS. Now it runs on iPad, with iPhone in the build too. The game was decompiled to C and rebuilt as a native ARM64 app rendering through Metal. No N64 hardware being simulated, no ROM interpreted at runtime, no streaming from a Mac. It isn't stuck at the N64's 240p and 20fps. Widescreen, full resolution, 60fps. This game deserves a controller, so controller support is native. Pair a Bluetooth controller and play the whole thing. Touch, keyboard, and mouse work too. I used Codex 5.6 Sol to build the iOS layer. Open sourcing it all below.

Kahris

1,176,550 Aufrufe • vor 2 Monaten

$Someone open-sourced a 66M parameter model that beats ElevenLabs, OpenAI, and Gemini and runs entirely offline on a Raspberry Pi. it's called Supertonic, a text-to-speech model so fast it turns an entire webpage into audio in under 1 second. locally. offline. for free. text-to-speech has lived in the cloud for years. every spoken character was an API call and a fraction of a cent. Supertonic 3 kills that entirely. the model is 99M parameters. ships as a single ONNX file. hits 167× faster than real-time on a laptop CPU. that's ~1,263 characters of speech per second. other open systems sit at 55–287. no cloud. no API. no GPU. → 31 languages, no separate adapters → works inside a browser tab (WebGPU/WASM) → handles phone numbers, currency, dates — no preprocessing → inline tags for laugh and breath → Turns an entire webpage into audio in under 1 second → 44.1kHz studio-grade WAV, no upsampler needed` and on real-world text, "$5.2M", "(212) 555-0142 ext. 402", "30kph”, it's the only one that reads them correctly. ElevenLabs Flash, OpenAI TTS-1, Gemini 2.5 Flash all fail. Supertonic passes. 11.2k stars. 100% Open Source.$

Someone open-sourced a 66M parameter model that beats ElevenLabs, OpenAI, and Gemini and runs entirely offline on a Raspberry Pi. it's called Supertonic, a text-to-speech model so fast it turns an entire webpage into audio in under 1 second. locally. offline. for free. text-to-speech has lived in the cloud for years. every spoken character was an API call and a fraction of a cent. Supertonic 3 kills that entirely. the model is 99M parameters. ships as a single ONNX file. hits 167× faster than real-time on a laptop CPU. that's ~1,263 characters of speech per second. other open systems sit at 55–287. no cloud. no API. no GPU. → 31 languages, no separate adapters → works inside a browser tab (WebGPU/WASM) → handles phone numbers, currency, dates — no preprocessing → inline tags for laugh and breath → Turns an entire webpage into audio in under 1 second → 44.1kHz studio-grade WAV, no upsampler needed` and on real-world text, "$5.2M", "(212) 555-0142 ext. 402", "30kph”, it's the only one that reads them correctly. ElevenLabs Flash, OpenAI TTS-1, Gemini 2.5 Flash all fail. Supertonic passes. 11.2k stars. 100% Open Source.

Superman

30,416 Aufrufe • vor 2 Monaten

GoldenEye 007 N64 running natively on iOS and iPadOS for the first time. Not an emulator. The GoldenEye decompilation community spent years reconstructing the original game. GoldenEye64Recomp, N64Recomp, N64ModernRuntime, and RT64 provided the static recompilation, runtime, and rendering foundations. I built GoldenPad on top: the iPhone and iPad app, touch interface, native audio and saves, controller support, and the mobile lifecycle work needed to make it run on real devices. It runs great on iPhone. GoldenEye runs better through GoldenPad than it has in any N64 emulator I have tried on iOS. Native ARM64 code, high-resolution Metal rendering, and modern dual-stick controls make a huge difference. No JIT, no N64 code being interpreted at runtime, and no streaming from a Mac. This is the original 1997 N64 game, not the XBLA version, and it is not based on GoldenEye Metal. I am actively working on full local split-screen multiplayer for iPad. MacOS support soon. I built the iOS and iPadOS integration with 5.6 Sol. Open sourcing it all below. Happy Friday!

GoldenEye 007 N64 running natively on iOS and iPadOS for the first time. Not an emulator. The GoldenEye decompilation community spent years reconstructing the original game. GoldenEye64Recomp, N64Recomp, N64ModernRuntime, and RT64 provided the static recompilation, runtime, and rendering foundations. I built GoldenPad on top: the iPhone and iPad app, touch interface, native audio and saves, controller support, and the mobile lifecycle work needed to make it run on real devices. It runs great on iPhone. GoldenEye runs better through GoldenPad than it has in any N64 emulator I have tried on iOS. Native ARM64 code, high-resolution Metal rendering, and modern dual-stick controls make a huge difference. No JIT, no N64 code being interpreted at runtime, and no streaming from a Mac. This is the original 1997 N64 game, not the XBLA version, and it is not based on GoldenEye Metal. I am actively working on full local split-screen multiplayer for iPad. MacOS support soon. I built the iOS and iPadOS integration with 5.6 Sol. Open sourcing it all below. Happy Friday!

Kahris

543,313 Aufrufe • vor 1 Monat

Grok Voice Agent API is now one of the most advanced voice AIs in the world It ranks #1 on BigBench Audio for speech reasoning Grok Voice already powers voice mode across Grok apps and runs in millions of Tesla vehicles Conversations feel so natural, expressive, fluid, and instantly responsive - like talking to a real person, not a machine Try it now on Grok, in Tesla, and across the growing ecosystem of apps and experiences powered by xAI

Grok Voice Agent API is now one of the most advanced voice AIs in the world It ranks #1 on BigBench Audio for speech reasoning Grok Voice already powers voice mode across Grok apps and runs in millions of Tesla vehicles Conversations feel so natural, expressive, fluid, and instantly responsive - like talking to a real person, not a machine Try it now on Grok, in Tesla, and across the growing ecosystem of apps and experiences powered by xAI

X Freeze

4,173,047 Aufrufe • vor 9 Monaten

Build an assistant that can store and search what it sees, hears, and is told, all without leaving the device. In Building AI Assistants with On-Device Memory, you'll build a local memory system that recalls text, voice, and images, and teach it to recognize something new from a few photos. Built in partnership with Qdrant and taught by Dylan Couzon, Developer Experience Engineer at Qdrant. This course also includes our new AI coding lab, so you can practice building with an AI coding agent from the mobile app. Enroll for free:

Build an assistant that can store and search what it sees, hears, and is told, all without leaving the device. In Building AI Assistants with On-Device Memory, you'll build a local memory system that recalls text, voice, and images, and teach it to recognize something new from a few photos. Built in partnership with Qdrant and taught by Dylan Couzon, Developer Experience Engineer at Qdrant. This course also includes our new AI coding lab, so you can practice building with an AI coding agent from the mobile app. Enroll for free:

DeepLearning.AI

13,842 Aufrufe • vor 11 Tagen

The world of tomorrow cannot run on a rented cloud. 🚫 With 10 billion humans and 10 billion autonomous agents, intelligence must be embedded at the edge - not centralized in a server farm. The QVAC SDK is the invisible engine for this transition. We’ve built the foundational toolkit for the next era: highly efficient, fully modular, and 100% sovereign. From a single light to an industrial grid, the power to build local-first AI is now in your hands. The revolution will not be hosted. It will be local. Learn more:

The world of tomorrow cannot run on a rented cloud. 🚫 With 10 billion humans and 10 billion autonomous agents, intelligence must be embedded at the edge - not centralized in a server farm. The QVAC SDK is the invisible engine for this transition. We’ve built the foundational toolkit for the next era: highly efficient, fully modular, and 100% sovereign. From a single light to an industrial grid, the power to build local-first AI is now in your hands. The revolution will not be hosted. It will be local. Learn more:

QVAC

2,909,096 Aufrufe • vor 4 Monaten

Viggle’s Mic 2.0 is here! With our upgraded model, take precise control over how a character talks and moves, in one shot. Turn images into videos simply with an audio or text prompt for speech. Or take it further—add a motion source to drive the character’s movements—action and voice, perfectly aligned. Try it free on our web, or on our iOS/Android apps.👇

Viggle’s Mic 2.0 is here! With our upgraded model, take precise control over how a character talks and moves, in one shot. Turn images into videos simply with an audio or text prompt for speech. Or take it further—add a motion source to drive the character’s movements—action and voice, perfectly aligned. Try it free on our web, or on our iOS/Android apps.👇

ViggleAI

36,207 Aufrufe • vor 1 Jahr

A 27B parameter model used to need a server room. Now it runs on: • iPhone • Android • Mac PrismML's Bonsai makes it possible. • 1-bit weights • 27B params in just 3.9GB • ~90% of full precision quality (PrismML evals) • Better than the 2-bit version at less than half the size The entire Bonsai family is now live in RunAnywhere. • 1.7B to 27B models • 1-bit + 2-bit ternary • Thinking mode On iOS and Mac, Bonsai runs through ggml's llama.cpp and Apple's MLX. On Android, Bonsai runs through ggml's llama.cpp and directly on the Qualcomm Hexagon NPU through QHexRT, our proprietary inference runtime. We built custom silicon kernels to make 1-bit inference on an NPU possible for the first time. Two years ago this needed a data center. Now it thinks in airplane mode. Now available in the RunAnywhere app on the App Store and Google Play.

A 27B parameter model used to need a server room. Now it runs on: • iPhone • Android • Mac PrismML's Bonsai makes it possible. • 1-bit weights • 27B params in just 3.9GB • ~90% of full precision quality (PrismML evals) • Better than the 2-bit version at less than half the size The entire Bonsai family is now live in RunAnywhere. • 1.7B to 27B models • 1-bit + 2-bit ternary • Thinking mode On iOS and Mac, Bonsai runs through ggml's llama.cpp and Apple's MLX. On Android, Bonsai runs through ggml's llama.cpp and directly on the Qualcomm Hexagon NPU through QHexRT, our proprietary inference runtime. We built custom silicon kernels to make 1-bit inference on an NPU possible for the first time. Two years ago this needed a data center. Now it thinks in airplane mode. Now available in the RunAnywhere app on the App Store and Google Play.

RunAnywhere (YC W26)

17,587 Aufrufe • vor 2 Monaten