正在加载视频...

视频加载失败

返回首页

Introducing NexaSDK for Android (Beta) — run the latest AI models locally, 9× more energy-efficient and 2× faster, on Android devices, powered by the Qualcomm Hexagon NPU. This is the first SDK to support NPU, GPU and CPU, unlocking the full power of every Android device — for example,...

nexa_ai's profile picture

NEXA AI

4,051 subscribers

26,091 次观看 • 9 个月前 •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

The next generation of mobile apps will run multimodal AI locally by default. Today, we’re making it practical for developers to ship. We just launched NexaSDK for Mobile on Product Hunt. Developers can run the latest multimodal AI models fully on-device in iOS & Android apps with Apple Neural Engine and Qualcomm Hexagon NPU acceleration. In just 3 lines of code, build chat, multimodal, search, and audio features with no cloud cost, complete privacy, 2x faster speed and 9× better energy efficiency. Try out NexaSDK for Mobile and we’d love your feedback (Product Hunt link in thread).
1:21

The next generation of mobile apps will run multimodal AI locally by default. Today, we’re making it practical for developers to ship. We just launched NexaSDK for Mobile on Product Hunt. Developers can run the latest multimodal AI models fully on-device in iOS & Android apps with Apple Neural Engine and Qualcomm Hexagon NPU acceleration. In just 3 lines of code, build chat, multimodal, search, and audio features with no cloud cost, complete privacy, 2x faster speed and 9× better energy efficiency. Try out NexaSDK for Mobile and we’d love your feedback (Product Hunt link in thread).

NEXA AI

319,337 次观看 • 8 个月前

For the first time, the latest LLMs run on the Apple Neural Engine — and NexaSDK is the only framework that makes it possible, powered by the NexaML engine. Last year, our two co-founders were invited by Apple DMLI team (Data & Machine Learning Innovation) to share their research about on-device multimodal model for local AI agents. One of the big questions in the room was: “Can the newest LLMs actually run on ANE?” At the time, nobody had a clear path. Today, that path exists. NexaSDK now runs Granite-4.0 (IBM), Qwen3 (Qwen), Gemma3 (Google), and Parakeet-v3 (NVIDIA) fully on Apple’s NPU — unlocking low-power, always-on, fast inference across Mac and iPhone. A new wave of NPU-first local AI apps is coming to Apple devices. Start with one line of code on Mac. iOS SDK coming soon.
1:42

For the first time, the latest LLMs run on the Apple Neural Engine — and NexaSDK is the only framework that makes it possible, powered by the NexaML engine. Last year, our two co-founders were invited by Apple DMLI team (Data & Machine Learning Innovation) to share their research about on-device multimodal model for local AI agents. One of the big questions in the room was: “Can the newest LLMs actually run on ANE?” At the time, nobody had a clear path. Today, that path exists. NexaSDK now runs Granite-4.0 (IBM), Qwen3 (Qwen), Gemma3 (Google), and Parakeet-v3 (NVIDIA) fully on Apple’s NPU — unlocking low-power, always-on, fast inference across Mac and iPhone. A new wave of NPU-first local AI apps is coming to Apple devices. Start with one line of code on Mac. iOS SDK coming soon.

NEXA AI

30,213 次观看 • 9 个月前

Windows ML is now generally available! This milestone brings powerful, local AI capability to every Windows 11 device, harnessing the full power of the GPU, NPU, and CPU. Big thank you to the team and our silicon partners, AMD, Intel, NVIDIA, and Qualcomm, for their collaboration to unlock real-time, secure, and efficient AI experiences for developers on Windows. Let’s go 🚀!
1:16

Windows ML is now generally available! This milestone brings powerful, local AI capability to every Windows 11 device, harnessing the full power of the GPU, NPU, and CPU. Big thank you to the team and our silicon partners, AMD, Intel, NVIDIA, and Qualcomm, for their collaboration to unlock real-time, secure, and efficient AI experiences for developers on Windows. Let’s go 🚀!

Pavan Davuluri

11,663 次观看 • 11 个月前

The QVAC SDK puts the "brain" directly into your pocket. From real-time on-device translation to multimodal understanding, build apps that work everywhere, even 30,000 feet in the air. Local AI is here: 💡Offline-First: No cloud, no latency, no "Department of Truth". 💻 Universal API: One codebase for iOS, Android, macOS, and Linux. 🔍 Multimodal: Understanding text, audio, and images without a server. If you can dream it, you can build it. The era of Stable Intelligence has begun. Start building:
0:41

The QVAC SDK puts the "brain" directly into your pocket. From real-time on-device translation to multimodal understanding, build apps that work everywhere, even 30,000 feet in the air. Local AI is here: 💡Offline-First: No cloud, no latency, no "Department of Truth". 💻 Universal API: One codebase for iOS, Android, macOS, and Linux. 🔍 Multimodal: Understanding text, audio, and images without a server. If you can dream it, you can build it. The era of Stable Intelligence has begun. Start building:

QVAC

36,652 次观看 • 4 个月前

Ready to build the future of stable private on-device AI? 🧠 Our latest tutorial shows you how to build a sovereign mobile app in minutes using the QVAC SDK and Expo. Start from a blank template and deploy in minutes a local Llama 3.2 inference running directly on your own devices. What you’ll learn: Modular Setup: Use the QVAC CLI to tree-shake and keep your mobile bundle lean. Local-First Flow: Initialize the SDK, download weights, and run high-speed inference without a cloud uplink. Cross-Platform Power: See the smoke test in action on a physical Samsung S25. No rented clouds. No API keys. Build local, on-device, unstoppable intelligence in your pocket. Watch the full guide and start building:
5:37

Ready to build the future of stable private on-device AI? 🧠 Our latest tutorial shows you how to build a sovereign mobile app in minutes using the QVAC SDK and Expo. Start from a blank template and deploy in minutes a local Llama 3.2 inference running directly on your own devices. What you’ll learn: Modular Setup: Use the QVAC CLI to tree-shake and keep your mobile bundle lean. Local-First Flow: Initialize the SDK, download weights, and run high-speed inference without a cloud uplink. Cross-Platform Power: See the smoke test in action on a physical Samsung S25. No rented clouds. No API keys. Build local, on-device, unstoppable intelligence in your pocket. Watch the full guide and start building:

QVAC

4,081,211 次观看 • 4 个月前

QVAC SDK 0.14.0 is live. This release makes the on-device stack faster on mobile, ships the developer-agent path, and takes local text-to-speech to 31 languages. Main highlights: - OpenCode and OpenClaw. The first official OpenCode plugin, plus a maintained OpenClaw compatibility path, both built on managed mode and qvac serve. Point a coding agent at a local model with far less setup and far fewer surprises. - Brain-computer interface transcription, on the SDK. Take recorded neural signal data and decode it into text, fully on-device, no cloud. Stream it in chunks through a simple API. In 0.14 it runs GPU-accelerated on iOS. - Text to Speech in 31 languages with our Supertonic3 upgrade. VOICE AND SPEECH - Supertonic3 multilingual TTS, 5 languages to 31. - Chatterbox and Supertonic now run on the Android GPU, with lower memory use (especially on iOS), quantized s3gen Chatterbox support, and a fix for Chatterbox occasionally emitting random speech. - Whisper transcription now runs on the iOS GPU. Parakeet runs on the Android GPU, with steadier real-time streaming. VISION AND OCR - VLM multi-tile batching: high-resolution Pan and Scan images are encoded in one pass instead of tile by tile, for faster vision throughput. - OCR on ggml (EasyOCR and DocTR) reaches full speed parity with the onnx path, across Metal, OpenCL, and Vulkan. PLATFORM AND RELIABILITY - Dynamic compute backends on Linux: one build picks the right backend at runtime, and opens the door to ROCm and CUDA support without per-backend builds. - Thinking tokens are kept out of the model context, so reasoning no longer fills the KV cache. SDK 0.14.0 is now leaner and faster to start. Let’s build.
1:51

QVAC SDK 0.14.0 is live. This release makes the on-device stack faster on mobile, ships the developer-agent path, and takes local text-to-speech to 31 languages. Main highlights: - OpenCode and OpenClaw. The first official OpenCode plugin, plus a maintained OpenClaw compatibility path, both built on managed mode and qvac serve. Point a coding agent at a local model with far less setup and far fewer surprises. - Brain-computer interface transcription, on the SDK. Take recorded neural signal data and decode it into text, fully on-device, no cloud. Stream it in chunks through a simple API. In 0.14 it runs GPU-accelerated on iOS. - Text to Speech in 31 languages with our Supertonic3 upgrade. VOICE AND SPEECH - Supertonic3 multilingual TTS, 5 languages to 31. - Chatterbox and Supertonic now run on the Android GPU, with lower memory use (especially on iOS), quantized s3gen Chatterbox support, and a fix for Chatterbox occasionally emitting random speech. - Whisper transcription now runs on the iOS GPU. Parakeet runs on the Android GPU, with steadier real-time streaming. VISION AND OCR - VLM multi-tile batching: high-resolution Pan and Scan images are encoded in one pass instead of tile by tile, for faster vision throughput. - OCR on ggml (EasyOCR and DocTR) reaches full speed parity with the onnx path, across Metal, OpenCL, and Vulkan. PLATFORM AND RELIABILITY - Dynamic compute backends on Linux: one build picks the right backend at runtime, and opens the door to ROCm and CUDA support without per-backend builds. - Thinking tokens are kept out of the model context, so reasoning no longer fills the KV cache. SDK 0.14.0 is now leaner and faster to start. Let’s build.

QVAC

23,973,950 次观看 • 2 个月前

Sam Altman recently said: “GPT-OSS has strong real-world performance comparable to o4-mini—and you can run it locally on your phone.” Many believed running a 20B-parameter model on mobile devices was still years away. At Nexa AI, we’ve built our foundation on deep on-device AI technology—turning that vision into reality. Today, GPT-OSS is running fully local on mobile devices through our app, Nexa Studio. Real performance on Snapdragon Gen 5: - 17 tokens/sec decoding speed - < 3 seconds Time-to-First-Token Developers can now use NexaSDK to build their own local AI apps powered by GPT-OSS. What this unlocks: - Real reasoning models running locally - The next wave of AI Agent use cases—without cloud limits - True data privacy: your data never leaves your device Appreciation to OpenAI Sam Altman Greg Brockman and the entire leadership team for pushing the boundaries of the open-source AI community. Thanks to Qualcomm for the partnership, and to Manoj Khilnani and Chun-Po (Jerry) Chang for the incredible collaboration.
0:31

Sam Altman recently said: “GPT-OSS has strong real-world performance comparable to o4-mini—and you can run it locally on your phone.” Many believed running a 20B-parameter model on mobile devices was still years away. At Nexa AI, we’ve built our foundation on deep on-device AI technology—turning that vision into reality. Today, GPT-OSS is running fully local on mobile devices through our app, Nexa Studio. Real performance on Snapdragon Gen 5: - 17 tokens/sec decoding speed - < 3 seconds Time-to-First-Token Developers can now use NexaSDK to build their own local AI apps powered by GPT-OSS. What this unlocks: - Real reasoning models running locally - The next wave of AI Agent use cases—without cloud limits - True data privacy: your data never leaves your device Appreciation to OpenAI Sam Altman Greg Brockman and the entire leadership team for pushing the boundaries of the open-source AI community. Thanks to Qualcomm for the partnership, and to Manoj Khilnani and Chun-Po (Jerry) Chang for the incredible collaboration.

NEXA AI

197,453 次观看 • 10 个月前

✨ Personal AI is the next computing platform. AI is shifting from something you access to something you build with, locally, at the edge, and across systems. We’re unlocking new possibilities for developers: • AMD Ryzen AI Halo, a local-first developer system, preorder starting in June, develop AI without limits on your desk • Gorgon Halo with up to 192GB unified memory, supporting 300B+ parameter models locally, run massive models locally We’re excited to partner with clem 🤗🤗, Co-founder and CEO of Hugging Face, to advance open-source AI for Ryzen AI. Our focus is seamless AI, from model to deployment. Cloud, edge, device. One continuum. Multi-agent systems, local inference at scale, open models as infrastructure. This is the next computing era 🚀
4:49

✨ Personal AI is the next computing platform. AI is shifting from something you access to something you build with, locally, at the edge, and across systems. We’re unlocking new possibilities for developers: • AMD Ryzen AI Halo, a local-first developer system, preorder starting in June, develop AI without limits on your desk • Gorgon Halo with up to 192GB unified memory, supporting 300B+ parameter models locally, run massive models locally We’re excited to partner with clem 🤗🤗, Co-founder and CEO of Hugging Face, to advance open-source AI for Ryzen AI. Our focus is seamless AI, from model to deployment. Cloud, edge, device. One continuum. Multi-agent systems, local inference at scale, open models as infrastructure. This is the next computing era 🚀

Jack Huynh

49,619 次观看 • 3 个月前

A 27B parameter model used to need a server room. Now it runs on: • iPhone • Android • Mac PrismML's Bonsai makes it possible. • 1-bit weights • 27B params in just 3.9GB • ~90% of full precision quality (PrismML evals) • Better than the 2-bit version at less than half the size The entire Bonsai family is now live in RunAnywhere. • 1.7B to 27B models • 1-bit + 2-bit ternary • Thinking mode On iOS and Mac, Bonsai runs through ggml's llama.cpp and Apple's MLX. On Android, Bonsai runs through ggml's llama.cpp and directly on the Qualcomm Hexagon NPU through QHexRT, our proprietary inference runtime. We built custom silicon kernels to make 1-bit inference on an NPU possible for the first time. Two years ago this needed a data center. Now it thinks in airplane mode. Now available in the RunAnywhere app on the App Store and Google Play.
0:27

A 27B parameter model used to need a server room. Now it runs on: • iPhone • Android • Mac PrismML's Bonsai makes it possible. • 1-bit weights • 27B params in just 3.9GB • ~90% of full precision quality (PrismML evals) • Better than the 2-bit version at less than half the size The entire Bonsai family is now live in RunAnywhere. • 1.7B to 27B models • 1-bit + 2-bit ternary • Thinking mode On iOS and Mac, Bonsai runs through ggml's llama.cpp and Apple's MLX. On Android, Bonsai runs through ggml's llama.cpp and directly on the Qualcomm Hexagon NPU through QHexRT, our proprietary inference runtime. We built custom silicon kernels to make 1-bit inference on an NPU possible for the first time. Two years ago this needed a data center. Now it thinks in airplane mode. Now available in the RunAnywhere app on the App Store and Google Play.

RunAnywhere (YC W26)

16,564 次观看 • 1 个月前

AI agents are evolving and becoming more proactive. From cloud-based to on-device, these systems can run continuously, handle tasks, and keep sensitive data local. New Liquid Foundation Models bring agents directly to your laptop and phone, even while you are offline. Watch the latest episode of Advanced Insights to learn more about our partnership with Liquid AI:
1:20

AI agents are evolving and becoming more proactive. From cloud-based to on-device, these systems can run continuously, handle tasks, and keep sensitive data local. New Liquid Foundation Models bring agents directly to your laptop and phone, even while you are offline. Watch the latest episode of Advanced Insights to learn more about our partnership with Liquid AI:

AMD

30,054 次观看 • 4 个月前

🚀 Introducing Spaghetti Models For Free A powerful way to track possible tropical storm paths and compare forecast scenarios. With this update, you can now: - View the latest and historical model runs - Filter models to focus on the guidance you trust - See and download intensity graphs to track trends over time Stay ahead of the storm with clearer insights than ever before. Check out the latest model run for Tropical Storm Fernand here: Available now for free on: iOS: Android: Browser: And to Plus/Pro subscribers using our Windows/Mac/Linux App
0:29

🚀 Introducing Spaghetti Models For Free A powerful way to track possible tropical storm paths and compare forecast scenarios. With this update, you can now: - View the latest and historical model runs - Filter models to focus on the guidance you trust - See and download intensity graphs to track trends over time Stay ahead of the storm with clearer insights than ever before. Check out the latest model run for Tropical Storm Fernand here: Available now for free on: iOS: Android: Browser: And to Plus/Pro subscribers using our Windows/Mac/Linux App

WeatherWise.app

36,211 次观看 • 1 年前

QVAC SDK 0.11.0 is live. 🛠️ This release focuses entirely on unlocking next-generation local compute and advanced visual workflows. What’s new: Next-Gen Models: Core engine updated to the latest version of Fabric, unlocking full support for Qwen 3.5, Qwen 3.6, and Gemma 4. Multi-GPU Support: The SDK can now split workloads across multiple graphics cards on the same machine, allowing you to run significantly larger models completely locally. Multi-Image Conditioning: Blend multiple reference images together in a single generation for advanced style mixing and composition control. On-Device Upscaling: Boost your generated images to high-quality resolutions, running securely on your own hardware. More improvements are waiting under the hood. Check the change logs, update your SDK today, and start building with
1:11

QVAC SDK 0.11.0 is live. 🛠️ This release focuses entirely on unlocking next-generation local compute and advanced visual workflows. What’s new: Next-Gen Models: Core engine updated to the latest version of Fabric, unlocking full support for Qwen 3.5, Qwen 3.6, and Gemma 4. Multi-GPU Support: The SDK can now split workloads across multiple graphics cards on the same machine, allowing you to run significantly larger models completely locally. Multi-Image Conditioning: Blend multiple reference images together in a single generation for advanced style mixing and composition control. On-Device Upscaling: Boost your generated images to high-quality resolutions, running securely on your own hardware. More improvements are waiting under the hood. Check the change logs, update your SDK today, and start building with

QVAC

2,006,449 次观看 • 3 个月前

Everyone wrote Apple off as the AI loser, but one hardware spec might flip that story upside down (Save this). @jason called Apple a screaming buy on the back of a single chip detail. The rumored M7 Ultra, expected around 2028, is designed to support up to 1.5TB of unified memory, enough to run frontier class trillion parameter AI models locally, with no cloud required. The Street's bear case on Apple is straightforward. Apple has no frontier model of its own, Siri has stumbled for years and the company effectively rents OpenAI's models for its hardest queries. That narrative treats Apple as the one Magnificent Seven name that missed the AI wave entirely but the bull case flips that framing on its head. If frontier AI models keep shrinking and getting cheaper to run, Apple doesn't need the smartest model in the world, it just needs to own the device that model runs on. And unified memory is the mechanism that makes this possible. Unlike traditional systems where the CPU and GPU each need separate memory, Apple's architecture lets the CPU, GPU and Neural Engine draw from one shared pool. A fully specced M7 Ultra could theoretically run something on the scale of a 1.2 trillion parameter model locally and that capability plugs directly into the one advantage Apple has spent over a decade building: privacy. Apple has already shipped Private Cloud Compute, a system designed so even Apple can't access user data processed off device. Apple doubled down on this at WWDC 2026, framing on device privacy as non-negotiable while rivals default to the cloud. If the best AI models get small enough to run on Apple silicon, the moat stops being the model and becomes the hardware it has to sit on. Milk Road Pro remains bullish on Apple and it remains as one of our core positions, if you want the full thesis + our full AI trades, come join us using the link below for just a $1.
2:41

Everyone wrote Apple off as the AI loser, but one hardware spec might flip that story upside down (Save this). @jason called Apple a screaming buy on the back of a single chip detail. The rumored M7 Ultra, expected around 2028, is designed to support up to 1.5TB of unified memory, enough to run frontier class trillion parameter AI models locally, with no cloud required. The Street's bear case on Apple is straightforward. Apple has no frontier model of its own, Siri has stumbled for years and the company effectively rents OpenAI's models for its hardest queries. That narrative treats Apple as the one Magnificent Seven name that missed the AI wave entirely but the bull case flips that framing on its head. If frontier AI models keep shrinking and getting cheaper to run, Apple doesn't need the smartest model in the world, it just needs to own the device that model runs on. And unified memory is the mechanism that makes this possible. Unlike traditional systems where the CPU and GPU each need separate memory, Apple's architecture lets the CPU, GPU and Neural Engine draw from one shared pool. A fully specced M7 Ultra could theoretically run something on the scale of a 1.2 trillion parameter model locally and that capability plugs directly into the one advantage Apple has spent over a decade building: privacy. Apple has already shipped Private Cloud Compute, a system designed so even Apple can't access user data processed off device. Apple doubled down on this at WWDC 2026, framing on device privacy as non-negotiable while rivals default to the cloud. If the best AI models get small enough to run on Apple silicon, the moat stops being the model and becomes the hardware it has to sit on. Milk Road Pro remains bullish on Apple and it remains as one of our core positions, if you want the full thesis + our full AI trades, come join us using the link below for just a $1.

Milk Road AI

37,459 次观看 • 1 个月前

The wait is over! Meet Arduino VENTUNO Q, where AI takes action. 💬 Run local LLMs like Qwen 3, Gemma 4, and Qwen 3 VLM directly on the board 🧠 NPU + CPU + GPU +MCU: Qualcomm Dragonwing IQ-8275 with up to 40 dense TOPS of AI performance and STM32H5 microcontroller for real-time control 🗄️ 16 GB RAM + 64 GB eMMC + expandable storage 🪁 Linux-powered, pre-loaded with Ubuntu OS + Zephyr RTOS 🛠️ Build AI faster using Arduino App Lab, Hugging Face, Edge Impulse, and Qualcomm AI Hub 💨 Move seamlessly from prototype to production through Works with Arduino Certification Program The first batch won’t last. Pre-order your VENTUNO Q with a free power supply and USB-C cable included! Get ready to enter a new era of Physical AI:
2:10

The wait is over! Meet Arduino VENTUNO Q, where AI takes action. 💬 Run local LLMs like Qwen 3, Gemma 4, and Qwen 3 VLM directly on the board 🧠 NPU + CPU + GPU +MCU: Qualcomm Dragonwing IQ-8275 with up to 40 dense TOPS of AI performance and STM32H5 microcontroller for real-time control 🗄️ 16 GB RAM + 64 GB eMMC + expandable storage 🪁 Linux-powered, pre-loaded with Ubuntu OS + Zephyr RTOS 🛠️ Build AI faster using Arduino App Lab, Hugging Face, Edge Impulse, and Qualcomm AI Hub 💨 Move seamlessly from prototype to production through Works with Arduino Certification Program The first batch won’t last. Pre-order your VENTUNO Q with a free power supply and USB-C cable included! Get ready to enter a new era of Physical AI:

Arduino

2,194,990 次观看 • 4 天前

QVAC SDK 0.12.0 is now live, bringing longer context, increased memory optimisation, new modalities, and broader ecosystem support directly to your device. Key Features and Updates: - TurboQuant KV-Cache Quantization: Fit much longer context in the same memory. TurboQuant, an algorithm from Google Research, compresses the KV cache by up to 5x, near-lossless. - Text-to-Video: Generate video from a text prompt, fully local, with the new wan2.1 model in the Diffusion addon - Apple Metal Performance for Flux2-klein: Diffusion on Apple Silicon now matches MLX performance, the native benchmark for Apple GPUs - Robot Control (new VLA addon): A GGML-based Vision-Language-Action addon brings fast, efficient robot control to edge devices - Coding Assistant / Harness Support: QVAC now works with OpenCode and OpenClaw as a local provider. A new @qvac/ai-sdk-provider package automates model registry and provider integration - Cross-Platform Voice: Text-to-speech and Parakeet transcription moved from ONNX to the GGML engine for better CPU and GPU support on macOS, iOS, Windows, Linux, and Android. Parakeet also adds long-term streaming diarization (tracking who spoke when on live audio) - Faster Lightweight Visual Classification: A new GGML-based Classification addon delivers millisecond-level classification, useful where a vision-language model (VLM) would be unnecessarily slow - Under the Hood: Fabric synced to llama.cpp v8828 (from v8189), plus GPU acceleration added to image-upscale models for faster results Full release notes:
1:29

QVAC SDK 0.12.0 is now live, bringing longer context, increased memory optimisation, new modalities, and broader ecosystem support directly to your device. Key Features and Updates: - TurboQuant KV-Cache Quantization: Fit much longer context in the same memory. TurboQuant, an algorithm from Google Research, compresses the KV cache by up to 5x, near-lossless. - Text-to-Video: Generate video from a text prompt, fully local, with the new wan2.1 model in the Diffusion addon - Apple Metal Performance for Flux2-klein: Diffusion on Apple Silicon now matches MLX performance, the native benchmark for Apple GPUs - Robot Control (new VLA addon): A GGML-based Vision-Language-Action addon brings fast, efficient robot control to edge devices - Coding Assistant / Harness Support: QVAC now works with OpenCode and OpenClaw as a local provider. A new @qvac/ai-sdk-provider package automates model registry and provider integration - Cross-Platform Voice: Text-to-speech and Parakeet transcription moved from ONNX to the GGML engine for better CPU and GPU support on macOS, iOS, Windows, Linux, and Android. Parakeet also adds long-term streaming diarization (tracking who spoke when on live audio) - Faster Lightweight Visual Classification: A new GGML-based Classification addon delivers millisecond-level classification, useful where a vision-language model (VLM) would be unnecessarily slow - Under the Hood: Fabric synced to llama.cpp v8828 (from v8189), plus GPU acceleration added to image-upscale models for faster results Full release notes:

QVAC

9,932,369 次观看 • 2 个月前

QVAC SDK 0.13.0 is live, and this version brings a lot of exciting updates! Local AI now plugs into your coding agent, ships as a desktop app in one command, and runs even more models. Highlights: NEW INTEGRATIONS - OpenCode and coding agents: the new @qvac/ai-sdk-provider makes QVAC a local provider. Less setup, same-model requests queue cleanly, and managed mode starts and supervises qvac serve for you. - Broader OpenAI-compatible API, validated across supported flows so covered capabilities stay consistent and testable. - Turn your QVAC project into a real desktop app for Mac, Windows, or Linux with a single command. The new Electron plugin handles the packaging and keeps the app small by including only what it needs. NEW MODELS - New pi0.5 model support - run a vision-language "robot brain" on a single ordinary graphics card, at full accuracy. - Image-to-video, fully local, via the Wan2.1 model in the Diffusion addon. - New BCI add-on: brain-computer interface transcription, fully local. Decode recorded neural signals into text on-device via the Whisper.cpp-based BCI model. IMPROVEMENTS - Whisper GPU transcription on Android, auto-picking the best backend (OpenCL on Adreno 700+, Vulkan elsewhere), unified on one ggml engine. - Parakeet steadier on mobile, with real end-of-utterance detection for streaming. - Supertonic TTS now runs full GPU across Metal, Vulkan, and OpenCL, with native streaming.
1:39

QVAC SDK 0.13.0 is live, and this version brings a lot of exciting updates! Local AI now plugs into your coding agent, ships as a desktop app in one command, and runs even more models. Highlights: NEW INTEGRATIONS - OpenCode and coding agents: the new @qvac/ai-sdk-provider makes QVAC a local provider. Less setup, same-model requests queue cleanly, and managed mode starts and supervises qvac serve for you. - Broader OpenAI-compatible API, validated across supported flows so covered capabilities stay consistent and testable. - Turn your QVAC project into a real desktop app for Mac, Windows, or Linux with a single command. The new Electron plugin handles the packaging and keeps the app small by including only what it needs. NEW MODELS - New pi0.5 model support - run a vision-language "robot brain" on a single ordinary graphics card, at full accuracy. - Image-to-video, fully local, via the Wan2.1 model in the Diffusion addon. - New BCI add-on: brain-computer interface transcription, fully local. Decode recorded neural signals into text on-device via the Whisper.cpp-based BCI model. IMPROVEMENTS - Whisper GPU transcription on Android, auto-picking the best backend (OpenCL on Adreno 700+, Vulkan elsewhere), unified on one ggml engine. - Parakeet steadier on mobile, with real end-of-utterance detection for streaming. - Supertonic TTS now runs full GPU across Metal, Vulkan, and OpenCL, with native streaming.

QVAC

20,931,912 次观看 • 2 个月前

Presenting: $PALM AI Applications System Hardware 📹 Watch the Reveal Teaser from below ✅ The first Web3 related microcontroller-based device that combines offline voice recognition with in-built AI profiles, performing on electronic circuits straight from the breadboard it was incepted from. 1️⃣ The next steps are to document the use cases of our system, which can be integrated into existing devices and physical services in real life. We will be sure to document and publish processes as the device goes into factory production all the way to shipping them out and showcasing the real-world adoption of our products. 2️⃣ Our hardware is built for flexibility and to innovate on, and we will be working with the top experts in the field to make the best out of it and is built to allow the device structure to be embedded as the smart component of any and all devices. ⌛️Stay tuned for the first use-case reveal of our AI Applications System inside an AI-enhanced, by default offline hardware wallet, fully built from scratch by our talented team. 🙏 Finally, thank you for the continued support. We will keep working as hard as ever. Enjoy the reveal.
1:35

Presenting: $PALM AI Applications System Hardware 📹 Watch the Reveal Teaser from below ✅ The first Web3 related microcontroller-based device that combines offline voice recognition with in-built AI profiles, performing on electronic circuits straight from the breadboard it was incepted from. 1️⃣ The next steps are to document the use cases of our system, which can be integrated into existing devices and physical services in real life. We will be sure to document and publish processes as the device goes into factory production all the way to shipping them out and showcasing the real-world adoption of our products. 2️⃣ Our hardware is built for flexibility and to innovate on, and we will be working with the top experts in the field to make the best out of it and is built to allow the device structure to be embedded as the smart component of any and all devices. ⌛️Stay tuned for the first use-case reveal of our AI Applications System inside an AI-enhanced, by default offline hardware wallet, fully built from scratch by our talented team. 🙏 Finally, thank you for the continued support. We will keep working as hard as ever. Enjoy the reveal.

PaLM AI - $PALM

166,276 次观看 • 2 年前

Laguna S 2.1 is built to run locally. We heard the ask for a serious open model in the 80–120B range. Laguna S 2.1 is our answer, and we want it to redefine what this size class can do. Weights ship in BF16, FP8, INT4 and NVFP4, with official GGUF and MLX conversions, plus official DFlash draft models for faster inference. Day-one support across llama.cpp, ollama, Valerie Lee Make Up, SGLang, NVIDIA TRT-LLM, Hugging Face transformers and ZML. Watch it run on an NVIDIA AI DGX Spark.
0:39

Laguna S 2.1 is built to run locally. We heard the ask for a serious open model in the 80–120B range. Laguna S 2.1 is our answer, and we want it to redefine what this size class can do. Weights ship in BF16, FP8, INT4 and NVFP4, with official GGUF and MLX conversions, plus official DFlash draft models for faster inference. Day-one support across llama.cpp, ollama, Valerie Lee Make Up, SGLang, NVIDIA TRT-LLM, Hugging Face transformers and ZML. Watch it run on an NVIDIA AI DGX Spark.

Poolside

31,242 次观看 • 1 个月前