Loading video...

Video Failed to Load

Go Home

Sam Altman recently said: “GPT-OSS has strong real-world performance comparable to o4-mini—and you can run it locally on your phone.” Many believed running a 20B-parameter model on mobile devices was still years away. At Nexa AI, we’ve built our foundation on deep on-device AI technology—turning that vision into reality....

nexa_ai's profile picture

NEXA AI

2,323 subscribers

197,453 views • 10 months ago •via X (Twitter)

Health & WellnessScience & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

A voice agent powered by gpt-oss. Running locally on my macBook. Demo recorded in a Waymo with WiFi turned off. I'm still on my space game voice AI kick, obviously. Code link below. For conversational voice AI, you want to set the gpt-oss reasoning behavior to "low". (The default is "medium".) Notes on how to do that and a jinja template you can use are in the repo. The LLM in the demo video is the big, 120B version of gpt-oss. You can use the smaller, 20B model for this, of course. But OpenAI really did a cool thing here designing the 120B model to run in "just" 80GB of VRAM. And the llama.cpp mlx inference is fast: ~250ms TTFT. Running a big model on-device feels like a time warp into the future of AI.
4:35

A voice agent powered by gpt-oss. Running locally on my macBook. Demo recorded in a Waymo with WiFi turned off. I'm still on my space game voice AI kick, obviously. Code link below. For conversational voice AI, you want to set the gpt-oss reasoning behavior to "low". (The default is "medium".) Notes on how to do that and a jinja template you can use are in the repo. The LLM in the demo video is the big, 120B version of gpt-oss. You can use the smaller, 20B model for this, of course. But OpenAI really did a cool thing here designing the 120B model to run in "just" 80GB of VRAM. And the llama.cpp mlx inference is fast: ~250ms TTFT. Running a big model on-device feels like a time warp into the future of AI.

kwindla

202,147 views • 1 year ago

A big milestone for AI on Windows: gpt‑oss‑20b is now available in Windows AI Foundry and Azure AI Foundry! You can now run this open-source, frontier-class model locally on a high-performance Windows PC. It’s fast, capable, and built for real-world use. Brought to life through collaboration across Windows, Azure, and OpenAI teams. We can’t wait to see what you create. 🚀
0:35

A big milestone for AI on Windows: gpt‑oss‑20b is now available in Windows AI Foundry and Azure AI Foundry! You can now run this open-source, frontier-class model locally on a high-performance Windows PC. It’s fast, capable, and built for real-world use. Brought to life through collaboration across Windows, Azure, and OpenAI teams. We can’t wait to see what you create. 🚀

Pavan Davuluri

80,597 views • 1 year ago

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.
0:39

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.

Databricks

10,132 views • 1 year ago

The next generation of mobile apps will run multimodal AI locally by default. Today, we’re making it practical for developers to ship. We just launched NexaSDK for Mobile on Product Hunt. Developers can run the latest multimodal AI models fully on-device in iOS & Android apps with Apple Neural Engine and Qualcomm Hexagon NPU acceleration. In just 3 lines of code, build chat, multimodal, search, and audio features with no cloud cost, complete privacy, 2x faster speed and 9× better energy efficiency. Try out NexaSDK for Mobile and we’d love your feedback (Product Hunt link in thread).
1:21

The next generation of mobile apps will run multimodal AI locally by default. Today, we’re making it practical for developers to ship. We just launched NexaSDK for Mobile on Product Hunt. Developers can run the latest multimodal AI models fully on-device in iOS & Android apps with Apple Neural Engine and Qualcomm Hexagon NPU acceleration. In just 3 lines of code, build chat, multimodal, search, and audio features with no cloud cost, complete privacy, 2x faster speed and 9× better energy efficiency. Try out NexaSDK for Mobile and we’d love your feedback (Product Hunt link in thread).

NEXA AI

319,337 views • 8 months ago

✨ Personal AI is the next computing platform. AI is shifting from something you access to something you build with, locally, at the edge, and across systems. We’re unlocking new possibilities for developers: • AMD Ryzen AI Halo, a local-first developer system, preorder starting in June, develop AI without limits on your desk • Gorgon Halo with up to 192GB unified memory, supporting 300B+ parameter models locally, run massive models locally We’re excited to partner with clem 🤗🤗, Co-founder and CEO of Hugging Face, to advance open-source AI for Ryzen AI. Our focus is seamless AI, from model to deployment. Cloud, edge, device. One continuum. Multi-agent systems, local inference at scale, open models as infrastructure. This is the next computing era 🚀
4:49

✨ Personal AI is the next computing platform. AI is shifting from something you access to something you build with, locally, at the edge, and across systems. We’re unlocking new possibilities for developers: • AMD Ryzen AI Halo, a local-first developer system, preorder starting in June, develop AI without limits on your desk • Gorgon Halo with up to 192GB unified memory, supporting 300B+ parameter models locally, run massive models locally We’re excited to partner with clem 🤗🤗, Co-founder and CEO of Hugging Face, to advance open-source AI for Ryzen AI. Our focus is seamless AI, from model to deployment. Cloud, edge, device. One continuum. Multi-agent systems, local inference at scale, open models as infrastructure. This is the next computing era 🚀

Jack Huynh

47,822 views • 2 months ago

GT Protocol AI Digest No.82: AI Starts Running the System Here are five stories worth your attention 👇 💻 NVIDIA Pushes AI to Your Device NVIDIA showcased RTX PCs and DGX systems that can run AI models and agents locally. The shift is important. AI is no longer tied to the cloud, it is moving directly onto user devices. 🧠 Gemini Becomes Personal Google is rolling out personalized Gemini across the US. The assistant adapts to your context and activity, turning AI from a generic tool into a persistent, tailored system. 🎨 Adobe Lets You Train Your Own AI Adobe now allows users to train Firefly models on their own artwork. This gives creators more control over style, but also raises new questions around ownership and dataset boundaries. ⚡️ Smaller GPT-5.4 Models Go Wide OpenAI introduced GPT-5.4 mini and nano, optimized for efficiency and broader deployment. Strong models are no longer limited to heavy infrastructure. 💳 Visa Prepares for AI Payments Visa is building systems for transactions initiated by AI agents. This moves AI beyond interfaces and into real economic activity. Read the full digest on our Medium 👉
0:44

GT Protocol AI Digest No.82: AI Starts Running the System Here are five stories worth your attention 👇 💻 NVIDIA Pushes AI to Your Device NVIDIA showcased RTX PCs and DGX systems that can run AI models and agents locally. The shift is important. AI is no longer tied to the cloud, it is moving directly onto user devices. 🧠 Gemini Becomes Personal Google is rolling out personalized Gemini across the US. The assistant adapts to your context and activity, turning AI from a generic tool into a persistent, tailored system. 🎨 Adobe Lets You Train Your Own AI Adobe now allows users to train Firefly models on their own artwork. This gives creators more control over style, but also raises new questions around ownership and dataset boundaries. ⚡️ Smaller GPT-5.4 Models Go Wide OpenAI introduced GPT-5.4 mini and nano, optimized for efficiency and broader deployment. Strong models are no longer limited to heavy infrastructure. 💳 Visa Prepares for AI Payments Visa is building systems for transactions initiated by AI agents. This moves AI beyond interfaces and into real economic activity. Read the full digest on our Medium 👉

GT Protocol

40,085 views • 4 months ago

🚨$OSS is not an AI company. → It is the hardware that lets AI exist where the cloud cannot. Most investors don’t understand $OSS because they think AI = software. $OSS builds the physical “brains” that run AI in extreme environments where cloud computing fails. Jets. Ships. Tanks. Drones. Space. Hospitals. That’s the game. 1) What $OSS actually is $OSS (One Stop Systems) designs rugged high-performance computers and storage systems for AI at the edge. Meaning: They bring data-center-level computing power into harsh environments. Their products include rugged servers, GPU accelerators, storage arrays, and expansion systems used for AI, sensor processing, and autonomous systems. In simple terms: Cloud AI = brain in a safe building. $OSS AI = brain inside machines operating in chaos. 2) Why this is crucial Most AI today runs in data centers. But the future of AI is not in the cloud. It’s on: • autonomous vehicles • military systems • drones • ships • industrial machines • medical devices These systems cannot wait for the cloud. Latency, connectivity, security, and survival demand local AI. $OSS delivers “data-center performance at the edge” across land, sea, and air. Without companies like OSS, autonomous systems simply don’t work. 3) What OSS actually does: Think of OSS as building AI engines that survive reality. 🌊 SEA example: naval surveillance aircraft and ships. $OSS supplies rugged storage and compute systems for U.S. Navy reconnaissance aircraft to collect and process massive sensor data in real time. Translation: Instead of sending raw data back to base, the aircraft analyzes threats instantly onboard. $OSS = the onboard AI brain. 🪖 LAND example: military vehicles and tactical operations. $OSS delivers high-performance servers and FPGA systems for mobile military intelligence platforms used by the U.S. Department of Defense. Translation: Tanks and vehicles detect threats, process sensor data, and make decisions locally. $OSS = the battlefield computer. ✈️ AIR example: airborne AI. $OSS builds GPU-accelerated servers designed for aircraft, described as a “datacenter in the sky.” Translation: Jets and drones run AI models mid-flight. $OSS = flying supercomputers. 🚀 SPACE example: $OSS hardware is designed for extreme environments and autonomous systems across aerospace and defense. Translation: Future satellites, space drones, and autonomous spacecraft need onboard AI. $OSS = the computing core of autonomous space systems. BONUS: CIVILIAN & COMMERCIAL $OSS systems are used in: • autonomous trucking and farming • industrial automation • healthcare imaging • energy and mining • telecom and 5G Example:A medical imaging company uses $OSS hardware to run real-time AI diagnostics in next-gen breast cancer scanners. $OSS = AI where milliseconds matter. 4) Who their customers are (pattern, not names) $OSS sells to: • defense primes • government programs • industrial OEMs • AI infrastructure companies • medical device manufacturers These customers share one trait: They cannot rely on the cloud. That’s why $OSS exists. 5) The mental model that makes $OSS obvious $NVDA = AI chips $PLTR = AI software $OSS = AI hardware in the real world If AI is electricity, $OSS builds the generators that work in storms. Most investors understand AI software. Few understand AI infrastructure at the edge. That gap is the opportunity. 6) The real thesis The world is moving toward: • autonomous warfare • autonomous vehicles • real-time AI systems • distributed intelligence All of that requires rugged edge computing. $OSS is positioned exactly there. Infrastructure. The hardest layer to build. And often the most valuable.
0:51

🚨$OSS is not an AI company. → It is the hardware that lets AI exist where the cloud cannot. Most investors don’t understand $OSS because they think AI = software. $OSS builds the physical “brains” that run AI in extreme environments where cloud computing fails. Jets. Ships. Tanks. Drones. Space. Hospitals. That’s the game. 1) What $OSS actually is $OSS (One Stop Systems) designs rugged high-performance computers and storage systems for AI at the edge. Meaning: They bring data-center-level computing power into harsh environments. Their products include rugged servers, GPU accelerators, storage arrays, and expansion systems used for AI, sensor processing, and autonomous systems. In simple terms: Cloud AI = brain in a safe building. $OSS AI = brain inside machines operating in chaos. 2) Why this is crucial Most AI today runs in data centers. But the future of AI is not in the cloud. It’s on: • autonomous vehicles • military systems • drones • ships • industrial machines • medical devices These systems cannot wait for the cloud. Latency, connectivity, security, and survival demand local AI. $OSS delivers “data-center performance at the edge” across land, sea, and air. Without companies like OSS, autonomous systems simply don’t work. 3) What OSS actually does: Think of OSS as building AI engines that survive reality. 🌊 SEA example: naval surveillance aircraft and ships. $OSS supplies rugged storage and compute systems for U.S. Navy reconnaissance aircraft to collect and process massive sensor data in real time. Translation: Instead of sending raw data back to base, the aircraft analyzes threats instantly onboard. $OSS = the onboard AI brain. 🪖 LAND example: military vehicles and tactical operations. $OSS delivers high-performance servers and FPGA systems for mobile military intelligence platforms used by the U.S. Department of Defense. Translation: Tanks and vehicles detect threats, process sensor data, and make decisions locally. $OSS = the battlefield computer. ✈️ AIR example: airborne AI. $OSS builds GPU-accelerated servers designed for aircraft, described as a “datacenter in the sky.” Translation: Jets and drones run AI models mid-flight. $OSS = flying supercomputers. 🚀 SPACE example: $OSS hardware is designed for extreme environments and autonomous systems across aerospace and defense. Translation: Future satellites, space drones, and autonomous spacecraft need onboard AI. $OSS = the computing core of autonomous space systems. BONUS: CIVILIAN & COMMERCIAL $OSS systems are used in: • autonomous trucking and farming • industrial automation • healthcare imaging • energy and mining • telecom and 5G Example:A medical imaging company uses $OSS hardware to run real-time AI diagnostics in next-gen breast cancer scanners. $OSS = AI where milliseconds matter. 4) Who their customers are (pattern, not names) $OSS sells to: • defense primes • government programs • industrial OEMs • AI infrastructure companies • medical device manufacturers These customers share one trait: They cannot rely on the cloud. That’s why $OSS exists. 5) The mental model that makes $OSS obvious $NVDA = AI chips $PLTR = AI software $OSS = AI hardware in the real world If AI is electricity, $OSS builds the generators that work in storms. Most investors understand AI software. Few understand AI infrastructure at the edge. That gap is the opportunity. 6) The real thesis The world is moving toward: • autonomous warfare • autonomous vehicles • real-time AI systems • distributed intelligence All of that requires rugged edge computing. $OSS is positioned exactly there. Infrastructure. The hardest layer to build. And often the most valuable.

Black Panther Capital

30,138 views • 6 months ago

this is huge news from Cursor, they've pulled of the impossible and turned their ai-wrapper into a in-destructible moat sam altman literally called it cursor's ai agent harness is available for anyone to build on, which means ai models are now a commodity > 1-time install and now anyone can run cursor's agent locally or via cloud. use any model (e.g. gpt 5.5) but with the added cursor harness that makes it 10X better. > its so good that 3 of cursors biggest competitors are embedding it into their products. > now cursor DOESN'T DEPEND on anthropic or openai. their own model (composer 2) competes directly! yesterday sam altman said the ai model and harness are one and the same and today cursor turned their harness into a self-owned moat fucking masterclass (coming from a former cursor / ai wrapper hater)
0:35

this is huge news from Cursor, they've pulled of the impossible and turned their ai-wrapper into a in-destructible moat sam altman literally called it cursor's ai agent harness is available for anyone to build on, which means ai models are now a commodity > 1-time install and now anyone can run cursor's agent locally or via cloud. use any model (e.g. gpt 5.5) but with the added cursor harness that makes it 10X better. > its so good that 3 of cursors biggest competitors are embedding it into their products. > now cursor DOESN'T DEPEND on anthropic or openai. their own model (composer 2) competes directly! yesterday sam altman said the ai model and harness are one and the same and today cursor turned their harness into a self-owned moat fucking masterclass (coming from a former cursor / ai wrapper hater)

Ejaaz

950,320 views • 3 months ago

QVAC SDK 0.10.0 is now live, bringing advanced local compute capabilities and specialized hardware optimization directly to your device Key Features and Updates: - Image-to-Image Diffusion: Transform and edit images using simple prompts with 100% local compute—no cloud uploads or external servers required - Dynamic Tooling & KV Cache Management:Your local LLM now receives a tailored toolbox for every interaction, with automatic KV cache clearing to maintain high-speed inference - Doctor CLI: A new diagnostic tool that analyzes your hardware and memory, providing specific instructions on how to optimize your GPU for local AI - Suspend & Resume API: Specifically designed for mobile environments, this allows apps to pause P2P swarms and RAG workspaces to meet background rules without losing model state - GPT-OSS Compatibility: Added support for the latest GPT-OSS models loaded externally, expanding the range of open-source intelligence available on the platform Build the future of private, unstoppable AI:
1:11

QVAC SDK 0.10.0 is now live, bringing advanced local compute capabilities and specialized hardware optimization directly to your device Key Features and Updates: - Image-to-Image Diffusion: Transform and edit images using simple prompts with 100% local compute—no cloud uploads or external servers required - Dynamic Tooling & KV Cache Management:Your local LLM now receives a tailored toolbox for every interaction, with automatic KV cache clearing to maintain high-speed inference - Doctor CLI: A new diagnostic tool that analyzes your hardware and memory, providing specific instructions on how to optimize your GPU for local AI - Suspend & Resume API: Specifically designed for mobile environments, this allows apps to pause P2P swarms and RAG workspaces to meet background rules without losing model state - GPT-OSS Compatibility: Added support for the latest GPT-OSS models loaded externally, expanding the range of open-source intelligence available on the platform Build the future of private, unstoppable AI:

QVAC

34,508 views • 3 months ago

🔗 Announcing LangChain OSS Skills LangChain has the most popular frameworks for building AI agents — and now your coding agent can be an expert in it. We're excited to release the first iteration of LangChain OSS Skills, giving your agent expertise in our open source frameworks. The skills include guidance on how to use langchain, langgraph, and deepagents to effectively build agents. ➡️ Install our OSS skills for your coding agent here: ➡️ Read more:
0:43

🔗 Announcing LangChain OSS Skills LangChain has the most popular frameworks for building AI agents — and now your coding agent can be an expert in it. We're excited to release the first iteration of LangChain OSS Skills, giving your agent expertise in our open source frameworks. The skills include guidance on how to use langchain, langgraph, and deepagents to effectively build agents. ➡️ Install our OSS skills for your coding agent here: ➡️ Read more:

LangChain OSS

65,840 views • 5 months ago

Ready to build the future of stable private on-device AI? 🧠 Our latest tutorial shows you how to build a sovereign mobile app in minutes using the QVAC SDK and Expo. Start from a blank template and deploy in minutes a local Llama 3.2 inference running directly on your own devices. What you’ll learn: Modular Setup: Use the QVAC CLI to tree-shake and keep your mobile bundle lean. Local-First Flow: Initialize the SDK, download weights, and run high-speed inference without a cloud uplink. Cross-Platform Power: See the smoke test in action on a physical Samsung S25. No rented clouds. No API keys. Build local, on-device, unstoppable intelligence in your pocket. Watch the full guide and start building:
5:37

Ready to build the future of stable private on-device AI? 🧠 Our latest tutorial shows you how to build a sovereign mobile app in minutes using the QVAC SDK and Expo. Start from a blank template and deploy in minutes a local Llama 3.2 inference running directly on your own devices. What you’ll learn: Modular Setup: Use the QVAC CLI to tree-shake and keep your mobile bundle lean. Local-First Flow: Initialize the SDK, download weights, and run high-speed inference without a cloud uplink. Cross-Platform Power: See the smoke test in action on a physical Samsung S25. No rented clouds. No API keys. Build local, on-device, unstoppable intelligence in your pocket. Watch the full guide and start building:

QVAC

4,081,211 views • 4 months ago

Windows ML is now generally available! This milestone brings powerful, local AI capability to every Windows 11 device, harnessing the full power of the GPU, NPU, and CPU. Big thank you to the team and our silicon partners, AMD, Intel, NVIDIA, and Qualcomm, for their collaboration to unlock real-time, secure, and efficient AI experiences for developers on Windows. Let’s go 🚀!
1:16

Windows ML is now generally available! This milestone brings powerful, local AI capability to every Windows 11 device, harnessing the full power of the GPU, NPU, and CPU. Big thank you to the team and our silicon partners, AMD, Intel, NVIDIA, and Qualcomm, for their collaboration to unlock real-time, secure, and efficient AI experiences for developers on Windows. Let’s go 🚀!

Pavan Davuluri

11,663 views • 10 months ago

For the first time, the latest LLMs run on the Apple Neural Engine — and NexaSDK is the only framework that makes it possible, powered by the NexaML engine. Last year, our two co-founders were invited by Apple DMLI team (Data & Machine Learning Innovation) to share their research about on-device multimodal model for local AI agents. One of the big questions in the room was: “Can the newest LLMs actually run on ANE?” At the time, nobody had a clear path. Today, that path exists. NexaSDK now runs Granite-4.0 (IBM), Qwen3 (Qwen), Gemma3 (Google), and Parakeet-v3 (NVIDIA) fully on Apple’s NPU — unlocking low-power, always-on, fast inference across Mac and iPhone. A new wave of NPU-first local AI apps is coming to Apple devices. Start with one line of code on Mac. iOS SDK coming soon.
1:42

For the first time, the latest LLMs run on the Apple Neural Engine — and NexaSDK is the only framework that makes it possible, powered by the NexaML engine. Last year, our two co-founders were invited by Apple DMLI team (Data & Machine Learning Innovation) to share their research about on-device multimodal model for local AI agents. One of the big questions in the room was: “Can the newest LLMs actually run on ANE?” At the time, nobody had a clear path. Today, that path exists. NexaSDK now runs Granite-4.0 (IBM), Qwen3 (Qwen), Gemma3 (Google), and Parakeet-v3 (NVIDIA) fully on Apple’s NPU — unlocking low-power, always-on, fast inference across Mac and iPhone. A new wave of NPU-first local AI apps is coming to Apple devices. Start with one line of code on Mac. iOS SDK coming soon.

NEXA AI

30,213 views • 9 months ago

Introducing Workshop: cloud + on-device agentic AI. And to celebrate, we're giving away $250k in Google Gemini AI credits. (details below). The future of AI work is neither cloud-based nor local. It's both. In Workshop Cloud, you can use agents powered by frontier models like Claude and/or open source models like Z.ai's GLM-5 to build internal tools, dashboards, and AI web apps. Or, breeze through tasks like managing your Google and Meta Ads. In Workshop Desktop, you can do all the same right on your computer, plus make desktop apps, mobile apps, and 3D creations. Our favorite part? You can power the full agent experience with local models like Qwen 3.5 family on your computer. Fully offline. 2026 is the year in which local models for agentic tasks will become viable for mainstream use. But the setup for tools like OpenClaw is like setting up Linux from scratch on your computer. Workshop Desktop is one-click to install on Windows, Mac, and Linux. It recommends which open source model you should use for your hardware and lets you download and run it right in the app. And its agent harness allows you to chat, create websites, build personal utilities, and analyze data. 100% offline. Or multitask with AI models in the cloud while running other agent threads locally. Start in Workshop Cloud when you want flexibility and speed. Download your project and continue in Workshop Desktop when you want local files, privacy, and/or better performance on large code bases. Publish from either. The agent tooling space is maturing and discerning users have come to expect a lot from their tools. We've packed Workshop with features to help you 10x your productivity. - Native support for skills - Autocompaction for seamless context management - Built-in AI for your apps - Dozens of connectors, like Google Drive, Big Query, and Supabase - dbt integration to ground your dashboards in your semantic layer - Native Github integration - Private app deployment - ... and more (+ we're shipping super fast) To access the free credit offer, RT this post and reply with "Workshop". Make sure you are following us so we can DM you the instructions to redeem. - First 100 to RT + comment get $500 in credits. - Everyone else gets up to $250 And thanks to our partners Modal, Google Gemini, and Z.ai!
3:50

Introducing Workshop: cloud + on-device agentic AI. And to celebrate, we're giving away $250k in Google Gemini AI credits. (details below). The future of AI work is neither cloud-based nor local. It's both. In Workshop Cloud, you can use agents powered by frontier models like Claude and/or open source models like Z.ai's GLM-5 to build internal tools, dashboards, and AI web apps. Or, breeze through tasks like managing your Google and Meta Ads. In Workshop Desktop, you can do all the same right on your computer, plus make desktop apps, mobile apps, and 3D creations. Our favorite part? You can power the full agent experience with local models like Qwen 3.5 family on your computer. Fully offline. 2026 is the year in which local models for agentic tasks will become viable for mainstream use. But the setup for tools like OpenClaw is like setting up Linux from scratch on your computer. Workshop Desktop is one-click to install on Windows, Mac, and Linux. It recommends which open source model you should use for your hardware and lets you download and run it right in the app. And its agent harness allows you to chat, create websites, build personal utilities, and analyze data. 100% offline. Or multitask with AI models in the cloud while running other agent threads locally. Start in Workshop Cloud when you want flexibility and speed. Download your project and continue in Workshop Desktop when you want local files, privacy, and/or better performance on large code bases. Publish from either. The agent tooling space is maturing and discerning users have come to expect a lot from their tools. We've packed Workshop with features to help you 10x your productivity. - Native support for skills - Autocompaction for seamless context management - Built-in AI for your apps - Dozens of connectors, like Google Drive, Big Query, and Supabase - dbt integration to ground your dashboards in your semantic layer - Native Github integration - Private app deployment - ... and more (+ we're shipping super fast) To access the free credit offer, RT this post and reply with "Workshop". Make sure you are following us so we can DM you the instructions to redeem. - First 100 to RT + comment get $500 in credits. - Everyone else gets up to $250 And thanks to our partners Modal, Google Gemini, and Z.ai!

Workshop AI

28,745 views • 4 months ago

Still buzzing from our live #COMPUTEX demos! Watching Chang Liu speak Mandarin while an AMD AI PC translated her words into English — live, on-device, with zero cloud assistance — was a true milestone. This demo proved real-time, voice-to-voice translation can run privately and with low latency on a single Ryzen AI system. Huge thanks to Nick Ni for orchestrating this seamless demo, Chang for her perfect delivery, and the entire AMD AI Group for turning months of hard work into that unforgettable moment. Why it matters: • Latency so low it feels natural — conversations flow smoothly • Data stays on-device — privacy uncompromised This is what next-gen Ryzen AI processors unlock — and it’s only the beginning. We’re committed to improving accuracy and reducing latency as we push the boundaries of what’s possible.
1:12

Still buzzing from our live #COMPUTEX demos! Watching Chang Liu speak Mandarin while an AMD AI PC translated her words into English — live, on-device, with zero cloud assistance — was a true milestone. This demo proved real-time, voice-to-voice translation can run privately and with low latency on a single Ryzen AI system. Huge thanks to Nick Ni for orchestrating this seamless demo, Chang for her perfect delivery, and the entire AMD AI Group for turning months of hard work into that unforgettable moment. Why it matters: • Latency so low it feels natural — conversations flow smoothly • Data stays on-device — privacy uncompromised This is what next-gen Ryzen AI processors unlock — and it’s only the beginning. We’re committed to improving accuracy and reducing latency as we push the boundaries of what’s possible.

Jack Huynh

14,634 views • 1 year ago

AMD on local AI: "this is the smallest AI development system in the world, capable of running models up to 200 billion parameters locally, not connected to anything" 128GB of unified memory shared by CPU, GPU, and NPU fits in your hand. Runs a model larger than GPT-3 with no internet $3,999 once. roughly $16 a month in power Cloud equivalent: up to $750 a month The question was never whether local AI could compete on power It was whether it could compete on price. Now it does
1:00

AMD on local AI: "this is the smallest AI development system in the world, capable of running models up to 200 billion parameters locally, not connected to anything" 128GB of unified memory shared by CPU, GPU, and NPU fits in your hand. Runs a model larger than GPT-3 with no internet $3,999 once. roughly $16 a month in power Cloud equivalent: up to $750 a month The question was never whether local AI could compete on power It was whether it could compete on price. Now it does

plutos

152,392 views • 2 months ago

Introducing NexaSDK for Android (Beta) — run the latest AI models locally, 9× more energy-efficient and 2× faster, on Android devices, powered by the Qualcomm Hexagon NPU. This is the first SDK to support NPU, GPU and CPU, unlocking the full power of every Android device — for example, LFM2-1.2B achieves 85 t/s on NPU vs 37 t/s on CPU. With just 3 lines of code, you can run the latest state-of-the-art models across every task, for example: Multimodal (Vision, Audio, Text): OmniNeural-4B Embedding: EmbeddingGemma from Google ASR: Parakeet-v3 from NVIDIA OCR: PaddleOCR from Baidu Inc. Rerank: Jina-reranker from Jina AI LLM: LFM2-1.2B from And we continue to deliver Day-0 model support across our framework. Build on-device AI into your Android app today and enjoy no cloud API cost, full privacy, and offline availability. Check out our Quickstart guide and example app below to get started in minutes.
0:54

Introducing NexaSDK for Android (Beta) — run the latest AI models locally, 9× more energy-efficient and 2× faster, on Android devices, powered by the Qualcomm Hexagon NPU. This is the first SDK to support NPU, GPU and CPU, unlocking the full power of every Android device — for example, LFM2-1.2B achieves 85 t/s on NPU vs 37 t/s on CPU. With just 3 lines of code, you can run the latest state-of-the-art models across every task, for example: Multimodal (Vision, Audio, Text): OmniNeural-4B Embedding: EmbeddingGemma from Google ASR: Parakeet-v3 from NVIDIA OCR: PaddleOCR from Baidu Inc. Rerank: Jina-reranker from Jina AI LLM: LFM2-1.2B from And we continue to deliver Day-0 model support across our framework. Build on-device AI into your Android app today and enjoy no cloud API cost, full privacy, and offline availability. Check out our Quickstart guide and example app below to get started in minutes.

NEXA AI

26,091 views • 9 months ago

You can run local AI models up to 120B without a $10,000 Mac Studio This phone-sized device is your own server for open-source models. 100% local and private. And you can use it to: - Power an agent like OpenClaw 24/7 - Completely replace a chatbot - Literally anything that requires an API It’s called Tiiny, and, once again, you can run the latest open-source models on it. Link below
16:10

You can run local AI models up to 120B without a $10,000 Mac Studio This phone-sized device is your own server for open-source models. 100% local and private. And you can use it to: - Power an agent like OpenClaw 24/7 - Completely replace a chatbot - Literally anything that requires an API It’s called Tiiny, and, once again, you can run the latest open-source models on it. Link below

Paul Couvert

41,245 views • 5 months ago

Today, we’re launching Gemma 4, our most intelligent open models to date. Built with the same breakthrough technology as Gemini 3, Gemma 4 brings advanced reasoning to your personal hardware and devices. Here’s what Gemma 4 unlocks for developers: — Intelligence-per-parameter: Our 31B (Dense) and 26B (MoE) models deliver state-of-the-art performance for their size, outcompeting models 20x their size on Arena.ai — Commercial flexibility: Released under a permissive Apache 2.0 license for complete developer flexibility and digital sovereignty — Agentic workflows: Native support for function-calling and structured JSON output allows you to build reliable, autonomous agents — Multimodal edge AI: The E2B and E4B models bring native vision, audio, and low latency to mobile and IoT devices — Long-context reasoning: Up to 256K context windows allow you to process entire repositories or large documents in a single prompt Whether you're building global applications in 140+ languages or local-first AI code assistants, Gemma 4 is built to be your foundation. Explore in Google AI Studio or download the weights on Hugging Face, Kaggle, and ollama.
2:51

Today, we’re launching Gemma 4, our most intelligent open models to date. Built with the same breakthrough technology as Gemini 3, Gemma 4 brings advanced reasoning to your personal hardware and devices. Here’s what Gemma 4 unlocks for developers: — Intelligence-per-parameter: Our 31B (Dense) and 26B (MoE) models deliver state-of-the-art performance for their size, outcompeting models 20x their size on Arena.ai — Commercial flexibility: Released under a permissive Apache 2.0 license for complete developer flexibility and digital sovereignty — Agentic workflows: Native support for function-calling and structured JSON output allows you to build reliable, autonomous agents — Multimodal edge AI: The E2B and E4B models bring native vision, audio, and low latency to mobile and IoT devices — Long-context reasoning: Up to 256K context windows allow you to process entire repositories or large documents in a single prompt Whether you're building global applications in 140+ languages or local-first AI code assistants, Gemma 4 is built to be your foundation. Explore in Google AI Studio or download the weights on Hugging Face, Kaggle, and ollama.

Google AI

1,670,114 views • 4 months ago