Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

🐆 Rapid-MLX v0.12 is here. We’ve officially evolved from a simple chat app into a full-fledged, on-device AI studio for Apple Silicon! 🖥️✨ We didn't just push the MLX inference engine to its limits and expand support for a massive lineup of local open-source models—we are alpha-launching the highly...

Raullen's profile picture

raullen

63,127 subscribers

34,148 Aufrufe • vor 1 Monat •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

🔴 The Pain: Running local MLX models is incredibly fast and private. But let's be real - testing tool calling via terminal is clunky, and there's zero good UI for it. 🟢 The Fix: rapid-mlx share Just ONE command gives you a polished web chat + seamless tool calling (works beautifully with gemma-4-12b-qat). We are proud to be the ONLY MLX inference engine in the community shipping this. ⚡️ 👇 Try it now: brew install raullenchai/rapid-mlx/rapid-mlx
0:40

🔴 The Pain: Running local MLX models is incredibly fast and private. But let's be real - testing tool calling via terminal is clunky, and there's zero good UI for it. 🟢 The Fix: rapid-mlx share Just ONE command gives you a polished web chat + seamless tool calling (works beautifully with gemma-4-12b-qat). We are proud to be the ONLY MLX inference engine in the community shipping this. ⚡️ 👇 Try it now: brew install raullenchai/rapid-mlx/rapid-mlx

raullen

22,768 Aufrufe • vor 3 Monaten

Thrilled to unveil what we've been cooking the last few weeks: the Gravity AI assistant. Local, free, owned by you. Now available for free on macOS -> GravityAI 🌠 Gravity ensures absolute privacy by keeping all conversations on your device. No compromises, your data is exclusively yours. Plus, with LLaVa and OCR, Gravity gains vision – just snap a screenshot, and it's ready to chat about anything on your screen. Everything has been built to optimize the power of Apple silicon: I used Mistral AI as a base LLM and a in-app instance of ollama. It is insanely fast. Gravity will continue to evolve from here. For example, we're working on speech recognition and speaker diarization to passively learn from your meetings and messages in the background, no integrations needed. Incredibly proud of our journey so far and a big shoutout to my co-founder Tye Daniel for grinding to make this happen (we were up till 4am making sure this ships today) We're hiring folks with talent and passion, and we welcome you to join us on this exciting journey!
0:40

Thrilled to unveil what we've been cooking the last few weeks: the Gravity AI assistant. Local, free, owned by you. Now available for free on macOS -> GravityAI 🌠 Gravity ensures absolute privacy by keeping all conversations on your device. No compromises, your data is exclusively yours. Plus, with LLaVa and OCR, Gravity gains vision – just snap a screenshot, and it's ready to chat about anything on your screen. Everything has been built to optimize the power of Apple silicon: I used Mistral AI as a base LLM and a in-app instance of ollama. It is insanely fast. Gravity will continue to evolve from here. For example, we're working on speech recognition and speaker diarization to passively learn from your meetings and messages in the background, no integrations needed. Incredibly proud of our journey so far and a big shoutout to my co-founder Tye Daniel for grinding to make this happen (we were up till 4am making sure this ships today) We're hiring folks with talent and passion, and we welcome you to join us on this exciting journey!

Sulaiman Khan Ghori

71,430 Aufrufe • vor 2 Jahren

Introducing Magnitude: your actually local agent 100% private and offline. No token costs, no API keys. Open source. Today's agents are local. The model isn't. Every prompt, every file, every secret gets sent straight to Anthropic and OpenAI. Magnitude is built around local models and runs the whole stack itself. The inference engine is part of the agent, so the models run inside it, right on your computer. It lives in your terminal, and setup is one command. Magnitude profiles your hardware and shows you which models fit, with the trade-offs between quality, speed, and memory. Pick one and start working. No painful config or server to babysit. Out of the box, it can use your shell, edit files, and run scripts. Add skills and it can work with Excel, PowerPoint, PDFs or Chrome. Use it for everyday work: - Analyze sensitive data - Manage private notes - Review code and logs - Search and organize files - Build docs or slides npm i -g @magnitudedev/cli GitHub:
0:35

Introducing Magnitude: your actually local agent 100% private and offline. No token costs, no API keys. Open source. Today's agents are local. The model isn't. Every prompt, every file, every secret gets sent straight to Anthropic and OpenAI. Magnitude is built around local models and runs the whole stack itself. The inference engine is part of the agent, so the models run inside it, right on your computer. It lives in your terminal, and setup is one command. Magnitude profiles your hardware and shows you which models fit, with the trade-offs between quality, speed, and memory. Pick one and start working. No painful config or server to babysit. Out of the box, it can use your shell, edit files, and run scripts. Add skills and it can work with Excel, PowerPoint, PDFs or Chrome. Use it for everyday work: - Analyze sensitive data - Manage private notes - Review code and logs - Search and organize files - Build docs or slides npm i -g @magnitudedev/cli GitHub:

Tom Greenwald

397,093 Aufrufe • vor 1 Monat

Introducing Workshop: cloud + on-device agentic AI. And to celebrate, we're giving away $250k in Google Gemini AI credits. (details below). The future of AI work is neither cloud-based nor local. It's both. In Workshop Cloud, you can use agents powered by frontier models like Claude and/or open source models like Z.ai's GLM-5 to build internal tools, dashboards, and AI web apps. Or, breeze through tasks like managing your Google and Meta Ads. In Workshop Desktop, you can do all the same right on your computer, plus make desktop apps, mobile apps, and 3D creations. Our favorite part? You can power the full agent experience with local models like Qwen 3.5 family on your computer. Fully offline. 2026 is the year in which local models for agentic tasks will become viable for mainstream use. But the setup for tools like OpenClaw is like setting up Linux from scratch on your computer. Workshop Desktop is one-click to install on Windows, Mac, and Linux. It recommends which open source model you should use for your hardware and lets you download and run it right in the app. And its agent harness allows you to chat, create websites, build personal utilities, and analyze data. 100% offline. Or multitask with AI models in the cloud while running other agent threads locally. Start in Workshop Cloud when you want flexibility and speed. Download your project and continue in Workshop Desktop when you want local files, privacy, and/or better performance on large code bases. Publish from either. The agent tooling space is maturing and discerning users have come to expect a lot from their tools. We've packed Workshop with features to help you 10x your productivity. - Native support for skills - Autocompaction for seamless context management - Built-in AI for your apps - Dozens of connectors, like Google Drive, Big Query, and Supabase - dbt integration to ground your dashboards in your semantic layer - Native Github integration - Private app deployment - ... and more (+ we're shipping super fast) To access the free credit offer, RT this post and reply with "Workshop". Make sure you are following us so we can DM you the instructions to redeem. - First 100 to RT + comment get $500 in credits. - Everyone else gets up to $250 And thanks to our partners Modal, Google Gemini, and Z.ai!
3:50

Introducing Workshop: cloud + on-device agentic AI. And to celebrate, we're giving away $250k in Google Gemini AI credits. (details below). The future of AI work is neither cloud-based nor local. It's both. In Workshop Cloud, you can use agents powered by frontier models like Claude and/or open source models like Z.ai's GLM-5 to build internal tools, dashboards, and AI web apps. Or, breeze through tasks like managing your Google and Meta Ads. In Workshop Desktop, you can do all the same right on your computer, plus make desktop apps, mobile apps, and 3D creations. Our favorite part? You can power the full agent experience with local models like Qwen 3.5 family on your computer. Fully offline. 2026 is the year in which local models for agentic tasks will become viable for mainstream use. But the setup for tools like OpenClaw is like setting up Linux from scratch on your computer. Workshop Desktop is one-click to install on Windows, Mac, and Linux. It recommends which open source model you should use for your hardware and lets you download and run it right in the app. And its agent harness allows you to chat, create websites, build personal utilities, and analyze data. 100% offline. Or multitask with AI models in the cloud while running other agent threads locally. Start in Workshop Cloud when you want flexibility and speed. Download your project and continue in Workshop Desktop when you want local files, privacy, and/or better performance on large code bases. Publish from either. The agent tooling space is maturing and discerning users have come to expect a lot from their tools. We've packed Workshop with features to help you 10x your productivity. - Native support for skills - Autocompaction for seamless context management - Built-in AI for your apps - Dozens of connectors, like Google Drive, Big Query, and Supabase - dbt integration to ground your dashboards in your semantic layer - Native Github integration - Private app deployment - ... and more (+ we're shipping super fast) To access the free credit offer, RT this post and reply with "Workshop". Make sure you are following us so we can DM you the instructions to redeem. - First 100 to RT + comment get $500 in credits. - Everyone else gets up to $250 And thanks to our partners Modal, Google Gemini, and Z.ai!

Workshop AI

29,379 Aufrufe • vor 6 Monaten

This is how you build the next generation of AI applications. You need an idea, a good model architecture, and a great harness. That's what MUZIM did. It's an app that runs local multimodal and vision models offline to parse and index your images, videos, and documents frame by frame. • Super fast on-device processing • On-device video & image understanding • You can also bring your API keys for heavy reasoning • Your data stays where it is / nothing goes to the cloud You can do a couple of things with this: 1. Vibe searching for whatever you remember in photos or raw video clips. The app will jump straight to the exact frame and timestamp of the video. This is search as it should be. 2. Use local-running agents to perform tasks on your files. I show a couple of examples in my video. You can check it out here: Thanks to the MUZIM by OpenSoul team for showing me the tool and partnering with me on this post.
6:30

This is how you build the next generation of AI applications. You need an idea, a good model architecture, and a great harness. That's what MUZIM did. It's an app that runs local multimodal and vision models offline to parse and index your images, videos, and documents frame by frame. • Super fast on-device processing • On-device video & image understanding • You can also bring your API keys for heavy reasoning • Your data stays where it is / nothing goes to the cloud You can do a couple of things with this: 1. Vibe searching for whatever you remember in photos or raw video clips. The app will jump straight to the exact frame and timestamp of the video. This is search as it should be. 2. Use local-running agents to perform tasks on your files. I show a couple of examples in my video. You can check it out here: Thanks to the MUZIM by OpenSoul team for showing me the tool and partnering with me on this post.

Santiago

65,953 Aufrufe • vor 1 Monat

Run your coding agent on a local model, with QVAC. OpenCode now plugs into a model on your own machine through our official plugin. That changes two things. Privacy by default. Your repo, your prompts, and every command the agent runs stay on your device. No third-party model ever sees your code. For an agent that reads your codebase and runs commands, that is the point, not a nice-to-have. New workflows. With no meter and no rate limit, the agent does not have to stop. Let it loop on a task, refactor a whole repo overnight, or run a watch-build-fix loop that keeps going. Setup takes a few minutes: one line in opencode.json and OpenCode runs on a local QVAC model. In the video demo, it handles three real developer tasks back to back, fully offline.
1:53

Run your coding agent on a local model, with QVAC. OpenCode now plugs into a model on your own machine through our official plugin. That changes two things. Privacy by default. Your repo, your prompts, and every command the agent runs stay on your device. No third-party model ever sees your code. For an agent that reads your codebase and runs commands, that is the point, not a nice-to-have. New workflows. With no meter and no rate limit, the agent does not have to stop. Let it loop on a task, refactor a whole repo overnight, or run a watch-build-fix loop that keeps going. Setup takes a few minutes: one line in opencode.json and OpenCode runs on a local QVAC model. In the video demo, it handles three real developer tasks back to back, fully offline.

QVAC

11,382,936 Aufrufe • vor 3 Monaten

QVAC SDK 0.13.0 is live, and this version brings a lot of exciting updates! Local AI now plugs into your coding agent, ships as a desktop app in one command, and runs even more models. Highlights: NEW INTEGRATIONS - OpenCode and coding agents: the new @qvac/ai-sdk-provider makes QVAC a local provider. Less setup, same-model requests queue cleanly, and managed mode starts and supervises qvac serve for you. - Broader OpenAI-compatible API, validated across supported flows so covered capabilities stay consistent and testable. - Turn your QVAC project into a real desktop app for Mac, Windows, or Linux with a single command. The new Electron plugin handles the packaging and keeps the app small by including only what it needs. NEW MODELS - New pi0.5 model support - run a vision-language "robot brain" on a single ordinary graphics card, at full accuracy. - Image-to-video, fully local, via the Wan2.1 model in the Diffusion addon. - New BCI add-on: brain-computer interface transcription, fully local. Decode recorded neural signals into text on-device via the Whisper.cpp-based BCI model. IMPROVEMENTS - Whisper GPU transcription on Android, auto-picking the best backend (OpenCL on Adreno 700+, Vulkan elsewhere), unified on one ggml engine. - Parakeet steadier on mobile, with real end-of-utterance detection for streaming. - Supertonic TTS now runs full GPU across Metal, Vulkan, and OpenCL, with native streaming.
1:39

QVAC SDK 0.13.0 is live, and this version brings a lot of exciting updates! Local AI now plugs into your coding agent, ships as a desktop app in one command, and runs even more models. Highlights: NEW INTEGRATIONS - OpenCode and coding agents: the new @qvac/ai-sdk-provider makes QVAC a local provider. Less setup, same-model requests queue cleanly, and managed mode starts and supervises qvac serve for you. - Broader OpenAI-compatible API, validated across supported flows so covered capabilities stay consistent and testable. - Turn your QVAC project into a real desktop app for Mac, Windows, or Linux with a single command. The new Electron plugin handles the packaging and keeps the app small by including only what it needs. NEW MODELS - New pi0.5 model support - run a vision-language "robot brain" on a single ordinary graphics card, at full accuracy. - Image-to-video, fully local, via the Wan2.1 model in the Diffusion addon. - New BCI add-on: brain-computer interface transcription, fully local. Decode recorded neural signals into text on-device via the Whisper.cpp-based BCI model. IMPROVEMENTS - Whisper GPU transcription on Android, auto-picking the best backend (OpenCL on Adreno 700+, Vulkan elsewhere), unified on one ggml engine. - Parakeet steadier on mobile, with real end-of-utterance detection for streaming. - Supertonic TTS now runs full GPU across Metal, Vulkan, and OpenCL, with native streaming.

QVAC

20,932,195 Aufrufe • vor 3 Monaten

🚨 OG YOUTUBER PEWDIEPIE JUST LAUNCHED A FREE, OPEN-SOURCE AI RIVAL TO CHATGPT AND CLAUDE While ChatGPT and Claude charge users for premium features, PewDiePie’s new AI workspace, Odysseus, is FREE. In his own words, "NO tracking, NO subscriptions, and can be run on your OWN computer." Odysseus is essentially “Claude and ChatGPT’s web UI, but SELF-hosted”, allowing users to run local AI models or use APIs while keeping control of their own data. Odysseus includes: - An AI agent that can find, create, edit and run files - Memory that learns from past conversations - Deep research with follow-up chat - An email client that flags urgent messages and drafts replies - A document editor for writing, formatting and fact-checking - Calendar, to-do notes and search tools - An image editor - “Cookbook,” which scans hardware, recommends local models and helps users run them - Mobile support Its BIGGEST selling point is privacy and control. “All your data is yours, as it should be.” He also made a firm commitment on pricing: “This project will never cost any money.” The launch comes just days after PewDiePie announced he was ENDING his vlogs. Retirement arc is wild.
1:00

🚨 OG YOUTUBER PEWDIEPIE JUST LAUNCHED A FREE, OPEN-SOURCE AI RIVAL TO CHATGPT AND CLAUDE While ChatGPT and Claude charge users for premium features, PewDiePie’s new AI workspace, Odysseus, is FREE. In his own words, "NO tracking, NO subscriptions, and can be run on your OWN computer." Odysseus is essentially “Claude and ChatGPT’s web UI, but SELF-hosted”, allowing users to run local AI models or use APIs while keeping control of their own data. Odysseus includes: - An AI agent that can find, create, edit and run files - Memory that learns from past conversations - Deep research with follow-up chat - An email client that flags urgent messages and drafts replies - A document editor for writing, formatting and fact-checking - Calendar, to-do notes and search tools - An image editor - “Cookbook,” which scans hardware, recommends local models and helps users run them - Mobile support Its BIGGEST selling point is privacy and control. “All your data is yours, as it should be.” He also made a firm commitment on pricing: “This project will never cost any money.” The launch comes just days after PewDiePie announced he was ENDING his vlogs. Retirement arc is wild.

Coin Bureau

74,128 Aufrufe • vor 3 Monaten

🚨 Founders: free, private, 100% local AI is finally here I downloaded Qwen 3.6 and ran it on my MacBook inside Strawberry browser. I couldn't believe it. We now have 100% free and private AI that is on par with the best models from OpenAI, Anthropic and Google. (see video!) The CTO of Hugging Face called this "the second revolution of AI." He's right. If you are a building an AI product, you HAVE to start thinking about how you can leverage open source models in your product. It's only a matter of time until local models are mainstream and can run on most people's devices. LLMs are commoditizing. The human brain only requires a AAA battery's worth of energy to run. If biology figured out efficient intelligence, software can too. Maybe we won't need artificial super intelligence and thousands of data centres to do most economically valuable work. Maybe there's a future where AI agents just run on your laptop, fine-tuned to you, fully owned by you, costing only what your energy bill costs. In this future, it's all about building the most delightful, intuitive experience. We've been building for exactly this moment. Stay tuned.
0:41

🚨 Founders: free, private, 100% local AI is finally here I downloaded Qwen 3.6 and ran it on my MacBook inside Strawberry browser. I couldn't believe it. We now have 100% free and private AI that is on par with the best models from OpenAI, Anthropic and Google. (see video!) The CTO of Hugging Face called this "the second revolution of AI." He's right. If you are a building an AI product, you HAVE to start thinking about how you can leverage open source models in your product. It's only a matter of time until local models are mainstream and can run on most people's devices. LLMs are commoditizing. The human brain only requires a AAA battery's worth of energy to run. If biology figured out efficient intelligence, software can too. Maybe we won't need artificial super intelligence and thousands of data centres to do most economically valuable work. Maybe there's a future where AI agents just run on your laptop, fine-tuned to you, fully owned by you, costing only what your energy bill costs. In this future, it's all about building the most delightful, intuitive experience. We've been building for exactly this moment. Stay tuned.

Charles Maddock

12,731 Aufrufe • vor 4 Monaten

no money for grok or midjourney? this tool is for you. there's a FREE tool created by an anon dev. open-source. runs locally. 117k stars on github. it generates: > images & video > 3d models > audio > 20+ models here's how to set it up in under 5 minutes: 1️⃣download ComfyUI Desktop go to and grab the desktop app for your system. windows 10+, mac (apple silicon), or linux. it installs like any normal app, it sets up python and every dependency for you in the background. no terminal, no config files. 2️⃣open it first launch, it spins up its own environment automatically. you just wait a few seconds and you're in. you'll land on a node canvas, that's the whole interface. 3️⃣load a starter workflow top menu → Workflow → Browse Templates → Image Generation. click it. this drops a ready-made setup onto your canvas so you don't build anything from scratch. 4️⃣grab a model comfyui ships empty on purpose, the model is the brain, and you pick it. in the template, the "Load Checkpoint" node has a Download button when no model is installed. click it. it pulls one in for you (a few GB, this is the only real wait). 5️⃣install ComfyUI Manager this is the one add-on you don't skip. it lets you install models, custom nodes, and updates with a click instead of the command line. grab it from github (link in comments). it's the difference between fighting comfyui and flying in it. one honest note: an NVIDIA gpu makes this fast, apple silicon works great too, and a weak machine still runs it just slower. that's the whole setup. you now own an image, video, and 3D studio that costs you nothing per month. save this. and the next time grok or midjourney asks for your card. you won't need it. disclaimer: comfyui itself is 100% free. so are the local models (sdxl, flux, wan 2.2, ltx-2). some premium models like seedance are pay-per-use api models, only if you want top-tier quality. the free local ones cover most of what you need. (github link in the comments) follow and turn on post notification for daily AI contents.
1:13

no money for grok or midjourney? this tool is for you. there's a FREE tool created by an anon dev. open-source. runs locally. 117k stars on github. it generates: > images & video > 3d models > audio > 20+ models here's how to set it up in under 5 minutes: 1️⃣download ComfyUI Desktop go to and grab the desktop app for your system. windows 10+, mac (apple silicon), or linux. it installs like any normal app, it sets up python and every dependency for you in the background. no terminal, no config files. 2️⃣open it first launch, it spins up its own environment automatically. you just wait a few seconds and you're in. you'll land on a node canvas, that's the whole interface. 3️⃣load a starter workflow top menu → Workflow → Browse Templates → Image Generation. click it. this drops a ready-made setup onto your canvas so you don't build anything from scratch. 4️⃣grab a model comfyui ships empty on purpose, the model is the brain, and you pick it. in the template, the "Load Checkpoint" node has a Download button when no model is installed. click it. it pulls one in for you (a few GB, this is the only real wait). 5️⃣install ComfyUI Manager this is the one add-on you don't skip. it lets you install models, custom nodes, and updates with a click instead of the command line. grab it from github (link in comments). it's the difference between fighting comfyui and flying in it. one honest note: an NVIDIA gpu makes this fast, apple silicon works great too, and a weak machine still runs it just slower. that's the whole setup. you now own an image, video, and 3D studio that costs you nothing per month. save this. and the next time grok or midjourney asks for your card. you won't need it. disclaimer: comfyui itself is 100% free. so are the local models (sdxl, flux, wan 2.2, ltx-2). some premium models like seedance are pay-per-use api models, only if you want top-tier quality. the free local ones cover most of what you need. (github link in the comments) follow and turn on post notification for daily AI contents.

m0h

14,542 Aufrufe • vor 3 Monaten

River 2.0 is here and live on Product Hunt 😸 🚀 We rebuilt River from the ground up to work for both massive global and hyper local communities. What's new: 🌍 Invite nearby community members – When you host an event within a community, you can automatically invite nearby community members. 🤝 Grow your following – When you host events inside a community, anyone who registers becomes your follower on River, and then you can invite them to your future events. 🚀 Host an event under your name – Run independent events under your own name and invite your followers directly, for free. We'd love your feedback and support on our launch! I'll post the link in the thread 👇 Thanks to @jason for hunting us both on Product Hunt and in real life 😜 And thanks to all the communities and hosts who've been with us since the beginning while we figure out how to build an enterprise-grade event platform with consumer UX and vibes 🙏
1:43

River 2.0 is here and live on Product Hunt 😸 🚀 We rebuilt River from the ground up to work for both massive global and hyper local communities. What's new: 🌍 Invite nearby community members – When you host an event within a community, you can automatically invite nearby community members. 🤝 Grow your following – When you host events inside a community, anyone who registers becomes your follower on River, and then you can invite them to your future events. 🚀 Host an event under your name – Run independent events under your own name and invite your followers directly, for free. We'd love your feedback and support on our launch! I'll post the link in the thread 👇 Thanks to @jason for hunting us both on Product Hunt and in real life 😜 And thanks to all the communities and hosts who've been with us since the beginning while we figure out how to build an enterprise-grade event platform with consumer UX and vibes 🙏

Rae 🍽️

52,926 Aufrufe • vor 1 Jahr

QVAC SDK 0.11.0 is live. 🛠️ This release focuses entirely on unlocking next-generation local compute and advanced visual workflows. What’s new: Next-Gen Models: Core engine updated to the latest version of Fabric, unlocking full support for Qwen 3.5, Qwen 3.6, and Gemma 4. Multi-GPU Support: The SDK can now split workloads across multiple graphics cards on the same machine, allowing you to run significantly larger models completely locally. Multi-Image Conditioning: Blend multiple reference images together in a single generation for advanced style mixing and composition control. On-Device Upscaling: Boost your generated images to high-quality resolutions, running securely on your own hardware. More improvements are waiting under the hood. Check the change logs, update your SDK today, and start building with
1:11

QVAC SDK 0.11.0 is live. 🛠️ This release focuses entirely on unlocking next-generation local compute and advanced visual workflows. What’s new: Next-Gen Models: Core engine updated to the latest version of Fabric, unlocking full support for Qwen 3.5, Qwen 3.6, and Gemma 4. Multi-GPU Support: The SDK can now split workloads across multiple graphics cards on the same machine, allowing you to run significantly larger models completely locally. Multi-Image Conditioning: Blend multiple reference images together in a single generation for advanced style mixing and composition control. On-Device Upscaling: Boost your generated images to high-quality resolutions, running securely on your own hardware. More improvements are waiting under the hood. Check the change logs, update your SDK today, and start building with

QVAC

2,006,449 Aufrufe • vor 4 Monaten

HERMES JUST GOT A CHATGPT INTERFACE AND IT IS COMPLETELY FREE. No terminal. No command line. No technical setup that takes half a day to figure out. Here is what just became possible. You can now run Hermes, DeepSeek, Ollama, and OpenClaw from a single clean chat interface. Switch between them in one click. Upload files directly. Attach knowledge bases and notes. Preview code without touching the terminal once. Use it on mobile. Make voice and video calls. All of it. Free. Open source. The setup took one conversation with Hermes itself. Pasted the GitHub link in. Hermes installed Open Web UI in Docker on its own. Connected the API server and gateway automatically. A clean ChatGPT-level interface running entirely on local hardware was live in minutes. No subscription. No data leaving your machine. No API bill at the end of the month. The people who set this up this weekend will have a local AI stack that rivals what most companies are paying $2,000 a month for in cloud infrastructure. The people who wait will keep paying for tools that send their data somewhere they cannot see. Both tools are free. Both are open source. The only thing between you and this setup is the next 30 minutes. Follow CyrilXBT for the exact config, setup steps, and local AI workflows I use to run a full stack without spending a dollar on cloud inference.
9:10

HERMES JUST GOT A CHATGPT INTERFACE AND IT IS COMPLETELY FREE. No terminal. No command line. No technical setup that takes half a day to figure out. Here is what just became possible. You can now run Hermes, DeepSeek, Ollama, and OpenClaw from a single clean chat interface. Switch between them in one click. Upload files directly. Attach knowledge bases and notes. Preview code without touching the terminal once. Use it on mobile. Make voice and video calls. All of it. Free. Open source. The setup took one conversation with Hermes itself. Pasted the GitHub link in. Hermes installed Open Web UI in Docker on its own. Connected the API server and gateway automatically. A clean ChatGPT-level interface running entirely on local hardware was live in minutes. No subscription. No data leaving your machine. No API bill at the end of the month. The people who set this up this weekend will have a local AI stack that rivals what most companies are paying $2,000 a month for in cloud infrastructure. The people who wait will keep paying for tools that send their data somewhere they cannot see. Both tools are free. Both are open source. The only thing between you and this setup is the next 30 minutes. Follow CyrilXBT for the exact config, setup steps, and local AI workflows I use to run a full stack without spending a dollar on cloud inference.

CyrilXBT

37,120 Aufrufe • vor 4 Monaten

For science, AI sovereignty and physics-grounded reasoning are non-negotiable. But how can we teach a small LLM like Gemma-4-E4B physics? One way is to use Agent Skills, but this has so far been limited to closed frontier models. mistral․rs now implements Agent Skills natively: the first self-hosted inference engine that does this as part of the local inference substrate, where we can use small models to solve complex scientific and other tasks in a flexible and scalable way. We are in a period of uncertainty about frontier models - access, pricing, deprecation, abrupt restriction. The good news is that when the entire stack runs locally we can build AI that is entirely your own: You own the weights, the skills, the execution loop, the data - all of it runs on your hardware and is reproducible and durable. While virtually all local inference engines expose a model behind an OpenAI-compatible endpoint, everything agentic is then assembled around it by an external orchestrator that injects context, manages tools, mounts files, and brokers execution. mistral․rs is natively agentic and moves that machinery into the server itself, allowing us to build complex agentic workflows and run them locally, on open-source models. With this new feature you can now upload Agent Skills bundles to /v1/skills, reference them from Responses API requests by identity, and run them inside a native agentic loop with persistent Python sessions, figure capture, sandboxed shell execution, file inputs mounted directly into the working session; plug-and-play and completely compatible with your existing code/workflow. A model with a native skill substrate can act, observe consequences, and can modify what it is able to do. The skill is retained procedural capability of the system. Attached is a short video of all of it: skills, code execution, the full agentic loop carried by Gemma-4-E4B; running entirely on my MacBook Pro. You can install and run a server with this capability in two lines in your terminal, with any quantization you need. Nice work by the Google Gemma team Logan Kilpatrick Demis Hassabis and Eric Buehler with mistral․rs!
1:08

For science, AI sovereignty and physics-grounded reasoning are non-negotiable. But how can we teach a small LLM like Gemma-4-E4B physics? One way is to use Agent Skills, but this has so far been limited to closed frontier models. mistral․rs now implements Agent Skills natively: the first self-hosted inference engine that does this as part of the local inference substrate, where we can use small models to solve complex scientific and other tasks in a flexible and scalable way. We are in a period of uncertainty about frontier models - access, pricing, deprecation, abrupt restriction. The good news is that when the entire stack runs locally we can build AI that is entirely your own: You own the weights, the skills, the execution loop, the data - all of it runs on your hardware and is reproducible and durable. While virtually all local inference engines expose a model behind an OpenAI-compatible endpoint, everything agentic is then assembled around it by an external orchestrator that injects context, manages tools, mounts files, and brokers execution. mistral․rs is natively agentic and moves that machinery into the server itself, allowing us to build complex agentic workflows and run them locally, on open-source models. With this new feature you can now upload Agent Skills bundles to /v1/skills, reference them from Responses API requests by identity, and run them inside a native agentic loop with persistent Python sessions, figure capture, sandboxed shell execution, file inputs mounted directly into the working session; plug-and-play and completely compatible with your existing code/workflow. A model with a native skill substrate can act, observe consequences, and can modify what it is able to do. The skill is retained procedural capability of the system. Attached is a short video of all of it: skills, code execution, the full agentic loop carried by Gemma-4-E4B; running entirely on my MacBook Pro. You can install and run a server with this capability in two lines in your terminal, with any quantization you need. Nice work by the Google Gemma team Logan Kilpatrick Demis Hassabis and Eric Buehler with mistral․rs!

Markus J. Buehler

10,229 Aufrufe • vor 3 Monaten

Today we’re introducing Superhuman Docs, the evolution of Coda (Superhuman Docs) into the best place for teams and AI to work together. I co-founded Coda to reimagine the modern document and enable anyone to make a doc as powerful as an app. Superhuman Docs builds on that mission, and is reimagined for how teams work with AI now. With Superhuman Docs, AI is no longer a solo experience. Docs AI works with you the way a teammate would, with full context of everything your team has built: your data, your briefs, your roadmaps, your connected tools. You can ask it to summarize a sprint, draft a decision record from your meeting notes, or pull a competitor analysis into a new page, and that work stays right where your teammates can pick it up. I’m incredibly proud of the team for bringing Docs to life! There’s so much more we’re launching, including a way to create custom interfaces on top of your data just by describing it. We’re also introducing Superhuman Databases for teams to manage up to 1 million rows, launching Docs MCP to open it up to the AI tools you already use, and debuting a brand new Mac app. We’ve been building toward this moment for a long time, and Docs starts rolling out today. If you’re an existing Coda user, everything you rely on in your docs will remain the same, and if you’re new, now is a great time to jump in.
4:07

Today we’re introducing Superhuman Docs, the evolution of Coda (Superhuman Docs) into the best place for teams and AI to work together. I co-founded Coda to reimagine the modern document and enable anyone to make a doc as powerful as an app. Superhuman Docs builds on that mission, and is reimagined for how teams work with AI now. With Superhuman Docs, AI is no longer a solo experience. Docs AI works with you the way a teammate would, with full context of everything your team has built: your data, your briefs, your roadmaps, your connected tools. You can ask it to summarize a sprint, draft a decision record from your meeting notes, or pull a competitor analysis into a new page, and that work stays right where your teammates can pick it up. I’m incredibly proud of the team for bringing Docs to life! There’s so much more we’re launching, including a way to create custom interfaces on top of your data just by describing it. We’re also introducing Superhuman Databases for teams to manage up to 1 million rows, launching Docs MCP to open it up to the AI tools you already use, and debuting a brand new Mac app. We’ve been building toward this moment for a long time, and Docs starts rolling out today. If you’re an existing Coda user, everything you rely on in your docs will remain the same, and if you’re new, now is a great time to jump in.

Shishir

24,342 Aufrufe • vor 2 Monaten

Local AI 101: open models, Hugging Face, and businesses to build (38 min masterclass) I still think cloud AI is the default for most things, and honestly it should be, the frontier models are the strongest and easiest to use. But something shifted in the last 4-5 months. You can now run genuinely good open models directly on your own laptop, or even your phone. And once you actually try it, it changes how you think about what AI is even for. LOCAL AI, CLEARLY EXPLAINED: 1. The model is the brain doing the thinking. Gemma, Llama, Mistral, and Qwen are the main families, and each is better at different things, some at reasoning, some at coding, some small enough to run on a phone. 2. Hugging Face is the warehouse where you find them. You go there to see what each model is good at, check the license, and grab the compressed versions that run on a normal computer. 3. The software is what runs the model on your machine. Start with LM Studio if you're not technical, it feels like a normal app where you search, download, and start chatting. Ollama is the one you reach for when you want to plug a model into your own apps. 4. The workflow is the actual product you build on top of it all. That's what I'm ideating around for some businesses to create. I think local AI just made a specific kind of business way easier to start. Find an industry that: 1. Sits on sensitive data they'd never paste into ChatGPT 2. Does the same review over and over 3. Runs on software from 2003 Then build a local AI tool that does that review on their own machine, so the data never leaves the building! Take home health agencies. Nurses write visit notes all day, and if a note is missing a detail, the billing gets denied or the audit flags it. Here's how I'd start: 1. Find 5 small agencies. Offer to review a batch of their notes for them. 2. Run the notes through Gemma locally (free, private, no cloud). Read every output yourself. 3. Write down the 20 issues that keep showing up: missing vitals, vague med changes, notes that don't support the billed level. 4. That list of 20 is your checklist. The checklist is the product. 5. Turn it into a local desktop app that flags those 20 things before a note gets submitted. You just went from a service anyone could offer to a product nobody else has, and you learned exactly what to build by doing the work by hand first. Same recipe works for restoration contractors (draft the damage report on-site before the tech leaves) and wealth advisors (catch the compliance landmine in a client email before it sends). Basically the framework is sensitive data, repeated review, ancient software. I think there are tons of businesses like this! Almost none of it clicked for me until I actually started using local AI. So if you take one thing from this, go run a model on your own machine once. Also a fun thing to try with your friends. Feel free to send this to a friend. The episode is live for free on The Startup Ideas Podcast (SIP) 🧃 (thanks to Google for sponsoring today's episode and supporting local AI) I feel like local AI one of those things you need to try for it to really click. Run one model on your own machine and you'll see what I mean! I go way deeper in the full 38 minute masterclass, the models, the setup, and the businesses to build. Link below. LINK TO WATCH: OR WATCH BELOW ON X What do you think of local AI?
38:45

Local AI 101: open models, Hugging Face, and businesses to build (38 min masterclass) I still think cloud AI is the default for most things, and honestly it should be, the frontier models are the strongest and easiest to use. But something shifted in the last 4-5 months. You can now run genuinely good open models directly on your own laptop, or even your phone. And once you actually try it, it changes how you think about what AI is even for. LOCAL AI, CLEARLY EXPLAINED: 1. The model is the brain doing the thinking. Gemma, Llama, Mistral, and Qwen are the main families, and each is better at different things, some at reasoning, some at coding, some small enough to run on a phone. 2. Hugging Face is the warehouse where you find them. You go there to see what each model is good at, check the license, and grab the compressed versions that run on a normal computer. 3. The software is what runs the model on your machine. Start with LM Studio if you're not technical, it feels like a normal app where you search, download, and start chatting. Ollama is the one you reach for when you want to plug a model into your own apps. 4. The workflow is the actual product you build on top of it all. That's what I'm ideating around for some businesses to create. I think local AI just made a specific kind of business way easier to start. Find an industry that: 1. Sits on sensitive data they'd never paste into ChatGPT 2. Does the same review over and over 3. Runs on software from 2003 Then build a local AI tool that does that review on their own machine, so the data never leaves the building! Take home health agencies. Nurses write visit notes all day, and if a note is missing a detail, the billing gets denied or the audit flags it. Here's how I'd start: 1. Find 5 small agencies. Offer to review a batch of their notes for them. 2. Run the notes through Gemma locally (free, private, no cloud). Read every output yourself. 3. Write down the 20 issues that keep showing up: missing vitals, vague med changes, notes that don't support the billed level. 4. That list of 20 is your checklist. The checklist is the product. 5. Turn it into a local desktop app that flags those 20 things before a note gets submitted. You just went from a service anyone could offer to a product nobody else has, and you learned exactly what to build by doing the work by hand first. Same recipe works for restoration contractors (draft the damage report on-site before the tech leaves) and wealth advisors (catch the compliance landmine in a client email before it sends). Basically the framework is sensitive data, repeated review, ancient software. I think there are tons of businesses like this! Almost none of it clicked for me until I actually started using local AI. So if you take one thing from this, go run a model on your own machine once. Also a fun thing to try with your friends. Feel free to send this to a friend. The episode is live for free on The Startup Ideas Podcast (SIP) 🧃 (thanks to Google for sponsoring today's episode and supporting local AI) I feel like local AI one of those things you need to try for it to really click. Run one model on your own machine and you'll see what I mean! I go way deeper in the full 38 minute masterclass, the models, the setup, and the businesses to build. Link below. LINK TO WATCH: OR WATCH BELOW ON X What do you think of local AI?

GREG ISENBERG

32,410 Aufrufe • vor 18 Tagen

New course: MCP: Build Rich-Context AI Apps with Anthropic. Learn to build AI apps that access tools, data, and prompts using the Model Context Protocol in this short course, created in partnership with Anthropic Anthropic and taught by Elie Schoppik Elie Schoppik, its Head of Technical Education. Connecting AI applications to external systems that bring rich context to LLM-based applications has often meant writing custom integrations for each use case. MCP is an open protocol that standardizes how LLMs access tools, data, and prompts from external sources, and simplifies how you provide context to your LLM-based applications. For example, you can provide context via third-party tools that let your LLM make API calls to search the web, access data from local docs, retrieve code from a GitHub repo, and so on. MCP, developed by Anthropic, is based on a client-server architecture that defines the communication details between an MCP client, hosted inside the AI application, and an MCP server that exposes tools, resources, and prompt templates. The server can be a subprocess launched by the client that runs locally or an independent process running remotely. In this hands-on course, you'll learn the core architecture behind MCP. You’ll create an MCP-compatible chatbot, build and deploy an MCP server, and connect the chatbot to your MCP server and other open-source servers. Here’s what you’ll do: - Understand why MCP makes AI development less fragmented and standardizes connections between AI applications and external data sources - Learn the core components of the client-server architecture of MCP and the underlying communication mechanism - Build a chatbot with custom tools for searching academic papers, and transform it into an MCP-compatible application - Build a local MCP server that exposes tools, resources, and prompt templates using FastMCP, and test it using MCP Inspector - Create an MCP client inside your chatbot to dynamically connect to your server - Connect your chatbot to reference servers built by Anthropic’s MCP team, such as filesystem, which implements filesystem operations, and fetch, which extracts contents from the web as markdown - Configure Claude Desktop to connect to your server and others, and explore how it abstracts away the low-level logic of MCP clients - Deploy your MCP server remotely and test it with the Inspector or other MCP-compatible applications - Learn about the roadmap for future MCP development, such as multi-agent architecture, MCP registry API, server discovery, authorization, and authentication MCP is an exciting and important technology that lets you build rich-context AI applications that connect to a growing ecosystem of MCP servers, with minimal integration work. Please sign up here!
2:43

New course: MCP: Build Rich-Context AI Apps with Anthropic. Learn to build AI apps that access tools, data, and prompts using the Model Context Protocol in this short course, created in partnership with Anthropic Anthropic and taught by Elie Schoppik Elie Schoppik, its Head of Technical Education. Connecting AI applications to external systems that bring rich context to LLM-based applications has often meant writing custom integrations for each use case. MCP is an open protocol that standardizes how LLMs access tools, data, and prompts from external sources, and simplifies how you provide context to your LLM-based applications. For example, you can provide context via third-party tools that let your LLM make API calls to search the web, access data from local docs, retrieve code from a GitHub repo, and so on. MCP, developed by Anthropic, is based on a client-server architecture that defines the communication details between an MCP client, hosted inside the AI application, and an MCP server that exposes tools, resources, and prompt templates. The server can be a subprocess launched by the client that runs locally or an independent process running remotely. In this hands-on course, you'll learn the core architecture behind MCP. You’ll create an MCP-compatible chatbot, build and deploy an MCP server, and connect the chatbot to your MCP server and other open-source servers. Here’s what you’ll do: - Understand why MCP makes AI development less fragmented and standardizes connections between AI applications and external data sources - Learn the core components of the client-server architecture of MCP and the underlying communication mechanism - Build a chatbot with custom tools for searching academic papers, and transform it into an MCP-compatible application - Build a local MCP server that exposes tools, resources, and prompt templates using FastMCP, and test it using MCP Inspector - Create an MCP client inside your chatbot to dynamically connect to your server - Connect your chatbot to reference servers built by Anthropic’s MCP team, such as filesystem, which implements filesystem operations, and fetch, which extracts contents from the web as markdown - Configure Claude Desktop to connect to your server and others, and explore how it abstracts away the low-level logic of MCP clients - Deploy your MCP server remotely and test it with the Inspector or other MCP-compatible applications - Learn about the roadmap for future MCP development, such as multi-agent architecture, MCP registry API, server discovery, authorization, and authentication MCP is an exciting and important technology that lets you build rich-context AI applications that connect to a growing ecosystem of MCP servers, with minimal integration work. Please sign up here!

Andrew Ng

142,256 Aufrufe • vor 1 Jahr

The Skillful AI platform is now live The place where you can unleash the true power of AI and let your creativity run free 🤖 Get 3X the performance by making up to 3 different LLMs work together for your needs 🤖 Create your custom personalities for the AI agents as detailed as you can dream of, then bring them to life on telegram, discord, or monetize them in our AI marketplace 🤖 Feed your Agents specific knowledge and keep it fully private through 's blind computing technology 🤖 Plug your AI into everything with our Skills and Integrations: From social media like X & Telegram, to agents launching their own tokens via @pumpdotfun, trading tokens on Solana to even making your own AI NPC characters for your games through our SDKs ✅ We’ve got a ton of exciting extra features coming to the platform very soon. We are committed to bringing you the ultimate AI ecosystem 🥂 Ps: Have questions about the platform? Drop a ticket in our Discord, and we’ll be happy to assist 🫡 🌐
0:48

The Skillful AI platform is now live The place where you can unleash the true power of AI and let your creativity run free 🤖 Get 3X the performance by making up to 3 different LLMs work together for your needs 🤖 Create your custom personalities for the AI agents as detailed as you can dream of, then bring them to life on telegram, discord, or monetize them in our AI marketplace 🤖 Feed your Agents specific knowledge and keep it fully private through 's blind computing technology 🤖 Plug your AI into everything with our Skills and Integrations: From social media like X & Telegram, to agents launching their own tokens via @pumpdotfun, trading tokens on Solana to even making your own AI NPC characters for your games through our SDKs ✅ We’ve got a ton of exciting extra features coming to the platform very soon. We are committed to bringing you the ultimate AI ecosystem 🥂 Ps: Have questions about the platform? Drop a ticket in our Discord, and we’ll be happy to assist 🫡 🌐

Skillful AI

113,541 Aufrufe • vor 1 Jahr