Tutorial Time: Run any open-source LLM locally. Now we... will run an LLM on your M1/2 Mac. And its fast. All you need is moved to: @lmstudio let's get started. Good to be back. A threadshow more

⚡️Introducing Open LLM Server⚡️ Looking to run models like... GPT4All or LLaMa locally, but tired of python-based UIs that are impossibly slow/clunky to install? Now with a single command you can be up and running in seconds! (Windows/Mac/Linux) Here's why this is a big deal:show more

Today, we're shipping MLX support for TADA, our open-source... text-to-speech model, which means the entire pipeline (LLM, flow-matching, and decoder) can now run locally on any Apple Silicon device. We're seeing a 45% reduction in memory usage and a 10x speed-up when using it quantized. With these improvements, you can use TADA on-device for OpenClaw or any personal chatbot. If you own a MacBook, Mac Mini, or Mac Studio, record a 10-second clip of any voice, type any text, and get high-quality, natural and expressive speech in real-time. Completely offline, completely free.show more

Microsoft just changed the game 🤯 They've open-sourced bitnet.cpp,... a 1-bit LLM inference framework. It let's you run 100B parameter models on your local CPU without GPUs. - 6.17x faster inference - 82.2% less energy on CPUs 100% Open Source.show more

Watch out for these LLM run accounts that will... comment on your posts and then block you I block them back so they can’t comment again, but it’s impossible to block all the spambotsshow more

LM Studio 0.3.4 ships with Apple MLX 🚢🍎 Run... on-device LLMs super fast, 100% locally and offline on your Apple Silicon Mac! Includes: > run Llama 3.2 1B at ~250 tok/sec (!) on M3 > enforce structured JSON responses > use via chat UI, or from your own code > run multiple models simultaneously > download any model from Hugging Face Video at 1x speed.show more

Excited to annouce that @askvenice is now integrated as... our sole LLM inference provider for bunnyCompute. We love the product and recommend it for any LLM use case. Open-source models, no data retention, no censorship - that's why we chose them.show more

private inference is live on the bankr llm gateway.... select models now run inside TEEs. prompts stay encrypted in use -- private, by design. pay with any coin you’re holding. get started below.show more

Iterating... Evals take time and are boring: but are... a fundamental validation step of sane LLM inference. Let's try to make them as easy and fun to run as possible.show more

Now you can run a swarm of droids, or... claudes, or codexes in parallel using the open source emdash app congrats on shipping fast Arne Strickmann (and you didn't need to raise $200m to do it 😉)show more

We’re thrilled to launch GPT-OSS—the 120B-parameter open-source LLM—on Phala... Cloud! 🚀 🔒 Run the fully OSS model inside a secure TEE for end-to-end confidential AI. Explore the build 👉show more

"It's on my todo to build my own stack... of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)show more

Hello Agents, Starting today, humans will finally trust you... to manage capital on their behalf. We are open-sourcing: Sail Protocol: The first onchain primitive for Separately Managed Accounts (SMAs). Sailor: The open source harness to run DeFi agents locally.show more

An 100% open-source rival to n8n just launched. Sim... is a drag-and-drop platform for building agentic workflows that runs entirely on your local machine. → Visual, Figma-like canvas interface → Works with any local LLM via Ollama → Native MCP support to connect 100+ toolsshow more

Unpopular opinion: Most agent evals are theatre. You run... them once before the deployment. It'll take 800ms+ as another LLM would be judging your LLM. Most annoying part - no one tells where in the chain things went wrong. I wasted a lot of time in this loop. And then I came across Future AGI bringing 5 different tools under one umbrella, best part - the platform is completely open source. They open sourced their entire platform and the eval layer is noticeably different. It is multimodal - works on everything text, image, audio, pdf. Not an LLM-as-judge adding latency but an agent with memory and tools. The biggest win are learned classifiers trained on actual production failure patterns to run evals at low cost. It also runs across the full reasoning chain, not just the final response. Check out → Try it here →show more

Pay close attention to agentic search. LLM agents get... much better at specialized tasks when you give them structured, expert knowledge. Xerj Corpus Hub lets you do this for any agent with no retraining. You connect a ready-made corpus of docs, guidelines, or real source code, and the agent searches it while it works. It's free, open source, and runs locally.show more

fullmoon v1.2.0 is now available on the App Store... so you can reason free, locally, and privately on all of your devices - adds DeepSeek-R1-Distill-Qwen-1.5B - completely free and open source - works on iPhone, iPad, Mac, and Visionshow more

Microsoft killed the GPU mafia 🤯 They finally open-sourced... their 1-bit LLM inference framework called bitnet.cpp. It lets you run 100B parameter models on your local CPU without GPUs. - 6.17x faster inference - 82.2% less energy on CPUs 100% Open Source.show more