Check this!! A 100% open-source toolkit to work with... LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!show more

Drag-and-drop UI to build AI agents! Langflow is a... powerful visual tool for building and deploying AI-powered agents and workflows—without writing any code. Supports all major LLMs, vector DBs, etc. 100% open-source, 62k+ stars 🌟show more

An 100% open-source rival to n8n just launched. Sim... is a drag-and-drop platform for building agentic workflows that runs entirely on your local machine. → Visual, Figma-like canvas interface → Works with any local LLM via Ollama → Native MCP support to connect 100+ toolsshow more

After months of work, and with the help of... our awesome community, we're excited to finally share LM Studio 0.3.0! 🎉 🔥 What's new: - Built-in Chat with Documents, 100% offline - OpenAI-like 'Structured Outputs' API with any local model - Total UI revamp (with dark/light/sepia themes) - Load & serve multiple LLMs *on the local network* - Available in 7 languages! 🌎🌍🌏 - Download any supported model from Hugging Face - Update LLM runtimes (llama.cpp) separately from the app ... and tons more goodies! Let us know how you like it! 👾🤝show more

Figma canvas to build AI agent workflows. Sim is... a lightweight, user-friendly platform for building AI agent workflows in minutes. It natively supports all major LLMs, Vector DBs, etc. 100% open-source with 7k+ stars!show more

Meet #DBRX: a general-purpose LLM that sets a new... standard for efficient open source models. Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications.show more

Fine-tune DeepSeek-OCR on your own language! (100% local) DeepSeek-OCR... is a 3B-parameter vision model that achieves 97% precision while using 10× fewer vision tokens than text-based LLMs. It handles tables, papers, and handwriting without killing your GPU or budget. Why it matters: Most vision models treat documents as massive sequences of tokens, making long-context processing expensive and slow. DeepSeek-OCR uses context optical compression to convert 2D layouts into vision tokens, enabling efficient processing of complex documents. The best part? You can easily fine-tune it for your specific use case on a single GPU. I used Unsloth to run this experiment on Persian text and saw an 88.26% improvement in character error rate. ↳ Base model: 149% character error rate (CER) ↳ Fine-tuned model: 60% CER (57% more accurate) ↳ Training time: 60 steps on a single GPU Persian was just the test case. You can swap in your own dataset for any language, document type, or specific domain you're working with. I've shared the complete guide in the next tweet - all the code, notebooks, and environment setup ready to run with a single click. Everything is 100% open-source!show more

Google released an app that allows you to run... LLMs from Hugging Face, fully privately and 100% local 🔥 > Generate code on-the-fly > Chat with images > Supports multi-turn conversations > Choose any model from Hugging Face > Based on LiteRT 🔥 > Sign in with HF Support for iOS coming soon! - exciting times for LiteRT and LocalLlama community! 💥show more

Introducing 𝗦𝘂𝗽𝗲𝗿 𝗝𝗦𝗢𝗡 𝗠𝗼𝗱𝗲, a framework for low latency... structured output generation from LLMs. Generate JSON up to 𝟮𝟬𝘅 𝗳𝗮𝘀𝘁𝗲𝗿 from OpenAI and open source models. ❌ No need to threaten the model, tip the AI, etc ❌ Built with Alex Derhacobian 🔧 🧵👇show more

⭐The Year of Inference is here. Featherless is now... an official inference provider on Hugging Face, unlocking 6,700+ LLMs for anyone to run, eval, and deploy instantly. It all starts with accessibility. From DeepSeek to Mistral, LLaMA to Qwen — powerful LLMs are one click away. We believe the future of AI is shaped by the long tail: personalized, specialized models tuned to real people’s needs. To get there, inference must be open, affordable, and usable by all. Whether you're fine-tuning, prototyping, or scaling a product, this moment is for you. 🫱🏻‍🫲🏻Let’s make inference the easiest part of building with AI. 📢 Share this so more builders know what’s now possible. Excited to be partnering with clem 🤗 Julien Chaumond Vaibhav (VB) Srivastav Simon Brandeis & Hugging Face team to take this to the next level!show more

Claude Cowork now has a free, 100% local competitor... 🤯 Rowboat connects to your Gmail and meeting notes, builds a knowledge graph of your work, and acts on it. → Voice-enabled → Works with any LLM (local or hosted) → MCP tool extensibility → Background agents + web search → Obsidian-compatible Markdown vault 14.3k GitHub stars. 100% open-source.show more

Our open-source RAG app, Verba, can now run Ollama... models locally to embed documents into Weaviate and generate answers without your data leaving your device! I tested it with Llama3, and it works great + super quickly on my M2; In this recording, I'm doing a little Verba-ception, asking Verba what Verba is 🤤 You can also use open-source models like Mistral, Claude, or your own custom LLMs. This will make doing RAG with sensitive data possible since you won't depend on APIs anymore. Looking forward to everyone trying it out 🤗 Update's coming next week!show more

Introducing Dexter. An open source financial agent in ~200... lines of code. Think: Claude Code, but for finance. What Dexter does today: • plans tasks • runs on its own • validates its work • researches stocks It’s built with OSS tools like for managing LLMs, prompts, outputs, etc. No coding experience needed to run. Goal: build the best financial agent and share every line of code along the way. Next: evals, starting withshow more

New Llama.cpp UI is a blessing for the local... AI world 🌎 - Blazing fast, beautiful, and private (ofc) - Use 150,000+ GGUF models in a super slick UI - Drop in PDFs, images, or text documents - Branch and edit conversations anytime - Parallel chats and image processing - Math and code rendering - Constrained generation with JSON schema supported Easy setup + open-source + community-built 🔥show more

Omg.. this is wild... This Github repo removes LLM... censorship permanently in 45 minutes. It's called Heretic - 100% Open Source. No jailbreaks, prompts, and just One command. ↳ Zero configuration ↳ Keeps model intelligence intact ↳ Works with Llama, Qwen, Gemma ↳ Runs locally But it won't stay under the radar forever.show more

Wow. This is one of the best interactive sites... I’ve seen for learning how LLMs work! 🔥 It starts w/ a clear intro and guides you through every core component: from Embedding, Layer Norm, and Self-Attention to MLPs, Transformer blocks, Softmax, and Output layers. link in 🧵↓show more

We finally have a "Figma for AI agents." It's... called Awesome-design-md. A curated collection of UI systems extracted from 50+ top websites, formatted specifically for coding agents. Instead of parsing screenshots or messy design files, you drop a DESIGN.md straight into your project. It upgrades your AI's UI skills instantly. > Unlocks 50+ elite design systems: Cursor, Vercel, Stripe, Spotify, SpaceX, and more > Structured into 9 clear sections: typography, spacing, elevation, rules > Includes light/dark previews for quick visual checks > Uses Google Stitch's native plain-text format for LLMs Every file also comes with an Agent Guide, ready-to-use prompts included. 100% Free. Open Source.show more

You built an app, nice But no one knows... about it. And the vibe is a bit... default. You need a brand. We built a skill for founders to generate distinct brands for any app. Create assets for web, social, app store, ads, and UI with a cohesive aesthetic Skill below 👇show more

Jan Desktop v0.7.7 is live 💛 This update brings... native MLX support on macOS, a broader UX and UI refresh across the app, and better support for developer workflows. You can now upload files in Projects, use the local API server with both local and remote models, and work more smoothly with tools like Claude Code and other CLIs. Update your Jan or download the latest version atshow more

Can a VLM see without a vision encoder? We... trained one for $100, inspired by Gemma 4 12B. Latency on an M3 Pro MacBook: 112 ms -> 1.1 ms for the image path 30% lower end-to-end image+LLM The architecture is just: patchify the image -> linear projection with pos embeddings -> LLM Writeup:show more

Gemma 4 is here! Our most intelligent open models... to date, are built on the same world-class research and tech as Gemini 3, and are sized to run and fine-tune efficiently on local hardware. Check out what Google Gemma 4 brings to devs: 💎 Advanced Reasoning: Deep logic tasks, complex multi-step planning, and beyond 💎 Longer context: Seamlessly analyze entire codebases with context windows of 128K tokens for our edge models and 256K tokens for our largest models 💎 Vision and audio: Rich, multimodal interactions out of the box 💎 140+ languages: Trained on 140+ languages 💎 Apache 2.0 license: industry-standard open-source licenseshow more