Check this!! A 100% open-source toolkit to work with... LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!show more

Drag-and-drop UI to build AI agents! Langflow is a... powerful visual tool for building and deploying AI-powered agents and workflows—without writing any code. Supports all major LLMs, vector DBs, etc. 100% open-source, 62k+ stars 🌟show more

An 100% open-source rival to n8n just launched. Sim... is a drag-and-drop platform for building agentic workflows that runs entirely on your local machine. → Visual, Figma-like canvas interface → Works with any local LLM via Ollama → Native MCP support to connect 100+ toolsshow more

After months of work, and with the help of... our awesome community, we're excited to finally share LM Studio 0.3.0! 🎉 🔥 What's new: - Built-in Chat with Documents, 100% offline - OpenAI-like 'Structured Outputs' API with any local model - Total UI revamp (with dark/light/sepia themes) - Load & serve multiple LLMs *on the local network* - Available in 7 languages! 🌎🌍🌏 - Download any supported model from Hugging Face - Update LLM runtimes (llama.cpp) separately from the app ... and tons more goodies! Let us know how you like it! 👾🤝show more

Figma canvas to build AI agent workflows. Sim is... a lightweight, user-friendly platform for building AI agent workflows in minutes. It natively supports all major LLMs, Vector DBs, etc. 100% open-source with 7k+ stars!show more

Meet #DBRX: a general-purpose LLM that sets a new... standard for efficient open source models. Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications.show more

Fine-tune DeepSeek-OCR on your own language! (100% local) DeepSeek-OCR... is a 3B-parameter vision model that achieves 97% precision while using 10× fewer vision tokens than text-based LLMs. It handles tables, papers, and handwriting without killing your GPU or budget. Why it matters: Most vision models treat documents as massive sequences of tokens, making long-context processing expensive and slow. DeepSeek-OCR uses context optical compression to convert 2D layouts into vision tokens, enabling efficient processing of complex documents. The best part? You can easily fine-tune it for your specific use case on a single GPU. I used Unsloth to run this experiment on Persian text and saw an 88.26% improvement in character error rate. ↳ Base model: 149% character error rate (CER) ↳ Fine-tuned model: 60% CER (57% more accurate) ↳ Training time: 60 steps on a single GPU Persian was just the test case. You can swap in your own dataset for any language, document type, or specific domain you're working with. I've shared the complete guide in the next tweet - all the code, notebooks, and environment setup ready to run with a single click. Everything is 100% open-source!show more

Google released an app that allows you to run... LLMs from Hugging Face, fully privately and 100% local 🔥 > Generate code on-the-fly > Chat with images > Supports multi-turn conversations > Choose any model from Hugging Face > Based on LiteRT 🔥 > Sign in with HF Support for iOS coming soon! - exciting times for LiteRT and LocalLlama community! 💥show more

Introducing 𝗦𝘂𝗽𝗲𝗿 𝗝𝗦𝗢𝗡 𝗠𝗼𝗱𝗲, a framework for low latency... structured output generation from LLMs. Generate JSON up to 𝟮𝟬𝘅 𝗳𝗮𝘀𝘁𝗲𝗿 from OpenAI and open source models. ❌ No need to threaten the model, tip the AI, etc ❌ Built with Alex Derhacobian 🔧 🧵👇show more

⭐The Year of Inference is here. Featherless is now... an official inference provider on Hugging Face, unlocking 6,700+ LLMs for anyone to run, eval, and deploy instantly. It all starts with accessibility. From DeepSeek to Mistral, LLaMA to Qwen — powerful LLMs are one click away. We believe the future of AI is shaped by the long tail: personalized, specialized models tuned to real people’s needs. To get there, inference must be open, affordable, and usable by all. Whether you're fine-tuning, prototyping, or scaling a product, this moment is for you. 🫱🏻‍🫲🏻Let’s make inference the easiest part of building with AI. 📢 Share this so more builders know what’s now possible. Excited to be partnering with clem 🤗 Julien Chaumond Vaibhav (VB) Srivastav Simon Brandeis & Hugging Face team to take this to the next level!show more

Our open-source RAG app, Verba, can now run Ollama... models locally to embed documents into Weaviate and generate answers without your data leaving your device! I tested it with Llama3, and it works great + super quickly on my M2; In this recording, I'm doing a little Verba-ception, asking Verba what Verba is 🤤 You can also use open-source models like Mistral, Claude, or your own custom LLMs. This will make doing RAG with sensitive data possible since you won't depend on APIs anymore. Looking forward to everyone trying it out 🤗 Update's coming next week!show more

Introducing Dexter. An open source financial agent in ~200... lines of code. Think: Claude Code, but for finance. What Dexter does today: • plans tasks • runs on its own • validates its work • researches stocks It’s built with OSS tools like for managing LLMs, prompts, outputs, etc. No coding experience needed to run. Goal: build the best financial agent and share every line of code along the way. Next: evals, starting withshow more

New Llama.cpp UI is a blessing for the local... AI world 🌎 - Blazing fast, beautiful, and private (ofc) - Use 150,000+ GGUF models in a super slick UI - Drop in PDFs, images, or text documents - Branch and edit conversations anytime - Parallel chats and image processing - Math and code rendering - Constrained generation with JSON schema supported Easy setup + open-source + community-built 🔥show more

Wow. This is one of the best interactive sites... I’ve seen for learning how LLMs work! 🔥 It starts w/ a clear intro and guides you through every core component: from Embedding, Layer Norm, and Self-Attention to MLPs, Transformer blocks, Softmax, and Output layers. link in 🧵↓show more

You built an app, nice But no one knows... about it. And the vibe is a bit... default. You need a brand. We built a skill for founders to generate distinct brands for any app. Create assets for web, social, app store, ads, and UI with a cohesive aesthetic Skill below 👇show more

Jan Desktop v0.7.7 is live 💛 This update brings... native MLX support on macOS, a broader UX and UI refresh across the app, and better support for developer workflows. You can now upload files in Projects, use the local API server with both local and remote models, and work more smoothly with tools like Claude Code and other CLIs. Update your Jan or download the latest version atshow more

Can a VLM see without a vision encoder? We... trained one for $100, inspired by Gemma 4 12B. Latency on an M3 Pro MacBook: 112 ms -> 1.1 ms for the image path 30% lower end-to-end image+LLM The architecture is just: patchify the image -> linear projection with pos embeddings -> LLM Writeup:show more

Gemma 4 is here! Our most intelligent open models... to date, are built on the same world-class research and tech as Gemini 3, and are sized to run and fine-tune efficiently on local hardware. Check out what Google Gemma 4 brings to devs: 💎 Advanced Reasoning: Deep logic tasks, complex multi-step planning, and beyond 💎 Longer context: Seamlessly analyze entire codebases with context windows of 128K tokens for our edge models and 256K tokens for our largest models 💎 Vision and audio: Rich, multimodal interactions out of the box 💎 140+ languages: Trained on 140+ languages 💎 Apache 2.0 license: industry-standard open-source licenseshow more

🚨 Alibaba just open sourced a GUI agent that... lives inside your webpage and controls it with natural language. It's called Page Agent and it's not a browser extension. It's pure JavaScript no Python, no Puppeteer, no headless browser, no screenshots. Just one script tag and your web app understands natural language. Here's what it actually does: → Embed it with a single tag or npm install → Control any web interface with plain English commands → Text-based DOM manipulation no OCR, no vision models needed → Bring your own LLM (GPT, Claude, Qwen, anything) → Ships a built-in UI with human-in-the-loop support → Turn 20-click ERP/CRM workflows into one sentence → Optional Chrome extension for multi-tab agent tasks → Works on any web app SaaS, admin panels, internal tools Companies are charging $30/month for AI copilots built on this exact idea. This is 3 lines of code. Your users. Your interface. The AI copilot layer for every web app just got open sourced. 1.6K stars. 100% Open Source. (Link in the comments)show more

Extracting structured outputs with LLMs is easy. But doing... large-scale extraction with precise citations and bounding boxes back to the source documents is way harder. With our latest release in LlamaExtract, we extract citation bounding boxes along with every single key and value within a document. You can see this in the UI. Hover over any k:v pair and you’ll be able to see the corresponding highlights in the source doc. If you’re a human reviewing a million docs (resumes, IDs, invoices, claims, contracts), this will help you 5x your ability to verify values and make sure things are correct. Check out these new extraction upgrades in LlamaCloud:show more

"It's on my todo to build my own stack... of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)show more