Dexter can now use local LLMs. We finally added... ollama support today. Includes models like: • qwen 3 • gemma 3 • deepseek r1 Because Dexter is built on LangChain, switching between local and cloud models is easy. Huge thanks to Harsh Gupta for shipping this.show more

I’ve been building Dexter for 2 months now. It’s... like Claude Code, but for finance. What Dexter can do: • find undervalued stocks • analyze them in detail • build investment thesis All of the code is open source. Bonus: Dexter can also run on local LLMs.show more

Ollama can now think! 🤔🤔🤔 For thinking models, and... especially useful for very thoughtful models like DeepSeek-R1-0528, Ollama can separate the thoughts and the response. Thinking can also be disabled! This is useful for getting a direct response. This works across Ollama's CLI, API, and Python/JavaScript libraries. 🧵 blog post 👇👇👇show more

Check this!! A 100% open-source toolkit to work with... LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!show more

DeepSeek R1 is *the* best model available right now.... It's at the level of o1, but you can use it for free, and it's much faster. A huge leap forward that nobody saw coming. No wonder so many people are throwing tantrums online trying to discredit the Chinese students who built this. You can use DeepSeek in Visual Studio Code right now: 1. Install the Qodo Gen AI extension 2. Select DeepSeek R1 from their list of models The Qodo team is hosting DeepSeek on their servers, so none of your data will go to China. I've been building a Tetris game using DeepSeek, and this is the most impressive model I've seen so far.show more

Jan Desktop v0.7.7 is live 💛 This update brings... native MLX support on macOS, a broader UX and UI refresh across the app, and better support for developer workflows. You can now upload files in Projects, use the local API server with both local and remote models, and work more smoothly with tools like Claude Code and other CLIs. Update your Jan or download the latest version atshow more

The leading model runnable on a single cloud H100... GPU now fits on a single home GPU! 🔥 We've optimized Gemma 3 27B with QAT so you can run our best-in-class open model on your desktop RTX 3090 or similar. See how easy it is to try via ollama! 👇show more

Found a big collection of jailbreaks Prompt collections for... working with GPT, Claude, Gemini, DeepSeek, Grok, and more: github{.}com/... 1. elder-plinius/L1B3RT4S > GitHub stars: 21K > supports models: ChatGPT, Claude, Gemini, DeepSeek, Grok, Llama, Copilot, Cursor, Perplexity 2. ShadowHackrs/Jailbreaks-GPT-Gemini-deepseek- > GitHub stars: 1.1K > supports models: GPT, Sora, Claude, Gemini, DeepSeek 3. Calrton/jailbreak-prompts > GitHub stars: 86 > supports models: Codex, GPT-5.x, Claude, Gemini, DeepSeek, Grok 4. Quincunx33/Ai-jailbreak > GitHub stars: 10 > supports models: Qwen 3.5, Gemma 4, Llama 4, Kimi K3, GPT-5.x, Gemini 3.x, Grok 4.x Found this while digging deeper after the GPT 5.6 prompt. The repo ecosystem is way bigger than the jailbreak itself.show more

Gemma 4 is here! Our most intelligent open models... to date, are built on the same world-class research and tech as Gemini 3, and are sized to run and fine-tune efficiently on local hardware. Check out what Google Gemma 4 brings to devs: 💎 Advanced Reasoning: Deep logic tasks, complex multi-step planning, and beyond 💎 Longer context: Seamlessly analyze entire codebases with context windows of 128K tokens for our edge models and 256K tokens for our largest models 💎 Vision and audio: Rich, multimodal interactions out of the box 💎 140+ languages: Trained on 140+ languages 💎 Apache 2.0 license: industry-standard open-source licenseshow more

Right now, you may not have access to models... like GPT‑5.6 Sol, GPT‑4.6 Terra, GPT‑5.6 Luna, Claude Mythos 5, or Claude Fable 5. But you can run something surprisingly powerful today, locally, and completely free. in the next 10 mins on your 8 GB VRAM gaming laptop. Gemma 4 26B A4B QAT (MoE) delivers strong performance on a standard 8 GB VRAM GPU using Ollama, with no API, no usage limits, and no external dependencies. Out of the box, it reaches around 20 tokens per second without any optimizations. Only one command in your terminal: Ollama run gemma4:26b This means: Full offline capability (privacy by default) Zero recurring cost Competitive performance for many real world tasks Fast enough for interactive use on cheap consumer hardware If you're waiting for cutting edge cloud models, you're missing what is already practical today: a capable, local LLM that runs entirely on your own machine.show more

Claude fable 5 is cooked Claude fable 5 Vs... Gemma 4 26b a4b qat MTP Gemma 4 26b running locally on my 8GB vram single RTX 4060 built this using three.js in a single session and 3 prompts. no cloud, no subscription 100% private unlimited use. how long until it can catch up completely?show more

wow, this new AI is incredible Promptly can generate... prompts for specific AI models like ChatGPT, Midjourney, many video generators and.. guide you how to make it better, this is super useful free to use now 7 examples:show more

🚨 do you understand what is happening?! OpenAI and... Anthropic are putting the best models behind approval lists. Meanwhile GLM 5.2 is running locally on a Mac Studio, coding in a loop 24/7. If someone can turn off your AI, you are renting your intelligence layer. Local models are getting so good now that you can create gameplays like this.👇show more

MRC is already deployed across all of OpenAI’s largest... supercomputers that we use to train frontier models, including our site with Oracle Cloud Infrastructure (OCI) in Abilene, Texas, and in Microsoft’s Fairwater supercomputers. MRC is now available through the Open Compute Project for the entire industry to use and build on.show more

Our open-source RAG app, Verba, can now run Ollama... models locally to embed documents into Weaviate and generate answers without your data leaving your device! I tested it with Llama3, and it works great + super quickly on my M2; In this recording, I'm doing a little Verba-ception, asking Verba what Verba is 🤤 You can also use open-source models like Mistral, Claude, or your own custom LLMs. This will make doing RAG with sensitive data possible since you won't depend on APIs anymore. Looking forward to everyone trying it out 🤗 Update's coming next week!show more

Introducing Jan v3, with updates to Jan Desktop v0.7.6... 💛 Jan v3 is our first v3 model, a 4B base built for fine-tuning and fast local use, with stronger math and coding. This release also includes a small Jan Desktop update, starting with a UI refresh as we move toward a more unified Jan experience. Try it: - Jan v3 is available in Jan Desktop and at - Get the latest desktop app at Model: - Jan-v3-4B: - Jan-v3-4B-GGUF: Thanks Qwen for the base model and Georgi Gerganov for llama.cpp 💛show more

Frontier world models now run on edge GPUs. ⚡... Now openly available, NVIDIA Cosmos 3 Edge brings advanced world-model capabilities to local devices. The 4-billion-parameter omnimodel can understand and generate text, image, video, ambient sound and action for physical AI across robotics, autonomous vehicles and smart infrastructure. 🔗 #SIGGRAPH2026show more

Throughout my journey in developing multimodal models, I’ve always... wanted a framework that lets me plug & play modality encoders/decoders on top of an auto-regressive LLM. I want to prototype fast, try new architectures, and have my demo files scale effortlessly — with full support for parallelism and optimization. Not just to hack⚙️, but also to scale🚀. So finally we built it for ourselves. LMMs-Engine: a lean, efficient framework built to train unified multimodal model at scale. From Qwen LLM, VLM, LLaVA-OV, and WanVideo, to unified models like Qwen-Omni and BAGEL — plus Linear-Attn GDN and research prototypes like RAE and SiT - all under one modular system that seamlessly integrates diverse datasets and optimization strategies. Powered by FSDP2 multi-dim parallelism, Ulysses sequence parallel, Flash-Attention, Liger Kernels, and Native Sparse Attention (also with bonus support for the Muon optimizer for all models).show more

My Coloso course is officially open!🎉 Thank you everyone... for your support! And thank you ye_jji for allowing me to use your art. You can find the link to my course in my bio where you can learn how to rig posed Live2D models like this! #vtubershow more