Gemma 4 E4B (4-bit) completed a full repo audit... by executing Bash code and tool calls locally. Runs on just 6GB RAM.show more

Gemma 4 E4B was able to search and cite... 10+ websites, execute code to find the best answer! 🔥 You only need 6GB RAM to try this in Unsloth Studio. GitHub repo:show more

Gemma 4 looks at a parking lot. Decides what... to ask. Calls SAM 3.1. "Segment all vehicles." 64 found. "Now just the white ones." 23 found. One model reasoning and orchestrating. One model executing. Both running locally on a MacBook. MLX. No cloud. No API.show more

Qwen3.5-4B searched 20+ websites, cited its sources, and found... the best answer! 🔥 Try this locally with just 4GB RAM via Unsloth Studio. The 4B model did this by executing tool calls + web search directly during its thinking trace.show more

Gemma 4 is now on Cloudflare Workers AI. Vision,... tool calling, reasoning and a 256k context window… Here’s a simple TanStack + Workers AI compliments app. 4 compliments because it’s Gemma 4.show more

Run Ideogram 4 with 6GB VRAM Locally WanGP now... supports Ideogram 4, just need around 6GB VRAM to run. The JSON based prompting lets you describe the layout of the image PRECISELY, and you can use the built-in prompt helper to build the prompt.show more

returning to deepdream in the times of LLMs here... I am using gemma 4 e4b, starting from a random image and optimizing its pixels to maximise the probability gemma captions them as a fantasy map with mountains, rivers, and castles actual AI art 😅show more

Want to teach Gemma to master chess? Check out... this awesome community project showing how to fine-tune Gemma 4 12B on your own data, 100% locally! Running text, images, and audio on just 8GB VRAM makes custom models more accessible than ever.show more

Omg.. this is wild... This Github repo removes LLM... censorship permanently in 45 minutes. It's called Heretic - 100% Open Source. No jailbreaks, prompts, and just One command. ↳ Zero configuration ↳ Keeps model intelligence intact ↳ Works with Llama, Qwen, Gemma ↳ Runs locally But it won't stay under the radar forever.show more

Unsloth Studio now installs in just one line of... code! 💚 Available on macOS, Windows and Linux. You can also run @NVIDIA's new model Nemotron 3 4B locally on just 4GB RAM.show more

Liquid's LFM2.5-8B-A1B smashed OpenAI's gpt-oss-20b on tool calling We... ran both locally on a MacBook Pro M5 Max, 64GB, and gave each the same trip-planning request that only completes if the model fires all 7 tool calls - weather for 3 cities, two currency conversions, an email and a reminder Outputs: LFM2.5-8B-A1B: 4.8 GB RAM usage, 7/7 tool-calls, 266 tok/s, 6.9s OpenAI gpt-oss-20b: 11 GB RAM usage, 3/7 tool-calls, 146 tok/s, 15.0s The 8B used less than half the RAM and still fired all 7 calls, while the 20B silently dropped more than half of its own. It also ran ~2x faster, wrapping the full agentic request in 6.9s against 15s. That's what 38T training tokens buy: a 1B-active MoE that nails the agentic tool calls a model 2.5x its active size keeps droppingshow more

Claude fable 5 is cooked Claude fable 5 Vs... Gemma 4 26b a4b qat MTP Gemma 4 26b running locally on my 8GB vram single RTX 4060 built this using three.js in a single session and 3 prompts. no cloud, no subscription 100% private unlimited use. how long until it can catch up completely?show more

Gemma 4 just dropped. I had it captioning video... in real-time within an hour. Running locally on a MacBook. No cloud. No API. Real-time scene understanding. Oh and SAM3 is segmenting every object in the same frame. Same laptop.show more

Gemma 4 analyzes the video. Generates key questions. Calls... Falcon Perception. "Find all the people." 156 found. "Detect only white cars." 8 found. A 26B model is running agentic multi-QA vision orchestration. The models are running locally on a MacBook with MLX. No API.show more

Meet Gemma 3n, a model that runs on as... little as 2GB of RAM 🤯 It shares the same architecture as Gemini Nano, and is engineered for incredible performance. We added audio understanding, so now it’s multimodal, fast and lean, and runs on-device (no cloud connection required!)show more

gemma-4-12B-agentic-fable5-composer2.5 V2 is out. the agentic upgrade to the... model trained on Fable 5's reasoning. Running it now with TurboQuant llama.cpp on a single RTX 4060( 8 GB VRAM) at 30 tokens/second with full 25000 context and reasoning: # The benchmarks v2 is built for coding + agentic work. writing code, running commands, using tools, debugging, multi step technical tasks. The clearest signal is tau2 bench telecom, an agentic tool use benchmark whose diagnose → fix → verify loop mirrors real terminal/debugging work: tau2 bench telecom numbers: base Gemma 4 12B: ~15% this finetune: ~55%. (Self reported) thats a huge jump # TheTom/llama-cpp-turboquant flags: llama-server.exe -m gemma4-v2-Q4_K_M.gguf -ngl 99 -c 25000 --cache-type-k q8_0 --cache-type-v turbo3 --port 8080 Flag breakdown: -ngl 99 → full GPU offload -c 25000 → 25K context --cache-type-k q8_0 --cache-type-v turbo3 → mixed-precision KV cache — K at 8-bit, V at ~3-bit via TurboQuant (Walsh Hadamard rotated polar quant, Google's own KV-compression research). Not even merged into mainline llama.cpp. running it off a fork. No API. No cloud. Just llama.cpp. well, a fork of it and any 6gb+ GPU. If you tried yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF, check this out and share your experience with the modelsshow more

Tried Gemma 4 ran locally on my iPhone today... I thought it'd be useful in case the apocalypse happens and I need to ask it for survival tips Like how to make a fire 🔥 I guess I'll freeze to death instead 🫠show more

Gemma 4 sees a kid and three dogs. Decides... what matters. Calls SAM 3.1 Mask and bounding box. Spotlight on subjects. Background blur. Background pixelation. Four effects. Fully agentic. Two models talking to each other on a MacBook. No App. No cloud. What would you edit?show more

This tool lets you face-swap on a live webcam... in real-time using just one photo. zoom calls, omegle, livestreams.. you can be literally anyone. 93k stars on github. runs on your laptop. 100% free.show more

Someone just built a desktop app that that generates... 3D models from images and runs 100% locally. It's called Modly. It runs entirely on your GPU, no cloud, no API bills. Just drop an image and get a 3D mesh. 100% Open Source.show more

Dexter just got a major upgrade. It now runs... on WhatsApp. You can chat with Dexter from anywhere. How it works: • run Dexter locally • pair with QR code • chat like normal Ask about any stock and Dexter reads filings, pulls financials, and gets to work.show more