Gemma 4 E4B (4-bit) completed a full repo audit... by executing Bash code and tool calls locally. Runs on just 6GB RAM.show more

Gemma 4 E4B was able to search and cite... 10+ websites, execute code to find the best answer! 🔥 You only need 6GB RAM to try this in Unsloth Studio. GitHub repo:show more

Gemma 4 looks at a parking lot. Decides what... to ask. Calls SAM 3.1. "Segment all vehicles." 64 found. "Now just the white ones." 23 found. One model reasoning and orchestrating. One model executing. Both running locally on a MacBook. MLX. No cloud. No API.show more

Qwen3.5-4B searched 20+ websites, cited its sources, and found... the best answer! 🔥 Try this locally with just 4GB RAM via Unsloth Studio. The 4B model did this by executing tool calls + web search directly during its thinking trace.show more

Gemma 4 is now on Cloudflare Workers AI. Vision,... tool calling, reasoning and a 256k context window… Here’s a simple TanStack + Workers AI compliments app. 4 compliments because it’s Gemma 4.show more

Run Ideogram 4 with 6GB VRAM Locally WanGP now... supports Ideogram 4, just need around 6GB VRAM to run. The JSON based prompting lets you describe the layout of the image PRECISELY, and you can use the built-in prompt helper to build the prompt.show more

returning to deepdream in the times of LLMs here... I am using gemma 4 e4b, starting from a random image and optimizing its pixels to maximise the probability gemma captions them as a fantasy map with mountains, rivers, and castles actual AI art 😅show more

Want to teach Gemma to master chess? Check out... this awesome community project showing how to fine-tune Gemma 4 12B on your own data, 100% locally! Running text, images, and audio on just 8GB VRAM makes custom models more accessible than ever.show more

Omg.. this is wild... This Github repo removes LLM... censorship permanently in 45 minutes. It's called Heretic - 100% Open Source. No jailbreaks, prompts, and just One command. ↳ Zero configuration ↳ Keeps model intelligence intact ↳ Works with Llama, Qwen, Gemma ↳ Runs locally But it won't stay under the radar forever.show more

Unsloth Studio now installs in just one line of... code! 💚 Available on macOS, Windows and Linux. You can also run @NVIDIA's new model Nemotron 3 4B locally on just 4GB RAM.show more

Liquid's LFM2.5-8B-A1B smashed OpenAI's gpt-oss-20b on tool calling We... ran both locally on a MacBook Pro M5 Max, 64GB, and gave each the same trip-planning request that only completes if the model fires all 7 tool calls - weather for 3 cities, two currency conversions, an email and a reminder Outputs: LFM2.5-8B-A1B: 4.8 GB RAM usage, 7/7 tool-calls, 266 tok/s, 6.9s OpenAI gpt-oss-20b: 11 GB RAM usage, 3/7 tool-calls, 146 tok/s, 15.0s The 8B used less than half the RAM and still fired all 7 calls, while the 20B silently dropped more than half of its own. It also ran ~2x faster, wrapping the full agentic request in 6.9s against 15s. That's what 38T training tokens buy: a 1B-active MoE that nails the agentic tool calls a model 2.5x its active size keeps droppingshow more

Claude fable 5 is cooked Claude fable 5 Vs... Gemma 4 26b a4b qat MTP Gemma 4 26b running locally on my 8GB vram single RTX 4060 built this using three.js in a single session and 3 prompts. no cloud, no subscription 100% private unlimited use. how long until it can catch up completely?show more

Gemma 4 just dropped. I had it captioning video... in real-time within an hour. Running locally on a MacBook. No cloud. No API. Real-time scene understanding. Oh and SAM3 is segmenting every object in the same frame. Same laptop.show more

A 46K-star repo runs a local proxy that routes... Claude Code requests to 48 free providers while keeping the full CLI and VS Code workflow intact. 1.3 billion free tokens a month.show more

Gemma 4 analyzes the video. Generates key questions. Calls... Falcon Perception. "Find all the people." 156 found. "Detect only white cars." 8 found. A 26B model is running agentic multi-QA vision orchestration. The models are running locally on a MacBook with MLX. No API.show more

As promised, instead of for $15,000 GPUs, we max... optimized a model that can fit comfortably in any GPU with 8GB VRAM running Windows 200 tok/s, *128k context, text/image/audio. Anyone who wants to join the local AI community with 5 year old laptop can run this with recipe below, and this test was done on 3070ti laptop I forgot I had. We pulled every instruct model released since May that fits 8 or 12 GB, and ran the six that mattered through the same 20 tasks: JSON extraction, code, a table, arithmetic, a fake-treaty honesty check, tool calls, language, a persona, a fact planted deep in a long prompt, and three photos. Gemma 4 E4B, Gemma 4 12B, Qwen3.5-9B, Qwen3.5-4B, Ornith-1.5-9B, the Qwen3.8-9B distill. E4B is not the top scorer. Qwen3.5-9B and Ornith beat it on long context and on reading fine print in a photo. It won the pick for the things a newcomer on an old card actually needs: Apache 2.0, text + image + audio in, 3 GB of headroom on an 8 GB card, Weights Google trained to be 4-bit (QAT), and Google's own speculative drafter shipped next to them. Nothing else in the tier has all five, and the drafter alone is worth 2–3×.show more

Meet Gemma 3n, a model that runs on as... little as 2GB of RAM 🤯 It shares the same architecture as Gemini Nano, and is engineered for incredible performance. We added audio understanding, so now it’s multimodal, fast and lean, and runs on-device (no cloud connection required!)show more

gemma-4-12B-agentic-fable5-composer2.5 V2 is out. the agentic upgrade to the... model trained on Fable 5's reasoning. Running it now with TurboQuant llama.cpp on a single RTX 4060( 8 GB VRAM) at 30 tokens/second with full 25000 context and reasoning: # The benchmarks v2 is built for coding + agentic work. writing code, running commands, using tools, debugging, multi step technical tasks. The clearest signal is tau2 bench telecom, an agentic tool use benchmark whose diagnose → fix → verify loop mirrors real terminal/debugging work: tau2 bench telecom numbers: base Gemma 4 12B: ~15% this finetune: ~55%. (Self reported) thats a huge jump # TheTom/llama-cpp-turboquant flags: llama-server.exe -m gemma4-v2-Q4_K_M.gguf -ngl 99 -c 25000 --cache-type-k q8_0 --cache-type-v turbo3 --port 8080 Flag breakdown: -ngl 99 → full GPU offload -c 25000 → 25K context --cache-type-k q8_0 --cache-type-v turbo3 → mixed-precision KV cache — K at 8-bit, V at ~3-bit via TurboQuant (Walsh Hadamard rotated polar quant, Google's own KV-compression research). Not even merged into mainline llama.cpp. running it off a fork. No API. No cloud. Just llama.cpp. well, a fork of it and any 6gb+ GPU. If you tried yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF, check this out and share your experience with the modelsshow more

SOMEONE JUST BUILT A FREE OPEN-SOURCE TOOL THAT TURNS... GPT-6 ASTRA OR ANY AI MODEL INTO A WORKFLOW BOT. IT RUNS LOCALLY, SUPPORTS 1,200 INTEGRATIONS AND PUTS A HUMAN APPROVAL GATE BEFORE EVERY EXTERNAL ACTION.show more

Tried Gemma 4 ran locally on my iPhone today... I thought it'd be useful in case the apocalypse happens and I need to ask it for survival tips Like how to make a fire 🔥 I guess I'll freeze to death instead 🫠show more

Holy sh*t, this is f**king insane😳 i cancelled my... higgsfield subscription for this a free repo with 7.9K stars dropped a full AI video studio that runs on your pc it runs on 6gb of vram, even old gpus wan 2.2, ltx-2, hunyuan video and flux built in no uploads, no subscriptions, no watermarks here is how you set it up: 1. git clone the repo 2. run the one-click install script 3. launch it and generate in your browser you will not find a FREE way to make AI Videos this year than thisshow more