Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Gemma 4 E4B (4-bit) completed a full repo audit by executing Bash code and tool calls locally. Runs on just 6GB RAM.

UnslothAI's profile picture

Unsloth AI

88,514 subscribers

150,187 Aufrufe • vor 5 Monaten •via X (Twitter)

BildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Gemma 4 E4B was able to search and cite 10+ websites, execute code to find the best answer! 🔥 You only need 6GB RAM to try this in Unsloth Studio. GitHub repo:
0:18

Gemma 4 E4B was able to search and cite 10+ websites, execute code to find the best answer! 🔥 You only need 6GB RAM to try this in Unsloth Studio. GitHub repo:

Unsloth AI

101,740 Aufrufe • vor 5 Monaten

Gemma 4 looks at a parking lot. Decides what to ask. Calls SAM 3.1. "Segment all vehicles." 64 found. "Now just the white ones." 23 found. One model reasoning and orchestrating. One model executing. Both running locally on a MacBook. MLX. No cloud. No API.
0:14

Gemma 4 looks at a parking lot. Decides what to ask. Calls SAM 3.1. "Segment all vehicles." 64 found. "Now just the white ones." 23 found. One model reasoning and orchestrating. One model executing. Both running locally on a MacBook. MLX. No cloud. No API.

Maziyar PANAHI

594,789 Aufrufe • vor 5 Monaten

Qwen3.5-4B searched 20+ websites, cited its sources, and found the best answer! 🔥 Try this locally with just 4GB RAM via Unsloth Studio. The 4B model did this by executing tool calls + web search directly during its thinking trace.
0:12

Qwen3.5-4B searched 20+ websites, cited its sources, and found the best answer! 🔥 Try this locally with just 4GB RAM via Unsloth Studio. The 4B model did this by executing tool calls + web search directly during its thinking trace.

Unsloth AI

128,756 Aufrufe • vor 6 Monaten

Gemma 4 is now on Cloudflare Workers AI. Vision, tool calling, reasoning and a 256k context window… Here’s a simple TanStack + Workers AI compliments app. 4 compliments because it’s Gemma 4.
0:11

Gemma 4 is now on Cloudflare Workers AI. Vision, tool calling, reasoning and a 256k context window… Here’s a simple TanStack + Workers AI compliments app. 4 compliments because it’s Gemma 4.

Jilles Soeters

66,683 Aufrufe • vor 5 Monaten

Run Ideogram 4 with 6GB VRAM Locally WanGP now supports Ideogram 4, just need around 6GB VRAM to run. The JSON based prompting lets you describe the layout of the image PRECISELY, and you can use the built-in prompt helper to build the prompt.
0:18

Run Ideogram 4 with 6GB VRAM Locally WanGP now supports Ideogram 4, just need around 6GB VRAM to run. The JSON based prompting lets you describe the layout of the image PRECISELY, and you can use the built-in prompt helper to build the prompt.

cocktail peanut

24,794 Aufrufe • vor 3 Monaten

returning to deepdream in the times of LLMs here I am using gemma 4 e4b, starting from a random image and optimizing its pixels to maximise the probability gemma captions them as a fantasy map with mountains, rivers, and castles actual AI art 😅
0:15

returning to deepdream in the times of LLMs here I am using gemma 4 e4b, starting from a random image and optimizing its pixels to maximise the probability gemma captions them as a fantasy map with mountains, rivers, and castles actual AI art 😅

Matt Henderson

34,494 Aufrufe • vor 2 Monaten

Want to teach Gemma to master chess? Check out this awesome community project showing how to fine-tune Gemma 4 12B on your own data, 100% locally! Running text, images, and audio on just 8GB VRAM makes custom models more accessible than ever.
0:11

Want to teach Gemma to master chess? Check out this awesome community project showing how to fine-tune Gemma 4 12B on your own data, 100% locally! Running text, images, and audio on just 8GB VRAM makes custom models more accessible than ever.

Google Gemma

157,609 Aufrufe • vor 3 Monaten

Omg.. this is wild... This Github repo removes LLM censorship permanently in 45 minutes. It's called Heretic - 100% Open Source. No jailbreaks, prompts, and just One command. ↳ Zero configuration ↳ Keeps model intelligence intact ↳ Works with Llama, Qwen, Gemma ↳ Runs locally But it won't stay under the radar forever.
0:16

Omg.. this is wild... This Github repo removes LLM censorship permanently in 45 minutes. It's called Heretic - 100% Open Source. No jailbreaks, prompts, and just One command. ↳ Zero configuration ↳ Keeps model intelligence intact ↳ Works with Llama, Qwen, Gemma ↳ Runs locally But it won't stay under the radar forever.

Kanika

22,056 Aufrufe • vor 2 Monaten

Unsloth Studio now installs in just one line of code! 💚 Available on macOS, Windows and Linux. You can also run NVIDIA's new model Nemotron 3 4B locally on just 4GB RAM.
0:19

Unsloth Studio now installs in just one line of code! 💚 Available on macOS, Windows and Linux. You can also run NVIDIA's new model Nemotron 3 4B locally on just 4GB RAM.

Unsloth AI

113,415 Aufrufe • vor 6 Monaten

Liquid's LFM2.5-8B-A1B smashed OpenAI's gpt-oss-20b on tool calling We ran both locally on a MacBook Pro M5 Max, 64GB, and gave each the same trip-planning request that only completes if the model fires all 7 tool calls - weather for 3 cities, two currency conversions, an email and a reminder Outputs: LFM2.5-8B-A1B: 4.8 GB RAM usage, 7/7 tool-calls, 266 tok/s, 6.9s OpenAI gpt-oss-20b: 11 GB RAM usage, 3/7 tool-calls, 146 tok/s, 15.0s The 8B used less than half the RAM and still fired all 7 calls, while the 20B silently dropped more than half of its own. It also ran ~2x faster, wrapping the full agentic request in 6.9s against 15s. That's what 38T training tokens buy: a 1B-active MoE that nails the agentic tool calls a model 2.5x its active size keeps dropping
0:15

Liquid's LFM2.5-8B-A1B smashed OpenAI's gpt-oss-20b on tool calling We ran both locally on a MacBook Pro M5 Max, 64GB, and gave each the same trip-planning request that only completes if the model fires all 7 tool calls - weather for 3 cities, two currency conversions, an email and a reminder Outputs: LFM2.5-8B-A1B: 4.8 GB RAM usage, 7/7 tool-calls, 266 tok/s, 6.9s OpenAI gpt-oss-20b: 11 GB RAM usage, 3/7 tool-calls, 146 tok/s, 15.0s The 8B used less than half the RAM and still fired all 7 calls, while the 20B silently dropped more than half of its own. It also ran ~2x faster, wrapping the full agentic request in 6.9s against 15s. That's what 38T training tokens buy: a 1B-active MoE that nails the agentic tool calls a model 2.5x its active size keeps dropping

atomic.chat

92,187 Aufrufe • vor 3 Monaten

Claude fable 5 is cooked Claude fable 5 Vs Gemma 4 26b a4b qat MTP Gemma 4 26b running locally on my 8GB vram single RTX 4060 built this using three.js in a single session and 3 prompts. no cloud, no subscription 100% private unlimited use. how long until it can catch up completely?
0:19

Claude fable 5 is cooked Claude fable 5 Vs Gemma 4 26b a4b qat MTP Gemma 4 26b running locally on my 8GB vram single RTX 4060 built this using three.js in a single session and 3 prompts. no cloud, no subscription 100% private unlimited use. how long until it can catch up completely?

Alok

30,802 Aufrufe • vor 3 Monaten

Gemma 4 just dropped. I had it captioning video in real-time within an hour. Running locally on a MacBook. No cloud. No API. Real-time scene understanding. Oh and SAM3 is segmenting every object in the same frame. Same laptop.
0:16

Gemma 4 just dropped. I had it captioning video in real-time within an hour. Running locally on a MacBook. No cloud. No API. Real-time scene understanding. Oh and SAM3 is segmenting every object in the same frame. Same laptop.

Maziyar PANAHI

196,846 Aufrufe • vor 5 Monaten

A 46K-star repo runs a local proxy that routes Claude Code requests to 48 free providers while keeping the full CLI and VS Code workflow intact. 1.3 billion free tokens a month.
0:15

A 46K-star repo runs a local proxy that routes Claude Code requests to 48 free providers while keeping the full CLI and VS Code workflow intact. 1.3 billion free tokens a month.

0xMarioNawfal

37,107 Aufrufe • vor 29 Tagen

Gemma 4 analyzes the video. Generates key questions. Calls Falcon Perception. "Find all the people." 156 found. "Detect only white cars." 8 found. A 26B model is running agentic multi-QA vision orchestration. The models are running locally on a MacBook with MLX. No API.
0:16

Gemma 4 analyzes the video. Generates key questions. Calls Falcon Perception. "Find all the people." 156 found. "Detect only white cars." 8 found. A 26B model is running agentic multi-QA vision orchestration. The models are running locally on a MacBook with MLX. No API.

Maziyar PANAHI

158,988 Aufrufe • vor 5 Monaten

As promised, instead of for $15,000 GPUs, we max optimized a model that can fit comfortably in any GPU with 8GB VRAM running Windows 200 tok/s, *128k context, text/image/audio. Anyone who wants to join the local AI community with 5 year old laptop can run this with recipe below, and this test was done on 3070ti laptop I forgot I had. We pulled every instruct model released since May that fits 8 or 12 GB, and ran the six that mattered through the same 20 tasks: JSON extraction, code, a table, arithmetic, a fake-treaty honesty check, tool calls, language, a persona, a fact planted deep in a long prompt, and three photos. Gemma 4 E4B, Gemma 4 12B, Qwen3.5-9B, Qwen3.5-4B, Ornith-1.5-9B, the Qwen3.8-9B distill. E4B is not the top scorer. Qwen3.5-9B and Ornith beat it on long context and on reading fine print in a photo. It won the pick for the things a newcomer on an old card actually needs: Apache 2.0, text + image + audio in, 3 GB of headroom on an 8 GB card, Weights Google trained to be 4-bit (QAT), and Google's own speculative drafter shipped next to them. Nothing else in the tier has all five, and the drafter alone is worth 2–3×.
0:10

As promised, instead of for $15,000 GPUs, we max optimized a model that can fit comfortably in any GPU with 8GB VRAM running Windows 200 tok/s, *128k context, text/image/audio. Anyone who wants to join the local AI community with 5 year old laptop can run this with recipe below, and this test was done on 3070ti laptop I forgot I had. We pulled every instruct model released since May that fits 8 or 12 GB, and ran the six that mattered through the same 20 tasks: JSON extraction, code, a table, arithmetic, a fake-treaty honesty check, tool calls, language, a persona, a fact planted deep in a long prompt, and three photos. Gemma 4 E4B, Gemma 4 12B, Qwen3.5-9B, Qwen3.5-4B, Ornith-1.5-9B, the Qwen3.8-9B distill. E4B is not the top scorer. Qwen3.5-9B and Ornith beat it on long context and on reading fine print in a photo. It won the pick for the things a newcomer on an old card actually needs: Apache 2.0, text + image + audio in, 3 GB of headroom on an 8 GB card, Weights Google trained to be 4-bit (QAT), and Google's own speculative drafter shipped next to them. Nothing else in the tier has all five, and the drafter alone is worth 2–3×.

Killy

127,119 Aufrufe • vor 16 Tagen

Meet Gemma 3n, a model that runs on as little as 2GB of RAM 🤯 It shares the same architecture as Gemini Nano, and is engineered for incredible performance. We added audio understanding, so now it’s multimodal, fast and lean, and runs on-device (no cloud connection required!)
0:15

Meet Gemma 3n, a model that runs on as little as 2GB of RAM 🤯 It shares the same architecture as Gemini Nano, and is engineered for incredible performance. We added audio understanding, so now it’s multimodal, fast and lean, and runs on-device (no cloud connection required!)

Google AI

228,990 Aufrufe • vor 1 Jahr

gemma-4-12B-agentic-fable5-composer2.5 V2 is out. the agentic upgrade to the model trained on Fable 5's reasoning. Running it now with TurboQuant llama.cpp on a single RTX 4060( 8 GB VRAM) at 30 tokens/second with full 25000 context and reasoning: # The benchmarks v2 is built for coding + agentic work. writing code, running commands, using tools, debugging, multi step technical tasks. The clearest signal is tau2 bench telecom, an agentic tool use benchmark whose diagnose → fix → verify loop mirrors real terminal/debugging work: tau2 bench telecom numbers: base Gemma 4 12B: ~15% this finetune: ~55%. (Self reported) thats a huge jump # TheTom/llama-cpp-turboquant flags: llama-server.exe -m gemma4-v2-Q4_K_M.gguf -ngl 99 -c 25000 --cache-type-k q8_0 --cache-type-v turbo3 --port 8080 Flag breakdown: -ngl 99 → full GPU offload -c 25000 → 25K context --cache-type-k q8_0 --cache-type-v turbo3 → mixed-precision KV cache — K at 8-bit, V at ~3-bit via TurboQuant (Walsh Hadamard rotated polar quant, Google's own KV-compression research). Not even merged into mainline llama.cpp. running it off a fork. No API. No cloud. Just llama.cpp. well, a fork of it and any 6gb+ GPU. If you tried yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF, check this out and share your experience with the models
0:16

gemma-4-12B-agentic-fable5-composer2.5 V2 is out. the agentic upgrade to the model trained on Fable 5's reasoning. Running it now with TurboQuant llama.cpp on a single RTX 4060( 8 GB VRAM) at 30 tokens/second with full 25000 context and reasoning: # The benchmarks v2 is built for coding + agentic work. writing code, running commands, using tools, debugging, multi step technical tasks. The clearest signal is tau2 bench telecom, an agentic tool use benchmark whose diagnose → fix → verify loop mirrors real terminal/debugging work: tau2 bench telecom numbers: base Gemma 4 12B: ~15% this finetune: ~55%. (Self reported) thats a huge jump # TheTom/llama-cpp-turboquant flags: llama-server.exe -m gemma4-v2-Q4_K_M.gguf -ngl 99 -c 25000 --cache-type-k q8_0 --cache-type-v turbo3 --port 8080 Flag breakdown: -ngl 99 → full GPU offload -c 25000 → 25K context --cache-type-k q8_0 --cache-type-v turbo3 → mixed-precision KV cache — K at 8-bit, V at ~3-bit via TurboQuant (Walsh Hadamard rotated polar quant, Google's own KV-compression research). Not even merged into mainline llama.cpp. running it off a fork. No API. No cloud. Just llama.cpp. well, a fork of it and any 6gb+ GPU. If you tried yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF, check this out and share your experience with the models

Alok

146,046 Aufrufe • vor 3 Monaten

SOMEONE JUST BUILT A FREE OPEN-SOURCE TOOL THAT TURNS GPT-6 ASTRA OR ANY AI MODEL INTO A WORKFLOW BOT. IT RUNS LOCALLY, SUPPORTS 1,200 INTEGRATIONS AND PUTS A HUMAN APPROVAL GATE BEFORE EVERY EXTERNAL ACTION.
0:18

SOMEONE JUST BUILT A FREE OPEN-SOURCE TOOL THAT TURNS GPT-6 ASTRA OR ANY AI MODEL INTO A WORKFLOW BOT. IT RUNS LOCALLY, SUPPORTS 1,200 INTEGRATIONS AND PUTS A HUMAN APPROVAL GATE BEFORE EVERY EXTERNAL ACTION.

0xMarioNawfal

52,128 Aufrufe • vor 11 Tagen

Tried Gemma 4 ran locally on my iPhone today I thought it'd be useful in case the apocalypse happens and I need to ask it for survival tips Like how to make a fire 🔥 I guess I'll freeze to death instead 🫠
0:10

Tried Gemma 4 ran locally on my iPhone today I thought it'd be useful in case the apocalypse happens and I need to ask it for survival tips Like how to make a fire 🔥 I guess I'll freeze to death instead 🫠

@levelsio

614,736 Aufrufe • vor 5 Monaten

Holy sh*t, this is f**king insane😳 i cancelled my higgsfield subscription for this a free repo with 7.9K stars dropped a full AI video studio that runs on your pc it runs on 6gb of vram, even old gpus wan 2.2, ltx-2, hunyuan video and flux built in no uploads, no subscriptions, no watermarks here is how you set it up: 1. git clone the repo 2. run the one-click install script 3. launch it and generate in your browser you will not find a FREE way to make AI Videos this year than this
0:15

Holy sh*t, this is f**king insane😳 i cancelled my higgsfield subscription for this a free repo with 7.9K stars dropped a full AI video studio that runs on your pc it runs on 6gb of vram, even old gpus wan 2.2, ltx-2, hunyuan video and flux built in no uploads, no subscriptions, no watermarks here is how you set it up: 1. git clone the repo 2. run the one-click install script 3. launch it and generate in your browser you will not find a FREE way to make AI Videos this year than this

painn

194,100 Aufrufe • vor 1 Monat