Loading video...

Video Failed to Load

Go Home

Unplugging completely! No WiFi and zero notifications. A great way to get deep focus on a project. Here is a walkthrough showing how to run Gemma 4 (26B A4B) fully offline with LM Studio & OpenCode to parse PDFs, ask questions, and build sites 100% locally.

googlegemma's profile picture

Google Gemma

94,206 subscribers

236,260 views • 3 months ago •via X (Twitter)

EducationHealth & WellnessScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

A long time coming but new mlx-lm is here with better batching support in the server and Gemma 4. pip install -U mlx-lm Here is a video where a single M3 Ultra serves 5 opencode sessions with Gemma 4 26B that process ~130k tokens in ~1.5 minutes.
2:03

A long time coming but new mlx-lm is here with better batching support in the server and Gemma 4. pip install -U mlx-lm Here is a video where a single M3 Ultra serves 5 opencode sessions with Gemma 4 26B that process ~130k tokens in ~1.5 minutes.

Angelos Katharopoulos

66,202 views • 3 months ago

Check out this video on how to run Gemma 4 locally on an iPhone! It runs completely offline and handles long context, meaning no data plan, no API calls, and no monthly fees required.
0:43

Check out this video on how to run Gemma 4 locally on an iPhone! It runs completely offline and handles long context, meaning no data plan, no API calls, and no monthly fees required.

Google Gemma

399,014 views • 3 months ago

What does it take to run 3, 5, or even 10 concurrent instances of Gemma 4 locally? We've open-sourced a demo letting you run multiple models side-by-side on your hardware. Gemma 4 26B A4B easily runs 10+ concurrent requests on a MacBook Pro M4 Max at 18 tokens/sec per request.
0:48

What does it take to run 3, 5, or even 10 concurrent instances of Gemma 4 locally? We've open-sourced a demo letting you run multiple models side-by-side on your hardware. Gemma 4 26B A4B easily runs 10+ concurrent requests on a MacBook Pro M4 Max at 18 tokens/sec per request.

Google Gemma

913,368 views • 3 months ago

The top question I got was does Halo support local LLM running on a Mac. Here's an example of the app using gemma-4-26b-a4b-qat via LM Studio running on a base M5/32GB. It's giving an average of 40 tok/s and in my brief testing is able to execute all tool calls correctly. Very usable with this app.
0:37

The top question I got was does Halo support local LLM running on a Mac. Here's an example of the app using gemma-4-26b-a4b-qat via LM Studio running on a base M5/32GB. It's giving an average of 40 tok/s and in my brief testing is able to execute all tool calls correctly. Very usable with this app.

Tanmay

11,682 views • 1 month ago

Kept you waiting, huh? 100% local and open source. Powered by Mario Zechner' pi coupled with qwen3 tts, parakeet.cpp and gemma-4-26b-a4b You'll need to provide the game iso but there is a script that rips all required assets automatically.
2:43

Kept you waiting, huh? 100% local and open source. Powered by Mario Zechner' pi coupled with qwen3 tts, parakeet.cpp and gemma-4-26b-a4b You'll need to provide the game iso but there is a script that rips all required assets automatically.

Tommy Falkowski

17,160 views • 1 month ago

A completely local agent that lives right inside your pocket. 📱 Watch Gemma 4 run 100% locally in the Google AI Edge Gallery app. It converts images into JSON schemas, transcribes audio, and uses agent skills to interact with apps, all entirely offline.
3:20

A completely local agent that lives right inside your pocket. 📱 Watch Gemma 4 run 100% locally in the Google AI Edge Gallery app. It converts images into JSON schemas, transcribes audio, and uses agent skills to interact with apps, all entirely offline.

Google Gemma

88,268 views • 2 months ago

Friendly reminder that Google has an official app to run Gemma 4 on your phone. - 100% open source - Fully offline and private - Multimodal with text/audio/image - Works with Gemma E4B and E2B And the app is available on both iOS and Android. Steps and download below
0:36

Friendly reminder that Google has an official app to run Gemma 4 on your phone. - 100% open source - Fully offline and private - Multimodal with text/audio/image - Works with Gemma E4B and E2B And the app is available on both iOS and Android. Steps and download below

Paul Couvert

725,767 views • 3 months ago

Frontier-level agentic capabilities and long-horizon coding, open source and fully private. That's GLM 5.2, now on Venice. Here's a full walkthrough to build a retro video game with GLM 5.2 and OpenCode, starting from a single prompt:
7:54

Frontier-level agentic capabilities and long-horizon coding, open source and fully private. That's GLM 5.2, now on Venice. Here's a full walkthrough to build a retro video game with GLM 5.2 and OpenCode, starting from a single prompt:

Venice

27,426 views • 1 month ago

Google's new Gemma 4 is excellent, and the 26B MoE version is likely the best model to run on a 32GB Framework Desktop. It's fast, smart, and also great for tool calling if you use it with OpenClaw🦞 or other local agent platforms.
1:03

Google's new Gemma 4 is excellent, and the 26B MoE version is likely the best model to run on a 32GB Framework Desktop. It's fast, smart, and also great for tool calling if you use it with OpenClaw🦞 or other local agent platforms.

Framework

58,593 views • 4 months ago

🚨BREAKING: OpenAI's Codex is now completely FREE to run locally with Ollama. No API costs. No rate limits. 100% private on your machine. You can now use both the Codex App and Codex CLI with powerful open-source models like DeepSeek V4, Gemma 4, and Qwen 3.6. Here's how to set it up in minutes:
0:31

🚨BREAKING: OpenAI's Codex is now completely FREE to run locally with Ollama. No API costs. No rate limits. 100% private on your machine. You can now use both the Codex App and Codex CLI with powerful open-source models like DeepSeek V4, Gemma 4, and Qwen 3.6. Here's how to set it up in minutes:

WorldofAI

812,584 views • 2 months ago

Running Gemma 4 12B locally at 28T/s. Facing issues with vision in LM Studio, but text performance is quite solid. Asked it to create a landing page for a tech event. Video is fast forwarded for the demo.
0:40

Running Gemma 4 12B locally at 28T/s. Facing issues with vision in LM Studio, but text performance is quite solid. Asked it to create a landing page for a tech event. Video is fast forwarded for the demo.

AshutoshShrivastava

15,686 views • 1 month ago

Claude Code is now completely free forever 🤯 Google just dropped Gemma 4 on Ollama, which means you can run Claude Code locally with zero API bills and zero subscriptions. Just install Gemma 4, connect it to Claude Code, and suddenly you have free AI agents running directly on your computer. Google may have just killed AI subscription costs. 🚀
0:28

Claude Code is now completely free forever 🤯 Google just dropped Gemma 4 on Ollama, which means you can run Claude Code locally with zero API bills and zero subscriptions. Just install Gemma 4, connect it to Claude Code, and suddenly you have free AI agents running directly on your computer. Google may have just killed AI subscription costs. 🚀

Julian Goldie SEO

607,191 views • 3 months ago

Gemma 4 now works on-device using React Native! You can now run Gemma 4 fully offline in your cross-platform apps with local hardware acceleration: ⚡ Vulkan delegate on Android ⚡ MLX delegate on Apple Silicon See Gemma 4's vision and tool-use capabilities in action, instantly reading a flyer and scheduling a calendar event, 100% on-device.
8:59

Gemma 4 now works on-device using React Native! You can now run Gemma 4 fully offline in your cross-platform apps with local hardware acceleration: ⚡ Vulkan delegate on Android ⚡ MLX delegate on Apple Silicon See Gemma 4's vision and tool-use capabilities in action, instantly reading a flyer and scheduling a calendar event, 100% on-device.

Google Gemma

115,365 views • 24 days ago

I just made a full walkthrough on how to build an AI quiz funnel that qualifies leads, collects data, and recommends offers (automatically) most people use chatbots as an interactive FAQ replacement but you can also use them to ask questions and guide users to a buying decision in the form of a quiz funnel reply “quiz” and I’ll send you a full walkthrough on how to build it (must be following)
0:21

I just made a full walkthrough on how to build an AI quiz funnel that qualifies leads, collects data, and recommends offers (automatically) most people use chatbots as an interactive FAQ replacement but you can also use them to ask questions and guide users to a buying decision in the form of a quiz funnel reply “quiz” and I’ll send you a full walkthrough on how to build it (must be following)

Tyler

25,231 views • 1 year ago

Claude Code is now completely free forever 🤯 Just connect it to Ollama and run a local model like Google’s new Gemma 4. That means Claude Code agents can run directly on your computer with zero API bills and zero subscriptions. Google may have just ended AI subscription fees for good. 🚀
0:30

Claude Code is now completely free forever 🤯 Just connect it to Ollama and run a local model like Google’s new Gemma 4. That means Claude Code agents can run directly on your computer with zero API bills and zero subscriptions. Google may have just ended AI subscription fees for good. 🚀

Julian Goldie SEO

10,098 views • 3 months ago

You can create a Grok Project, have it search for relevant research papers, and attach the good ones to your project. Because Grok 4 can parse PDFs, you can interact with the model, and it will have direct knowledge of your research.
1:26

You can create a Grok Project, have it search for relevant research papers, and attach the good ones to your project. Because Grok 4 can parse PDFs, you can interact with the model, and it will have direct knowledge of your research.

tetsuo

1,662,794 views • 10 months ago

i tested a fully local ai coding setup: gemma4 from Google DeepMind running through LM Studio, paired with pi which is a minimal open source coding harness this is part 1 of a two part series. here we cover the why and the complete hands-on setup 0:00 - Running a coding agent fully local 0:47 - Why Pi as the coding agent harness 1:39 - Why Gemma 4 and which variant to pick 2:44 - Architecture: Pi, LM Studio and Gemma 4 3:45 - LM Studio setup and model download 5:01 - Starting the local server 5:19 - API sanity check with curl 6:08 - Installing the Pi coding agent 6:20 - Configuring models.json for local models 8:20 - First run: selecting the model in Pi 8:58 - Fixing the context length error 10:16 - Testing the working setup 10:50 - What is coming in Part 2
11:32

i tested a fully local ai coding setup: gemma4 from Google DeepMind running through LM Studio, paired with pi which is a minimal open source coding harness this is part 1 of a two part series. here we cover the why and the complete hands-on setup 0:00 - Running a coding agent fully local 0:47 - Why Pi as the coding agent harness 1:39 - Why Gemma 4 and which variant to pick 2:44 - Architecture: Pi, LM Studio and Gemma 4 3:45 - LM Studio setup and model download 5:01 - Starting the local server 5:19 - API sanity check with curl 6:08 - Installing the Pi coding agent 6:20 - Configuring models.json for local models 8:20 - First run: selecting the model in Pi 8:58 - Fixing the context length error 10:16 - Testing the working setup 10:50 - What is coming in Part 2

Nidhi Singh

16,289 views • 1 month ago

This afternoon I picked up a new Nvidia DGX Spark computer with the goal of trying to run Gemma 4 31b (4bit) on it locally as a server. Just 1.5 hours later, it’s working! Using Open WebUI on my MacBook as the interface and it’s connecting to my DGX Spark running as a Gemma 4 server.
0:46

This afternoon I picked up a new Nvidia DGX Spark computer with the goal of trying to run Gemma 4 31b (4bit) on it locally as a server. Just 1.5 hours later, it’s working! Using Open WebUI on my MacBook as the interface and it’s connecting to my DGX Spark running as a Gemma 4 server.

Dave Lee

139,246 views • 3 months ago

That is the easiest way to chat with a complete Github Repository!👀 Replace "github" with "gitingest" in the url, and you get the whole repo as a single string, paste into AI studio and use Google DeepMind Gemini 2.0 Flash Million Token Context video to ask questions! 🤯 Here is how you can chat with the whole python SDK docs. ⬇️
0:44

That is the easiest way to chat with a complete Github Repository!👀 Replace "github" with "gitingest" in the url, and you get the whole repo as a single string, paste into AI studio and use Google DeepMind Gemini 2.0 Flash Million Token Context video to ask questions! 🤯 Here is how you can chat with the whole python SDK docs. ⬇️

Philipp Schmid

97,475 views • 1 year ago