Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Hot tip for anyone doing AI dev: Use Ollama to easily run models like Deepseek-r1 or Gemma locally on your machine. It downloads them and spins up a server with an OpenAI SDK compatible API The smaller models are fast and good enough to work on new features or... show more

Wes Bos

435,287 subscribers

153,435 views • 1 year ago •via X (Twitter)

Health & Wellness Science & Technology Education

Anya Rossi• Live Now

Private livecam show

11 Comments

Tanner Linsley1 year ago

You're so cool. I wish I could be this level of cool.

Wes Bos1 year ago

I only hope to be the level of cool that it takes to have a stack named after me

Rahim Nathwani1 year ago

If you're doing `ollama run deepseek-r1` you're NOT running a Deepseek R1 model, but a Qwen3 8B param model finetuned on outputs from R1. Deepseek R1 has 671B params, requiring >700GB of (V)RAM. There's a 1.58-bit quantized version that fits in 131GB.

Dennis1 year ago

@lmstudio is another great option.

goosewin1 year ago

In my experience, these models are rarely good enough for solving the kinds of problems I face day to day

🐧 lalo adrian morales 𝕏1 year ago

been @ollama #1 fan since day 1!

Arvid Kahl1 year ago

This kind of AI-related work will be why many devs will go back to desktop computers with solid GPUs. The speed you get our of a well-quantized model like the one you use w/ Ollama on a high-end Mac Studio is magical. That's what I'm using, and it rocks :D

Peter Cruckshank1 year ago

I feel like I don't think I've got enough VRAM to run a good enough local model 😮‍💨 Guess that means UPGRADE!! 🎉🙌🏻 This does look like it would be fun to try out on smaller features.

рома1 year ago

What do you think is the best small model to run locally? I tried only Mistral yet

zuri-zel1 year ago

what about using lmstudio? have you tried both?

Wes Bos1 year ago

the app, or the SDK? I haven't tried either. Any good?

Related Videos

🚨BREAKING: OpenAI's Codex is now completely FREE to run locally with Ollama. No API costs. No rate limits. 100% private on your machine. You can now use both the Codex App and Codex CLI with powerful open-source models like DeepSeek V4, Gemma 4, and Qwen 3.6. Here's how to set it up in minutes:

🚨BREAKING: OpenAI's Codex is now completely FREE to run locally with Ollama. No API costs. No rate limits. 100% private on your machine. You can now use both the Codex App and Codex CLI with powerful open-source models like DeepSeek V4, Gemma 4, and Qwen 3.6. Here's how to set it up in minutes:

WorldofAI

810,346 views • 1 month ago

DeepSeek-R1. Now running *locally* on your Umbrel. Yes, you can now self-host open source AI models like R1, Llama, and more on your home cloud — thanks to ollama and Open WebUI. Download Open WebUI and Ollama from the Umbrel App Store to get started.

DeepSeek-R1. Now running locally on your Umbrel. Yes, you can now self-host open source AI models like R1, Llama, and more on your home cloud — thanks to ollama and Open WebUI. Download Open WebUI and Ollama from the Umbrel App Store to get started.

Umbrel ☂️

36,562 views • 1 year ago

How to use 50+ API keys (models) for FREE on OpenClaw API??? - go to - login or register your account - click on "more models" - click on "use case" and select what you need it for - choose the model and open it - click on "view code" → "Generate API key" many models don't allow direct deploy, so use the "view code" button to generate API access basically Nvidia NIM gives you the ability to test almost any model from their list for FREE some of them are not worse than GPT 5.2 or Claude Opus 4.6, some might even perform better depending on the task how to understand if a model is efficient and compare it with others??? - go to - type the model name in search - click on "benchmarks" - you’ll see performance tests and rankings this way you can easily compare free models with paid ones of course there are RPM limits, on many models it’s around ~40 requests per minute each model is different, after generating the API key, RPM limits are shown in the top-right corner nothing stops you from using them, many work perfectly fine, super solid option for first tests and for learning OpenClaw or any other system where you need an AI API model

How to use 50+ API keys (models) for FREE on OpenClaw API??? - go to - login or register your account - click on "more models" - click on "use case" and select what you need it for - choose the model and open it - click on "view code" → "Generate API key" many models don't allow direct deploy, so use the "view code" button to generate API access basically Nvidia NIM gives you the ability to test almost any model from their list for FREE some of them are not worse than GPT 5.2 or Claude Opus 4.6, some might even perform better depending on the task how to understand if a model is efficient and compare it with others??? - go to - type the model name in search - click on "benchmarks" - you’ll see performance tests and rankings this way you can easily compare free models with paid ones of course there are RPM limits, on many models it’s around ~40 requests per minute each model is different, after generating the API key, RPM limits are shown in the top-right corner nothing stops you from using them, many work perfectly fine, super solid option for first tests and for learning OpenClaw or any other system where you need an AI API model

Ronin

58,789 views • 4 months ago

You can run local AI models up to 120B without a $10,000 Mac Studio This phone-sized device is your own server for open-source models. 100% local and private. And you can use it to: - Power an agent like OpenClaw 24/7 - Completely replace a chatbot - Literally anything that requires an API It’s called Tiiny, and, once again, you can run the latest open-source models on it. Link below

You can run local AI models up to 120B without a $10,000 Mac Studio This phone-sized device is your own server for open-source models. 100% local and private. And you can use it to: - Power an agent like OpenClaw 24/7 - Completely replace a chatbot - Literally anything that requires an API It’s called Tiiny, and, once again, you can run the latest open-source models on it. Link below

Paul Couvert

41,185 views • 4 months ago

Here's a mini-ChatGPT app that runs locally on your computer. You can chat with it just like you would chat with ChatGPT. We use: - DeepSeek R1 as the LLM - ollama to locally serve R1 - Chainlit for the UI Let's build it!

Here's a mini-ChatGPT app that runs locally on your computer. You can chat with it just like you would chat with ChatGPT. We use: - DeepSeek R1 as the LLM - ollama to locally serve R1 - Chainlit for the UI Let's build it!

Avi Chawla

40,282 views • 1 year ago

🆕 How to run (and finetune) open source AI models with a simple API! In 5 mins, I go over how to: ◆ Generate text with DeepSeek R1 & Llama 3 ◆ Generate code with Qwen on LlamaCoder ◆ Generate images with Flux on BlinkShot ◆ Finetune a model on your own data & run it

🆕 How to run (and finetune) open source AI models with a simple API! In 5 mins, I go over how to: ◆ Generate text with DeepSeek R1 & Llama 3 ◆ Generate code with Qwen on LlamaCoder ◆ Generate images with Flux on BlinkShot ◆ Finetune a model on your own data & run it

Hassan

30,236 views • 1 year ago

Want to reduce your Claude Code bill? Claude Code uses smaller models like Haiku for simple tasks. Instead of sending every small request to a paid API, run those tasks locally with Jan and keep heavier work in the cloud. One setup. Lower API usage. More control. Get the latest version at

Want to reduce your Claude Code bill? Claude Code uses smaller models like Haiku for simple tasks. Instead of sending every small request to a paid API, run those tasks locally with Jan and keep heavier work in the cloud. One setup. Lower API usage. More control. Get the latest version at

👋 Jan

13,169 views • 5 months ago

Gemma 4 is now available in Android Studio! By running Gemma 4 locally on your machine you get access to AI code-assistance that doesn't require an internet connection or an API key for its core operations — so you’ll never run out of token quota →

Gemma 4 is now available in Android Studio! By running Gemma 4 locally on your machine you get access to AI code-assistance that doesn't require an internet connection or an API key for its core operations — so you’ll never run out of token quota →

Android Studio

124,115 views • 3 months ago

Next mlx-vlm release will ship with continuous batching support on the server 🚀 What's coming: → Continuous batching — new requests join the active batch immediately, no waiting. Mixed image + text batches supported → OpenAI-compatible API — field-for-field match with mlx-lm, reasoning/content split for thinking models, tag-aware streaming → Multi-turn tool calling — full tool use support across streaming and non-streaming, works with Gemma4 and other templates → Vision feature caching — cache image embeddings across turns. Gemma4: 228x speedup, Qwen3.5: 23x on cache hit All running locally on Apple Silicon. Check our this demo running 4 concurrent requests (mixed image + text) to gemma-4-26B-A4B-IT by Google Gemma in bf16 using Pi + MLX-VLM server on my M3 Ultra. One of the requests ingests a 8K resolution image!

Next mlx-vlm release will ship with continuous batching support on the server 🚀 What's coming: → Continuous batching — new requests join the active batch immediately, no waiting. Mixed image + text batches supported → OpenAI-compatible API — field-for-field match with mlx-lm, reasoning/content split for thinking models, tag-aware streaming → Multi-turn tool calling — full tool use support across streaming and non-streaming, works with Gemma4 and other templates → Vision feature caching — cache image embeddings across turns. Gemma4: 228x speedup, Qwen3.5: 23x on cache hit All running locally on Apple Silicon. Check our this demo running 4 concurrent requests (mixed image + text) to gemma-4-26B-A4B-IT by Google Gemma in bf16 using Pi + MLX-VLM server on my M3 Ultra. One of the requests ingests a 8K resolution image!

Prince Canuma

82,169 views • 3 months ago

WTF 🤯🤯🤯 Running your own ChatGPT or LLM on your laptop just takes minutes! You just need to - Install moved to: @lmstudio - Download a model - That's it! You can even run a local server to make API requests Same requests as with OpenAI API You only need to change the URL

WTF 🤯🤯🤯 Running your own ChatGPT or LLM on your laptop just takes minutes! You just need to - Install moved to: @lmstudio - Download a model - That's it! You can even run a local server to make API requests Same requests as with OpenAI API You only need to change the URL

Rodrigo Rocco 👨‍💻📈📗 from JobBoardSearch 🔎

383,546 views • 2 years ago

Claude Code is now completely free forever 🤯 Just connect it to Ollama and run a local model like Google’s new Gemma 4. That means Claude Code agents can run directly on your computer with zero API bills and zero subscriptions. Google may have just ended AI subscription fees for good. 🚀

Claude Code is now completely free forever 🤯 Just connect it to Ollama and run a local model like Google’s new Gemma 4. That means Claude Code agents can run directly on your computer with zero API bills and zero subscriptions. Google may have just ended AI subscription fees for good. 🚀

Julian Goldie SEO

10,098 views • 3 months ago

how you can use openAI codex & gpt 5.5 completely FREE (the full guide) 100% legit. no subscription, zero API cost. up to 1M+ token/day. you need just an openAI account and here's how to set it up in 5mins. openAI has a program that gives eligible developers free API usage every day in exchange for sharing API data that helps improve future models. it's not a one-time credit, your allowance refreshes daily. depending on your usage tier, you can get access to hundreds of thousands, or even millions, of free tokens every single day on supported models. here's how to activate it: 1️⃣open your API dashboard: 2️⃣go to settings → data controls 3️⃣enable data sharing for your organization or project 4️⃣make sure your account has a positive API balance 5️⃣save the settings if your account is eligible, you'll see a message confirming access to complimentary daily usage. before you turn it on, know the tradeoff: • prompts and outputs from shared projects can be used to improve openai's models • don't use it for confidential information, client work, or sensitive data • eligibility depends on your account type and settings for everyone else, it's an incredible deal. use it to: • learn AI development • build side projects • experiment with codex • test agents and automations • prototype ideas without worrying about API costs most developers burn money testing ideas. this lets you experiment at scale while spending little to nothing.

how you can use openAI codex & gpt 5.5 completely FREE (the full guide) 100% legit. no subscription, zero API cost. up to 1M+ token/day. you need just an openAI account and here's how to set it up in 5mins. openAI has a program that gives eligible developers free API usage every day in exchange for sharing API data that helps improve future models. it's not a one-time credit, your allowance refreshes daily. depending on your usage tier, you can get access to hundreds of thousands, or even millions, of free tokens every single day on supported models. here's how to activate it: 1️⃣open your API dashboard: 2️⃣go to settings → data controls 3️⃣enable data sharing for your organization or project 4️⃣make sure your account has a positive API balance 5️⃣save the settings if your account is eligible, you'll see a message confirming access to complimentary daily usage. before you turn it on, know the tradeoff: • prompts and outputs from shared projects can be used to improve openai's models • don't use it for confidential information, client work, or sensitive data • eligibility depends on your account type and settings for everyone else, it's an incredible deal. use it to: • learn AI development • build side projects • experiment with codex • test agents and automations • prototype ideas without worrying about API costs most developers burn money testing ideas. this lets you experiment at scale while spending little to nothing.

m0h

68,972 views • 1 month ago

WOW! OPENAI DID IT! They released their first TWO open weights models! This is HUGE news for the entire AI industry. It means you can RIGHT NOW run cutting edge AI models locally on your computer Here's all the benefits and how to set up the models locally yourself:

WOW! OPENAI DID IT! They released their first TWO open weights models! This is HUGE news for the entire AI industry. It means you can RIGHT NOW run cutting edge AI models locally on your computer Here's all the benefits and how to set up the models locally yourself:

Alex Finn

71,875 views • 11 months ago

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Daniel San

584,021 views • 1 year ago

Run state-of-the-art RAG applications locally on your computer with ollama and use all the fantastic open-source models like llama3, msk's awesome models, or Command R from Cohere With Verba 1.0, we put it all in your hands 🙌 Get on board for a wild open-source ride, we're bridging any moat as open-source is here to win

Run state-of-the-art RAG applications locally on your computer with ollama and use all the fantastic open-source models like llama3, msk's awesome models, or Command R from Cohere With Verba 1.0, we put it all in your hands 🙌 Get on board for a wild open-source ride, we're bridging any moat as open-source is here to win

Philip Vollet

41,450 views • 2 years ago

AI agents are a real paradigm shift You can literally make your computer work for you to do any task. All I've used is: - Replit to get it running - Browser Use (free & open source) - Google AI Studio for the API - DeepSeek R1 to implement it (I'm not paying $200 for ChatGPT sorry) Here the AI agent fetches information on its own and reuses it to write new content. But you can use it for literally any industry. Run it once or schedule it at regular intervals... you're in total control And it's nothing like automating on Make or Zapier: AI agents adapt to every situation and can handle far more complex scenarios.

AI agents are a real paradigm shift You can literally make your computer work for you to do any task. All I've used is: - Replit to get it running - Browser Use (free & open source) - Google AI Studio for the API - DeepSeek R1 to implement it (I'm not paying $200 for ChatGPT sorry) Here the AI agent fetches information on its own and reuses it to write new content. But you can use it for literally any industry. Run it once or schedule it at regular intervals... you're in total control And it's nothing like automating on Make or Zapier: AI agents adapt to every situation and can handle far more complex scenarios.

Paul Couvert

76,636 views • 1 year ago

Over the past six months, we shipped 30+ models, features, and upgraded tools for the API. Our changelog has been busy. Here’s what you may have missed for the API: New models • GPT-5.5 • GPT-5.4 mini • GPT-5.4 nano • GPT-Realtime-2 • GPT-Realtime-Whisper • GPT-Realtime-Translate • GPT-Image-2 Agent building blocks • Agents SDK harness & sandbox • Skills in the Responses API • Server-side compaction • WebSocket mode • Hosted shell More ways to build • Admin API enhancements • OpenAI CLI • Models on Amazon Bedrock

Over the past six months, we shipped 30+ models, features, and upgraded tools for the API. Our changelog has been busy. Here’s what you may have missed for the API: New models • GPT-5.5 • GPT-5.4 mini • GPT-5.4 nano • GPT-Realtime-2 • GPT-Realtime-Whisper • GPT-Realtime-Translate • GPT-Image-2 Agent building blocks • Agents SDK harness & sandbox • Skills in the Responses API • Server-side compaction • WebSocket mode • Hosted shell More ways to build • Admin API enhancements • OpenAI CLI • Models on Amazon Bedrock

OpenAI Developers

158,800 views • 26 days ago

DeepSeek V3 0324 is freaking nuts! You will love when you use. - The best and safe place to use right now is Nebius AI Studio. - OpenAI SDK Compatible API. It's insane model especially for UI, it is as good as Claude Sonnet 3.5. More details below 👇 1/3 Nebius AI Studio

DeepSeek V3 0324 is freaking nuts! You will love when you use. - The best and safe place to use right now is Nebius AI Studio. - OpenAI SDK Compatible API. It's insane model especially for UI, it is as good as Claude Sonnet 3.5. More details below 👇 1/3 Nebius AI Studio

AshutoshShrivastava

10,245 views • 1 year ago