Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

Hot tip for anyone doing AI dev: Use Ollama to easily run models like Deepseek-r1 or Gemma locally on your machine. It downloads them and spins up a server with an OpenAI SDK compatible API The smaller models are fast and good enough to work on new features or... show more

Wes Bos

436,734 subscribers

153,499 просмотров • 1 год назад •via X (Twitter)

Здоровье и велнес Наука и технологии Образование

Anya Rossi• Live Now

Private livecam show

Комментарии: 11

Фото профиля Tanner Linsley

Tanner Linsley1 год назад

You're so cool. I wish I could be this level of cool.

Фото профиля Wes Bos

Wes Bos1 год назад

I only hope to be the level of cool that it takes to have a stack named after me

Фото профиля Rahim Nathwani

Rahim Nathwani1 год назад

If you're doing `ollama run deepseek-r1` you're NOT running a Deepseek R1 model, but a Qwen3 8B param model finetuned on outputs from R1. Deepseek R1 has 671B params, requiring >700GB of (V)RAM. There's a 1.58-bit quantized version that fits in 131GB.

Фото профиля Dennis

Dennis1 год назад

@lmstudio is another great option.

Фото профиля goosewin

goosewin1 год назад

In my experience, these models are rarely good enough for solving the kinds of problems I face day to day

Фото профиля 🐧 lalo adrian morales 𝕏

🐧 lalo adrian morales 𝕏1 год назад

been @ollama #1 fan since day 1!

Фото профиля Arvid Kahl

Arvid Kahl1 год назад

This kind of AI-related work will be why many devs will go back to desktop computers with solid GPUs. The speed you get our of a well-quantized model like the one you use w/ Ollama on a high-end Mac Studio is magical. That's what I'm using, and it rocks :D

Фото профиля Peter Cruckshank

Peter Cruckshank1 год назад

I feel like I don't think I've got enough VRAM to run a good enough local model 😮‍💨 Guess that means UPGRADE!! 🎉🙌🏻 This does look like it would be fun to try out on smaller features.

Фото профиля рома

рома1 год назад

What do you think is the best small model to run locally? I tried only Mistral yet

Фото профиля zuri-zel

zuri-zel1 год назад

what about using lmstudio? have you tried both?

Фото профиля Wes Bos

Wes Bos1 год назад

the app, or the SDK? I haven't tried either. Any good?

Похожие видео

🚨BREAKING: OpenAI's Codex is now completely FREE to run locally with Ollama. No API costs. No rate limits. 100% private on your machine. You can now use both the Codex App and Codex CLI with powerful open-source models like DeepSeek V4, Gemma 4, and Qwen 3.6. Here's how to set it up in minutes:

🚨BREAKING: OpenAI's Codex is now completely FREE to run locally with Ollama. No API costs. No rate limits. 100% private on your machine. You can now use both the Codex App and Codex CLI with powerful open-source models like DeepSeek V4, Gemma 4, and Qwen 3.6. Here's how to set it up in minutes:

WorldofAI

812,375 просмотров • 2 месяцев назад

DeepSeek-R1. Now running *locally* on your Umbrel. Yes, you can now self-host open source AI models like R1, Llama, and more on your home cloud — thanks to ollama and Open WebUI. Download Open WebUI and Ollama from the Umbrel App Store to get started.

DeepSeek-R1. Now running locally on your Umbrel. Yes, you can now self-host open source AI models like R1, Llama, and more on your home cloud — thanks to ollama and Open WebUI. Download Open WebUI and Ollama from the Umbrel App Store to get started.

Umbrel ☂️

36,562 просмотров • 1 год назад

How to use 50+ API keys (models) for FREE on OpenClaw API??? - go to - login or register your account - click on "more models" - click on "use case" and select what you need it for - choose the model and open it - click on "view code" → "Generate API key" many models don't allow direct deploy, so use the "view code" button to generate API access basically Nvidia NIM gives you the ability to test almost any model from their list for FREE some of them are not worse than GPT 5.2 or Claude Opus 4.6, some might even perform better depending on the task how to understand if a model is efficient and compare it with others??? - go to - type the model name in search - click on "benchmarks" - you’ll see performance tests and rankings this way you can easily compare free models with paid ones of course there are RPM limits, on many models it’s around ~40 requests per minute each model is different, after generating the API key, RPM limits are shown in the top-right corner nothing stops you from using them, many work perfectly fine, super solid option for first tests and for learning OpenClaw or any other system where you need an AI API model

How to use 50+ API keys (models) for FREE on OpenClaw API??? - go to - login or register your account - click on "more models" - click on "use case" and select what you need it for - choose the model and open it - click on "view code" → "Generate API key" many models don't allow direct deploy, so use the "view code" button to generate API access basically Nvidia NIM gives you the ability to test almost any model from their list for FREE some of them are not worse than GPT 5.2 or Claude Opus 4.6, some might even perform better depending on the task how to understand if a model is efficient and compare it with others??? - go to - type the model name in search - click on "benchmarks" - you’ll see performance tests and rankings this way you can easily compare free models with paid ones of course there are RPM limits, on many models it’s around ~40 requests per minute each model is different, after generating the API key, RPM limits are shown in the top-right corner nothing stops you from using them, many work perfectly fine, super solid option for first tests and for learning OpenClaw or any other system where you need an AI API model

Ronin

58,789 просмотров • 5 месяцев назад

You can run local AI models up to 120B without a $10,000 Mac Studio This phone-sized device is your own server for open-source models. 100% local and private. And you can use it to: - Power an agent like OpenClaw 24/7 - Completely replace a chatbot - Literally anything that requires an API It’s called Tiiny, and, once again, you can run the latest open-source models on it. Link below

You can run local AI models up to 120B without a $10,000 Mac Studio This phone-sized device is your own server for open-source models. 100% local and private. And you can use it to: - Power an agent like OpenClaw 24/7 - Completely replace a chatbot - Literally anything that requires an API It’s called Tiiny, and, once again, you can run the latest open-source models on it. Link below

Paul Couvert

41,245 просмотров • 4 месяцев назад

Here's a mini-ChatGPT app that runs locally on your computer. You can chat with it just like you would chat with ChatGPT. We use: - DeepSeek R1 as the LLM - ollama to locally serve R1 - Chainlit for the UI Let's build it!

Here's a mini-ChatGPT app that runs locally on your computer. You can chat with it just like you would chat with ChatGPT. We use: - DeepSeek R1 as the LLM - ollama to locally serve R1 - Chainlit for the UI Let's build it!

Avi Chawla

40,282 просмотров • 1 год назад

🆕 How to run (and finetune) open source AI models with a simple API! In 5 mins, I go over how to: ◆ Generate text with DeepSeek R1 & Llama 3 ◆ Generate code with Qwen on LlamaCoder ◆ Generate images with Flux on BlinkShot ◆ Finetune a model on your own data & run it

🆕 How to run (and finetune) open source AI models with a simple API! In 5 mins, I go over how to: ◆ Generate text with DeepSeek R1 & Llama 3 ◆ Generate code with Qwen on LlamaCoder ◆ Generate images with Flux on BlinkShot ◆ Finetune a model on your own data & run it

Hassan

30,236 просмотров • 1 год назад

Want to reduce your Claude Code bill? Claude Code uses smaller models like Haiku for simple tasks. Instead of sending every small request to a paid API, run those tasks locally with Jan and keep heavier work in the cloud. One setup. Lower API usage. More control. Get the latest version at

Want to reduce your Claude Code bill? Claude Code uses smaller models like Haiku for simple tasks. Instead of sending every small request to a paid API, run those tasks locally with Jan and keep heavier work in the cloud. One setup. Lower API usage. More control. Get the latest version at

👋 Jan

13,169 просмотров • 5 месяцев назад

Gemma 4 is now available in Android Studio! By running Gemma 4 locally on your machine you get access to AI code-assistance that doesn't require an internet connection or an API key for its core operations — so you’ll never run out of token quota →

Gemma 4 is now available in Android Studio! By running Gemma 4 locally on your machine you get access to AI code-assistance that doesn't require an internet connection or an API key for its core operations — so you’ll never run out of token quota →

Android Studio

124,158 просмотров • 4 месяцев назад

HERMES CAN NOW RUN FOR FREE FOREVER A new Gemma 4 update just removed the biggest problem with local AI agents. The Upgrade: → Gemma 4 runs around 90% faster on Apple Silicon using Ollama + MLX → Plug it into Hermes with a few terminal commands → Run private agent workflows without subscriptions, token limits, or API bills What It Can Actually Do: ✓ Build and preview apps locally ✓ Use /learn to turn tutorials into permanent skills ✓ Read files, analyse landing pages, summarise emails, and track AI news ✓ Run loops until a task is complete instead of waiting for another prompt ✓ Launch multiple Gemma 4 subagents to work on separate tasks in parallel No Apple Silicon? ✔ OpenRouter offers the 31B model through a free API The real win is not faster chat. It is having Hermes build, retry, check its work, and operate in the background without charging you for every loop.

HERMES CAN NOW RUN FOR FREE FOREVER A new Gemma 4 update just removed the biggest problem with local AI agents. The Upgrade: → Gemma 4 runs around 90% faster on Apple Silicon using Ollama + MLX → Plug it into Hermes with a few terminal commands → Run private agent workflows without subscriptions, token limits, or API bills What It Can Actually Do: ✓ Build and preview apps locally ✓ Use /learn to turn tutorials into permanent skills ✓ Read files, analyse landing pages, summarise emails, and track AI news ✓ Run loops until a task is complete instead of waiting for another prompt ✓ Launch multiple Gemma 4 subagents to work on separate tasks in parallel No Apple Silicon? ✔ OpenRouter offers the 31B model through a free API The real win is not faster chat. It is having Hermes build, retry, check its work, and operate in the background without charging you for every loop.

Julian Goldie SEO

11,234 просмотров • 27 дней назад

Next mlx-vlm release will ship with continuous batching support on the server 🚀 What's coming: → Continuous batching — new requests join the active batch immediately, no waiting. Mixed image + text batches supported → OpenAI-compatible API — field-for-field match with mlx-lm, reasoning/content split for thinking models, tag-aware streaming → Multi-turn tool calling — full tool use support across streaming and non-streaming, works with Gemma4 and other templates → Vision feature caching — cache image embeddings across turns. Gemma4: 228x speedup, Qwen3.5: 23x on cache hit All running locally on Apple Silicon. Check our this demo running 4 concurrent requests (mixed image + text) to gemma-4-26B-A4B-IT by Google Gemma in bf16 using Pi + MLX-VLM server on my M3 Ultra. One of the requests ingests a 8K resolution image!

Next mlx-vlm release will ship with continuous batching support on the server 🚀 What's coming: → Continuous batching — new requests join the active batch immediately, no waiting. Mixed image + text batches supported → OpenAI-compatible API — field-for-field match with mlx-lm, reasoning/content split for thinking models, tag-aware streaming → Multi-turn tool calling — full tool use support across streaming and non-streaming, works with Gemma4 and other templates → Vision feature caching — cache image embeddings across turns. Gemma4: 228x speedup, Qwen3.5: 23x on cache hit All running locally on Apple Silicon. Check our this demo running 4 concurrent requests (mixed image + text) to gemma-4-26B-A4B-IT by Google Gemma in bf16 using Pi + MLX-VLM server on my M3 Ultra. One of the requests ingests a 8K resolution image!

Prince Canuma

82,169 просмотров • 3 месяцев назад

WTF 🤯🤯🤯 Running your own ChatGPT or LLM on your laptop just takes minutes! You just need to - Install moved to: @lmstudio - Download a model - That's it! You can even run a local server to make API requests Same requests as with OpenAI API You only need to change the URL

WTF 🤯🤯🤯 Running your own ChatGPT or LLM on your laptop just takes minutes! You just need to - Install moved to: @lmstudio - Download a model - That's it! You can even run a local server to make API requests Same requests as with OpenAI API You only need to change the URL

Rodrigo Rocco 👨‍💻📈📗 from JobBoardSearch 🔎

383,546 просмотров • 2 лет назад

how you can use openAI codex & gpt 5.5 completely FREE (the full guide) 100% legit. no subscription, zero API cost. up to 1M+ token/day. you need just an openAI account and here's how to set it up in 5mins. openAI has a program that gives eligible developers free API usage every day in exchange for sharing API data that helps improve future models. it's not a one-time credit, your allowance refreshes daily. depending on your usage tier, you can get access to hundreds of thousands, or even millions, of free tokens every single day on supported models. here's how to activate it: 1️⃣open your API dashboard: 2️⃣go to settings → data controls 3️⃣enable data sharing for your organization or project 4️⃣make sure your account has a positive API balance 5️⃣save the settings if your account is eligible, you'll see a message confirming access to complimentary daily usage. before you turn it on, know the tradeoff: • prompts and outputs from shared projects can be used to improve openai's models • don't use it for confidential information, client work, or sensitive data • eligibility depends on your account type and settings for everyone else, it's an incredible deal. use it to: • learn AI development • build side projects • experiment with codex • test agents and automations • prototype ideas without worrying about API costs most developers burn money testing ideas. this lets you experiment at scale while spending little to nothing.

how you can use openAI codex & gpt 5.5 completely FREE (the full guide) 100% legit. no subscription, zero API cost. up to 1M+ token/day. you need just an openAI account and here's how to set it up in 5mins. openAI has a program that gives eligible developers free API usage every day in exchange for sharing API data that helps improve future models. it's not a one-time credit, your allowance refreshes daily. depending on your usage tier, you can get access to hundreds of thousands, or even millions, of free tokens every single day on supported models. here's how to activate it: 1️⃣open your API dashboard: 2️⃣go to settings → data controls 3️⃣enable data sharing for your organization or project 4️⃣make sure your account has a positive API balance 5️⃣save the settings if your account is eligible, you'll see a message confirming access to complimentary daily usage. before you turn it on, know the tradeoff: • prompts and outputs from shared projects can be used to improve openai's models • don't use it for confidential information, client work, or sensitive data • eligibility depends on your account type and settings for everyone else, it's an incredible deal. use it to: • learn AI development • build side projects • experiment with codex • test agents and automations • prototype ideas without worrying about API costs most developers burn money testing ideas. this lets you experiment at scale while spending little to nothing.

m0h

68,972 просмотров • 1 месяц назад

Claude Code is now completely free forever 🤯 Just connect it to Ollama and run a local model like Google’s new Gemma 4. That means Claude Code agents can run directly on your computer with zero API bills and zero subscriptions. Google may have just ended AI subscription fees for good. 🚀

Claude Code is now completely free forever 🤯 Just connect it to Ollama and run a local model like Google’s new Gemma 4. That means Claude Code agents can run directly on your computer with zero API bills and zero subscriptions. Google may have just ended AI subscription fees for good. 🚀

Julian Goldie SEO

10,098 просмотров • 3 месяцев назад

WOW! OPENAI DID IT! They released their first TWO open weights models! This is HUGE news for the entire AI industry. It means you can RIGHT NOW run cutting edge AI models locally on your computer Here's all the benefits and how to set up the models locally yourself:

WOW! OPENAI DID IT! They released their first TWO open weights models! This is HUGE news for the entire AI industry. It means you can RIGHT NOW run cutting edge AI models locally on your computer Here's all the benefits and how to set up the models locally yourself:

Alex Finn

71,875 просмотров • 1 год назад

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Daniel San

584,100 просмотров • 1 год назад

Run state-of-the-art RAG applications locally on your computer with ollama and use all the fantastic open-source models like llama3, msk's awesome models, or Command R from Cohere With Verba 1.0, we put it all in your hands 🙌 Get on board for a wild open-source ride, we're bridging any moat as open-source is here to win

Run state-of-the-art RAG applications locally on your computer with ollama and use all the fantastic open-source models like llama3, msk's awesome models, or Command R from Cohere With Verba 1.0, we put it all in your hands 🙌 Get on board for a wild open-source ride, we're bridging any moat as open-source is here to win

Philip Vollet

41,450 просмотров • 2 лет назад

AI agents are a real paradigm shift You can literally make your computer work for you to do any task. All I've used is: - Replit to get it running - Browser Use (free & open source) - Google AI Studio for the API - DeepSeek R1 to implement it (I'm not paying $200 for ChatGPT sorry) Here the AI agent fetches information on its own and reuses it to write new content. But you can use it for literally any industry. Run it once or schedule it at regular intervals... you're in total control And it's nothing like automating on Make or Zapier: AI agents adapt to every situation and can handle far more complex scenarios.

AI agents are a real paradigm shift You can literally make your computer work for you to do any task. All I've used is: - Replit to get it running - Browser Use (free & open source) - Google AI Studio for the API - DeepSeek R1 to implement it (I'm not paying $200 for ChatGPT sorry) Here the AI agent fetches information on its own and reuses it to write new content. But you can use it for literally any industry. Run it once or schedule it at regular intervals... you're in total control And it's nothing like automating on Make or Zapier: AI agents adapt to every situation and can handle far more complex scenarios.

Paul Couvert

76,636 просмотров • 1 год назад

Over the past six months, we shipped 30+ models, features, and upgraded tools for the API. Our changelog has been busy. Here’s what you may have missed for the API: New models • GPT-5.5 • GPT-5.4 mini • GPT-5.4 nano • GPT-Realtime-2 • GPT-Realtime-Whisper • GPT-Realtime-Translate • GPT-Image-2 Agent building blocks • Agents SDK harness & sandbox • Skills in the Responses API • Server-side compaction • WebSocket mode • Hosted shell More ways to build • Admin API enhancements • OpenAI CLI • Models on Amazon Bedrock

Over the past six months, we shipped 30+ models, features, and upgraded tools for the API. Our changelog has been busy. Here’s what you may have missed for the API: New models • GPT-5.5 • GPT-5.4 mini • GPT-5.4 nano • GPT-Realtime-2 • GPT-Realtime-Whisper • GPT-Realtime-Translate • GPT-Image-2 Agent building blocks • Agents SDK harness & sandbox • Skills in the Responses API • Server-side compaction • WebSocket mode • Hosted shell More ways to build • Admin API enhancements • OpenAI CLI • Models on Amazon Bedrock

OpenAI Developers

158,800 просмотров • 1 месяц назад