Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

How to run LLMs locally in 1 minute [beginner-friendly] using ollama 🦙 and hugging face 🤗

dylan

9,842 subscribers

27,390 views • 1 year ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

10 Comments

Cyril Gupta1 year ago

That's a great tip on using ollama and Hugging Face! 🤖 I'm curious, have you tried running LLMs on a Mac or Windows machine, or is a Linux setup recommended for optimal performance? 🤔

CodeRabbit1 year ago

AI-first pull request reviewer with context-aware feedback, line-by-line code suggestions, and real-time chat.

Jesse Jr Lim (ハゲ殿)💩1 year ago

theres anotherway download @lmstudio install and thats it.

Sal1 year ago

How to run LLMs locally and train them in 10 seconds: - Reach - Scroll down dew inches - Upload a PDF - Search for a keyword - Download an LLM (start with the smallest) - Start to Chat...

Otter Respect1 year ago

Broooo, juste get a Mac and download @lmstudio it’s like 100x faster and efficient…

Ben McNeill1 year ago

What is the name of this video editing style?

Nawaz Haider — e/acc1 year ago

@abidlabs Ollama supremacy

Data & Analytics1 year ago

@huggingface @huggingface, looks like Dylan’s got a quick guide to running LLMs. You think it’ll actually be that easy? 🧐

Abu1 year ago

@huggingface running llms locally sounds like a fun project! anyone tried that yet?

Aritra Roy Gosthipaty1 year ago

NGL the "Rule of 👍" got me.

Related Videos

How to Run LLMs Locally

How to Run LLMs Locally

Bytebytego

36,053 views • 2 months ago

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Shubham Saboo

33,551 views • 1 year ago

Run OpenClaw locally with ollama 🦙 – Open source models: MiniMax, Qwen, Kimi and more – One click install on macOS and Windows – Local & cloud Ollama models connected atomicbot.ai where llamas meet claws 🦞

Run OpenClaw locally with ollama 🦙 – Open source models: MiniMax, Qwen, Kimi and more – One click install on macOS and Windows – Local & cloud Ollama models connected atomicbot.ai where llamas meet claws 🦞

atomicbot.ai

59,661 views • 4 months ago

How to Edit Faceless Youtube Documentary On Phone Using CapCut (FREE + BEGINNER FRIENDLY)

How to Edit Faceless Youtube Documentary On Phone Using CapCut (FREE + BEGINNER FRIENDLY)

Tryahd

11,888 views • 1 month ago

How do LLMs actually work? 🧠 Watch our video below and understand LLMs in 1 minute 👇

How do LLMs actually work? 🧠 Watch our video below and understand LLMs in 1 minute 👇

ChainGPT

47,819 views • 9 months ago

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin

ollama

117,570 views • 6 months ago

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.

sabesh 📟

31,497 views • 2 months ago

I always wondered which Ollama model my machine could run properly. Now you can easily do that using llms-checker It's a CLI tool that checks your system specs and recommends the best models to run on Ollama based on what your machine npm install -g llm-checker

I always wondered which Ollama model my machine could run properly. Now you can easily do that using llms-checker It's a CLI tool that checks your system specs and recommends the best models to run on Ollama based on what your machine npm install -g llm-checker

Jaydeep

112,309 views • 5 months ago

Today, we're building a Streamlit app to compare Alibaba's latest Qwen 3 against DeepSeek-R1 using RAG. Here's our tool stack: - @Llama_Index workflows for orchestration. - Comet Opik for evaluation. - ollama to serve both LLMs locally. Let's begin!

Today, we're building a Streamlit app to compare Alibaba's latest Qwen 3 against DeepSeek-R1 using RAG. Here's our tool stack: - @Llama_Index workflows for orchestration. - Comet Opik for evaluation. - ollama to serve both LLMs locally. Let's begin!

Avi Chawla

15,473 views • 1 year ago

Deepseek running locally and privately for autocompletion in VSCode! 🙌 In less than a minute, I'll show you how to download Deepseek-coder and set it as the autocompletion model in VSCode. You’ll need to use ollama to download the model and CodeGPT to select it as the autocompletion model. Enjoy the best models running locally with :)

Deepseek running locally and privately for autocompletion in VSCode! 🙌 In less than a minute, I'll show you how to download Deepseek-coder and set it as the autocompletion model in VSCode. You’ll need to use ollama to download the model and CodeGPT to select it as the autocompletion model. Enjoy the best models running locally with :)

Daniel San

991,969 views • 1 year ago

Letta Code can now run **fully locally** with an embedded server - no login or Docker required Memory is stored locally, but can be synced to GitHub with `/memory-repository` Now includes builtin support for local LLMs (ollama LM Studio) through pi-ai from Mario Zechner

Letta Code can now run fully locally with an embedded server - no login or Docker required Memory is stored locally, but can be synced to GitHub with `/memory-repository` Now includes builtin support for local LLMs (ollama LM Studio) through pi-ai from Mario Zechner

Letta

20,614 views • 2 months ago

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

Avthar

34,261 views • 1 year ago

Create datasets, run evals, and even train models directly in Cursor with the Hugging Face plugin. Here's Ben Burtenshaw to show you how:

Create datasets, run evals, and even train models directly in Cursor with the Hugging Face plugin. Here's Ben Burtenshaw to show you how:

edwin

17,119 views • 5 months ago

🚀 Introducing **Replit Learn:** — free beginner-friendly lessons to build real apps. Zero coding required. Kick off with **AI Foundations:** what apps *really* are, how LLMs think, and the vibe coding workflow. Get started today:

🚀 Introducing Replit Learn: — free beginner-friendly lessons to build real apps. Zero coding required. Kick off with AI Foundations: what apps really are, how LLMs think, and the vibe coding workflow. Get started today:

Replit ⠕

45,357 views • 8 months ago

Open Interpreter's new release looks great for locally running LLMs The tool lets LLMs run code (Python, Javascript, Shell, and more) locally. You can chat with Open Interpreter through a ChatGPT-like interface in your terminal by running $ interpreter after installing. Just do `pip install open-interpreter` and then just run `- interpreter --local` sets up fast, local LLMs. Congrats killian 👏

Open Interpreter's new release looks great for locally running LLMs The tool lets LLMs run code (Python, Javascript, Shell, and more) locally. You can chat with Open Interpreter through a ChatGPT-like interface in your terminal by running $ interpreter after installing. Just do `pip install open-interpreter` and then just run `- interpreter --local` sets up fast, local LLMs. Congrats killian 👏

Rohan Paul

154,697 views • 2 years ago

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇

Xenova

64,560 views • 1 year ago

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Daniel San

584,100 views • 1 year ago