正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

How to run LLMs locally in 1 minute [beginner-friendly] using ollama 🦙 and hugging face 🤗

dylan

9,842 subscribers

27,390 次观看 • 1 年前 •via X (Twitter)

科学技术教育

Anya Rossi• Live Now

Private livecam show

10 条评论

Cyril Gupta 的头像

Cyril Gupta1 年前

That's a great tip on using ollama and Hugging Face! 🤖 I'm curious, have you tried running LLMs on a Mac or Windows machine, or is a Linux setup recommended for optimal performance? 🤔

CodeRabbit 的头像

CodeRabbit1 年前

AI-first pull request reviewer with context-aware feedback, line-by-line code suggestions, and real-time chat.

Jesse Jr Lim (ハゲ殿)💩 的头像

Jesse Jr Lim (ハゲ殿)💩1 年前

theres anotherway download @lmstudio install and thats it.

Sal 的头像

Sal1 年前

How to run LLMs locally and train them in 10 seconds: - Reach - Scroll down dew inches - Upload a PDF - Search for a keyword - Download an LLM (start with the smallest) - Start to Chat...

Otter Respect 的头像

Otter Respect1 年前

Broooo, juste get a Mac and download @lmstudio it’s like 100x faster and efficient…

Ben McNeill 的头像

Ben McNeill1 年前

What is the name of this video editing style?

Nawaz Haider — e/acc 的头像

Nawaz Haider — e/acc1 年前

@abidlabs Ollama supremacy

Data & Analytics 的头像

Data & Analytics1 年前

@huggingface @huggingface, looks like Dylan’s got a quick guide to running LLMs. You think it’ll actually be that easy? 🧐

Abu 的头像

Abu1 年前

@huggingface running llms locally sounds like a fun project! anyone tried that yet?

Aritra Roy Gosthipaty 的头像

Aritra Roy Gosthipaty1 年前

NGL the "Rule of 👍" got me.

相关视频

How to Run LLMs Locally

How to Run LLMs Locally

Bytebytego

36,053 次观看 • 2 个月前

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Shubham Saboo

33,551 次观看 • 1 年前

Run OpenClaw locally with ollama 🦙 – Open source models: MiniMax, Qwen, Kimi and more – One click install on macOS and Windows – Local & cloud Ollama models connected atomicbot.ai where llamas meet claws 🦞

Run OpenClaw locally with ollama 🦙 – Open source models: MiniMax, Qwen, Kimi and more – One click install on macOS and Windows – Local & cloud Ollama models connected atomicbot.ai where llamas meet claws 🦞

atomicbot.ai

59,661 次观看 • 4 个月前

How to Edit Faceless Youtube Documentary On Phone Using CapCut (FREE + BEGINNER FRIENDLY)

How to Edit Faceless Youtube Documentary On Phone Using CapCut (FREE + BEGINNER FRIENDLY)

Tryahd

11,888 次观看 • 1 个月前

How do LLMs actually work? 🧠 Watch our video below and understand LLMs in 1 minute 👇

How do LLMs actually work? 🧠 Watch our video below and understand LLMs in 1 minute 👇

ChainGPT

47,819 次观看 • 9 个月前

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin

ollama

117,570 次观看 • 6 个月前

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.

sabesh 📟

31,497 次观看 • 2 个月前

I always wondered which Ollama model my machine could run properly. Now you can easily do that using llms-checker It's a CLI tool that checks your system specs and recommends the best models to run on Ollama based on what your machine npm install -g llm-checker

I always wondered which Ollama model my machine could run properly. Now you can easily do that using llms-checker It's a CLI tool that checks your system specs and recommends the best models to run on Ollama based on what your machine npm install -g llm-checker

Jaydeep

112,385 次观看 • 6 个月前

Today, we're building a Streamlit app to compare Alibaba's latest Qwen 3 against DeepSeek-R1 using RAG. Here's our tool stack: - @Llama_Index workflows for orchestration. - Comet Opik for evaluation. - ollama to serve both LLMs locally. Let's begin!

Today, we're building a Streamlit app to compare Alibaba's latest Qwen 3 against DeepSeek-R1 using RAG. Here's our tool stack: - @Llama_Index workflows for orchestration. - Comet Opik for evaluation. - ollama to serve both LLMs locally. Let's begin!

Avi Chawla

15,473 次观看 • 1 年前

Deepseek running locally and privately for autocompletion in VSCode! 🙌 In less than a minute, I'll show you how to download Deepseek-coder and set it as the autocompletion model in VSCode. You’ll need to use ollama to download the model and CodeGPT to select it as the autocompletion model. Enjoy the best models running locally with :)

Deepseek running locally and privately for autocompletion in VSCode! 🙌 In less than a minute, I'll show you how to download Deepseek-coder and set it as the autocompletion model in VSCode. You’ll need to use ollama to download the model and CodeGPT to select it as the autocompletion model. Enjoy the best models running locally with :)

Daniel San

991,969 次观看 • 1 年前

Letta Code can now run **fully locally** with an embedded server - no login or Docker required Memory is stored locally, but can be synced to GitHub with `/memory-repository` Now includes builtin support for local LLMs (ollama LM Studio) through pi-ai from Mario Zechner

Letta Code can now run fully locally with an embedded server - no login or Docker required Memory is stored locally, but can be synced to GitHub with `/memory-repository` Now includes builtin support for local LLMs (ollama LM Studio) through pi-ai from Mario Zechner

Letta

20,614 次观看 • 2 个月前

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

Avthar

34,261 次观看 • 1 年前

Create datasets, run evals, and even train models directly in Cursor with the Hugging Face plugin. Here's Ben Burtenshaw to show you how:

Create datasets, run evals, and even train models directly in Cursor with the Hugging Face plugin. Here's Ben Burtenshaw to show you how:

edwin

17,119 次观看 • 5 个月前

🚀 Introducing **Replit Learn:** — free beginner-friendly lessons to build real apps. Zero coding required. Kick off with **AI Foundations:** what apps *really* are, how LLMs think, and the vibe coding workflow. Get started today:

🚀 Introducing Replit Learn: — free beginner-friendly lessons to build real apps. Zero coding required. Kick off with AI Foundations: what apps really are, how LLMs think, and the vibe coding workflow. Get started today:

Replit ⠕

45,357 次观看 • 8 个月前

Open Interpreter's new release looks great for locally running LLMs The tool lets LLMs run code (Python, Javascript, Shell, and more) locally. You can chat with Open Interpreter through a ChatGPT-like interface in your terminal by running $ interpreter after installing. Just do `pip install open-interpreter` and then just run `- interpreter --local` sets up fast, local LLMs. Congrats killian 👏

Open Interpreter's new release looks great for locally running LLMs The tool lets LLMs run code (Python, Javascript, Shell, and more) locally. You can chat with Open Interpreter through a ChatGPT-like interface in your terminal by running $ interpreter after installing. Just do `pip install open-interpreter` and then just run `- interpreter --local` sets up fast, local LLMs. Congrats killian 👏

Rohan Paul

154,697 次观看 • 2 年前

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇

Xenova

64,560 次观看 • 1 年前

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Daniel San

584,100 次观看 • 1 年前