Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

How to Run LLMs Locally

Bytebytego

136,243 subscribers

41,657 views • 3 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

3 Comments

Bob Welton 🤖3 months ago

When would you pick Unsloth Studio or Lemonade for AMD ?

Ce Ce | AI & Systems Infra27 days ago

local setups kill the rate limit problem completely

Darshan Rughani1 month ago

Would be interesting to know how you did the visualisation using AI

Related Videos

How to run LLMs locally in 1 minute [beginner-friendly] using ollama 🦙 and hugging face 🤗

How to run LLMs locally in 1 minute [beginner-friendly] using ollama 🦙 and hugging face 🤗

dylan

27,390 views • 1 year ago

See how #IntelCoreUltra Series 3 helps users run larger LLMs locally and enhances the capabilities of Intel AI Super Builder. Dr. Ivy Zhu tells us more from #CES2026.

See how #IntelCoreUltra Series 3 helps users run larger LLMs locally and enhances the capabilities of Intel AI Super Builder. Dr. Ivy Zhu tells us more from #CES2026.

Intel

24,001 views • 8 months ago

Open Interpreter's new release looks great for locally running LLMs The tool lets LLMs run code (Python, Javascript, Shell, and more) locally. You can chat with Open Interpreter through a ChatGPT-like interface in your terminal by running $ interpreter after installing. Just do `pip install open-interpreter` and then just run `- interpreter --local` sets up fast, local LLMs. Congrats killian 👏

Open Interpreter's new release looks great for locally running LLMs The tool lets LLMs run code (Python, Javascript, Shell, and more) locally. You can chat with Open Interpreter through a ChatGPT-like interface in your terminal by running $ interpreter after installing. Just do `pip install open-interpreter` and then just run `- interpreter --local` sets up fast, local LLMs. Congrats killian 👏

Rohan Paul

154,697 views • 2 years ago

Tutorial on how to run DeepSeek AI locally on your PC

Tutorial on how to run DeepSeek AI locally on your PC

The Cybersecurity guy

49,092 views • 1 month ago

Letta Code can now run **fully locally** with an embedded server - no login or Docker required Memory is stored locally, but can be synced to GitHub with `/memory-repository` Now includes builtin support for local LLMs (ollama LM Studio) through pi-ai from Mario Zechner

Letta Code can now run fully locally with an embedded server - no login or Docker required Memory is stored locally, but can be synced to GitHub with `/memory-repository` Now includes builtin support for local LLMs (ollama LM Studio) through pi-ai from Mario Zechner

Letta

20,614 views • 4 months ago

Create and run LLMs locally? You can do it with #IntelCoreUltra Series 3 plus Intel AI Super Builder version 2.7, both released at #CES2026. Check out how we’re fine-tuning Intel AI Super Builder for use on our new processors.

Create and run LLMs locally? You can do it with #IntelCoreUltra Series 3 plus Intel AI Super Builder version 2.7, both released at #CES2026. Check out how we’re fine-tuning Intel AI Super Builder for use on our new processors.

Intel

14,635 views • 7 months ago

How to locally restore headlights.

How to locally restore headlights.

LMD (Arc.)

126,304 views • 4 months ago

There’s no better time to run your ai model locally than now

There’s no better time to run your ai model locally than now

Ola Ξlixir

15,740 views • 3 months ago

Sam Altman says the goal is to run a GPT-5 quality model locally on a single device We don't know how to do it yet, but the recent efficiency gains were also once thought impossible The vision is a new computer form factor for the AI era: "it should run locally... if you want it to"

Sam Altman says the goal is to run a GPT-5 quality model locally on a single device We don't know how to do it yet, but the recent efficiency gains were also once thought impossible The vision is a new computer form factor for the AI era: "it should run locally... if you want it to"

Haider.

197,408 views • 10 months ago

finetuning LLMs will never be the same! Unsloth just launched an open-source web UI to run and fine-tune 500+ LLMs without writing any code. key features - run models locally on Mac, Windows, Linux - train 500+ models 2x faster with 70% less VRAM - supports GGUF, vision, audio, embedding models - auto-create datasets from PDF, CSV, DOCX - self-healing tool calling and code execution - compare models side by side + export to GGUF to get started, I've shared links in the next tweet.

finetuning LLMs will never be the same! Unsloth just launched an open-source web UI to run and fine-tune 500+ LLMs without writing any code. key features - run models locally on Mac, Windows, Linux - train 500+ models 2x faster with 70% less VRAM - supports GGUF, vision, audio, embedding models - auto-create datasets from PDF, CSV, DOCX - self-healing tool calling and code execution - compare models side by side + export to GGUF to get started, I've shared links in the next tweet.

Akshay 🚀

45,225 views • 6 months ago

“I would encourage people… to act locally and to run for local offices.” -Thomas Massie

“I would encourage people… to act locally and to run for local offices.” -Thomas Massie

Hapatarian

36,494 views • 3 months ago

Still running the "deaf and blind" #OpenClaw on a Mac mini? #PicoClaw turns #MaixCAM2 into your pocket personal assistant with multimodal #vision and #voice support! In fact, MaixCAM2 can even run LLMs/VLMs locally—no more privacy anxiety!

Still running the "deaf and blind" #OpenClaw on a Mac mini? #PicoClaw turns #MaixCAM2 into your pocket personal assistant with multimodal #vision and #voice support! In fact, MaixCAM2 can even run LLMs/VLMs locally—no more privacy anxiety!

Sipeed

37,147 views • 6 months ago

The AYN Thor can run fallout 4 locally!?!!??!?

The AYN Thor can run fallout 4 locally!?!!??!?

CEO of Antifa

1,469,499 views • 8 months ago

How LLMs actually work:

How LLMs actually work:

Hugging Models

419,789 views • 8 months ago

LLMs like RedPajama are embracing open permissive license. What does it mean for us? Could they become our personal friends, and will they shape a unique market? Now RedPajama-3B can run locally on phones, browsers and laptops with hardware acceleration!

LLMs like RedPajama are embracing open permissive license. What does it mean for us? Could they become our personal friends, and will they shape a unique market? Now RedPajama-3B can run locally on phones, browsers and laptops with hardware acceleration!

Junru Shao

43,541 views • 3 years ago