Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

How to Run LLMs Locally

bytebytego's profile picture

Bytebytego

136,243 subscribers

41,657 görüntüleme • 3 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

3 Yorum

Bob Welton 🤖 profil fotoğrafı
Bob Welton 🤖3 ay önce

When would you pick Unsloth Studio or Lemonade for AMD ?

Ce Ce | AI & Systems Infra profil fotoğrafı
Ce Ce | AI & Systems Infra27 gün önce

local setups kill the rate limit problem completely

Darshan Rughani profil fotoğrafı
Darshan Rughani1 ay önce

Would be interesting to know how you did the visualisation using AI

Benzer Videolar

How to run LLMs locally in 1 minute [beginner-friendly] using ollama 🦙 and hugging face 🤗
0:58

How to run LLMs locally in 1 minute [beginner-friendly] using ollama 🦙 and hugging face 🤗

dylan

27,390 görüntüleme • 1 yıl önce

See how #IntelCoreUltra Series 3 helps users run larger LLMs locally and enhances the capabilities of Intel AI Super Builder. Dr. Ivy Zhu tells us more from #CES2026.
1:04

See how #IntelCoreUltra Series 3 helps users run larger LLMs locally and enhances the capabilities of Intel AI Super Builder. Dr. Ivy Zhu tells us more from #CES2026.

Intel

24,001 görüntüleme • 8 ay önce

Open Interpreter's new release looks great for locally running LLMs The tool lets LLMs run code (Python, Javascript, Shell, and more) locally. You can chat with Open Interpreter through a ChatGPT-like interface in your terminal by running $ interpreter after installing. Just do `pip install open-interpreter` and then just run `- interpreter --local` sets up fast, local LLMs. Congrats killian 👏
1:23

Open Interpreter's new release looks great for locally running LLMs The tool lets LLMs run code (Python, Javascript, Shell, and more) locally. You can chat with Open Interpreter through a ChatGPT-like interface in your terminal by running $ interpreter after installing. Just do `pip install open-interpreter` and then just run `- interpreter --local` sets up fast, local LLMs. Congrats killian 👏

Rohan Paul

154,697 görüntüleme • 2 yıl önce

Tutorial on how to run DeepSeek AI locally on your PC
4:04

Tutorial on how to run DeepSeek AI locally on your PC

The Cybersecurity guy

49,092 görüntüleme • 1 ay önce

Letta Code can now run **fully locally** with an embedded server - no login or Docker required Memory is stored locally, but can be synced to GitHub with `/memory-repository` Now includes builtin support for local LLMs (ollama LM Studio) through pi-ai from Mario Zechner
0:34

Letta Code can now run **fully locally** with an embedded server - no login or Docker required Memory is stored locally, but can be synced to GitHub with `/memory-repository` Now includes builtin support for local LLMs (ollama LM Studio) through pi-ai from Mario Zechner

Letta

20,614 görüntüleme • 4 ay önce

Create and run LLMs locally? You can do it with #IntelCoreUltra Series 3 plus Intel AI Super Builder version 2.7, both released at #CES2026. Check out how we’re fine-tuning Intel AI Super Builder for use on our new processors.
0:37

Create and run LLMs locally? You can do it with #IntelCoreUltra Series 3 plus Intel AI Super Builder version 2.7, both released at #CES2026. Check out how we’re fine-tuning Intel AI Super Builder for use on our new processors.

Intel

14,635 görüntüleme • 7 ay önce

How to locally restore headlights.
4:53

How to locally restore headlights.

LMD (Arc.)

126,304 görüntüleme • 4 ay önce

There’s no better time to run your ai model locally than now
0:49

There’s no better time to run your ai model locally than now

Ola Ξlixir

15,740 görüntüleme • 3 ay önce

Sam Altman says the goal is to run a GPT-5 quality model locally on a single device We don't know how to do it yet, but the recent efficiency gains were also once thought impossible The vision is a new computer form factor for the AI era: "it should run locally... if you want it to"
0:47

Sam Altman says the goal is to run a GPT-5 quality model locally on a single device We don't know how to do it yet, but the recent efficiency gains were also once thought impossible The vision is a new computer form factor for the AI era: "it should run locally... if you want it to"

Haider.

197,408 görüntüleme • 10 ay önce

finetuning LLMs will never be the same! Unsloth just launched an open-source web UI to run and fine-tune 500+ LLMs without writing any code. key features - run models locally on Mac, Windows, Linux - train 500+ models 2x faster with 70% less VRAM - supports GGUF, vision, audio, embedding models - auto-create datasets from PDF, CSV, DOCX - self-healing tool calling and code execution - compare models side by side + export to GGUF to get started, I've shared links in the next tweet.
0:38

finetuning LLMs will never be the same! Unsloth just launched an open-source web UI to run and fine-tune 500+ LLMs without writing any code. key features - run models locally on Mac, Windows, Linux - train 500+ models 2x faster with 70% less VRAM - supports GGUF, vision, audio, embedding models - auto-create datasets from PDF, CSV, DOCX - self-healing tool calling and code execution - compare models side by side + export to GGUF to get started, I've shared links in the next tweet.

Akshay 🚀

45,225 görüntüleme • 6 ay önce

“I would encourage people… to act locally and to run for local offices.” -Thomas Massie
0:23

“I would encourage people… to act locally and to run for local offices.” -Thomas Massie

Hapatarian

36,494 görüntüleme • 3 ay önce

Still running the "deaf and blind" #OpenClaw on a Mac mini? #PicoClaw turns #MaixCAM2 into your pocket personal assistant with multimodal #vision and #voice support! In fact, MaixCAM2 can even run LLMs/VLMs locally—no more privacy anxiety!
0:27

Still running the "deaf and blind" #OpenClaw on a Mac mini? #PicoClaw turns #MaixCAM2 into your pocket personal assistant with multimodal #vision and #voice support! In fact, MaixCAM2 can even run LLMs/VLMs locally—no more privacy anxiety!

Sipeed

37,147 görüntüleme • 6 ay önce

The AYN Thor can run fallout 4 locally!?!!??!?
0:55

The AYN Thor can run fallout 4 locally!?!!??!?

CEO of Antifa

1,469,499 görüntüleme • 8 ay önce

How LLMs actually work:
2:12

How LLMs actually work:

Hugging Models

419,789 görüntüleme • 8 ay önce

LLMs like RedPajama are embracing open permissive license. What does it mean for us? Could they become our personal friends, and will they shape a unique market? Now RedPajama-3B can run locally on phones, browsers and laptops with hardware acceleration!
0:20

LLMs like RedPajama are embracing open permissive license. What does it mean for us? Could they become our personal friends, and will they shape a unique market? Now RedPajama-3B can run locally on phones, browsers and laptops with hardware acceleration!

Junru Shao

43,541 görüntüleme • 3 yıl önce