Загрузка видео...

Не удалось загрузить видео

На главную

Tutorial Time: Run any open-source LLM locally. Now we will run an LLM on your M1/2 Mac. And its fast. All you need is moved to: @lmstudio let's get started. Good to be back. A thread

LinusEkenstam's profile picture

Linus ✦ Ekenstam

239,661 subscribers

915,787 просмотров • 2 лет назад •via X (Twitter)

Наука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Our AI financial agent now shows its thinking Much like how Perplexity shows its tasks Here is how it works: • we have two LLMs • LLM #1 receives raw user query • LLM #1 creates tasks to answer query • LLM #2 receives these tasks • LLM #2 uses tools to execute tasks • LLM #2 streams answer to you We can add a 3rd LLM to do the last step. This would let LLM #2 focus only on task execution. I will add this in a follow-up. The code is open source so you can see how everything is done.
0:12

Our AI financial agent now shows its thinking Much like how Perplexity shows its tasks Here is how it works: • we have two LLMs • LLM #1 receives raw user query • LLM #1 creates tasks to answer query • LLM #2 receives these tasks • LLM #2 uses tools to execute tasks • LLM #2 streams answer to you We can add a 3rd LLM to do the last step. This would let LLM #2 focus only on task execution. I will add this in a follow-up. The code is open source so you can see how everything is done.

virat

19,481 просмотров • 1 год назад

⚡️Introducing Open LLM Server⚡️ Looking to run models like GPT4All or LLaMa locally, but tired of python-based UIs that are impossibly slow/clunky to install? Now with a single command you can be up and running in seconds! (Windows/Mac/Linux) Here's why this is a big deal:
0:12

⚡️Introducing Open LLM Server⚡️ Looking to run models like GPT4All or LLaMa locally, but tired of python-based UIs that are impossibly slow/clunky to install? Now with a single command you can be up and running in seconds! (Windows/Mac/Linux) Here's why this is a big deal:

dcSpark

16,499 просмотров • 3 лет назад

Chat now has an LLM tool to run notebook cells, which allows the agent to perform updates based on cell run results or perform its own data exploration.
0:17

Chat now has an LLM tool to run notebook cells, which allows the agent to perform updates based on cell run results or perform its own data exploration.

Visual Studio Code

11,429 просмотров • 1 год назад

Watch out for these LLM run accounts that will comment on your posts and then block you I block them back so they can’t comment again, but it’s impossible to block all the spambots
0:14

Watch out for these LLM run accounts that will comment on your posts and then block you I block them back so they can’t comment again, but it’s impossible to block all the spambots

Whole Mars Catalog

20,057 просмотров • 10 месяцев назад

LM Studio 0.3.4 ships with Apple MLX 🚢🍎 Run on-device LLMs super fast, 100% locally and offline on your Apple Silicon Mac! Includes: > run Llama 3.2 1B at ~250 tok/sec (!) on M3 > enforce structured JSON responses > use via chat UI, or from your own code > run multiple models simultaneously > download any model from Hugging Face Video at 1x speed.
0:19

LM Studio 0.3.4 ships with Apple MLX 🚢🍎 Run on-device LLMs super fast, 100% locally and offline on your Apple Silicon Mac! Includes: > run Llama 3.2 1B at ~250 tok/sec (!) on M3 > enforce structured JSON responses > use via chat UI, or from your own code > run multiple models simultaneously > download any model from Hugging Face Video at 1x speed.

LM Studio

171,777 просмотров • 1 год назад

private inference is live on the bankr llm gateway. select models now run inside TEEs. prompts stay encrypted in use -- private, by design. pay with any coin you’re holding. get started below.
0:15

private inference is live on the bankr llm gateway. select models now run inside TEEs. prompts stay encrypted in use -- private, by design. pay with any coin you’re holding. get started below.

Bankr

26,998 просмотров • 9 дней назад

Iterating... Evals take time and are boring: but are a fundamental validation step of sane LLM inference. Let's try to make them as easy and fun to run as possible.
0:10

Iterating... Evals take time and are boring: but are a fundamental validation step of sane LLM inference. Let's try to make them as easy and fun to run as possible.

antirez

32,727 просмотров • 1 месяц назад

every time i get an LLM on a phone call i try this, this is the first time its worked :3
0:10

every time i get an LLM on a phone call i try this, this is the first time its worked :3

maeve ~

23,121 просмотров • 6 месяцев назад

Now you can run a swarm of droids, or claudes, or codexes in parallel using the open source emdash app congrats on shipping fast Arne Strickmann (and you didn't need to raise $200m to do it 😉)
0:18

Now you can run a swarm of droids, or claudes, or codexes in parallel using the open source emdash app congrats on shipping fast Arne Strickmann (and you didn't need to raise $200m to do it 😉)

Ian Nuttall

35,523 просмотров • 9 месяцев назад

We’re thrilled to launch GPT-OSS—the 120B-parameter open-source LLM—on Phala Cloud! 🚀 🔒 Run the fully OSS model inside a secure TEE for end-to-end confidential AI. Explore the build 👉
0:13

We’re thrilled to launch GPT-OSS—the 120B-parameter open-source LLM—on Phala Cloud! 🚀 🔒 Run the fully OSS model inside a secure TEE for end-to-end confidential AI. Explore the build 👉

Phala

12,176 просмотров • 11 месяцев назад

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)
0:12

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)

Alex Cheema - e/acc

243,248 просмотров • 1 год назад

An 100% open-source rival to n8n just launched. Sim is a drag-and-drop platform for building agentic workflows that runs entirely on your local machine. → Visual, Figma-like canvas interface → Works with any local LLM via Ollama → Native MCP support to connect 100+ tools
0:13

An 100% open-source rival to n8n just launched. Sim is a drag-and-drop platform for building agentic workflows that runs entirely on your local machine. → Visual, Figma-like canvas interface → Works with any local LLM via Ollama → Native MCP support to connect 100+ tools

Oliver Prompts

77,286 просмотров • 5 месяцев назад

Unpopular opinion: Most agent evals are theatre. You run them once before the deployment. It'll take 800ms+ as another LLM would be judging your LLM. Most annoying part - no one tells where in the chain things went wrong. I wasted a lot of time in this loop. And then I came across Future AGI bringing 5 different tools under one umbrella, best part - the platform is completely open source. They open sourced their entire platform and the eval layer is noticeably different. It is multimodal - works on everything text, image, audio, pdf. Not an LLM-as-judge adding latency but an agent with memory and tools. The biggest win are learned classifiers trained on actual production failure patterns to run evals at low cost. It also runs across the full reasoning chain, not just the final response. Check out → Try it here →
0:13

Unpopular opinion: Most agent evals are theatre. You run them once before the deployment. It'll take 800ms+ as another LLM would be judging your LLM. Most annoying part - no one tells where in the chain things went wrong. I wasted a lot of time in this loop. And then I came across Future AGI bringing 5 different tools under one umbrella, best part - the platform is completely open source. They open sourced their entire platform and the eval layer is noticeably different. It is multimodal - works on everything text, image, audio, pdf. Not an LLM-as-judge adding latency but an agent with memory and tools. The biggest win are learned classifiers trained on actual production failure patterns to run evals at low cost. It also runs across the full reasoning chain, not just the final response. Check out → Try it here →

Swapna Kumar Panda

49,557 просмотров • 2 месяцев назад

Microsoft killed the GPU mafia 🤯 They finally open-sourced their 1-bit LLM inference framework called bitnet.cpp. It lets you run 100B parameter models on your local CPU without GPUs. - 6.17x faster inference - 82.2% less energy on CPUs 100% Open Source.
0:13

Microsoft killed the GPU mafia 🤯 They finally open-sourced their 1-bit LLM inference framework called bitnet.cpp. It lets you run 100B parameter models on your local CPU without GPUs. - 6.17x faster inference - 82.2% less energy on CPUs 100% Open Source.

Oliver Prompts

1,627,934 просмотров • 5 месяцев назад

fullmoon v1.2.0 is now available on the App Store so you can reason free, locally, and privately on all of your devices - adds DeepSeek-R1-Distill-Qwen-1.5B - completely free and open source - works on iPhone, iPad, Mac, and Vision
0:12

fullmoon v1.2.0 is now available on the App Store so you can reason free, locally, and privately on all of your devices - adds DeepSeek-R1-Distill-Qwen-1.5B - completely free and open source - works on iPhone, iPad, Mac, and Vision

fullmoon

36,279 просмотров • 1 год назад

Prompt “Weird dude dancing on Default Cube, pixar style”. I can set this up on any Mac computer running M1, all using Open Source apps. Almost realtime now.
0:13

Prompt “Weird dude dancing on Default Cube, pixar style”. I can set this up on any Mac computer running M1, all using Open Source apps. Almost realtime now.

BLENDER SUSHI 🫶 X - 24/7 Blenderian

33,660 просмотров • 2 лет назад

Does LLM RL post-training need to be on-policy?
0:13

Does LLM RL post-training need to be on-policy?

Kianté Brantley

113,605 просмотров • 4 месяцев назад

Let's run it back, Philly 👀 Get your tickets NOW:
0:18

Let's run it back, Philly 👀 Get your tickets NOW:

Philadelphia Eagles

64,132 просмотров • 5 дней назад

China just released a desktop automation agent that runs 100% locally. It can run any desktop app, open files, browse websites, and automate tasks without needing an internet connection. 100% Open-Source.
0:15

China just released a desktop automation agent that runs 100% locally. It can run any desktop app, open files, browse websites, and automate tasks without needing an internet connection. 100% Open-Source.

Hasan Toor

1,187,925 просмотров • 5 месяцев назад

China just released a desktop automation agent that runs 100% locally. It can run any desktop app, open files, browse websites, and automate tasks without needing an internet connection. 100% Open-Source.
0:15

China just released a desktop automation agent that runs 100% locally. It can run any desktop app, open files, browse websites, and automate tasks without needing an internet connection. 100% Open-Source.

Tulsi Soni

49,775 просмотров • 3 дней назад