Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

I'm getting there folks... Playing with bigger opensource models and getting Sonnet-ish replies within my OpenClaw🦞 for 'free'🔥 Loaded up Qwen3.5-397b-a17b on the mac studio and after learning about MLX and LM studio for a day & finally got it working 🤓

jessegenet's profile picture

Jesse Genet

57,695 subscribers

56,928 görüntüleme • 2 ay önce •via X (Twitter)

EğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.
0:53

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.

Patrick J Kennedy

73,547 görüntüleme • 4 ay önce

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.
1:39

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.

sabesh 📟

30,332 görüntüleme • 1 ay önce

🎊 Kudos to the teams at Qwen on the launch of Qwen 3.5 with Qwen3.5-397B-A17B. 🙌 Developers can start building today for free: Or download and customize it with NVIDIA NeMo:
0:49

🎊 Kudos to the teams at Qwen on the launch of Qwen 3.5 with Qwen3.5-397B-A17B. 🙌 Developers can start building today for free: Or download and customize it with NVIDIA NeMo:

NVIDIA AI Developer

26,904 görüntüleme • 4 ay önce

I'm so in love with antirez' ds4. Patched some slop on it to get better streaming, but I can just install a pi extension on a 128GB mac and it manages everything for me. No need for mlx-lm, ollama or lm studio or finagling pi configs.
1:33

I'm so in love with antirez' ds4. Patched some slop on it to get better streaming, but I can just install a pi extension on a 128GB mac and it manages everything for me. No need for mlx-lm, ollama or lm studio or finagling pi configs.

Armin Ronacher ⇌

56,139 görüntüleme • 1 ay önce

It’s happened. Mac Studio is here. Gemma 4 31b Google DeepMind installed, chatting with my main OpenClaw🦞 for $0 in token expenses now... I've burned $5-6k on tokens on my crazy ideas over past few months, so this mac studio should pencil out for me within 3 months or so 🤓
2:58

It’s happened. Mac Studio is here. Gemma 4 31b Google DeepMind installed, chatting with my main OpenClaw🦞 for $0 in token expenses now... I've burned $5-6k on tokens on my crazy ideas over past few months, so this mac studio should pencil out for me within 3 months or so 🤓

Jesse Genet

849,516 görüntüleme • 2 ay önce

Running Qwen3.5-397B-A17B (4bit quants, 177 GB) on two DGX Sparks using llama.cpp with RPC and RDMA:
0:32

Running Qwen3.5-397B-A17B (4bit quants, 177 GB) on two DGX Sparks using llama.cpp with RPC and RDMA:

Radoslav Gerganov

25,622 görüntüleme • 1 ay önce

OpenCode + MLX + Qwen3.5-397B-A17B-4bit. Video is 8x, but the goal is showing that It works! This is something unimaginable just few months ago. MLX Team is pushing like crazy and M5 Ultra will do the rest 🚀
0:21

OpenCode + MLX + Qwen3.5-397B-A17B-4bit. Video is 8x, but the goal is showing that It works! This is something unimaginable just few months ago. MLX Team is pushing like crazy and M5 Ultra will do the rest 🚀

Ivan Fioravanti ᯅ

48,692 görüntüleme • 4 ay önce

My OpenClaw🦞 spawned a new OpenClaw🦞 agent on its machine AND got it talking in our comms platform without me touching the mac mini 🤯
2:00

My OpenClaw🦞 spawned a new OpenClaw🦞 agent on its machine AND got it talking in our comms platform without me touching the mac mini 🤯

Jesse Genet

21,675 görüntüleme • 3 ay önce

Real talk: it’s called the bleeding edge for a reason 🤪 Making progress on using local models within OpenClaw🦞 and dabbling with Nous Research Hermes agent, but everything takes tinkering folks!
2:34

Real talk: it’s called the bleeding edge for a reason 🤪 Making progress on using local models within OpenClaw🦞 and dabbling with Nous Research Hermes agent, but everything takes tinkering folks!

Jesse Genet

21,763 görüntüleme • 2 ay önce

Update: Qwen3.5:9b head-to-head (MLX, Apple Silicon optimized) Mac Studio M2 Ultra: 89.74 tok/s Mac Mini M4: 20.82 tok/s MLX basically doubles the speed on both machines.
1:02

Update: Qwen3.5:9b head-to-head (MLX, Apple Silicon optimized) Mac Studio M2 Ultra: 89.74 tok/s Mac Mini M4: 20.82 tok/s MLX basically doubles the speed on both machines.

stevibe

134,256 görüntüleme • 3 ay önce

Interested in making Windows even less secure? You can run OpenClaw🦞 locally on Framework Desktop using LM Studio and AI at AMD and give it full control over your life!
0:25

Interested in making Windows even less secure? You can run OpenClaw🦞 locally on Framework Desktop using LM Studio and AI at AMD and give it full control over your life!

Framework

83,104 görüntüleme • 3 ay önce

LM Studio - Hugging Face Model Manager! My personal gift and sign of love for Hugging Face and LM Studio 🫶🏻 A simple script to import models from HF Cache to LM Studio without using additional space 😎 just using symbolic links! Have fun!
0:36

LM Studio - Hugging Face Model Manager! My personal gift and sign of love for Hugging Face and LM Studio 🫶🏻 A simple script to import models from HF Cache to LM Studio without using additional space 😎 just using symbolic links! Have fun!

Ivan Fioravanti ᯅ

14,844 görüntüleme • 1 yıl önce

Qwen3.5-397B-A17B with Vision running on a Single M3 Ultra 🚀 Shout out to the Qwen team because they cooked with this model! Get started today: > uv pip install -U mlx-vlm Model collection 👇🏽 Repo:
0:59

Qwen3.5-397B-A17B with Vision running on a Single M3 Ultra 🚀 Shout out to the Qwen team because they cooked with this model! Get started today: > uv pip install -U mlx-vlm Model collection 👇🏽 Repo:

Prince Canuma

11,386 görüntüleme • 4 ay önce

CINEMA STUDIO IS EVERYWHERE. And now you can try it FREE. Cinema Studio + Relight + Shots - UP TO 110 FREE generations in one bundle. Studio-level power. Finally democratized. For 9 hours: retweet & reply & like & follow for 220 creds
0:24

CINEMA STUDIO IS EVERYWHERE. And now you can try it FREE. Cinema Studio + Relight + Shots - UP TO 110 FREE generations in one bundle. Studio-level power. Finally democratized. For 9 hours: retweet & reply & like & follow for 220 creds

Higgsfield AI 🧩

75,126 görüntüleme • 5 ay önce

Finally getting the studio back up and running. Tracks coming soon. This guitar is an indispensable part of my studio. This is a wicked cool 1959 Danelectro. 😎
2:00

Finally getting the studio back up and running. Tracks coming soon. This guitar is an indispensable part of my studio. This is a wicked cool 1959 Danelectro. 😎

Iraqveteran8888

13,553 görüntüleme • 11 ay önce

Day 4 of OpenClaw 🦞 I hired my 7th AI employee today!! Claude Code is running on my MacBook nonstop, while my AI company is working for me 24/7 on my Mac mini. THIS IS TRULY THE FUTURE. My entire startup costs only $250/mo, and we are just getting started. I will start making entire departments soon with Jarvis!! ⚡️
3:58

Day 4 of OpenClaw 🦞 I hired my 7th AI employee today!! Claude Code is running on my MacBook nonstop, while my AI company is working for me 24/7 on my Mac mini. THIS IS TRULY THE FUTURE. My entire startup costs only $250/mo, and we are just getting started. I will start making entire departments soon with Jarvis!! ⚡️

Vadim

764,452 görüntüleme • 4 ay önce

Here is a real-life run, end-to-end from training to using the trained LLM in LM Studio by LM Studio MLX-LoRA-Studio gives you a user friendly, extremely customisable training interface for fine-tuning and training LLMs. Its a MacOS native app, front- and backend. Will be releasing the App in the coming days. GH Repo:
4:41

Here is a real-life run, end-to-end from training to using the trained LLM in LM Studio by LM Studio MLX-LoRA-Studio gives you a user friendly, extremely customisable training interface for fine-tuning and training LLMs. Its a MacOS native app, front- and backend. Will be releasing the App in the coming days. GH Repo:

Gökdeniz Gülmez

11,226 görüntüleme • 9 gün önce

thanks for getting PPF ep2 to a million views!! if you're interested, i put up the project files, Clip Studio Paint and Flash animation files, early rough storyboards and animatic versions, other doodles and more up for a dollar on the usual site, link in the replies:
0:39

thanks for getting PPF ep2 to a million views!! if you're interested, i put up the project files, Clip Studio Paint and Flash animation files, early rough storyboards and animatic versions, other doodles and more up for a dollar on the usual site, link in the replies:

🤠

1,139,185 görüntüleme • 2 yıl önce

Extending on Dan Woods (and Claude's) repo I managed to get Qwen3.5-397B-A17B-4bit (224GB) running comfortably on my new M5 Max Laptop. Shout out to Carsen Klock's MacTop too. Over 10 Tok/sec!!!
0:28

Extending on Dan Woods (and Claude's) repo I managed to get Qwen3.5-397B-A17B-4bit (224GB) running comfortably on my new M5 Max Laptop. Shout out to Carsen Klock's MacTop too. Over 10 Tok/sec!!!

John T Davies 🇪🇺

17,807 görüntüleme • 3 ay önce