Загрузка видео...

Не удалось загрузить видео

На главную

I'm getting there folks... Playing with bigger opensource models and getting Sonnet-ish replies within my OpenClaw🦞 for 'free'🔥 Loaded up Qwen3.5-397b-a17b on the mac studio and after learning about MLX and LM studio for a day & finally got it working 🤓

jessegenet's profile picture

Jesse Genet

57,695 subscribers

56,928 просмотров • 2 месяцев назад •via X (Twitter)

ОбразованиеНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.
0:53

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.

Patrick J Kennedy

73,547 просмотров • 4 месяцев назад

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.
1:39

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.

sabesh 📟

30,332 просмотров • 1 месяц назад

🎊 Kudos to the teams at Qwen on the launch of Qwen 3.5 with Qwen3.5-397B-A17B. 🙌 Developers can start building today for free: Or download and customize it with NVIDIA NeMo:
0:49

🎊 Kudos to the teams at Qwen on the launch of Qwen 3.5 with Qwen3.5-397B-A17B. 🙌 Developers can start building today for free: Or download and customize it with NVIDIA NeMo:

NVIDIA AI Developer

26,904 просмотров • 4 месяцев назад

I'm so in love with antirez' ds4. Patched some slop on it to get better streaming, but I can just install a pi extension on a 128GB mac and it manages everything for me. No need for mlx-lm, ollama or lm studio or finagling pi configs.
1:33

I'm so in love with antirez' ds4. Patched some slop on it to get better streaming, but I can just install a pi extension on a 128GB mac and it manages everything for me. No need for mlx-lm, ollama or lm studio or finagling pi configs.

Armin Ronacher ⇌

56,139 просмотров • 1 месяц назад

It’s happened. Mac Studio is here. Gemma 4 31b Google DeepMind installed, chatting with my main OpenClaw🦞 for $0 in token expenses now... I've burned $5-6k on tokens on my crazy ideas over past few months, so this mac studio should pencil out for me within 3 months or so 🤓
2:58

It’s happened. Mac Studio is here. Gemma 4 31b Google DeepMind installed, chatting with my main OpenClaw🦞 for $0 in token expenses now... I've burned $5-6k on tokens on my crazy ideas over past few months, so this mac studio should pencil out for me within 3 months or so 🤓

Jesse Genet

849,656 просмотров • 2 месяцев назад

Running Qwen3.5-397B-A17B (4bit quants, 177 GB) on two DGX Sparks using llama.cpp with RPC and RDMA:
0:32

Running Qwen3.5-397B-A17B (4bit quants, 177 GB) on two DGX Sparks using llama.cpp with RPC and RDMA:

Radoslav Gerganov

25,622 просмотров • 1 месяц назад

OpenCode + MLX + Qwen3.5-397B-A17B-4bit. Video is 8x, but the goal is showing that It works! This is something unimaginable just few months ago. MLX Team is pushing like crazy and M5 Ultra will do the rest 🚀
0:21

OpenCode + MLX + Qwen3.5-397B-A17B-4bit. Video is 8x, but the goal is showing that It works! This is something unimaginable just few months ago. MLX Team is pushing like crazy and M5 Ultra will do the rest 🚀

Ivan Fioravanti ᯅ

48,692 просмотров • 4 месяцев назад

My OpenClaw🦞 spawned a new OpenClaw🦞 agent on its machine AND got it talking in our comms platform without me touching the mac mini 🤯
2:00

My OpenClaw🦞 spawned a new OpenClaw🦞 agent on its machine AND got it talking in our comms platform without me touching the mac mini 🤯

Jesse Genet

21,675 просмотров • 3 месяцев назад

Real talk: it’s called the bleeding edge for a reason 🤪 Making progress on using local models within OpenClaw🦞 and dabbling with Nous Research Hermes agent, but everything takes tinkering folks!
2:34

Real talk: it’s called the bleeding edge for a reason 🤪 Making progress on using local models within OpenClaw🦞 and dabbling with Nous Research Hermes agent, but everything takes tinkering folks!

Jesse Genet

21,763 просмотров • 2 месяцев назад

Update: Qwen3.5:9b head-to-head (MLX, Apple Silicon optimized) Mac Studio M2 Ultra: 89.74 tok/s Mac Mini M4: 20.82 tok/s MLX basically doubles the speed on both machines.
1:02

Update: Qwen3.5:9b head-to-head (MLX, Apple Silicon optimized) Mac Studio M2 Ultra: 89.74 tok/s Mac Mini M4: 20.82 tok/s MLX basically doubles the speed on both machines.

stevibe

134,256 просмотров • 3 месяцев назад

Interested in making Windows even less secure? You can run OpenClaw🦞 locally on Framework Desktop using LM Studio and AI at AMD and give it full control over your life!
0:25

Interested in making Windows even less secure? You can run OpenClaw🦞 locally on Framework Desktop using LM Studio and AI at AMD and give it full control over your life!

Framework

83,104 просмотров • 4 месяцев назад

LM Studio - Hugging Face Model Manager! My personal gift and sign of love for Hugging Face and LM Studio 🫶🏻 A simple script to import models from HF Cache to LM Studio without using additional space 😎 just using symbolic links! Have fun!
0:36

LM Studio - Hugging Face Model Manager! My personal gift and sign of love for Hugging Face and LM Studio 🫶🏻 A simple script to import models from HF Cache to LM Studio without using additional space 😎 just using symbolic links! Have fun!

Ivan Fioravanti ᯅ

14,844 просмотров • 1 год назад

Qwen3.5-397B-A17B with Vision running on a Single M3 Ultra 🚀 Shout out to the Qwen team because they cooked with this model! Get started today: > uv pip install -U mlx-vlm Model collection 👇🏽 Repo:
0:59

Qwen3.5-397B-A17B with Vision running on a Single M3 Ultra 🚀 Shout out to the Qwen team because they cooked with this model! Get started today: > uv pip install -U mlx-vlm Model collection 👇🏽 Repo:

Prince Canuma

11,386 просмотров • 4 месяцев назад

CINEMA STUDIO IS EVERYWHERE. And now you can try it FREE. Cinema Studio + Relight + Shots - UP TO 110 FREE generations in one bundle. Studio-level power. Finally democratized. For 9 hours: retweet & reply & like & follow for 220 creds
0:24

CINEMA STUDIO IS EVERYWHERE. And now you can try it FREE. Cinema Studio + Relight + Shots - UP TO 110 FREE generations in one bundle. Studio-level power. Finally democratized. For 9 hours: retweet & reply & like & follow for 220 creds

Higgsfield AI 🧩

75,126 просмотров • 5 месяцев назад

Day 4 of OpenClaw 🦞 I hired my 7th AI employee today!! Claude Code is running on my MacBook nonstop, while my AI company is working for me 24/7 on my Mac mini. THIS IS TRULY THE FUTURE. My entire startup costs only $250/mo, and we are just getting started. I will start making entire departments soon with Jarvis!! ⚡️
3:58

Day 4 of OpenClaw 🦞 I hired my 7th AI employee today!! Claude Code is running on my MacBook nonstop, while my AI company is working for me 24/7 on my Mac mini. THIS IS TRULY THE FUTURE. My entire startup costs only $250/mo, and we are just getting started. I will start making entire departments soon with Jarvis!! ⚡️

Vadim

764,452 просмотров • 4 месяцев назад

Finally getting the studio back up and running. Tracks coming soon. This guitar is an indispensable part of my studio. This is a wicked cool 1959 Danelectro. 😎
2:00

Finally getting the studio back up and running. Tracks coming soon. This guitar is an indispensable part of my studio. This is a wicked cool 1959 Danelectro. 😎

Iraqveteran8888

13,553 просмотров • 11 месяцев назад

Here is a real-life run, end-to-end from training to using the trained LLM in LM Studio by LM Studio MLX-LoRA-Studio gives you a user friendly, extremely customisable training interface for fine-tuning and training LLMs. Its a MacOS native app, front- and backend. Will be releasing the App in the coming days. GH Repo:
4:41

Here is a real-life run, end-to-end from training to using the trained LLM in LM Studio by LM Studio MLX-LoRA-Studio gives you a user friendly, extremely customisable training interface for fine-tuning and training LLMs. Its a MacOS native app, front- and backend. Will be releasing the App in the coming days. GH Repo:

Gökdeniz Gülmez

11,226 просмотров • 10 дней назад

Extending on Dan Woods (and Claude's) repo I managed to get Qwen3.5-397B-A17B-4bit (224GB) running comfortably on my new M5 Max Laptop. Shout out to Carsen Klock's MacTop too. Over 10 Tok/sec!!!
0:28

Extending on Dan Woods (and Claude's) repo I managed to get Qwen3.5-397B-A17B-4bit (224GB) running comfortably on my new M5 Max Laptop. Shout out to Carsen Klock's MacTop too. Over 10 Tok/sec!!!

John T Davies 🇪🇺

17,807 просмотров • 3 месяцев назад

thanks for getting PPF ep2 to a million views!! if you're interested, i put up the project files, Clip Studio Paint and Flash animation files, early rough storyboards and animatic versions, other doodles and more up for a dollar on the usual site, link in the replies:
0:39

thanks for getting PPF ep2 to a million views!! if you're interested, i put up the project files, Clip Studio Paint and Flash animation files, early rough storyboards and animatic versions, other doodles and more up for a dollar on the usual site, link in the replies:

🤠

1,139,185 просмотров • 2 лет назад