Загрузка видео...
Не удалось загрузить видео
DeepSeek-R1 on Mac Studio 192GB 🪄
259,545 просмотров • 1 год назад •via X (Twitter)
Комментарии: 12

Georgi Gerganov1 год назад
The model is quantized by @UnslothAI

Solar Heavy1 год назад
- Moonlight

Unsloth AI1 год назад
Looks soo good! 🎇🐋

Daniel Nakov1 год назад
come on apple, new studio

Georgi Gerganov1 год назад
M4 studio with 256GB would be the final boss

unfazed.1 год назад
@JudeSkrr il a encore drop

Vasilii Kharitonov 🌍1 год назад
Tried R1 32B 8bit on M4 Pro with 48 GB memory (ggml-org/DeepSeek-R1-Distill-Qwen-32B-Q8_0-GGUF), seems to run great 👍 Memory usage is 43.3/48.0GB, eval time is about 7 tokens per second.

GP1 год назад
I need your cli setup 😏

Woody Lu1 год назад
Could you share the noise level (in DB) of the mac when running it locally?

Georgi Gerganov1 год назад
Not sure how to measure it. It only makes noise for very long contexts, otherwise it's completely silent. And when it makes noise, it's not really loud IMO.

Alexander Kvamme1 год назад
What profiling tool are you using? Much cleaner than htop

Georgi Gerganov1 год назад
asitop
