正在加载视频...

视频加载失败

返回首页

DeepSeek-R1 on Mac Studio 192GB 🪄

ggerganov's profile picture

Georgi Gerganov

59,308 subscribers

259,545 次观看 • 1 年前 •via X (Twitter)

科学技术
LIVE

Anya Rossi• Live Now

Private livecam show

12 条评论

Georgi Gerganov 的头像
Georgi Gerganov1 年前

The model is quantized by @UnslothAI

Solar Heavy 的头像
Solar Heavy1 年前

- Moonlight

Unsloth AI 的头像
Unsloth AI1 年前

Looks soo good! 🎇🐋

Daniel Nakov 的头像
Daniel Nakov1 年前

come on apple, new studio

Georgi Gerganov 的头像
Georgi Gerganov1 年前

M4 studio with 256GB would be the final boss

unfazed. 的头像
unfazed.1 年前

@JudeSkrr il a encore drop

Vasilii Kharitonov 🌍 的头像
Vasilii Kharitonov 🌍1 年前

Tried R1 32B 8bit on M4 Pro with 48 GB memory (ggml-org/DeepSeek-R1-Distill-Qwen-32B-Q8_0-GGUF), seems to run great 👍 Memory usage is 43.3/48.0GB, eval time is about 7 tokens per second.

GP 的头像
GP1 年前

I need your cli setup 😏

Woody Lu 的头像
Woody Lu1 年前

Could you share the noise level (in DB) of the mac when running it locally?

Georgi Gerganov 的头像
Georgi Gerganov1 年前

Not sure how to measure it. It only makes noise for very long contexts, otherwise it's completely silent. And when it makes noise, it's not really loud IMO.

Alexander Kvamme 的头像
Alexander Kvamme1 年前

What profiling tool are you using? Much cleaner than htop

Georgi Gerganov 的头像
Georgi Gerganov1 年前

asitop

相关视频

we just added an early preview of DeepSeek-R1 to the fullmoon TestFlight you can use it on iPhone, iPad, Mac, and Vision
0:20

we just added an early preview of DeepSeek-R1 to the fullmoon TestFlight you can use it on iPhone, iPad, Mac, and Vision

Jordan Singer

52,763 次观看 • 1 年前

DeepSeek R1 + FactSet = Financial Research on Steroids
0:34

DeepSeek R1 + FactSet = Financial Research on Steroids

Aravind Srinivas

582,222 次观看 • 1 年前

DeepSeek R1 is now active on FluxAI.
0:49

DeepSeek R1 is now active on FluxAI.

Daniel Keller

23,528 次观看 • 1 年前

OpenAI's nightmare: DeepSeek R1 on a Raspberry Pi
4:17

OpenAI's nightmare: DeepSeek R1 on a Raspberry Pi

Jeff Geerling

23,725 次观看 • 1 年前

o3-mini-high (left) vs. deepseek-r1 (right) results from the first try deepseek-r1 is cracked... wtf!
0:30

o3-mini-high (left) vs. deepseek-r1 (right) results from the first try deepseek-r1 is cracked... wtf!

elvis

719,808 次观看 • 1 年前

Watch DeepSeek-R1 (8B) "think" in realtime on a regular computer.
1:43

Watch DeepSeek-R1 (8B) "think" in realtime on a regular computer.

Vincent Kennedy

43,351 次观看 • 1 年前

🚨 DeepSeek just dropped DeepSeek R1-0528 and it's INSANE for coding Built an entire game with Nebius Studio in three turn. The improvement from previous versions is wild. - API access available - Safe to use If this is R1... DeepSeek R2 is going to be absolutely nuts. How to access 👇 1/3
0:44

🚨 DeepSeek just dropped DeepSeek R1-0528 and it's INSANE for coding Built an entire game with Nebius Studio in three turn. The improvement from previous versions is wild. - API access available - Safe to use If this is R1... DeepSeek R2 is going to be absolutely nuts. How to access 👇 1/3

AshutoshShrivastava

61,058 次观看 • 1 年前

Grok 4's coding skills are worse than DeepSeek-R1 (the old version, not even the newer DeepSeek-R1-0528)! 😅 #Grok4
0:54

Grok 4's coding skills are worse than DeepSeek-R1 (the old version, not even the newer DeepSeek-R1-0528)! 😅 #Grok4

ShanghaiPanda （ Account deactivation）

118,909 次观看 • 1 年前

DeepSeek R1 + Perplexity is INSANE 🤯
13:04

DeepSeek R1 + Perplexity is INSANE 🤯

Julian Goldie SEO

168,119 次观看 • 1 年前

Sarvam-M now has 8.6 lakh downloads on Hugging Face, beating DeepSeek-R1!
1:58

Sarvam-M now has 8.6 lakh downloads on Hugging Face, beating DeepSeek-R1!

Caleb

55,857 次观看 • 1 年前

Automate Anything with DeepSeek-R1, here’s how
19:40

Automate Anything with DeepSeek-R1, here’s how

Julian Goldie SEO

880,579 次观看 • 1 年前

Build anything with DeepSeek-R1, here's how...
18:30

Build anything with DeepSeek-R1, here's how...

Julian Goldie SEO

3,470,239 次观看 • 1 年前

DeepSeek-R1 + RooCode is INSANE (FREE!) 🤯
13:19

DeepSeek-R1 + RooCode is INSANE (FREE!) 🤯

Julian Goldie SEO

48,802 次观看 • 1 年前

Project Veritas: Make DeepSeek R1 truth seeking
0:42

Project Veritas: Make DeepSeek R1 truth seeking

Aravind Srinivas

96,558 次观看 • 1 年前

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵
0:59

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵

Baseten

59,330 次观看 • 1 年前

Latest Fireship video featured my run of DeepSeek R1 on M4 Mac Minis. Apple Silicon dominates in memory/bw unit economics, ideal for huge MoE models like R1 at batch_size=1 (the real-world use-case). SOTA AI may come from China, but it will run on American hardware.
0:21

Latest Fireship video featured my run of DeepSeek R1 on M4 Mac Minis. Apple Silicon dominates in memory/bw unit economics, ideal for huge MoE models like R1 at batch_size=1 (the real-world use-case). SOTA AI may come from China, but it will run on American hardware.

Alex Cheema - e/acc

79,775 次观看 • 1 年前

⚡️New "Thinking" UI with DeepSeek R1 Distilled models, running completely locally on iPhone
0:58

⚡️New "Thinking" UI with DeepSeek R1 Distilled models, running completely locally on iPhone

Private LLM

188,633 次观看 • 1 年前