Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

DeepSeek-R1 on Mac Studio 192GB 🪄

Georgi Gerganov

59,308 subscribers

259,545 views • 1 year ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

12 Comments

Georgi Gerganov1 year ago

The model is quantized by @UnslothAI

Solar Heavy1 year ago

- Moonlight

Unsloth AI1 year ago

Looks soo good! 🎇🐋

Daniel Nakov1 year ago

come on apple, new studio

Georgi Gerganov1 year ago

M4 studio with 256GB would be the final boss

unfazed.1 year ago

@JudeSkrr il a encore drop

Vasilii Kharitonov 🌍1 year ago

Tried R1 32B 8bit on M4 Pro with 48 GB memory (ggml-org/DeepSeek-R1-Distill-Qwen-32B-Q8_0-GGUF), seems to run great 👍 Memory usage is 43.3/48.0GB, eval time is about 7 tokens per second.

GP1 year ago

I need your cli setup 😏

Woody Lu1 year ago

Could you share the noise level (in DB) of the mac when running it locally?

Georgi Gerganov1 year ago

Not sure how to measure it. It only makes noise for very long contexts, otherwise it's completely silent. And when it makes noise, it's not really loud IMO.

Alexander Kvamme1 year ago

What profiling tool are you using? Much cleaner than htop

Georgi Gerganov1 year ago

asitop

Related Videos

we just added an early preview of DeepSeek-R1 to the fullmoon TestFlight you can use it on iPhone, iPad, Mac, and Vision

we just added an early preview of DeepSeek-R1 to the fullmoon TestFlight you can use it on iPhone, iPad, Mac, and Vision

Jordan Singer

52,763 views • 1 year ago

DeepSeek R1 is now active on FluxAI.

DeepSeek R1 is now active on FluxAI.

Daniel Keller

23,528 views • 1 year ago

DeepSeek R1 + FactSet = Financial Research on Steroids

DeepSeek R1 + FactSet = Financial Research on Steroids

Aravind Srinivas

582,222 views • 1 year ago

OpenAI's nightmare: DeepSeek R1 on a Raspberry Pi

OpenAI's nightmare: DeepSeek R1 on a Raspberry Pi

Jeff Geerling

23,725 views • 1 year ago

o3-mini-high (left) vs. deepseek-r1 (right) results from the first try deepseek-r1 is cracked... wtf!

o3-mini-high (left) vs. deepseek-r1 (right) results from the first try deepseek-r1 is cracked... wtf!

elvis

719,808 views • 1 year ago

Watch DeepSeek-R1 (8B) "think" in realtime on a regular computer.

Watch DeepSeek-R1 (8B) "think" in realtime on a regular computer.

Vincent Kennedy

43,351 views • 1 year ago

🚨 DeepSeek just dropped DeepSeek R1-0528 and it's INSANE for coding Built an entire game with Nebius Studio in three turn. The improvement from previous versions is wild. - API access available - Safe to use If this is R1... DeepSeek R2 is going to be absolutely nuts. How to access 👇 1/3

🚨 DeepSeek just dropped DeepSeek R1-0528 and it's INSANE for coding Built an entire game with Nebius Studio in three turn. The improvement from previous versions is wild. - API access available - Safe to use If this is R1... DeepSeek R2 is going to be absolutely nuts. How to access 👇 1/3

AshutoshShrivastava

61,058 views • 1 year ago

Grok 4's coding skills are worse than DeepSeek-R1 (the old version, not even the newer DeepSeek-R1-0528)! 😅 #Grok4

Grok 4's coding skills are worse than DeepSeek-R1 (the old version, not even the newer DeepSeek-R1-0528)! 😅 #Grok4

ShanghaiPanda （ Account deactivation）

118,909 views • 1 year ago

DeepSeek R1 + Perplexity is INSANE 🤯

DeepSeek R1 + Perplexity is INSANE 🤯

Julian Goldie SEO

168,119 views • 1 year ago

Sarvam-M now has 8.6 lakh downloads on Hugging Face, beating DeepSeek-R1!

Sarvam-M now has 8.6 lakh downloads on Hugging Face, beating DeepSeek-R1!

Caleb

55,857 views • 1 year ago

Build anything with DeepSeek-R1, here's how...

Build anything with DeepSeek-R1, here's how...

Julian Goldie SEO

3,470,090 views • 1 year ago

DeepSeek-R1 + RooCode is INSANE (FREE!) 🤯

DeepSeek-R1 + RooCode is INSANE (FREE!) 🤯

Julian Goldie SEO

48,802 views • 1 year ago

Project Veritas: Make DeepSeek R1 truth seeking

Project Veritas: Make DeepSeek R1 truth seeking

Aravind Srinivas

96,558 views • 1 year ago

Automate Anything with DeepSeek-R1, here’s how

Automate Anything with DeepSeek-R1, here’s how

Julian Goldie SEO

880,579 views • 1 year ago

Latest Fireship video featured my run of DeepSeek R1 on M4 Mac Minis. Apple Silicon dominates in memory/bw unit economics, ideal for huge MoE models like R1 at batch_size=1 (the real-world use-case). SOTA AI may come from China, but it will run on American hardware.

Latest Fireship video featured my run of DeepSeek R1 on M4 Mac Minis. Apple Silicon dominates in memory/bw unit economics, ideal for huge MoE models like R1 at batch_size=1 (the real-world use-case). SOTA AI may come from China, but it will run on American hardware.

Alex Cheema - e/acc

79,775 views • 1 year ago

⚡️New "Thinking" UI with DeepSeek R1 Distilled models, running completely locally on iPhone

⚡️New "Thinking" UI with DeepSeek R1 Distilled models, running completely locally on iPhone

Private LLM

188,633 views • 1 year ago

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵

Baseten

59,330 views • 1 year ago