Loading video...

Video Failed to Load

Go Home

OpenAI's nightmare: DeepSeek R1 on a Raspberry Pi

23,725 views • 1 year ago •via X (Twitter)

11 Comments

Jeff Geerling's profile picture
Jeff Geerling1 year ago

Blog post with links to how I ran it with ollama on Pi 5's CPU (Qwen Distilled 14b) and an AmpereOne (671b), and llama.cpp + Vulkan on AMD GPU:

Jeff Geerling's profile picture
Jeff Geerling1 year ago

And direct link to the DeepSeek benchmark results (yes I did run on both the Pi CPU alone and on eGPU):

The Information's profile picture
The Information1 year ago

OpenAI is betting on a little-known startup to stay ahead of Elon Musk in the supercomputer race.

🇨🇳🇺🇸🇪🇺LDOJason's profile picture
🇨🇳🇺🇸🇪🇺LDOJason1 year ago

Might be sensitive question, if you run it local, will you still worry about the "called" security issue without use their cloud?

Jeff Geerling's profile picture
Jeff Geerling1 year ago

No, not when running it through Ollama or llama.cpp at least.

Icegeist's profile picture
Icegeist1 year ago

@nvidia Could you please send him an H100? I would really like to see that GPU on top of an Raspberry PI 5 🔥

🦆 SchizoDuckie 🦆's profile picture
🦆 SchizoDuckie 🦆1 year ago

It's a cool enough feat without the clickbait title man.

Joel DeTeves's profile picture
Joel DeTeves1 year ago

> No confusion about who precisely is Winnie the Pooh Jeff’s videos are now banned from behind the Great Firewall

We are Adam 🌵's profile picture
We are Adam 🌵1 year ago

How Qwen relates to DeepSeek? It's not clear to me

Jeff Geerling's profile picture
Jeff Geerling1 year ago

The Qwen-Distilled-14b model is distilled using DeepSeek to make it a more useful model than standard Qwen 2.5. And Ollama labels distilled models as "deepseek-r1" still lol

Stefan Andrzejuk's profile picture
Stefan Andrzejuk1 year ago

Can you please make a video on increasing my social credit score using my raspberry pi?

Related Videos