Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

671-billion-parameter DeepSeek-R1 model at up to 3,872 tokens per second

AK

410,152 subscribers

227,579 views • 1 year ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

6 Comments

AK1 year ago

developers can now get started easily pip install --upgrade "ai-gradio[nvidia]" import gradio as gr import ai_gradio gr.load( name='nvidia:deepseek-ai/deepseek-r1', src=ai_gradio.registry, coder=True # remove for regular chat ).launch() github:

Lab4crypto1 year ago

🚀 Don't gamble with your portfolio! Use our advanced hybrid quant risk tool using on/off-chain data and make informed decisions. 📈 Acess to 1000+ charts for your crypto journey. 📚Join our Premium Telegram for daily alerts. 📊+21 projects supported. 🏗️ Beginners and experts.

Mitesh 🎴1 year ago

How much memory for graphics you need for that ?

Kas1 year ago

I can’t find anything about the cost

Maxim1 year ago

Price?

WAGMI | Crypto, DeFi & Web3 News1 year ago

AI is revolutionizing research!

Related Videos

Securely experiment and build your own specialized agents, as the 671-billion-parameter DeepSeek-R1 model is now available as an NVIDIA NIM microservice in preview on Learn more ➡️

Securely experiment and build your own specialized agents, as the 671-billion-parameter DeepSeek-R1 model is now available as an NVIDIA NIM microservice in preview on Learn more ➡️

NVIDIA AI Developer

643,329 views • 1 year ago

DeepSeek R1 671B just broke speed records at 198 t/s it is now the fastest reasoning model available you can try it in coding mode on anychat soon prompt: make two fancy D3.js animated looping speedometers, first one is title deepseek R1 671B and second one is OpenAI o3-mini, deep seek should go up to 198 tokens/second and openai o3-mini should go up to 174 tokens/second

DeepSeek R1 671B just broke speed records at 198 t/s it is now the fastest reasoning model available you can try it in coding mode on anychat soon prompt: make two fancy D3.js animated looping speedometers, first one is title deepseek R1 671B and second one is OpenAI o3-mini, deep seek should go up to 198 tokens/second and openai o3-mini should go up to 174 tokens/second

AK

135,360 views • 1 year ago

This is all you need for running Deepseek R1 671B at home. Her the model with Q4 running on a $2000 Local Machine - 3.5 to 4 tokens per second. 512GB DDR4 RAM Video from "Digital Spaceport" YT Channel (link in comment)

This is all you need for running Deepseek R1 671B at home. Her the model with Q4 running on a $2000 Local Machine - 3.5 to 4 tokens per second. 512GB DDR4 RAM Video from "Digital Spaceport" YT Channel (link in comment)

Rohan Paul

311,988 views • 1 year ago

DAAUUUMMMM! Deep Seek R1 - 4bit on a single Mac Studio 512gb. 18.26 Tokens per second with MLX. Took over a minute to load the model but I sped that up. Generation was great! thanks Awni Hannun mlx is the future.

DAAUUUMMMM! Deep Seek R1 - 4bit on a single Mac Studio 512gb. 18.26 Tokens per second with MLX. Took over a minute to load the model but I sped that up. Generation was great! thanks Awni Hannun mlx is the future.

Austin Vance

172,817 views • 1 year ago

ArrrZero: Why DeepSeek R1 is less important than R1-Zero. While everyone's talking about DeepSeek R1, the real game-changer is R1-Zero. In this video I cover how this model went straight from base model to reasoning chatbot in one giant leap.

ArrrZero: Why DeepSeek R1 is less important than R1-Zero. While everyone's talking about DeepSeek R1, the real game-changer is R1-Zero. In this video I cover how this model went straight from base model to reasoning chatbot in one giant leap.

Ishan Anand

60,031 views • 1 year ago

DeepSeek's R1 Model has shocked the World. Here is how it works. #DeepSeek #R1 #AI

DeepSeek's R1 Model has shocked the World. Here is how it works. #DeepSeek #R1 #AI

Gaurav Sen

87,427 views • 1 year ago

DeepSeek R1 (the full 680B model) runs nicely in higher quality 4-bit on 3 M2 Ultras with MLX. Asked it a coding question and it thought for ~2k tokens and generated 3500 tokens overall:

DeepSeek R1 (the full 680B model) runs nicely in higher quality 4-bit on 3 M2 Ultras with MLX. Asked it a coding question and it thought for ~2k tokens and generated 3500 tokens overall:

Awni Hannun

997,198 views • 1 year ago

THIS DEVELOPER JUST RAN A TRILLION PARAMETER MODEL ON 4 MAC STUDIOS - 10X FASTER AND 5X CHEAPER THAN CLOUD CODE 19:00 he says it out loud. "we just ran a trillion parameter model. 30 something tokens per second. wow." RDMA over Thunderbolt made the cluster 10x faster than before. tensor parallelism splits the model between machines in parallel instead of sequentially DeepSeek V3 full size without quantization. 183GB per machine. still 25 tokens per second. faster than most people can read Kimi K2 with trillion parameters and 256,000 context window. loaded, responded and adapted memory usage dynamically based on prompt size 4 machines consuming 66 watts total. cloud GPU for the same workload costs $1,900/month a cluster that used to cost millions now assembled from Mac Studios in a few hours

THIS DEVELOPER JUST RAN A TRILLION PARAMETER MODEL ON 4 MAC STUDIOS - 10X FASTER AND 5X CHEAPER THAN CLOUD CODE 19:00 he says it out loud. "we just ran a trillion parameter model. 30 something tokens per second. wow." RDMA over Thunderbolt made the cluster 10x faster than before. tensor parallelism splits the model between machines in parallel instead of sequentially DeepSeek V3 full size without quantization. 183GB per machine. still 25 tokens per second. faster than most people can read Kimi K2 with trillion parameters and 256,000 context window. loaded, responded and adapted memory usage dynamically based on prompt size 4 machines consuming 66 watts total. cloud GPU for the same workload costs $1,900/month a cluster that used to cost millions now assembled from Mac Studios in a few hours

Noisy

78,601 views • 8 days ago

$FYI, you can use DeepSeek R1 (deepseek/deepseek-r1:free) and V3 (deepseek/deepseek-chat:free) for free in Cline. These models deliver performance close to Claude Sonnet 3.5/3.7 but at a fraction of the cost—or in this case, completely free. Just a heads-up: performance may slow down during peak traffic.$

FYI, you can use DeepSeek R1 (deepseek/deepseek-r1:free) and V3 (deepseek/deepseek-chat:free) for free in Cline. These models deliver performance close to Claude Sonnet 3.5/3.7 but at a fraction of the cost—or in this case, completely free. Just a heads-up: performance may slow down during peak traffic.

Cline

104,917 views • 1 year ago

Reasoning on Apple Vision Pro with Apple MLX and DeepSeek R1 Qwen 7B 4bit! 🔥 14 tokens per sec! 🔥 Note: sorry for the shaking footage, I was excited to see it running 😂

Reasoning on Apple Vision Pro with Apple MLX and DeepSeek R1 Qwen 7B 4bit! 🔥 14 tokens per sec! 🔥 Note: sorry for the shaking footage, I was excited to see it running 😂

Ivan Fioravanti ᯅ

24,324 views • 1 year ago

DeepSeek released R1, the best open-source reasoning model that is on par with OpenAI's o1! I have built a RAG app to chat with your PDF files using the DeepSeek R1 model, running locally on your computer. 100% Open Source

DeepSeek released R1, the best open-source reasoning model that is on par with OpenAI's o1! I have built a RAG app to chat with your PDF files using the DeepSeek R1 model, running locally on your computer. 100% Open Source

Sumanth

678,561 views • 1 year ago

The new version of DeepSeek-R1, it's an INSANE model, my god. DeepSeek Engineer v2 with function calling support drops tomorrow. I have to.

The new version of DeepSeek-R1, it's an INSANE model, my god. DeepSeek Engineer v2 with function calling support drops tomorrow. I have to.

Pietro Schirano

138,907 views • 1 year ago

President Trump says China's DeepSeek R1 AI model is a "wake-up call" for American companies but it is a good thing for faster and cheaper methods of AI to be developed #DeepSeekR1 #DeepSeek

President Trump says China's DeepSeek R1 AI model is a "wake-up call" for American companies but it is a good thing for faster and cheaper methods of AI to be developed #DeepSeekR1 #DeepSeek

sumit🇮🇳

11,561 views • 1 year ago

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:

Hyperbolic

33,228 views • 1 year ago

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵

Baseten

59,327 views • 1 year ago

Testing DeepSeek R1 in VSCode with CodeGPT Step-by-step guide to connect: ✨ Select "LLMs Cloud model" ✨ Choose DeepSeek as the provider ✨ Pick the "deepseek-reasoner" model ✨ Select code and/or files from your project and send them to the model That’s it! You’re all set to use this amazing DeepSeek model... 🚀 P.S.: Update to the latest version of CodeGPT to start using it!

Testing DeepSeek R1 in VSCode with CodeGPT Step-by-step guide to connect: ✨ Select "LLMs Cloud model" ✨ Choose DeepSeek as the provider ✨ Pick the "deepseek-reasoner" model ✨ Select code and/or files from your project and send them to the model That’s it! You’re all set to use this amazing DeepSeek model... 🚀 P.S.: Update to the latest version of CodeGPT to start using it!

Daniel San

34,346 views • 1 year ago

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Daniel San

583,939 views • 1 year ago