Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

671-billion-parameter DeepSeek-R1 model at up to 3,872 tokens per second

_akhaliq's profile picture

AK

410,152 subscribers

227,579 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

6 Kommentare

Profilbild von AK
AKvor 1 Jahr

developers can now get started easily pip install --upgrade "ai-gradio[nvidia]" import gradio as gr import ai_gradio gr.load( name='nvidia:deepseek-ai/deepseek-r1', src=ai_gradio.registry, coder=True # remove for regular chat ).launch() github:

Profilbild von Lab4crypto
Lab4cryptovor 1 Jahr

🚀 Don't gamble with your portfolio! Use our advanced hybrid quant risk tool using on/off-chain data and make informed decisions. 📈 Acess to 1000+ charts for your crypto journey. 📚Join our Premium Telegram for daily alerts. 📊+21 projects supported. 🏗️ Beginners and experts.

Profilbild von Mitesh 🎴
Mitesh 🎴vor 1 Jahr

How much memory for graphics you need for that ?

Profilbild von Kas
Kasvor 1 Jahr

I can’t find anything about the cost

Profilbild von Maxim
Maximvor 1 Jahr

Price?

Profilbild von WAGMI | Crypto, DeFi & Web3 News
WAGMI | Crypto, DeFi & Web3 Newsvor 1 Jahr

AI is revolutionizing research!

Ähnliche Videos

Securely experiment and build your own specialized agents, as the 671-billion-parameter DeepSeek-R1 model is now available as an NVIDIA NIM microservice in preview on Learn more ➡️
1:03

Securely experiment and build your own specialized agents, as the 671-billion-parameter DeepSeek-R1 model is now available as an NVIDIA NIM microservice in preview on Learn more ➡️

NVIDIA AI Developer

643,329 Aufrufe • vor 1 Jahr

DeepSeek R1 671B just broke speed records at 198 t/s it is now the fastest reasoning model available you can try it in coding mode on anychat soon prompt: make two fancy D3.js animated looping speedometers, first one is title deepseek R1 671B and second one is OpenAI o3-mini, deep seek should go up to 198 tokens/second and openai o3-mini should go up to 174 tokens/second
0:22

DeepSeek R1 671B just broke speed records at 198 t/s it is now the fastest reasoning model available you can try it in coding mode on anychat soon prompt: make two fancy D3.js animated looping speedometers, first one is title deepseek R1 671B and second one is OpenAI o3-mini, deep seek should go up to 198 tokens/second and openai o3-mini should go up to 174 tokens/second

AK

135,360 Aufrufe • vor 1 Jahr

This is all you need for running Deepseek R1 671B at home. Her the model with Q4 running on a $2000 Local Machine - 3.5 to 4 tokens per second. 512GB DDR4 RAM Video from "Digital Spaceport" YT Channel (link in comment)
0:59

This is all you need for running Deepseek R1 671B at home. Her the model with Q4 running on a $2000 Local Machine - 3.5 to 4 tokens per second. 512GB DDR4 RAM Video from "Digital Spaceport" YT Channel (link in comment)

Rohan Paul

311,988 Aufrufe • vor 1 Jahr

DAAUUUMMMM! Deep Seek R1 - 4bit on a single Mac Studio 512gb. 18.26 Tokens per second with MLX. Took over a minute to load the model but I sped that up. Generation was great! thanks Awni Hannun mlx is the future.
1:30

DAAUUUMMMM! Deep Seek R1 - 4bit on a single Mac Studio 512gb. 18.26 Tokens per second with MLX. Took over a minute to load the model but I sped that up. Generation was great! thanks Awni Hannun mlx is the future.

Austin Vance

172,817 Aufrufe • vor 1 Jahr

ArrrZero: Why DeepSeek R1 is less important than R1-Zero. While everyone's talking about DeepSeek R1, the real game-changer is R1-Zero. In this video I cover how this model went straight from base model to reasoning chatbot in one giant leap.
13:10

ArrrZero: Why DeepSeek R1 is less important than R1-Zero. While everyone's talking about DeepSeek R1, the real game-changer is R1-Zero. In this video I cover how this model went straight from base model to reasoning chatbot in one giant leap.

Ishan Anand

60,031 Aufrufe • vor 1 Jahr

DeepSeek's R1 Model has shocked the World. Here is how it works. #DeepSeek #R1 #AI
1:01

DeepSeek's R1 Model has shocked the World. Here is how it works. #DeepSeek #R1 #AI

Gaurav Sen

87,427 Aufrufe • vor 1 Jahr

DeepSeek R1 (the full 680B model) runs nicely in higher quality 4-bit on 3 M2 Ultras with MLX. Asked it a coding question and it thought for ~2k tokens and generated 3500 tokens overall:
1:28

DeepSeek R1 (the full 680B model) runs nicely in higher quality 4-bit on 3 M2 Ultras with MLX. Asked it a coding question and it thought for ~2k tokens and generated 3500 tokens overall:

Awni Hannun

997,198 Aufrufe • vor 1 Jahr

THIS DEVELOPER JUST RAN A TRILLION PARAMETER MODEL ON 4 MAC STUDIOS - 10X FASTER AND 5X CHEAPER THAN CLOUD CODE 19:00 he says it out loud. "we just ran a trillion parameter model. 30 something tokens per second. wow." RDMA over Thunderbolt made the cluster 10x faster than before. tensor parallelism splits the model between machines in parallel instead of sequentially DeepSeek V3 full size without quantization. 183GB per machine. still 25 tokens per second. faster than most people can read Kimi K2 with trillion parameters and 256,000 context window. loaded, responded and adapted memory usage dynamically based on prompt size 4 machines consuming 66 watts total. cloud GPU for the same workload costs $1,900/month a cluster that used to cost millions now assembled from Mac Studios in a few hours
22:35

THIS DEVELOPER JUST RAN A TRILLION PARAMETER MODEL ON 4 MAC STUDIOS - 10X FASTER AND 5X CHEAPER THAN CLOUD CODE 19:00 he says it out loud. "we just ran a trillion parameter model. 30 something tokens per second. wow." RDMA over Thunderbolt made the cluster 10x faster than before. tensor parallelism splits the model between machines in parallel instead of sequentially DeepSeek V3 full size without quantization. 183GB per machine. still 25 tokens per second. faster than most people can read Kimi K2 with trillion parameters and 256,000 context window. loaded, responded and adapted memory usage dynamically based on prompt size 4 machines consuming 66 watts total. cloud GPU for the same workload costs $1,900/month a cluster that used to cost millions now assembled from Mac Studios in a few hours

Noisy

78,601 Aufrufe • vor 7 Tagen

DeepSeek released R1, the best open-source reasoning model that is on par with OpenAI's o1! I have built a RAG app to chat with your PDF files using the DeepSeek R1 model, running locally on your computer. 100% Open Source
0:50

DeepSeek released R1, the best open-source reasoning model that is on par with OpenAI's o1! I have built a RAG app to chat with your PDF files using the DeepSeek R1 model, running locally on your computer. 100% Open Source

Sumanth

678,561 Aufrufe • vor 1 Jahr

The new version of DeepSeek-R1, it's an INSANE model, my god. DeepSeek Engineer v2 with function calling support drops tomorrow. I have to.
0:25

The new version of DeepSeek-R1, it's an INSANE model, my god. DeepSeek Engineer v2 with function calling support drops tomorrow. I have to.

Pietro Schirano

138,907 Aufrufe • vor 1 Jahr

FYI, you can use DeepSeek R1 (deepseek/deepseek-r1:free) and V3 (deepseek/deepseek-chat:free) for free in Cline. These models deliver performance close to Claude Sonnet 3.5/3.7 but at a fraction of the cost—or in this case, completely free. Just a heads-up: performance may slow down during peak traffic.
0:24

FYI, you can use DeepSeek R1 (deepseek/deepseek-r1:free) and V3 (deepseek/deepseek-chat:free) for free in Cline. These models deliver performance close to Claude Sonnet 3.5/3.7 but at a fraction of the cost—or in this case, completely free. Just a heads-up: performance may slow down during peak traffic.

Cline

104,917 Aufrufe • vor 1 Jahr

Reasoning on Apple Vision Pro with Apple MLX and DeepSeek R1 Qwen 7B 4bit! 🔥 14 tokens per sec! 🔥 Note: sorry for the shaking footage, I was excited to see it running 😂
0:55

Reasoning on Apple Vision Pro with Apple MLX and DeepSeek R1 Qwen 7B 4bit! 🔥 14 tokens per sec! 🔥 Note: sorry for the shaking footage, I was excited to see it running 😂

Ivan Fioravanti ᯅ

24,324 Aufrufe • vor 1 Jahr

President Trump says China's DeepSeek R1 AI model is a "wake-up call" for American companies but it is a good thing for faster and cheaper methods of AI to be developed #DeepSeekR1 #DeepSeek
1:35

President Trump says China's DeepSeek R1 AI model is a "wake-up call" for American companies but it is a good thing for faster and cheaper methods of AI to be developed #DeepSeekR1 #DeepSeek

sumit🇮🇳

11,561 Aufrufe • vor 1 Jahr

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:
0:20

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:

Hyperbolic

33,228 Aufrufe • vor 1 Jahr

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵
0:59

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵

Baseten

59,327 Aufrufe • vor 1 Jahr

Testing DeepSeek R1 in VSCode with CodeGPT Step-by-step guide to connect: ✨ Select "LLMs Cloud model" ✨ Choose DeepSeek as the provider ✨ Pick the "deepseek-reasoner" model ✨ Select code and/or files from your project and send them to the model That’s it! You’re all set to use this amazing DeepSeek model... 🚀 P.S.: Update to the latest version of CodeGPT to start using it!
0:52

Testing DeepSeek R1 in VSCode with CodeGPT Step-by-step guide to connect: ✨ Select "LLMs Cloud model" ✨ Choose DeepSeek as the provider ✨ Pick the "deepseek-reasoner" model ✨ Select code and/or files from your project and send them to the model That’s it! You’re all set to use this amazing DeepSeek model... 🚀 P.S.: Update to the latest version of CodeGPT to start using it!

Daniel San

34,346 Aufrufe • vor 1 Jahr

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇
3:45

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Daniel San

583,939 Aufrufe • vor 1 Jahr