Загрузка видео...

Не удалось загрузить видео

На главную

671-billion-parameter DeepSeek-R1 model at up to 3,872 tokens per second

_akhaliq's profile picture

AK

410,152 subscribers

227,579 просмотров • 1 год назад •via X (Twitter)

Наука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 6

Фото профиля AK
AK1 год назад

developers can now get started easily pip install --upgrade "ai-gradio[nvidia]" import gradio as gr import ai_gradio gr.load( name='nvidia:deepseek-ai/deepseek-r1', src=ai_gradio.registry, coder=True # remove for regular chat ).launch() github:

Фото профиля Lab4crypto
Lab4crypto1 год назад

🚀 Don't gamble with your portfolio! Use our advanced hybrid quant risk tool using on/off-chain data and make informed decisions. 📈 Acess to 1000+ charts for your crypto journey. 📚Join our Premium Telegram for daily alerts. 📊+21 projects supported. 🏗️ Beginners and experts.

Фото профиля Mitesh 🎴
Mitesh 🎴1 год назад

How much memory for graphics you need for that ?

Фото профиля Kas
Kas1 год назад

I can’t find anything about the cost

Фото профиля Maxim
Maxim1 год назад

Price?

Фото профиля WAGMI | Crypto, DeFi & Web3 News
WAGMI | Crypto, DeFi & Web3 News1 год назад

AI is revolutionizing research!

Похожие видео

Securely experiment and build your own specialized agents, as the 671-billion-parameter DeepSeek-R1 model is now available as an NVIDIA NIM microservice in preview on Learn more ➡️
1:03

Securely experiment and build your own specialized agents, as the 671-billion-parameter DeepSeek-R1 model is now available as an NVIDIA NIM microservice in preview on Learn more ➡️

NVIDIA AI Developer

643,329 просмотров • 1 год назад

DeepSeek R1 671B just broke speed records at 198 t/s it is now the fastest reasoning model available you can try it in coding mode on anychat soon prompt: make two fancy D3.js animated looping speedometers, first one is title deepseek R1 671B and second one is OpenAI o3-mini, deep seek should go up to 198 tokens/second and openai o3-mini should go up to 174 tokens/second
0:22

DeepSeek R1 671B just broke speed records at 198 t/s it is now the fastest reasoning model available you can try it in coding mode on anychat soon prompt: make two fancy D3.js animated looping speedometers, first one is title deepseek R1 671B and second one is OpenAI o3-mini, deep seek should go up to 198 tokens/second and openai o3-mini should go up to 174 tokens/second

AK

135,360 просмотров • 1 год назад

This is all you need for running Deepseek R1 671B at home. Her the model with Q4 running on a $2000 Local Machine - 3.5 to 4 tokens per second. 512GB DDR4 RAM Video from "Digital Spaceport" YT Channel (link in comment)
0:59

This is all you need for running Deepseek R1 671B at home. Her the model with Q4 running on a $2000 Local Machine - 3.5 to 4 tokens per second. 512GB DDR4 RAM Video from "Digital Spaceport" YT Channel (link in comment)

Rohan Paul

311,988 просмотров • 1 год назад

DAAUUUMMMM! Deep Seek R1 - 4bit on a single Mac Studio 512gb. 18.26 Tokens per second with MLX. Took over a minute to load the model but I sped that up. Generation was great! thanks Awni Hannun mlx is the future.
1:30

DAAUUUMMMM! Deep Seek R1 - 4bit on a single Mac Studio 512gb. 18.26 Tokens per second with MLX. Took over a minute to load the model but I sped that up. Generation was great! thanks Awni Hannun mlx is the future.

Austin Vance

172,817 просмотров • 1 год назад

ArrrZero: Why DeepSeek R1 is less important than R1-Zero. While everyone's talking about DeepSeek R1, the real game-changer is R1-Zero. In this video I cover how this model went straight from base model to reasoning chatbot in one giant leap.
13:10

ArrrZero: Why DeepSeek R1 is less important than R1-Zero. While everyone's talking about DeepSeek R1, the real game-changer is R1-Zero. In this video I cover how this model went straight from base model to reasoning chatbot in one giant leap.

Ishan Anand

60,031 просмотров • 1 год назад

DeepSeek's R1 Model has shocked the World. Here is how it works. #DeepSeek #R1 #AI
1:01

DeepSeek's R1 Model has shocked the World. Here is how it works. #DeepSeek #R1 #AI

Gaurav Sen

87,427 просмотров • 1 год назад

DeepSeek R1 (the full 680B model) runs nicely in higher quality 4-bit on 3 M2 Ultras with MLX. Asked it a coding question and it thought for ~2k tokens and generated 3500 tokens overall:
1:28

DeepSeek R1 (the full 680B model) runs nicely in higher quality 4-bit on 3 M2 Ultras with MLX. Asked it a coding question and it thought for ~2k tokens and generated 3500 tokens overall:

Awni Hannun

997,198 просмотров • 1 год назад

THIS DEVELOPER JUST RAN A TRILLION PARAMETER MODEL ON 4 MAC STUDIOS - 10X FASTER AND 5X CHEAPER THAN CLOUD CODE 19:00 he says it out loud. "we just ran a trillion parameter model. 30 something tokens per second. wow." RDMA over Thunderbolt made the cluster 10x faster than before. tensor parallelism splits the model between machines in parallel instead of sequentially DeepSeek V3 full size without quantization. 183GB per machine. still 25 tokens per second. faster than most people can read Kimi K2 with trillion parameters and 256,000 context window. loaded, responded and adapted memory usage dynamically based on prompt size 4 machines consuming 66 watts total. cloud GPU for the same workload costs $1,900/month a cluster that used to cost millions now assembled from Mac Studios in a few hours
22:35

THIS DEVELOPER JUST RAN A TRILLION PARAMETER MODEL ON 4 MAC STUDIOS - 10X FASTER AND 5X CHEAPER THAN CLOUD CODE 19:00 he says it out loud. "we just ran a trillion parameter model. 30 something tokens per second. wow." RDMA over Thunderbolt made the cluster 10x faster than before. tensor parallelism splits the model between machines in parallel instead of sequentially DeepSeek V3 full size without quantization. 183GB per machine. still 25 tokens per second. faster than most people can read Kimi K2 with trillion parameters and 256,000 context window. loaded, responded and adapted memory usage dynamically based on prompt size 4 machines consuming 66 watts total. cloud GPU for the same workload costs $1,900/month a cluster that used to cost millions now assembled from Mac Studios in a few hours

Noisy

78,601 просмотров • 7 дней назад

DeepSeek released R1, the best open-source reasoning model that is on par with OpenAI's o1! I have built a RAG app to chat with your PDF files using the DeepSeek R1 model, running locally on your computer. 100% Open Source
0:50

DeepSeek released R1, the best open-source reasoning model that is on par with OpenAI's o1! I have built a RAG app to chat with your PDF files using the DeepSeek R1 model, running locally on your computer. 100% Open Source

Sumanth

678,561 просмотров • 1 год назад

The new version of DeepSeek-R1, it's an INSANE model, my god. DeepSeek Engineer v2 with function calling support drops tomorrow. I have to.
0:25

The new version of DeepSeek-R1, it's an INSANE model, my god. DeepSeek Engineer v2 with function calling support drops tomorrow. I have to.

Pietro Schirano

138,907 просмотров • 1 год назад

FYI, you can use DeepSeek R1 (deepseek/deepseek-r1:free) and V3 (deepseek/deepseek-chat:free) for free in Cline. These models deliver performance close to Claude Sonnet 3.5/3.7 but at a fraction of the cost—or in this case, completely free. Just a heads-up: performance may slow down during peak traffic.
0:24

FYI, you can use DeepSeek R1 (deepseek/deepseek-r1:free) and V3 (deepseek/deepseek-chat:free) for free in Cline. These models deliver performance close to Claude Sonnet 3.5/3.7 but at a fraction of the cost—or in this case, completely free. Just a heads-up: performance may slow down during peak traffic.

Cline

104,917 просмотров • 1 год назад

Reasoning on Apple Vision Pro with Apple MLX and DeepSeek R1 Qwen 7B 4bit! 🔥 14 tokens per sec! 🔥 Note: sorry for the shaking footage, I was excited to see it running 😂
0:55

Reasoning on Apple Vision Pro with Apple MLX and DeepSeek R1 Qwen 7B 4bit! 🔥 14 tokens per sec! 🔥 Note: sorry for the shaking footage, I was excited to see it running 😂

Ivan Fioravanti ᯅ

24,324 просмотров • 1 год назад

President Trump says China's DeepSeek R1 AI model is a "wake-up call" for American companies but it is a good thing for faster and cheaper methods of AI to be developed #DeepSeekR1 #DeepSeek
1:35

President Trump says China's DeepSeek R1 AI model is a "wake-up call" for American companies but it is a good thing for faster and cheaper methods of AI to be developed #DeepSeekR1 #DeepSeek

sumit🇮🇳

11,561 просмотров • 1 год назад

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:
0:20

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:

Hyperbolic

33,228 просмотров • 1 год назад

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵
0:59

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵

Baseten

59,327 просмотров • 1 год назад

Testing DeepSeek R1 in VSCode with CodeGPT Step-by-step guide to connect: ✨ Select "LLMs Cloud model" ✨ Choose DeepSeek as the provider ✨ Pick the "deepseek-reasoner" model ✨ Select code and/or files from your project and send them to the model That’s it! You’re all set to use this amazing DeepSeek model... 🚀 P.S.: Update to the latest version of CodeGPT to start using it!
0:52

Testing DeepSeek R1 in VSCode with CodeGPT Step-by-step guide to connect: ✨ Select "LLMs Cloud model" ✨ Choose DeepSeek as the provider ✨ Pick the "deepseek-reasoner" model ✨ Select code and/or files from your project and send them to the model That’s it! You’re all set to use this amazing DeepSeek model... 🚀 P.S.: Update to the latest version of CodeGPT to start using it!

Daniel San

34,346 просмотров • 1 год назад

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇
3:45

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Daniel San

583,939 просмотров • 1 год назад