正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

671-billion-parameter DeepSeek-R1 model at up to 3,872 tokens per second

AK

410,152 subscribers

227,579 次观看 • 1 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

6 条评论

AK 的头像

AK1 年前

developers can now get started easily pip install --upgrade "ai-gradio[nvidia]" import gradio as gr import ai_gradio gr.load( name='nvidia:deepseek-ai/deepseek-r1', src=ai_gradio.registry, coder=True # remove for regular chat ).launch() github:

Lab4crypto 的头像

Lab4crypto1 年前

🚀 Don't gamble with your portfolio! Use our advanced hybrid quant risk tool using on/off-chain data and make informed decisions. 📈 Acess to 1000+ charts for your crypto journey. 📚Join our Premium Telegram for daily alerts. 📊+21 projects supported. 🏗️ Beginners and experts.

Mitesh 🎴 的头像

Mitesh 🎴1 年前

How much memory for graphics you need for that ?

Kas 的头像

Kas1 年前

I can’t find anything about the cost

Maxim 的头像

Maxim1 年前

Price?

WAGMI | Crypto, DeFi & Web3 News 的头像

WAGMI | Crypto, DeFi & Web3 News1 年前

AI is revolutionizing research!

相关视频

Securely experiment and build your own specialized agents, as the 671-billion-parameter DeepSeek-R1 model is now available as an NVIDIA NIM microservice in preview on Learn more ➡️

Securely experiment and build your own specialized agents, as the 671-billion-parameter DeepSeek-R1 model is now available as an NVIDIA NIM microservice in preview on Learn more ➡️

NVIDIA AI Developer

643,329 次观看 • 1 年前

DeepSeek R1 671B just broke speed records at 198 t/s it is now the fastest reasoning model available you can try it in coding mode on anychat soon prompt: make two fancy D3.js animated looping speedometers, first one is title deepseek R1 671B and second one is OpenAI o3-mini, deep seek should go up to 198 tokens/second and openai o3-mini should go up to 174 tokens/second

DeepSeek R1 671B just broke speed records at 198 t/s it is now the fastest reasoning model available you can try it in coding mode on anychat soon prompt: make two fancy D3.js animated looping speedometers, first one is title deepseek R1 671B and second one is OpenAI o3-mini, deep seek should go up to 198 tokens/second and openai o3-mini should go up to 174 tokens/second

AK

135,360 次观看 • 1 年前

This is all you need for running Deepseek R1 671B at home. Her the model with Q4 running on a $2000 Local Machine - 3.5 to 4 tokens per second. 512GB DDR4 RAM Video from "Digital Spaceport" YT Channel (link in comment)

This is all you need for running Deepseek R1 671B at home. Her the model with Q4 running on a $2000 Local Machine - 3.5 to 4 tokens per second. 512GB DDR4 RAM Video from "Digital Spaceport" YT Channel (link in comment)

Rohan Paul

311,988 次观看 • 1 年前

DAAUUUMMMM! Deep Seek R1 - 4bit on a single Mac Studio 512gb. 18.26 Tokens per second with MLX. Took over a minute to load the model but I sped that up. Generation was great! thanks Awni Hannun mlx is the future.

DAAUUUMMMM! Deep Seek R1 - 4bit on a single Mac Studio 512gb. 18.26 Tokens per second with MLX. Took over a minute to load the model but I sped that up. Generation was great! thanks Awni Hannun mlx is the future.

Austin Vance

172,817 次观看 • 1 年前

ArrrZero: Why DeepSeek R1 is less important than R1-Zero. While everyone's talking about DeepSeek R1, the real game-changer is R1-Zero. In this video I cover how this model went straight from base model to reasoning chatbot in one giant leap.

ArrrZero: Why DeepSeek R1 is less important than R1-Zero. While everyone's talking about DeepSeek R1, the real game-changer is R1-Zero. In this video I cover how this model went straight from base model to reasoning chatbot in one giant leap.

Ishan Anand

60,031 次观看 • 1 年前

DeepSeek's R1 Model has shocked the World. Here is how it works. #DeepSeek #R1 #AI

DeepSeek's R1 Model has shocked the World. Here is how it works. #DeepSeek #R1 #AI

Gaurav Sen

87,427 次观看 • 1 年前

DeepSeek R1 (the full 680B model) runs nicely in higher quality 4-bit on 3 M2 Ultras with MLX. Asked it a coding question and it thought for ~2k tokens and generated 3500 tokens overall:

DeepSeek R1 (the full 680B model) runs nicely in higher quality 4-bit on 3 M2 Ultras with MLX. Asked it a coding question and it thought for ~2k tokens and generated 3500 tokens overall:

Awni Hannun

997,198 次观看 • 1 年前

THIS DEVELOPER JUST RAN A TRILLION PARAMETER MODEL ON 4 MAC STUDIOS - 10X FASTER AND 5X CHEAPER THAN CLOUD CODE 19:00 he says it out loud. "we just ran a trillion parameter model. 30 something tokens per second. wow." RDMA over Thunderbolt made the cluster 10x faster than before. tensor parallelism splits the model between machines in parallel instead of sequentially DeepSeek V3 full size without quantization. 183GB per machine. still 25 tokens per second. faster than most people can read Kimi K2 with trillion parameters and 256,000 context window. loaded, responded and adapted memory usage dynamically based on prompt size 4 machines consuming 66 watts total. cloud GPU for the same workload costs $1,900/month a cluster that used to cost millions now assembled from Mac Studios in a few hours

THIS DEVELOPER JUST RAN A TRILLION PARAMETER MODEL ON 4 MAC STUDIOS - 10X FASTER AND 5X CHEAPER THAN CLOUD CODE 19:00 he says it out loud. "we just ran a trillion parameter model. 30 something tokens per second. wow." RDMA over Thunderbolt made the cluster 10x faster than before. tensor parallelism splits the model between machines in parallel instead of sequentially DeepSeek V3 full size without quantization. 183GB per machine. still 25 tokens per second. faster than most people can read Kimi K2 with trillion parameters and 256,000 context window. loaded, responded and adapted memory usage dynamically based on prompt size 4 machines consuming 66 watts total. cloud GPU for the same workload costs $1,900/month a cluster that used to cost millions now assembled from Mac Studios in a few hours

Noisy

78,601 次观看 • 7 天前

DeepSeek released R1, the best open-source reasoning model that is on par with OpenAI's o1! I have built a RAG app to chat with your PDF files using the DeepSeek R1 model, running locally on your computer. 100% Open Source

DeepSeek released R1, the best open-source reasoning model that is on par with OpenAI's o1! I have built a RAG app to chat with your PDF files using the DeepSeek R1 model, running locally on your computer. 100% Open Source

Sumanth

678,561 次观看 • 1 年前

The new version of DeepSeek-R1, it's an INSANE model, my god. DeepSeek Engineer v2 with function calling support drops tomorrow. I have to.

The new version of DeepSeek-R1, it's an INSANE model, my god. DeepSeek Engineer v2 with function calling support drops tomorrow. I have to.

Pietro Schirano

138,907 次观看 • 1 年前

$FYI, you can use DeepSeek R1 (deepseek/deepseek-r1:free) and V3 (deepseek/deepseek-chat:free) for free in Cline. These models deliver performance close to Claude Sonnet 3.5/3.7 but at a fraction of the cost—or in this case, completely free. Just a heads-up: performance may slow down during peak traffic.$

FYI, you can use DeepSeek R1 (deepseek/deepseek-r1:free) and V3 (deepseek/deepseek-chat:free) for free in Cline. These models deliver performance close to Claude Sonnet 3.5/3.7 but at a fraction of the cost—or in this case, completely free. Just a heads-up: performance may slow down during peak traffic.

Cline

104,917 次观看 • 1 年前

Reasoning on Apple Vision Pro with Apple MLX and DeepSeek R1 Qwen 7B 4bit! 🔥 14 tokens per sec! 🔥 Note: sorry for the shaking footage, I was excited to see it running 😂

Reasoning on Apple Vision Pro with Apple MLX and DeepSeek R1 Qwen 7B 4bit! 🔥 14 tokens per sec! 🔥 Note: sorry for the shaking footage, I was excited to see it running 😂

Ivan Fioravanti ᯅ

24,324 次观看 • 1 年前

President Trump says China's DeepSeek R1 AI model is a "wake-up call" for American companies but it is a good thing for faster and cheaper methods of AI to be developed #DeepSeekR1 #DeepSeek

President Trump says China's DeepSeek R1 AI model is a "wake-up call" for American companies but it is a good thing for faster and cheaper methods of AI to be developed #DeepSeekR1 #DeepSeek

sumit🇮🇳

11,561 次观看 • 1 年前

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:

DeepSeek-R1-0528 is now live on Hyperbolic’s Serverless Inference! We also are the first to serve the latest DeepSeek model on Hugging Face. 🟣 Run it instantly:

Hyperbolic

33,228 次观看 • 1 年前

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵

Baseten

59,327 次观看 • 1 年前

Testing DeepSeek R1 in VSCode with CodeGPT Step-by-step guide to connect: ✨ Select "LLMs Cloud model" ✨ Choose DeepSeek as the provider ✨ Pick the "deepseek-reasoner" model ✨ Select code and/or files from your project and send them to the model That’s it! You’re all set to use this amazing DeepSeek model... 🚀 P.S.: Update to the latest version of CodeGPT to start using it!

Testing DeepSeek R1 in VSCode with CodeGPT Step-by-step guide to connect: ✨ Select "LLMs Cloud model" ✨ Choose DeepSeek as the provider ✨ Pick the "deepseek-reasoner" model ✨ Select code and/or files from your project and send them to the model That’s it! You’re all set to use this amazing DeepSeek model... 🚀 P.S.: Update to the latest version of CodeGPT to start using it!

Daniel San

34,346 次观看 • 1 年前

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Introducing DeepSeek R1:1.5b Running Locally in Cursor! In less than 4 minutes, I set up the DeepSeek R1:1.5b model, download it, and run it locally to seamlessly work with code in Cursor The video is shown in real-time, with the model impressively running on an Intel Core i5 😱 using Ollama and the CodeGPT extension 👇

Daniel San

583,939 次观看 • 1 年前