Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

ollama run llama3.1:405b Tested in with AMD MI300X 🤯

ollama's profile picture

ollama

184,876 subscribers

98,209 görüntüleme • 2 yıl önce •via X (Twitter)

Bilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

10 Yorum

Dr. Daniel Bender profil fotoğrafı
Dr. Daniel Bender2 yıl önce

@TensorWaveCloud @AMD Does it run with CPU offloading, as the AMD MI300X only brings 192 GB of memory? Asking, because your model pages states that the 405B model of Llama 3.1 has a size of 231 GB?

Dr. Daniel Bender profil fotoğrafı
Dr. Daniel Bender2 yıl önce

@TensorWaveCloud @AMD 231GB of memory is needed to run it in 4bit quantization. 🥹 That is only a magnitude more than we currently have in the best consumer GPUs. 🤣

Keith profil fotoğrafı
Keith2 yıl önce

@TensorWaveCloud @AMD Wai- that is actually insane I am testing Llama 3.1 8B, it's so fast! @Meta really cooked with this one!

Vaibhav (VB) Srivastav profil fotoğrafı
Vaibhav (VB) Srivastav2 yıl önce

@TensorWaveCloud @AMD FYI! Unless you’ve patched L3.1 on your own, the generations for all L3.1 405B, 70B & 8B are not accurate and off:

ollama profil fotoğrafı
ollama2 yıl önce

@TensorWaveCloud @AMD 🙏 Thank you! We are upstreaming the patch! 🙏🙏🙏 Please support open-source!! When you get early access again, please help make the fixes! ❤️❤️❤️

Justin Trugman profil fotoğrafı
Justin Trugman2 yıl önce

@TensorWaveCloud @AMD I'm going to need more VRAM

Daniel Nguyen ⚡ profil fotoğrafı
Daniel Nguyen ⚡2 yıl önce

@TensorWaveCloud @AMD Amazing

@konczdev profil fotoğrafı
@konczdev2 yıl önce

@TensorWaveCloud @AMD Can you run crysis?

Dheeraj unni profil fotoğrafı
Dheeraj unni2 yıl önce

@TensorWaveCloud @AMD Brb gonna get a giga cluster to run this

Neilio profil fotoğrafı
Neilio2 yıl önce

@TensorWaveCloud @AMD 👍

Benzer Videolar

$AMD is down more than 40% from its ATH. Meanwhile, who’s all in on $AMD? Mark Zuckerberg. Llama 405B runs inferences exclusively on the $AMD MI300X chip.
4:02

$AMD is down more than 40% from its ATH. Meanwhile, who’s all in on $AMD? Mark Zuckerberg. Llama 405B runs inferences exclusively on the $AMD MI300X chip.

Antonio Linares

150,656 görüntüleme • 1 yıl önce

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin
0:43

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin

ollama

117,716 görüntüleme • 8 ay önce

Ollama can now run subagents in OpenCode Parallelize tasks which require longer context windows like research, refactoring, and code reviews ollama launch opencode
0:57

Ollama can now run subagents in OpenCode Parallelize tasks which require longer context windows like research, refactoring, and code reviews ollama launch opencode

ollama

126,327 görüntüleme • 7 ay önce

Ollama now supports the DeepSeek Harness. ollama launch dsh Run it completely in your own environment. It comes with Ollama's web search pre-installed. You can use its trajectory view to see what is happening in the background.
0:33

Ollama now supports the DeepSeek Harness. ollama launch dsh Run it completely in your own environment. It comes with Ollama's web search pre-installed. You can use its trajectory view to see what is happening in the background.

ollama

96,494 görüntüleme • 2 ay önce

Ollama now supports subagents and web search in Claude Code! Subagents can run tasks in parallel, such as file search, code exploration, and research, each in their own context. No MCP servers to configure or API keys required. Try it with any model on Ollama's cloud: ollama launch claude --model minimax-m2.5:cloud
0:43

Ollama now supports subagents and web search in Claude Code! Subagents can run tasks in parallel, such as file search, code exploration, and research, each in their own context. No MCP servers to configure or API keys required. Try it with any model on Ollama's cloud: ollama launch claude --model minimax-m2.5:cloud

ollama

84,243 görüntüleme • 7 ay önce

Ollama v0.8 is here! Now it can stream responses with tool calling! Example of Ollama doing web search:
0:32

Ollama v0.8 is here! Now it can stream responses with tool calling! Example of Ollama doing web search:

ollama

148,328 görüntüleme • 1 yıl önce

Open models are already being used in the enterprise. Over 85% of the Fortune 500 companies already use Ollama to fulfill specific tasks. Jeffrey Morgan Why open models and Ollama? Ownership. Open models are yours to keep, customize, and optimize. Affordable. Run it the way you like, in your own environment. Private. Your data belongs to you.
1:37

Open models are already being used in the enterprise. Over 85% of the Fortune 500 companies already use Ollama to fulfill specific tasks. Jeffrey Morgan Why open models and Ollama? Ownership. Open models are yours to keep, customize, and optimize. Affordable. Run it the way you like, in your own environment. Private. Your data belongs to you.

ollama

43,258 görüntüleme • 3 ay önce

Ollama v0.33 is here! You can now easily configure Claude Desktop to seamlessly work with Ollama as a third-party gateway provider. One toggle. Cloud & local models just work👇
0:28

Ollama v0.33 is here! You can now easily configure Claude Desktop to seamlessly work with Ollama as a third-party gateway provider. One toggle. Cloud & local models just work👇

ollama

496,489 görüntüleme • 1 ay önce

Ollama now supports Jev-like decision models all locally. Use decision models like Nimble for tasks like ticket triaging, model routing, and content moderation. ollama pull nimble Here’s Nimble playing Ollama racer through the new local /v1/systemone API by making decisions in real-time. 🏎️
0:23

Ollama now supports Jev-like decision models all locally. Use decision models like Nimble for tasks like ticket triaging, model routing, and content moderation. ollama pull nimble Here’s Nimble playing Ollama racer through the new local /v1/systemone API by making decisions in real-time. 🏎️

ollama

663,502 görüntüleme • 14 gün önce

Using AI at Meta's Muse Glimmer all locally to process personal monthly credit card statements. Your data belongs to you! Try different agent tasks using your favorite apps / harnesses with Ollama.
1:06

Using AI at Meta's Muse Glimmer all locally to process personal monthly credit card statements. Your data belongs to you! Try different agent tasks using your favorite apps / harnesses with Ollama.

ollama

30,913 görüntüleme • 2 ay önce

Ollama can now launch Pi, a minimal coding agent which you can customize for your workflow ollama launch pi You can even ask pi to write extensions for itself
0:20

Ollama can now launch Pi, a minimal coding agent which you can customize for your workflow ollama launch pi You can even ask pi to write extensions for itself

ollama

191,330 görüntüleme • 7 ay önce

Running Llama 3.1 locally as a code assistant in VSCode with ollama ✨ Download Ollama ( ✨ Download CodeGPT ( ✨ Select the Llama 3.1 model (8b, 70b or 405b) ✨ Click download ✨ Enjoy! :)
0:30

Running Llama 3.1 locally as a code assistant in VSCode with ollama ✨ Download Ollama ( ✨ Download CodeGPT ( ✨ Select the Llama 3.1 model (8b, 70b or 405b) ✨ Click download ✨ Enjoy! :)

Daniel San

360,018 görüntüleme • 2 yıl önce

U.S. open-source models are quickly gaining ground. @Nvidia's newest Nemotron Ultra is fast growing on Ollama and unlocking complex, longer running tasks for developers
0:41

U.S. open-source models are quickly gaining ground. @Nvidia's newest Nemotron Ultra is fast growing on Ollama and unlocking complex, longer running tasks for developers

ollama

74,064 görüntüleme • 3 ay önce

Ollama 0.2 is here! Concurrency is now enabled by default. This unlocks 2 major features: Parallel requests Ollama can now serve multiple requests at the same time, using only a little bit of additional memory for each request. This enables use cases such as: - Handling multiple chat sessions at the same time - Hosting code completion LLMs for your team - Processing different parts of a document simultaneously - Running multiple agents at the same time Run multiple models Ollama now supports loading different models at the same time. This improves several use cases: - Retrieval Augmented Generation (RAG): both the embedding and text completion models can be loaded into memory simultaneously. - Agents: multiple versions of an agent can now run simultaneously - Running large and small models side-by-side Models are automatically loaded and unloaded based on requests and how much GPU memory is available.
0:23

Ollama 0.2 is here! Concurrency is now enabled by default. This unlocks 2 major features: Parallel requests Ollama can now serve multiple requests at the same time, using only a little bit of additional memory for each request. This enables use cases such as: - Handling multiple chat sessions at the same time - Hosting code completion LLMs for your team - Processing different parts of a document simultaneously - Running multiple agents at the same time Run multiple models Ollama now supports loading different models at the same time. This improves several use cases: - Retrieval Augmented Generation (RAG): both the embedding and text completion models can be loaded into memory simultaneously. - Agents: multiple versions of an agent can now run simultaneously - Running large and small models side-by-side Models are automatically loaded and unloaded based on requests and how much GPU memory is available.

ollama

219,468 görüntüleme • 2 yıl önce

While everyone is crying, Zuck has gone all in on $AMD. Llama runs inferences exclusively on $AMD MI300X. This deal shows $AMD has an edge in inference over $NVDA, which will be a much larger market than training.
12:28

While everyone is crying, Zuck has gone all in on $AMD. Llama runs inferences exclusively on $AMD MI300X. This deal shows $AMD has an edge in inference over $NVDA, which will be a much larger market than training.

Antonio Linares

170,272 görüntüleme • 1 yıl önce

GLM 5.2, open frontier-scale intelligence on Microsoft Foundry with AMD MI300X. Running a Codex goal with an open model never felt this good!
0:54

GLM 5.2, open frontier-scale intelligence on Microsoft Foundry with AMD MI300X. Running a Codex goal with an open model never felt this good!

Alvaro Bartolome

27,277 görüntüleme • 3 ay önce

Ollama can now think! 🤔🤔🤔 For thinking models, and especially useful for very thoughtful models like DeepSeek-R1-0528, Ollama can separate the thoughts and the response. Thinking can also be disabled! This is useful for getting a direct response. This works across Ollama's CLI, API, and Python/JavaScript libraries. 🧵 blog post 👇👇👇
1:38

Ollama can now think! 🤔🤔🤔 For thinking models, and especially useful for very thoughtful models like DeepSeek-R1-0528, Ollama can separate the thoughts and the response. Thinking can also be disabled! This is useful for getting a direct response. This works across Ollama's CLI, API, and Python/JavaScript libraries. 🧵 blog post 👇👇👇

ollama

106,316 görüntüleme • 1 yıl önce

Jeffrey Morgan was on TBPN this week to discuss Ollama's Series B fundraise and why open models are quickly becoming the default choice for developers Full video:
10:09

Jeffrey Morgan was on TBPN this week to discuss Ollama's Series B fundraise and why open models are quickly becoming the default choice for developers Full video:

ollama

38,378 görüntüleme • 3 ay önce