正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

ollama run llama3.1:405b Tested in with AMD MI300X 🤯

ollama

176,708 subscribers

98,184 次观看 • 2 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 条评论

Dr. Daniel Bender 的头像

Dr. Daniel Bender2 年前

@TensorWaveCloud @AMD Does it run with CPU offloading, as the AMD MI300X only brings 192 GB of memory? Asking, because your model pages states that the 405B model of Llama 3.1 has a size of 231 GB?

Dr. Daniel Bender 的头像

Dr. Daniel Bender2 年前

@TensorWaveCloud @AMD 231GB of memory is needed to run it in 4bit quantization. 🥹 That is only a magnitude more than we currently have in the best consumer GPUs. 🤣

Keith 的头像

Keith2 年前

@TensorWaveCloud @AMD Wai- that is actually insane I am testing Llama 3.1 8B, it's so fast! @Meta really cooked with this one!

Vaibhav (VB) Srivastav 的头像

Vaibhav (VB) Srivastav2 年前

@TensorWaveCloud @AMD FYI! Unless you’ve patched L3.1 on your own, the generations for all L3.1 405B, 70B & 8B are not accurate and off:

ollama 的头像

ollama2 年前

@TensorWaveCloud @AMD 🙏 Thank you! We are upstreaming the patch! 🙏🙏🙏 Please support open-source!! When you get early access again, please help make the fixes! ❤️❤️❤️

Justin Trugman 的头像

Justin Trugman2 年前

@TensorWaveCloud @AMD I'm going to need more VRAM

Daniel Nguyen ⚡ 的头像

Daniel Nguyen ⚡2 年前

@TensorWaveCloud @AMD Amazing

@konczdev 的头像

@konczdev2 年前

@TensorWaveCloud @AMD Can you run crysis?

Dheeraj unni 的头像

Dheeraj unni2 年前

@TensorWaveCloud @AMD Brb gonna get a giga cluster to run this

Neilio 的头像

Neilio2 年前

@TensorWaveCloud @AMD 👍

相关视频

$AMD is down more than 40% from its ATH. Meanwhile, who’s all in on $AMD? Mark Zuckerberg. Llama 405B runs inferences exclusively on the $AMD MI300X chip.

$AMD is down more than 40% from its ATH. Meanwhile, who’s all in on $AMD? Mark Zuckerberg. Llama 405B runs inferences exclusively on the $AMD MI300X chip.

Antonio Linares

150,656 次观看 • 1 年前

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin

ollama

117,570 次观看 • 6 个月前

Ollama can now run subagents in OpenCode Parallelize tasks which require longer context windows like research, refactoring, and code reviews ollama launch opencode

Ollama can now run subagents in OpenCode Parallelize tasks which require longer context windows like research, refactoring, and code reviews ollama launch opencode

ollama

126,094 次观看 • 5 个月前

Ollama now supports the DeepSeek Harness. ollama launch dsh Run it completely in your own environment. It comes with Ollama's web search pre-installed. You can use its trajectory view to see what is happening in the background.

Ollama now supports the DeepSeek Harness. ollama launch dsh Run it completely in your own environment. It comes with Ollama's web search pre-installed. You can use its trajectory view to see what is happening in the background.

ollama

88,195 次观看 • 3 天前

Ollama now supports subagents and web search in Claude Code! Subagents can run tasks in parallel, such as file search, code exploration, and research, each in their own context. No MCP servers to configure or API keys required. Try it with any model on Ollama's cloud: ollama launch claude --model minimax-m2.5:cloud

Ollama now supports subagents and web search in Claude Code! Subagents can run tasks in parallel, such as file search, code exploration, and research, each in their own context. No MCP servers to configure or API keys required. Try it with any model on Ollama's cloud: ollama launch claude --model minimax-m2.5:cloud

ollama

84,163 次观看 • 6 个月前

Ollama v0.8 is here! Now it can stream responses with tool calling! Example of Ollama doing web search:

Ollama v0.8 is here! Now it can stream responses with tool calling! Example of Ollama doing web search:

ollama

148,287 次观看 • 1 年前

Open models are already being used in the enterprise. Over 85% of the Fortune 500 companies already use Ollama to fulfill specific tasks. Jeffrey Morgan Why open models and Ollama? Ownership. Open models are yours to keep, customize, and optimize. Affordable. Run it the way you like, in your own environment. Private. Your data belongs to you.

Open models are already being used in the enterprise. Over 85% of the Fortune 500 companies already use Ollama to fulfill specific tasks. Jeffrey Morgan Why open models and Ollama? Ownership. Open models are yours to keep, customize, and optimize. Affordable. Run it the way you like, in your own environment. Private. Your data belongs to you.

ollama

42,988 次观看 • 1 个月前

Using AI at Meta's Muse Glimmer all locally to process personal monthly credit card statements. Your data belongs to you! Try different agent tasks using your favorite apps / harnesses with Ollama.

Using AI at Meta's Muse Glimmer all locally to process personal monthly credit card statements. Your data belongs to you! Try different agent tasks using your favorite apps / harnesses with Ollama.

ollama

27,167 次观看 • 5 天前

Ollama can now launch Pi, a minimal coding agent which you can customize for your workflow ollama launch pi You can even ask pi to write extensions for itself

Ollama can now launch Pi, a minimal coding agent which you can customize for your workflow ollama launch pi You can even ask pi to write extensions for itself

ollama

191,330 次观看 • 5 个月前

Running Llama 3.1 locally as a code assistant in VSCode with ollama ✨ Download Ollama ( ✨ Download CodeGPT ( ✨ Select the Llama 3.1 model (8b, 70b or 405b) ✨ Click download ✨ Enjoy! :)

Running Llama 3.1 locally as a code assistant in VSCode with ollama ✨ Download Ollama ( ✨ Download CodeGPT ( ✨ Select the Llama 3.1 model (8b, 70b or 405b) ✨ Click download ✨ Enjoy! :)

Daniel San

359,980 次观看 • 2 年前

U.S. open-source models are quickly gaining ground. @Nvidia's newest Nemotron Ultra is fast growing on Ollama and unlocking complex, longer running tasks for developers

U.S. open-source models are quickly gaining ground. @Nvidia's newest Nemotron Ultra is fast growing on Ollama and unlocking complex, longer running tasks for developers

ollama

73,881 次观看 • 1 个月前

Ollama 0.2 is here! Concurrency is now enabled by default. This unlocks 2 major features: Parallel requests Ollama can now serve multiple requests at the same time, using only a little bit of additional memory for each request. This enables use cases such as: - Handling multiple chat sessions at the same time - Hosting code completion LLMs for your team - Processing different parts of a document simultaneously - Running multiple agents at the same time Run multiple models Ollama now supports loading different models at the same time. This improves several use cases: - Retrieval Augmented Generation (RAG): both the embedding and text completion models can be loaded into memory simultaneously. - Agents: multiple versions of an agent can now run simultaneously - Running large and small models side-by-side Models are automatically loaded and unloaded based on requests and how much GPU memory is available.

Ollama 0.2 is here! Concurrency is now enabled by default. This unlocks 2 major features: Parallel requests Ollama can now serve multiple requests at the same time, using only a little bit of additional memory for each request. This enables use cases such as: - Handling multiple chat sessions at the same time - Hosting code completion LLMs for your team - Processing different parts of a document simultaneously - Running multiple agents at the same time Run multiple models Ollama now supports loading different models at the same time. This improves several use cases: - Retrieval Augmented Generation (RAG): both the embedding and text completion models can be loaded into memory simultaneously. - Agents: multiple versions of an agent can now run simultaneously - Running large and small models side-by-side Models are automatically loaded and unloaded based on requests and how much GPU memory is available.

ollama

219,429 次观看 • 2 年前

Ollama can now think! 🤔🤔🤔 For thinking models, and especially useful for very thoughtful models like DeepSeek-R1-0528, Ollama can separate the thoughts and the response. Thinking can also be disabled! This is useful for getting a direct response. This works across Ollama's CLI, API, and Python/JavaScript libraries. 🧵 blog post 👇👇👇

Ollama can now think! 🤔🤔🤔 For thinking models, and especially useful for very thoughtful models like DeepSeek-R1-0528, Ollama can separate the thoughts and the response. Thinking can also be disabled! This is useful for getting a direct response. This works across Ollama's CLI, API, and Python/JavaScript libraries. 🧵 blog post 👇👇👇

ollama

106,287 次观看 • 1 年前

GLM 5.2, open frontier-scale intelligence on Microsoft Foundry with AMD MI300X. Running a Codex goal with an open model never felt this good!

GLM 5.2, open frontier-scale intelligence on Microsoft Foundry with AMD MI300X. Running a Codex goal with an open model never felt this good!

Alvaro Bartolome

27,277 次观看 • 1 个月前

While everyone is crying, Zuck has gone all in on $AMD. Llama runs inferences exclusively on $AMD MI300X. This deal shows $AMD has an edge in inference over $NVDA, which will be a much larger market than training.

While everyone is crying, Zuck has gone all in on $AMD. Llama runs inferences exclusively on $AMD MI300X. This deal shows $AMD has an edge in inference over $NVDA, which will be a much larger market than training.

Antonio Linares

170,180 次观看 • 1 年前

Jeffrey Morgan was on TBPN this week to discuss Ollama's Series B fundraise and why open models are quickly becoming the default choice for developers Full video:

Jeffrey Morgan was on TBPN this week to discuss Ollama's Series B fundraise and why open models are quickly becoming the default choice for developers Full video:

ollama

37,170 次观看 • 1 个月前

Claude Desktop can now run with free local models. This is a huge workflow shift. → Install Ollama. → Run local models on your machine. → Connect Ollama to Claude Code. → Launch Claude Desktop with Ollama. → Swap models depending on the task. Save this video, you’ll use Claude with way more freedom. Want the SOP? DM me. 💬

Claude Desktop can now run with free local models. This is a huge workflow shift. → Install Ollama. → Run local models on your machine. → Connect Ollama to Claude Code. → Launch Claude Desktop with Ollama. → Swap models depending on the task. Save this video, you’ll use Claude with way more freedom. Want the SOP? DM me. 💬

Julian Goldie SEO

11,444 次观看 • 3 个月前

Discover how @AWSCloud advanced by AMD helps a gaming company run with the best in #cloud to deliver leading-edge performance, flexibility, and scalability. See how your business can run with the best to innovate on another level at

Discover how @AWSCloud advanced by AMD helps a gaming company run with the best in #cloud to deliver leading-edge performance, flexibility, and scalability. See how your business can run with the best to innovate on another level at

AMD

18,309 次观看 • 3 个月前