Loading video...

Video Failed to Load

Go Home

Your laptop just became an AI lab. New `docker model run` in Docker Desktop (Beta) ๐Ÿณ the demo with Kevin Wittek shows: ๐Ÿ–ฅ๏ธ CLI chat ๐Ÿง  Model listing ๐Ÿงฉ GenAI app integration w/ OpenAI SDK #Docker #LLM #AIDev #LocalDev #GenAI #DevTools

26,024 views โ€ข 1 year ago โ€ขvia X (Twitter)

11 Comments

Matthew Rogers's profile picture
Matthew Rogers1 year ago

@Kiview What does hardware accelerated mean here? Mps? This looks like youโ€™re just running @ollama ?

MightyBot's profile picture
MightyBot1 year ago

๐Ÿง  Unified Search. Smarter Meetings. Effortless CRM. MightyBot is your AI agent platform for seamless workflowsโ€”record meetings, automate CRM updates, and find answers across apps in seconds. ๐ŸŒŸ Focus on what matters. We'll handle the grind.

๐Ÿ‚'s profile picture
๐Ÿ‚1 year ago

@Kiview how is this different from ollama?

Yakin Rubaiyat's profile picture
Yakin Rubaiyat1 year ago

@Kiview Can you collaborate with Ollama and improve it? I really need this.

Matthew Rogers's profile picture
Matthew Rogers1 year ago

@Kiview Does this work with mlx?

changedetection.io's profile picture
changedetection.io1 year ago

@Kiview This is AWESOME, well done! ๐Ÿ˜๐Ÿ˜๐ŸŽ‰๐ŸŽ‰

Ettore Di Giacinto's profile picture
Ettore Di Giacinto1 year ago

@Kiview I like it. I guess that's the whole point of commoditizing AI

Big Bruno's profile picture
Big Bruno1 year ago

@Kiview Can this be linked to OpenUI

johnnieskywalker's profile picture
johnnieskywalker1 year ago

@Kiview so it's @ollama without need to install ollama cli?

tolu's profile picture
tolu1 year ago

@Kiview Can you upload that project to a github repo so we can test? Also I do to understand the api key environment variable. What keys are you using in this example?

ryan yang's profile picture
ryan yang1 year ago

@Kiview Local AI sandboxes? Start non-critical workflows hereโ€”test latency, iterate. Modular steps > full rebuilds. Measure ROI, then scale. Coffee fuels the debug grind. Dockerโ€™s approach aligns with phased pilots.

Related Videos