Loading video...

Video Failed to Load

Go Home

Open-source LLMs are getting really good. They’re not as powerful as GPT-4, but they’re improving quickly and worth experimenting with. If you want to run AI models like Mistral-7B on your laptop this is the easiest way to do it.

575,582 views • 2 years ago •via X (Twitter)

10 Comments

Mckay Wrigley's profile picture
Mckay Wrigley2 years ago

Mistral-7B last week felt like a major inflection point in OSS LLMs. Exciting for more people to begin playing around with locally running models!

Nick Dobos's profile picture
Nick Dobos2 years ago

GPT4All and LMStudio are also great app options Recently found LMStudio and its my new fav Better if you want an actual app instead of the command line Both have 1 click drop in local webserver openAi api compatible endpoints -

Yash 🧑‍💻's profile picture
Yash 🧑‍💻2 years ago

I used the LLM for code, so I still prefer GPT-4 🤖

Mckay Wrigley's profile picture
Mckay Wrigley2 years ago

Well yeah GPT-4 is the best and definitely what people should use for best results but exploring other LLMs is interesting and will be important going forward

Andrew Ruiz's profile picture
Andrew Ruiz2 years ago

That’s such a great name. Ollama.

Bland's profile picture
Bland2 years ago

@mckaywrigley For real - how's 'Bland' though? :D

Sense's profile picture
Sense2 years ago

Ollama is going to be huge. Feels like Docker, missing some feature still but great start.

Jai Rod's profile picture
Jai Rod2 years ago

Are these API access?

Mckay Wrigley's profile picture
Mckay Wrigley2 years ago

Nope they run locally on your machine for free

Max Howell's profile picture
Max Howell2 years ago

pkgx can run this. Just type `ollama` @pkgxdev

Related Videos