Загрузка видео...

Не удалось загрузить видео

На главную

Open-source LLMs are getting really good. They’re not as powerful as GPT-4, but they’re improving quickly and worth experimenting with. If you want to run AI models like Mistral-7B on your laptop this is the easiest way to do it.

575,582 просмотров • 2 лет назад •via X (Twitter)

Комментарии: 10

Фото профиля Mckay Wrigley
Mckay Wrigley2 лет назад

Mistral-7B last week felt like a major inflection point in OSS LLMs. Exciting for more people to begin playing around with locally running models!

Фото профиля Nick Dobos
Nick Dobos2 лет назад

GPT4All and LMStudio are also great app options Recently found LMStudio and its my new fav Better if you want an actual app instead of the command line Both have 1 click drop in local webserver openAi api compatible endpoints -

Фото профиля Yash 🧑‍💻
Yash 🧑‍💻2 лет назад

I used the LLM for code, so I still prefer GPT-4 🤖

Фото профиля Mckay Wrigley
Mckay Wrigley2 лет назад

Well yeah GPT-4 is the best and definitely what people should use for best results but exploring other LLMs is interesting and will be important going forward

Фото профиля Andrew Ruiz
Andrew Ruiz2 лет назад

That’s such a great name. Ollama.

Фото профиля Bland
Bland2 лет назад

@mckaywrigley For real - how's 'Bland' though? :D

Фото профиля Sense
Sense2 лет назад

Ollama is going to be huge. Feels like Docker, missing some feature still but great start.

Фото профиля Jai Rod
Jai Rod2 лет назад

Are these API access?

Фото профиля Mckay Wrigley
Mckay Wrigley2 лет назад

Nope they run locally on your machine for free

Фото профиля Max Howell
Max Howell2 лет назад

pkgx can run this. Just type `ollama` @pkgxdev

Похожие видео