Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

I was able to run Meta’s Llama 2 7B parameters locally without internet connection on my 15 Pro Max It was a bit hot and a dumb cuz small LLM as a beta app (LLM Farm) Imagine it was a iOS centric and optimized one for Apple uses tho 🤌🏻

17,614 görüntüleme • 2 yıl önce •via X (Twitter)

8 Yorum

AppleLeaker profil fotoğrafı
AppleLeaker2 yıl önce

Wow. Could you please share how you were able to run this on-device?

ShrimpApplePro 🍤 ずっと真夜中でいいのに profil fotoğrafı
ShrimpApplePro 🍤 ずっと真夜中でいいのに2 yıl önce

LLM Farm (Testflight) You can use the sample models or trying others on hugginface I think you can get a GPT 2 as well I would recommend run it on a M1 machine or A17 Pro cuz holy hell it eats RAM and hot af on first run 💀

ShrimpApplePro 🍤 ずっと真夜中でいいのに profil fotoğrafı
ShrimpApplePro 🍤 ずっと真夜中でいいのに2 yıl önce

Idk if it tuned after I talked to it but its responds are a lot faster than 2 days ago.

anpaure profil fotoğrafı
anpaure2 yıl önce

respect for zutomayo

Ben profil fotoğrafı
Ben2 yıl önce

How much memory does this 7b model take?

La Pyae 🚀 profil fotoğrafı
La Pyae 🚀2 yıl önce

I wonder if it is still work for Llama 3.1 as well .

INIYSA profil fotoğrafı
INIYSA2 yıl önce

To add, iPhone autocorrect feature already using smal gpt-2 based model

ShrimpApplePro 🍤 ずっと真夜中でいいのに profil fotoğrafı
ShrimpApplePro 🍤 ずっと真夜中でいいのに2 yıl önce

Ooh interesting

Benzer Videolar