Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

I was able to run Meta’s Llama 2 7B parameters locally without internet connection on my 15 Pro Max It was a bit hot and a dumb cuz small LLM as a beta app (LLM Farm) Imagine it was a iOS centric and optimized one for Apple uses tho 🤌🏻

VNchocoTaco's profile picture

ShrimpApplePro 🍤 ずっと真夜中でいいのに

33,964 subscribers

17,614 Aufrufe • vor 2 Jahren •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

8 Kommentare

Profilbild von AppleLeaker
AppleLeakervor 2 Jahren

Wow. Could you please share how you were able to run this on-device?

Profilbild von ShrimpApplePro 🍤 ずっと真夜中でいいのに
ShrimpApplePro 🍤 ずっと真夜中でいいのにvor 2 Jahren

LLM Farm (Testflight) You can use the sample models or trying others on hugginface I think you can get a GPT 2 as well I would recommend run it on a M1 machine or A17 Pro cuz holy hell it eats RAM and hot af on first run 💀

Profilbild von ShrimpApplePro 🍤 ずっと真夜中でいいのに
ShrimpApplePro 🍤 ずっと真夜中でいいのにvor 2 Jahren

Idk if it tuned after I talked to it but its responds are a lot faster than 2 days ago.

Profilbild von anpaure
anpaurevor 2 Jahren

respect for zutomayo

Profilbild von Ben
Benvor 2 Jahren

How much memory does this 7b model take?

Profilbild von La Pyae 🚀
La Pyae 🚀vor 2 Jahren

I wonder if it is still work for Llama 3.1 as well .

Profilbild von INIYSA
INIYSAvor 2 Jahren

To add, iPhone autocorrect feature already using smal gpt-2 based model

Profilbild von ShrimpApplePro 🍤 ずっと真夜中でいいのに
ShrimpApplePro 🍤 ずっと真夜中でいいのにvor 2 Jahren

Ooh interesting

Ähnliche Videos

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):
0:35

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Shubham Saboo

189,778 Aufrufe • vor 2 Jahren

Introducing: Cohere Command A+ We’ve created our most powerful LLM yet, optimized it to run on as little hardware as possible, and released it open-source for all.
1:07

Introducing: Cohere Command A+ We’ve created our most powerful LLM yet, optimized it to run on as little hardware as possible, and released it open-source for all.

Cohere

744,686 Aufrufe • vor 4 Monaten

Claude 3.5 Sonnet creates fully working ChatGPT clone from just a screenshot in 2 minutes. It uses Llama-3 running locally on your computer (100% free and without internet).
0:52

Claude 3.5 Sonnet creates fully working ChatGPT clone from just a screenshot in 2 minutes. It uses Llama-3 running locally on your computer (100% free and without internet).

Shubham Saboo

345,020 Aufrufe • vor 2 Jahren

“I ordered an iPhone 17 Pro Max from the UK, but after receiving it and checking it, I realised that it had ‘Apple Acconut’ instead of ‘Apple Account,’ and there was no option for the battery health.” — A Ghanaian woman was left shocked after discovering that the iPhone 17 Pro Max she ordered from the UK was counterfeit, with a misspelled ‘Apple Acconut’ instead of ‘Apple Account,’ no battery health option, and other fake features.
1:01

“I ordered an iPhone 17 Pro Max from the UK, but after receiving it and checking it, I realised that it had ‘Apple Acconut’ instead of ‘Apple Account,’ and there was no option for the battery health.” — A Ghanaian woman was left shocked after discovering that the iPhone 17 Pro Max she ordered from the UK was counterfeit, with a misspelled ‘Apple Acconut’ instead of ‘Apple Account,’ no battery health option, and other fake features.

𝐀𝐒𝐊

136,182 Aufrufe • vor 2 Monaten

Apple just released a web page promoting privacy and it uses an iPhone 15 Pro with no Liquid glass representation anywhere. It mentions a lot about Apple Intelligence Looks like this web page was made for WWDC24 and finally released because Apple Intelligence is almost ready
0:37

Apple just released a web page promoting privacy and it uses an iPhone 15 Pro with no Liquid glass representation anywhere. It mentions a lot about Apple Intelligence Looks like this web page was made for WWDC24 and finally released because Apple Intelligence is almost ready

SLK15

283,278 Aufrufe • vor 8 Monaten

ollie: i was 15 when i moved to italy, and it was tough for me because i went pretty much alone. i didn’t know anyone, i didn’t speak the language, and i was a bit stuck there. there i had to grow up very quickly. it was tough, i struggled and i think my family struggled as well, because it was a big part of the family gone. but again it was another compromise that needed to be made, and i was very happy to make it.
0:44

ollie: i was 15 when i moved to italy, and it was tough for me because i went pretty much alone. i didn’t know anyone, i didn’t speak the language, and i was a bit stuck there. there i had to grow up very quickly. it was tough, i struggled and i think my family struggled as well, because it was a big part of the family gone. but again it was another compromise that needed to be made, and i was very happy to make it.

nat ✧

198,590 Aufrufe • vor 7 Tagen

how many of you send things to yourself on whatsapp and never find them again? i tried fixing it. built a mac app that lives in your notch. - drag and drop any media. - ask it anything later. - uses local llm and runs locally. - pay once, keep it forever. ~ ~ built this at build something wonderful w/ Devesh.
2:22

how many of you send things to yourself on whatsapp and never find them again? i tried fixing it. built a mac app that lives in your notch. - drag and drop any media. - ask it anything later. - uses local llm and runs locally. - pay once, keep it forever. ~ ~ built this at build something wonderful w/ Devesh.

Akhil

26,602 Aufrufe • vor 2 Monaten

I was able to squeeze in a quick visit to Tunisia, and one of my main goals was to see the famous and iconic 'Blue Quran'. Here is a brief video about it. PS. Apologies for video quality and appearance, it was an unplanned and hectic trip. 😉
5:14

I was able to squeeze in a quick visit to Tunisia, and one of my main goals was to see the famous and iconic 'Blue Quran'. Here is a brief video about it. PS. Apologies for video quality and appearance, it was an unplanned and hectic trip. 😉

Dr. Yasir Qadhi

44,872 Aufrufe • vor 1 Jahr

HOLY SHIT!! I WAS USING CHEETOR USB FOR MY ANIMATION FINAL CUZ I COULDNT FIND MY REGULAR ONE AND THERE WAS A PROGRAM ON THE USB WITH AN AUTOBOT SYMBOL AND I RAN IT AND I GOT CHEETOR DESKTOP PET
0:24

HOLY SHIT!! I WAS USING CHEETOR USB FOR MY ANIMATION FINAL CUZ I COULDNT FIND MY REGULAR ONE AND THERE WAS A PROGRAM ON THE USB WITH AN AUTOBOT SYMBOL AND I RAN IT AND I GOT CHEETOR DESKTOP PET

⚡️✨️ZEKROM✨️⚡️cybercattechno @ blue/sky

563,088 Aufrufe • vor 2 Jahren

solo grinded to e1 for a full month and decided i was done only playing for the win for a bit and just want to actually enjoy myself until i grind again sometime soon. running it down on billy for max KP is as fun as it gets on this game
2:09

solo grinded to e1 for a full month and decided i was done only playing for the win for a bit and just want to actually enjoy myself until i grind again sometime soon. running it down on billy for max KP is as fun as it gets on this game

Arev

28,286 Aufrufe • vor 3 Monaten

It was a longer day in court than normal today so I was grateful to Eva Chipiuk, BSc, LLB, LLM for taking a few minutes to talk about Carrie Sakamoto hearings this week and what we can expect tomorrow. It will be an early start tomorrow in hopes counsel will be able to wrap up.
5:21

It was a longer day in court than normal today so I was grateful to Eva Chipiuk, BSc, LLB, LLM for taking a few minutes to talk about Carrie Sakamoto hearings this week and what we can expect tomorrow. It will be an early start tomorrow in hopes counsel will be able to wrap up.

Tamara Lich 🇨🇦

23,183 Aufrufe • vor 3 Monaten

"I found out about a week ago that this was even a possibility and it was (a) surprise. It was a bit of excitement. I was definitely looking for the opportunity and God willing, it happened." #Rams DE Myles Garrett on the trade from the #Browns
0:40

"I found out about a week ago that this was even a possibility and it was (a) surprise. It was a bit of excitement. I was definitely looking for the opportunity and God willing, it happened." #Rams DE Myles Garrett on the trade from the #Browns

92.3 The Fan

61,601 Aufrufe • vor 3 Monaten

"It was all a little bit pathetic" 👀 One week on, Max Verstappen and George Russell respond to their incident in Baku ⬇️
1:26

"It was all a little bit pathetic" 👀 One week on, Max Verstappen and George Russell respond to their incident in Baku ⬇️

Sky Sports F1

234,180 Aufrufe • vor 3 Jahren

Will Ospreay has revealed part of the reason behind why Baba O'Riley was chosen for his AEW All In 2026 entrance was because the song was used for an MV Zone tribute video to Bryan Danielson in 2011. "There was a song that we wanted, but we just couldn’t get a licence fee for it. I won’t put it out there because maybe one of these days I will be able to track it down again. I’d like to leave that as a surprise. But it was Mike Mansury that came up with the idea of The Who Baba O’Riley. "I’ll be honest with you, I have a connection with that song because there was a music video from the MV Zone. It was like a kind of little backyard wrestling music video group, and they did a Bryan Danielson tribute to that song, so I have a little bit of a connection to it. "I was just okay, I quite like the idea and The Who is British as well, so that’s kind of cool. But I remember listening to it and on the travels that me and Al (Alex Windsor) did, and I was just like, I don’t know if I feel it. The other song that I wanted got my juices flowing. It was my favourite song. I don’t know if I feel it. It was only when I heard the voiceover and I saw the clips that were all around it. I was like, 'this is perfect. This is it. Don’t change a thing.'" (Source: Chris Van Vliet)
8:51

Will Ospreay has revealed part of the reason behind why Baba O'Riley was chosen for his AEW All In 2026 entrance was because the song was used for an MV Zone tribute video to Bryan Danielson in 2011. "There was a song that we wanted, but we just couldn’t get a licence fee for it. I won’t put it out there because maybe one of these days I will be able to track it down again. I’d like to leave that as a surprise. But it was Mike Mansury that came up with the idea of The Who Baba O’Riley. "I’ll be honest with you, I have a connection with that song because there was a music video from the MV Zone. It was like a kind of little backyard wrestling music video group, and they did a Bryan Danielson tribute to that song, so I have a little bit of a connection to it. "I was just okay, I quite like the idea and The Who is British as well, so that’s kind of cool. But I remember listening to it and on the travels that me and Al (Alex Windsor) did, and I was just like, I don’t know if I feel it. The other song that I wanted got my juices flowing. It was my favourite song. I don’t know if I feel it. It was only when I heard the voiceover and I saw the clips that were all around it. I was like, 'this is perfect. This is it. Don’t change a thing.'" (Source: Chris Van Vliet)

Cultaholic Wrestling

29,644 Aufrufe • vor 16 Tagen

Thanks to Qnoox I discovered this: Dr. Sbaitso from 1992 (33 years ago!) One of the first AI chat apps, I guess you could call it a highly primitive LLM, running on MS-DOS The cool thing is it already had speech synthesis so it could speak back via TTS! And when I was talking to it, within a few questions it was already asking for more compute, it wanted to become ChatGPT :D Installed it on now, you have to exit to DOS first, then CD SBAITSO, and then run SBAITSO2.BAT
1:23

Thanks to Qnoox I discovered this: Dr. Sbaitso from 1992 (33 years ago!) One of the first AI chat apps, I guess you could call it a highly primitive LLM, running on MS-DOS The cool thing is it already had speech synthesis so it could speak back via TTS! And when I was talking to it, within a few questions it was already asking for more compute, it wanted to become ChatGPT :D Installed it on now, you have to exit to DOS first, then CD SBAITSO, and then run SBAITSO2.BAT

@levelsio

259,439 Aufrufe • vor 11 Monaten

MEGGY MADE IT!!! I literally threw my arms around the vet’s neck and cried my eyes out. I was able to see her for a bit and she is in recovery
0:29

MEGGY MADE IT!!! I literally threw my arms around the vet’s neck and cried my eyes out. I was able to see her for a bit and she is in recovery

The Tails of Cat Castle #lovewins

130,059 Aufrufe • vor 1 Jahr