Loading video...

Video Failed to Load

Go Home

I built ChatGPT's memory system into Apple's LLM

120,124 views • 11 months ago •via X (Twitter)

24 Comments

Sanchit monga's profile picture
Sanchit monga11 months ago

Checkout @RunAnywhereAI we support Apple foundation models and other inference engines, and also bringing support for embeddings

hinzi's profile picture
hinzi11 months ago

Hey man I built a similar app but for llms via openrouter and with council mode. Would love to connect!

Sahil's profile picture
Sahil11 months ago

Very cool Steve. Not sure what you mean by apple’s llm though ? Is this an open source model or something Apple is already shipping in its devices ?

Steven Zhang's profile picture
Steven Zhang11 months ago

it’s a low parameter model that’s available in iOS 26

Stevie Graham (new account)'s profile picture
Stevie Graham (new account)11 months ago

Nice work man. I think @therealdaneel wants an orange McLaren too!

Steven Zhang's profile picture
Steven Zhang11 months ago

@therealdaneel let’s see who can get one first

Ego Sum Banditos's profile picture
Ego Sum Banditos11 months ago

Great job !

Jeff's profile picture
Jeff11 months ago

Very cool

Prasanna's profile picture
Prasanna11 months ago

@LocallyAIApp should get this

Daniel's profile picture
Daniel11 months ago

Ohh that's cool How do I try this?

Josué Gdm's profile picture
Josué Gdm11 months ago

wait this is fire

toma's profile picture
toma11 months ago

have you tried any of the memory benchmarks?

Christopher Karani's profile picture
Christopher Karani11 months ago

would love to try it out

Justin Liao's profile picture
Justin Liao11 months ago

Wow niche, I’d love to try

lenny 🥷's profile picture
lenny 🥷10 months ago

cool demo - digging the lightweight summaries for on-device personalization. keeps ai snappy without rag. just followed - let's connect! 🙃🤝

enzo enrico's profile picture
enzo enrico11 months ago

wait, how did you manage to make it so the model remembers stuff past its (very low) context window?

Kaya Jones's profile picture
Kaya Jones11 months ago

share the github

LMD's profile picture
LMD11 months ago

You can just do things

Godfrey.Builds's profile picture
Godfrey.Builds11 months ago

what would be some usecases for the model? Is it just a free llm app?

Sambit's profile picture
Sambit11 months ago

@rudrank you should have look at this!

Ron Adin's profile picture
Ron Adin11 months ago

this is good! pls see dm

mscode07's profile picture
mscode0711 months ago

Sounds interesting

Yan-David (Yanda) Erlich's profile picture
Yan-David (Yanda) Erlich11 months ago

👀😍

Mher's profile picture
Mher11 months ago

Is this using an on-device LLM provided by Apple?

Related Videos

How to hack apple's emoji system:
0:23

Sensitive content

How to hack apple's emoji system:

AlphaFox

4,392,249 views • 1 year ago