Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

I built ChatGPT's memory system into Apple's LLM

stevenzhang's profile picture

Steven Zhang

11,562 subscribers

120,124 görüntüleme • 10 ay önce •via X (Twitter)

EğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

24 Yorum

Sanchit monga profil fotoğrafı
Sanchit monga10 ay önce

Checkout @RunAnywhereAI we support Apple foundation models and other inference engines, and also bringing support for embeddings

hinzi profil fotoğrafı
hinzi10 ay önce

Hey man I built a similar app but for llms via openrouter and with council mode. Would love to connect!

Sahil profil fotoğrafı
Sahil10 ay önce

Very cool Steve. Not sure what you mean by apple’s llm though ? Is this an open source model or something Apple is already shipping in its devices ?

Steven Zhang profil fotoğrafı
Steven Zhang10 ay önce

it’s a low parameter model that’s available in iOS 26

Stevie Graham (new account) profil fotoğrafı
Stevie Graham (new account)10 ay önce

Nice work man. I think @therealdaneel wants an orange McLaren too!

Steven Zhang profil fotoğrafı
Steven Zhang10 ay önce

@therealdaneel let’s see who can get one first

Ego Sum Banditos profil fotoğrafı
Ego Sum Banditos10 ay önce

Great job !

Jeff profil fotoğrafı
Jeff10 ay önce

Very cool

Prasanna profil fotoğrafı
Prasanna10 ay önce

@LocallyAIApp should get this

Daniel profil fotoğrafı
Daniel10 ay önce

Ohh that's cool How do I try this?

Josué Gdm profil fotoğrafı
Josué Gdm10 ay önce

wait this is fire

toma profil fotoğrafı
toma10 ay önce

have you tried any of the memory benchmarks?

Christopher Karani profil fotoğrafı
Christopher Karani10 ay önce

would love to try it out

Justin Liao profil fotoğrafı
Justin Liao10 ay önce

Wow niche, I’d love to try

lenny 🥷 profil fotoğrafı
lenny 🥷9 ay önce

cool demo - digging the lightweight summaries for on-device personalization. keeps ai snappy without rag. just followed - let's connect! 🙃🤝

enzo enrico profil fotoğrafı
enzo enrico10 ay önce

wait, how did you manage to make it so the model remembers stuff past its (very low) context window?

Kaya Jones profil fotoğrafı
Kaya Jones10 ay önce

share the github

LMD profil fotoğrafı
LMD10 ay önce

You can just do things

Godfrey.Builds profil fotoğrafı
Godfrey.Builds10 ay önce

what would be some usecases for the model? Is it just a free llm app?

Sambit profil fotoğrafı
Sambit10 ay önce

@rudrank you should have look at this!

Ron Adin profil fotoğrafı
Ron Adin10 ay önce

this is good! pls see dm

mscode07 profil fotoğrafı
mscode0710 ay önce

Sounds interesting

Yan-David (Yanda) Erlich profil fotoğrafı
Yan-David (Yanda) Erlich10 ay önce

👀😍

Mher profil fotoğrafı
Mher10 ay önce

Is this using an on-device LLM provided by Apple?

Benzer Videolar

I turned my iPad into Tom Riddle’s diary with Apple’s new Foundation Models, an LLM built into iOS. It’s lightning fast!
0:34

I turned my iPad into Tom Riddle’s diary with Apple’s new Foundation Models, an LLM built into iOS. It’s lightning fast!

Ethan Saadia @ SIGGRAPH

330,886 görüntüleme • 1 yıl önce

Holy shit... One month before Andrej Karpathy dropped the “LLM Wiki” idea… someone had already built it. Not theory. Not hype. A working system. LLMs today restart from zero every time. No memory. No evolution. No learning. That’s broken. Most people use CLAUDE.md / AGENTS.md → Manual updates → Easy to forget → Knowledge gets lost That’s not intelligence. That’s a notepad. So I built dynamic memory for LLMs: • Learns automatically • Stores without manual effort • Weakens irrelevant data over time • Strengthens what actually matters Before the “LLM Wiki” idea went viral, this already had: • Brain-like decay/boost memory • Smart deduplication (no noise) • Experience tracking per tech • Cross-referenced knowledge graph • Loss-proof backups • Auto-grouped tool sessions Then I added: • memory_audit (clean + optimize memory) • Memory injection directly into tools Now this isn’t just a concept. It’s a live system that turns LLMs from stateless tools → evolving intelligence. Using it daily: → ~5K tokens → Zero manual work → Memory that actually compounds Link in comments. RT & Bookmark — this will be standard soon.
0:32

Holy shit... One month before Andrej Karpathy dropped the “LLM Wiki” idea… someone had already built it. Not theory. Not hype. A working system. LLMs today restart from zero every time. No memory. No evolution. No learning. That’s broken. Most people use CLAUDE.md / AGENTS.md → Manual updates → Easy to forget → Knowledge gets lost That’s not intelligence. That’s a notepad. So I built dynamic memory for LLMs: • Learns automatically • Stores without manual effort • Weakens irrelevant data over time • Strengthens what actually matters Before the “LLM Wiki” idea went viral, this already had: • Brain-like decay/boost memory • Smart deduplication (no noise) • Experience tracking per tech • Cross-referenced knowledge graph • Loss-proof backups • Auto-grouped tool sessions Then I added: • memory_audit (clean + optimize memory) • Memory injection directly into tools Now this isn’t just a concept. It’s a live system that turns LLMs from stateless tools → evolving intelligence. Using it daily: → ~5K tokens → Zero manual work → Memory that actually compounds Link in comments. RT & Bookmark — this will be standard soon.

Nainsi Dwivedi

15,814 görüntüleme • 6 ay önce

How to hack apple's emoji system:
0:23

Sensitive content

How to hack apple's emoji system:

AlphaFox

4,392,079 görüntüleme • 1 yıl önce

He is 17 sold an LLM system to Anthropic for $2.2M - and at Stanford shared how to build and sell one from scratch: 00:20 - how to build an LLM system that Anthropic will buy for millions 08:34 - one prompt in Opus 5 and the LLM system is ready to sell in 60 minutes 23:47 - how to sell an LLM to Anthropic at 17 with no experience and reach $2.2M a year after watching I built my first LLM system in 60 minutes - and sold it to Anthropic for $120k. save & watch - the article below is one file that builds an LLM system and sells it to Anthropic for $2.2M.
36:05

He is 17 sold an LLM system to Anthropic for $2.2M - and at Stanford shared how to build and sell one from scratch: 00:20 - how to build an LLM system that Anthropic will buy for millions 08:34 - one prompt in Opus 5 and the LLM system is ready to sell in 60 minutes 23:47 - how to sell an LLM to Anthropic at 17 with no experience and reach $2.2M a year after watching I built my first LLM system in 60 minutes - and sold it to Anthropic for $120k. save & watch - the article below is one file that builds an LLM system and sells it to Anthropic for $2.2M.

Noisy

25,571 görüntüleme • 1 ay önce

I built an LLM from scratch. Here's everything I learned along the way.
1:54

I built an LLM from scratch. Here's everything I learned along the way.

CJ (Coding Garden)

258,519 görüntüleme • 3 ay önce

I needed a quick tool to convert any sort of GitHub links into a format an LLM could read. So I built it. GitHub → LLM It's completely free and works with projects, folders, or files 🪄 Deployed on Replit ⠕
0:28

I needed a quick tool to convert any sort of GitHub links into a format an LLM could read. So I built it. GitHub → LLM It's completely free and works with projects, folders, or files 🪄 Deployed on Replit ⠕

Pietro Schirano

120,827 görüntüleme • 2 yıl önce

He is a 1st year AI engineering student at Stanford - and already launched an automated system making $2.1M a year: 00:20 - how Anthropic engineers make millions with LLM and Transformers 38:34 - In-Context Learning makes AI smarter for free 59:47 - 1st year student made $2.1M using LLM from scratch after watching I gave LLM the idea I had been holding in my head for 3 years - it built it in one evening. save & watch - the article below is a step by step guide to build your automated LLM system.
1:16:48

He is a 1st year AI engineering student at Stanford - and already launched an automated system making $2.1M a year: 00:20 - how Anthropic engineers make millions with LLM and Transformers 38:34 - In-Context Learning makes AI smarter for free 59:47 - 1st year student made $2.1M using LLM from scratch after watching I gave LLM the idea I had been holding in my head for 3 years - it built it in one evening. save & watch - the article below is a step by step guide to build your automated LLM system.

Noisy

43,713 görüntüleme • 3 ay önce

I built the LLM interface I wished existed. interface0 is for power users: cross-provider memory & chat, multi-model synthesis, sharing & team features, granular context engineering, template prompts, forking, prompt enhancing, & more Here's a demo—see 🧵 for the rest
3:43

I built the LLM interface I wished existed. interface0 is for power users: cross-provider memory & chat, multi-model synthesis, sharing & team features, granular context engineering, template prompts, forking, prompt enhancing, & more Here's a demo—see 🧵 for the rest

Andy Bromberg

26,673 görüntüleme • 1 yıl önce

CLAUDE COWORK TOUR: I built my own rules and memory system (harness) so that Claude Cowork remembers everything I do. In this video I show you the specific folder structures, files, and why I did it this way. I use this same system for all 3 of my companies.
13:09

CLAUDE COWORK TOUR: I built my own rules and memory system (harness) so that Claude Cowork remembers everything I do. In this video I show you the specific folder structures, files, and why I did it this way. I use this same system for all 3 of my companies.

Justin Brooke

26,774 görüntüleme • 6 ay önce

He is 18 built an LLM and sold it to Anthropic for $3.2M - and at Stanford shared how to repeat it from scratch: 00:30 - how to build an LLM worth $100k in one evening 21:34 - how one LLM controls 1000 processes at the same time 43:47 - from first prompt to $3.2M from Anthropic after watching I built my first LLM in 60 minutes- a week later Anthropic offered me $100k for the system. save & watch - the article below shows how to build an LLM and sell it to Anthropic for $3.2M from scratch
1:44:13

He is 18 built an LLM and sold it to Anthropic for $3.2M - and at Stanford shared how to repeat it from scratch: 00:30 - how to build an LLM worth $100k in one evening 21:34 - how one LLM controls 1000 processes at the same time 43:47 - from first prompt to $3.2M from Anthropic after watching I built my first LLM in 60 minutes- a week later Anthropic offered me $100k for the system. save & watch - the article below shows how to build an LLM and sell it to Anthropic for $3.2M from scratch

Noisy

46,947 görüntüleme • 1 ay önce

Used Karpathy's LLM Wiki to turn Claude Code into a self-evolving system. Fed it my frontend & CRM sources, and it built a fully updating dashboard with Shadcn packages and constantly improving and linking everything for smarter outputs! Full setup video:
0:25

Used Karpathy's LLM Wiki to turn Claude Code into a self-evolving system. Fed it my frontend & CRM sources, and it built a fully updating dashboard with Shadcn packages and constantly improving and linking everything for smarter outputs! Full setup video:

WorldofAI

133,594 görüntüleme • 7 ay önce

The whole session ranks among my favorite David talks. Built friction out of the system not into the system and the XRP Ledger is built for business!
0:27

The whole session ranks among my favorite David talks. Built friction out of the system not into the system and the XRP Ledger is built for business!

Vet

35,717 görüntüleme • 1 yıl önce

SCIENTISTS TURN LIGHT INTO A MEMORY SYSTEM Scientists built a tiny photonic chip and sent identical photons through it, expecting messy quantum behavior. Instead, the light started acting like a memory system, forming patterns that match a classic AI model used for associative memory. In simple terms, the interference between photons did the math needed to store and recall patterns. No brain, no computer, just light physics doing the computing. Source: NewsForce
2:34

SCIENTISTS TURN LIGHT INTO A MEMORY SYSTEM Scientists built a tiny photonic chip and sent identical photons through it, expecting messy quantum behavior. Instead, the light started acting like a memory system, forming patterns that match a classic AI model used for associative memory. In simple terms, the interference between photons did the math needed to store and recall patterns. No brain, no computer, just light physics doing the computing. Source: NewsForce

NewsForce

29,578 görüntüleme • 8 ay önce

LLM + Memory + Planning + Tools = Agents 🤖 Last month, Job and I discussed how generative AI is shifting how companies offer customer support. How can we add more layers to our RAG apps to make it more agentic? LLM: Large language model alone Memory: Short-term and long-term memory Planning: Breaking down questions into sub-questions, plan the steps needed before taking action, etc. Tools: Calculator, code executor, weather API, etc. I hope you find this small clip interesting! The link to the full recording is below.
2:19

LLM + Memory + Planning + Tools = Agents 🤖 Last month, Job and I discussed how generative AI is shifting how companies offer customer support. How can we add more layers to our RAG apps to make it more agentic? LLM: Large language model alone Memory: Short-term and long-term memory Planning: Breaking down questions into sub-questions, plan the steps needed before taking action, etc. Tools: Calculator, code executor, weather API, etc. I hope you find this small clip interesting! The link to the full recording is below.

Erika Shorten

32,443 görüntüleme • 2 yıl önce

Fellas, stop guessing. I built a system that turns content into income, and I’m teaching you step-by-step. This ain’t luck, it’s strategy!
0:30

Fellas, stop guessing. I built a system that turns content into income, and I’m teaching you step-by-step. This ain’t luck, it’s strategy!

Tysin Black 2.0

11,485 görüntüleme • 1 yıl önce

Introducing Brain in Computer. Brain is a continuously learning memory system. Every task on Computer plugs into a context graph built by Brain. It makes Computer more stateful with every run. Available as a research preview for all Perplexity Max subscribers.
1:06

Introducing Brain in Computer. Brain is a continuously learning memory system. Every task on Computer plugs into a context graph built by Brain. It makes Computer more stateful with every run. Available as a research preview for all Perplexity Max subscribers.

Perplexity

612,738 görüntüleme • 4 ay önce

I built the best memory for voice agents while sponsoring Y Combinator hackathon. Introducing: Voice AI + Memory! We built a deep supermemory integration for Pipecat AI, so now even your agents have great memory With user profiles, these are almost-instant latency as well :)
2:11

I built the best memory for voice agents while sponsoring Y Combinator hackathon. Introducing: Voice AI + Memory! We built a deep supermemory integration for Pipecat AI, so now even your agents have great memory With user profiles, these are almost-instant latency as well :)

Dhravya Shah

83,511 görüntüleme • 8 ay önce

How I Built Grey Matter, A Procedural Data System in Blender
1:12

How I Built Grey Matter, A Procedural Data System in Blender

Sam Hox

84,439 görüntüleme • 1 yıl önce