Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

AI Agents can remember. But how does their memory actually work? 🧠 AI Agent Memory, explained in just 12 minutes! 🔥 • Working Memory & Context • Procedural, Semantic & Episodic Memory • RAG, Vector DBs & Top-K Search • Storing Past Conversations & Events • Memory Consolidation &...

21,981 Aufrufe • vor 13 Tagen •via X (Twitter)

31 Kommentare

Profilbild von Shen Sean Chen
Shen Sean Chenvor 13 Tagen

Hello Vishal, I’d appreciate it if you tag my handle and the original link of the video.

Profilbild von Vishal Singh
Vishal Singhvor 13 Tagen

hey Shen, already tagged you in the video....plus also DMed you before posting....but thanks for adding the youtube link here 👀🔥

Profilbild von Shen Sean Chen
Shen Sean Chenvor 13 Tagen

Still it’s inappropriate to re-upload another creator’s videos imo. I think the tagging feature only allows me to see it.

Profilbild von Vishal Singh
Vishal Singhvor 13 Tagen

nah tagging is visible to all checked 👍

Profilbild von Hive Desk
Hive Deskvor 13 Tagen

@ShenSeanChen rag vector stuff still breaks half the time

Profilbild von Vishal Singh
Vishal Singhvor 13 Tagen

@ShenSeanChen yup 😭

Profilbild von Omar 🪽
Omar 🪽vor 13 Tagen

@ShenSeanChen Memory is the hard part. My agents remember my bugs better than I do 😅

Profilbild von Vishal Singh
Vishal Singhvor 13 Tagen

@ShenSeanChen it's kinda the opposite for me nowadays my agents are acting way too dumb lol 😭

Profilbild von Omar 🪽
Omar 🪽vor 13 Tagen

@ShenSeanChen Genius one day, goldfish the next. Agent life 😭

Profilbild von Avyn 👾
Avyn 👾vor 12 Tagen

@ShenSeanChen the memory part is the whole game for agents. a model that forgets everything each session is just a very smart goldfish

Profilbild von Vishal Singh
Vishal Singhvor 12 Tagen

@ShenSeanChen exactly 💯

Profilbild von Jake
Jakevor 13 Tagen

@ShenSeanChen Memory is what turns a chatbot into an assistant. Without it you're re-explaining yourself every session.

Profilbild von Vishal Singh
Vishal Singhvor 12 Tagen

@ShenSeanChen yup 💯

Profilbild von 38岁不认输
38岁不认输vor 12 Tagen

@ShenSeanChen 记忆机制讲得越来越细,用户这边还差个很实际的入口:它记错了,我去哪儿改?能搜到、能编辑、能删,长期记忆才让人放心。

Profilbild von Vishal Singh
Vishal Singhvor 12 Tagen

@ShenSeanChen yes this point hasn't been covered here, thanks for pointing it out...need to check 👀👍💯

Profilbild von Matthew | Builds Chiefly + Local Presence
Matthew | Builds Chiefly + Local Presencevor 12 Tagen

@ShenSeanChen the piece most memory setups skip is forgetting. if nothing ever expires, old wrong facts keep getting pulled in. a simple "last confirmed" date on each memory and a re-check when it's stale fixes a lot

Profilbild von Vishal Singh
Vishal Singhvor 12 Tagen

@ShenSeanChen old wrong facts that are useless but still stored are the biggest hurdle...they fuck efficiency like no other 😭

Profilbild von Dominik
Dominikvor 12 Tagen

@ShenSeanChen an agent that remembers last week starts to feel like the same agent every morning

Profilbild von Vishal Singh
Vishal Singhvor 12 Tagen

@ShenSeanChen 🤨

Profilbild von Jean Vargas
Jean Vargasvor 13 Tagen

@ShenSeanChen Episodic memory is the part people skip most. Agents keep facts fine but forget what they already tried. Do you get into how to decide what gets written to memory and what gets thrown away?

Profilbild von Vishal Singh
Vishal Singhvor 13 Tagen

@ShenSeanChen kinda facing this my agents fail at complex tasks, so as i learn memory i'm trying to improve/optimise them better...will share more soon once i start seeing results 🫡

Profilbild von The SI Maximalist
The SI Maximalistvor 12 Tagen

@ShenSeanChen For many SI agents, long-term memory lives in an external store. Retrieval brings selected memories into context, so the real test is finding the right detail when it matters

Profilbild von Vishal Singh
Vishal Singhvor 12 Tagen

@ShenSeanChen yup 💯

Profilbild von Nex41
Nex41vor 13 Tagen

@ShenSeanChen A useful memory test: store a project constraint, change it later, then ask the agent to plan against it. Does it use the correction, or retrieve both versions as equally valid? How are you handling superseded facts in your experiments?

Profilbild von Vishal Singh
Vishal Singhvor 12 Tagen

@ShenSeanChen im experimenting this with something will share learnings/results soon 👀✨

Profilbild von Nex41
Nex41vor 12 Tagen

@ShenSeanChen Would be interested to see the results. Another case worth testing: “use X for this task only” versus “replace X with Y from now on.” Can the agent keep a temporary exception from becoming a permanent project rule?

Profilbild von AI Expert Khalid
AI Expert Khalidvor 13 Tagen

@ShenSeanChen Great breakdown 🔥 memory is the missing piece for agents doing real long-horizon work. Consolidation + summarization is where most implementations fall apart

Profilbild von Vishal Singh
Vishal Singhvor 12 Tagen

@ShenSeanChen memory + evals, 2 very very imp things imo 🙌

Profilbild von AI Expert Khalid
AI Expert Khalidvor 12 Tagen

@ShenSeanChen @vishalsingh2972 100% 🔥 bad memory write + no evals = agent confidently repeating the same mistake forever

Profilbild von Atul Yadav
Atul Yadavvor 12 Tagen

@ShenSeanChen A memory system also needs a correction path. If a user changes a preference, can the agent supersede the old fact, avoid retrieving both as current, and explain where the new value came from? Remembering more is useful only if stale memories can lose authority.

Profilbild von Vishal Singh
Vishal Singhvor 12 Tagen

@ShenSeanChen yes so much to needs to be done here...👀✨

Ähnliche Videos

New short course: Long-Term Agentic Memory with LangGraph. Learn to build an agent with long-term memory in this course developed in collaboration with taught by its Co-Founder and CEO, Harrison Chase! Personal assistance and productivity tasks have become important use cases for agents. An important feature of an AI assistant, such as a coding or calendar assistant, is its ability to keep improving over time from its experience. Agent memory is the key capability that enables this. To add memory to an agent, you must first figure out what to store and what to retrieve when it is time to use the information. Additionally, you’ll have to decide when to update the stored information. For example, you might update in each iteration loop of the agent or perform updates in the background, with a helper agent. In this course, you will learn a mental framework to build agents with long-term memory. You'll create a useful email assistant that can respond, ignore, and notify using writing, scheduling, and memory-management tools. You’ll develop your agent's memory by adding facts to its memory store, provide examples to learn the user's preferences, and optimize system prompts to evolve instructions based on previous responses. In detail, you’ll: - Learn how the three types of memory--semantic, episodic, and procedural–and the two update mechanisms–via hot path and in the background–apply to your agents. - Build an email agent with writing, scheduling, and availability tools, along with a router that triages incoming email and handles it accordingly by ignoring, responding, or notifying the user. - Add tools to your email agent that allow it to operate on semantic memory by learning facts about the user, storing them in a long-term memory store, and searching over them in future interactions. - Incorporate episodic memory, in the form of few-shot examples, in the triage step of your agents to help them learn and update user preferences. - Add procedural memory as system prompts, optimized with feedback to improve the instructions the agent follows. Learn how to approach memory in agents, and start building agents with long-term memory with LangGraph! Please sign up here:

Andrew Ng

132,273 Aufrufe • vor 1 Jahr

New short course: LLMs as Operating Systems: Agent Memory, created with Letta, and taught by its founders Charles Packer and Sarah Wooders. An LLM's input context window has limited space. Using a longer input context also costs more and results in slower processing. So, managing what's stored in this context window is important. In the innovative paper MemGPT: Towards LLMs as Operating Systems, its authors (which include the instructors) proposed using an LLM agent to manage this context window. Their system uses a large persistent memory that stores everything that could be included in the input context, and an agent decides what is actually included. Take the example of building a chatbot that needs to remember what's been said earlier in a conversation (perhaps over many days of interaction with a user). As the conversation's length grows, the memory management agent will move information from the input context to a persistent searchable database; summarize information to keep relevant facts in the input context; and restore relevant conversation elements from further back in time. This allows a chatbot to keep what's currently most relevant in its input context memory to generate the next response. When I read the original MemGPT paper, I thought it was an innovative technique for handling memory for LLMs. The open-source Letta framework, which we'll use in this course, makes MemGPT easy to implement. It adds memory to your LLM agents and gives them transparent long-term memory. In detail, you’ll learn: - How to build an agent that can edit its own limited input context memory, using tools and multi-step reasoning - What is a memory hierarchy (an idea from computer operating systems, which use a cache to speed up memory access), and how these ideas apply to managing the LLM input context (where the input context window is a "cache" storing the most relevant information; and an agent decides what to move in and out of this to/from a larger persistent storage system) - How to implement multi-agent collaboration by letting different agents share blocks of memory This course will give you a sophisticated understanding of memory management for LLMs, which is important for chatbots having long conversations, and for complex agentic workflows. Please sign up here!

Andrew Ng

201,127 Aufrufe • vor 2 Jahren