Loading video...

Video Failed to Load

Go Home

Seeing, Listening, Remembering, and Reasoning A Multimodal Agent with Long-Term Memory

_akhaliq's profile picture

AK

425,857 subscribers

19,923 views • 11 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Multimodal Reasoning AI Agents are here with Gemini 2.0 Flash Thinking I built a multimodal AI agent that can reason and understand images using gemini flash reasoning LLM. 100% Opensource Code with step-by-step tutorial.
0:20

Multimodal Reasoning AI Agents are here with Gemini 2.0 Flash Thinking I built a multimodal AI agent that can reason and understand images using gemini flash reasoning LLM. 100% Opensource Code with step-by-step tutorial.

Shubham Saboo

36,596 views • 1 year ago

We've solved another piece of the generalist gaming agent puzzle! Mario requires different skills than Pokemon: reactive navigation, spatial reasoning, and safe exploration rather than long-term memory and zero-sum reasoning. Check out our new paper on finetuning VLMs to beat Mario via PPO. 👇
0:43

We've solved another piece of the generalist gaming agent puzzle! Mario requires different skills than Pokemon: reactive navigation, spatial reasoning, and safe exploration rather than long-term memory and zero-sum reasoning. Check out our new paper on finetuning VLMs to beat Mario via PPO. 👇

Seth Karten

80,747 views • 3 months ago

InternLM-XComposer2.5-OmniLive A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
2:53

InternLM-XComposer2.5-OmniLive A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

AK

43,691 views • 1 year ago

🚀 Say hello to the new & improved phidata 🚀 Build, ship, and monitor Agents with blazing-fast memory, knowledge, tools & reasoning 🔥 ⚡️ 70% faster memory & knowledge 🛠 100+ tools 🧠 Reasoning Agents 🤝 Multi-agent collaboration 📊 Built-in monitoring and Agent UI
0:34

🚀 Say hello to the new & improved phidata 🚀 Build, ship, and monitor Agents with blazing-fast memory, knowledge, tools & reasoning 🔥 ⚡️ 70% faster memory & knowledge 🛠 100+ tools 🧠 Reasoning Agents 🤝 Multi-agent collaboration 📊 Built-in monitoring and Agent UI

Ashpreet Bedi

114,568 views • 1 year ago

New short course: Long-Term Agentic Memory with LangGraph. Learn to build an agent with long-term memory in this course developed in collaboration with taught by its Co-Founder and CEO, Harrison Chase! Personal assistance and productivity tasks have become important use cases for agents. An important feature of an AI assistant, such as a coding or calendar assistant, is its ability to keep improving over time from its experience. Agent memory is the key capability that enables this. To add memory to an agent, you must first figure out what to store and what to retrieve when it is time to use the information. Additionally, you’ll have to decide when to update the stored information. For example, you might update in each iteration loop of the agent or perform updates in the background, with a helper agent. In this course, you will learn a mental framework to build agents with long-term memory. You'll create a useful email assistant that can respond, ignore, and notify using writing, scheduling, and memory-management tools. You’ll develop your agent's memory by adding facts to its memory store, provide examples to learn the user's preferences, and optimize system prompts to evolve instructions based on previous responses. In detail, you’ll: - Learn how the three types of memory--semantic, episodic, and procedural–and the two update mechanisms–via hot path and in the background–apply to your agents. - Build an email agent with writing, scheduling, and availability tools, along with a router that triages incoming email and handles it accordingly by ignoring, responding, or notifying the user. - Add tools to your email agent that allow it to operate on semantic memory by learning facts about the user, storing them in a long-term memory store, and searching over them in future interactions. - Incorporate episodic memory, in the form of few-shot examples, in the triage step of your agents to help them learn and update user preferences. - Add procedural memory as system prompts, optimized with feedback to improve the instructions the agent follows. Learn how to approach memory in agents, and start building agents with long-term memory with LangGraph! Please sign up here:
2:06

New short course: Long-Term Agentic Memory with LangGraph. Learn to build an agent with long-term memory in this course developed in collaboration with taught by its Co-Founder and CEO, Harrison Chase! Personal assistance and productivity tasks have become important use cases for agents. An important feature of an AI assistant, such as a coding or calendar assistant, is its ability to keep improving over time from its experience. Agent memory is the key capability that enables this. To add memory to an agent, you must first figure out what to store and what to retrieve when it is time to use the information. Additionally, you’ll have to decide when to update the stored information. For example, you might update in each iteration loop of the agent or perform updates in the background, with a helper agent. In this course, you will learn a mental framework to build agents with long-term memory. You'll create a useful email assistant that can respond, ignore, and notify using writing, scheduling, and memory-management tools. You’ll develop your agent's memory by adding facts to its memory store, provide examples to learn the user's preferences, and optimize system prompts to evolve instructions based on previous responses. In detail, you’ll: - Learn how the three types of memory--semantic, episodic, and procedural–and the two update mechanisms–via hot path and in the background–apply to your agents. - Build an email agent with writing, scheduling, and availability tools, along with a router that triages incoming email and handles it accordingly by ignoring, responding, or notifying the user. - Add tools to your email agent that allow it to operate on semantic memory by learning facts about the user, storing them in a long-term memory store, and searching over them in future interactions. - Incorporate episodic memory, in the form of few-shot examples, in the triage step of your agents to help them learn and update user preferences. - Add procedural memory as system prompts, optimized with feedback to improve the instructions the agent follows. Learn how to approach memory in agents, and start building agents with long-term memory with LangGraph! Please sign up here:

Andrew Ng

131,850 views • 1 year ago

Satya Nadella says the 3 capabilities needed for AI agents are now in place and improving exponentially: a universal interface of multimodality; the neural algebra of reasoning and planning; and long-term memory, rich context and tool use
1:09

Satya Nadella says the 3 capabilities needed for AI agents are now in place and improving exponentially: a universal interface of multimodality; the neural algebra of reasoning and planning; and long-term memory, rich context and tool use

Tsarathustra

69,091 views • 1 year ago

4. A search agent with multi-step trip planning and reasoning
1:47

4. A search agent with multi-step trip planning and reasoning

Chief AI Officer

56,091 views • 2 years ago

Build Multi Agent Systems with Reasoning and Context Thanks to sonnet-4, we have level 4 autonomous multi-agent systems working. Learn how to add: -> Reasoning Tools (think -> analyze) -> Shared Agentic Context -> Agentic Memory Code below 👇
14:17

Build Multi Agent Systems with Reasoning and Context Thanks to sonnet-4, we have level 4 autonomous multi-agent systems working. Learn how to add: -> Reasoning Tools (think -> analyze) -> Shared Agentic Context -> Agentic Memory Code below 👇

Ashpreet Bedi

38,576 views • 1 year ago

Machine Mental Imagery Empower Multimodal Reasoning with Latent Visual Tokens
0:34

Machine Mental Imagery Empower Multimodal Reasoning with Latent Visual Tokens

AK

43,516 views • 1 year ago

Long-term memories don’t always rely on short-term ones. New research uncovers a parallel pathway to memory formation, reshaping how we understand and treat memory impairments.
2:04

Long-term memories don’t always rely on short-term ones. New research uncovers a parallel pathway to memory formation, reshaping how we understand and treat memory impairments.

Neuroscience News

42,454 views • 1 year ago

We’ve developed a memory system for our models that provides both short-term visual memory and long-term semantic memory. Our approach allows us to train robots to perform long and complex tasks, like cleaning up a kitchen or preparing a grilled cheese sandwich from scratch 👇
2:16

We’ve developed a memory system for our models that provides both short-term visual memory and long-term semantic memory. Our approach allows us to train robots to perform long and complex tasks, like cleaning up a kitchen or preparing a grilled cheese sandwich from scratch 👇

Physical Intelligence

455,336 views • 5 months ago

Why having a goldfish memory is key to long-term success...
0:59

Why having a goldfish memory is key to long-term success...

Alan Stein, Jr.

53,491 views • 1 year ago

Gemini 2.5 is driving new advancements in robotics with its strong coding, spatial reasoning, and multimodal capabilities. 🦾
0:20

Gemini 2.5 is driving new advancements in robotics with its strong coding, spatial reasoning, and multimodal capabilities. 🦾

Google AI Developers

36,119 views • 1 year ago

Google's Project Astra using Gemini 2.0 is capable of multimodal reasoning, tool use, search, cross-session and cross-device memory, understanding your phone screen and the real world through glasses to be a universal AI assistant
2:32

Google's Project Astra using Gemini 2.0 is capable of multimodal reasoning, tool use, search, cross-session and cross-device memory, understanding your phone screen and the real world through glasses to be a universal AI assistant

Tsarathustra

18,938 views • 1 year ago

Google NotebookLM is absolutely amazing! I can’t stress this enough , if you’re not using it for learning purposes, you’re missing out on one of the best AI products available right now. With its interactive mode, it’s truly on another level. Anyway, Google has published a new AI architecture called Titans , This architecture gives AI systems more human-like memory, incorporating both short-term and long-term memory capabilities. With Titans, AI can now learn and reason more like humans, remembering an entire book while still processing new information. They tested Titans on various tasks, including language modeling, reasoning, and genomics. The results show that it outperforms existing models, especially when handling very long contexts.
1:41

Google NotebookLM is absolutely amazing! I can’t stress this enough , if you’re not using it for learning purposes, you’re missing out on one of the best AI products available right now. With its interactive mode, it’s truly on another level. Anyway, Google has published a new AI architecture called Titans , This architecture gives AI systems more human-like memory, incorporating both short-term and long-term memory capabilities. With Titans, AI can now learn and reason more like humans, remembering an entire book while still processing new information. They tested Titans on various tasks, including language modeling, reasoning, and genomics. The results show that it outperforms existing models, especially when handling very long contexts.

AshutoshShrivastava

121,968 views • 1 year ago

As one example of 1.5 Pro’s sophisticated multimodal understanding and reasoning capabilities with long context, when given a 44-minute silent film, the model can analyze various plot points and events, and even makes sense of small details you might have missed.
1:58

As one example of 1.5 Pro’s sophisticated multimodal understanding and reasoning capabilities with long context, when given a 44-minute silent film, the model can analyze various plot points and events, and even makes sense of small details you might have missed.

Sundar Pichai

348,363 views • 2 years ago

1/ Office Agent turns a few words into a PowerPoint or Word doc, with deep research and reasoning.
0:51

1/ Office Agent turns a few words into a PowerPoint or Word doc, with deep research and reasoning.

Satya Nadella

78,521 views • 10 months ago

Introducing Devin Auto-Triage: Your AI first-responder with long-term memory. Devin can monitor incoming bugs, alerts, and incidents, investigate them, and come back with context, next steps, or a PR.
0:49

Introducing Devin Auto-Triage: Your AI first-responder with long-term memory. Devin can monitor incoming bugs, alerts, and incidents, investigate them, and come back with context, next steps, or a PR.

Cognition

241,815 views • 2 months ago