正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Seeing, Listening, Remembering, and Reasoning A Multimodal Agent with Long-Term Memory

AK

425,857 subscribers

19,923 次观看 • 10 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Multimodal Reasoning AI Agents are here with Gemini 2.0 Flash Thinking I built a multimodal AI agent that can reason and understand images using gemini flash reasoning LLM. 100% Opensource Code with step-by-step tutorial.

Multimodal Reasoning AI Agents are here with Gemini 2.0 Flash Thinking I built a multimodal AI agent that can reason and understand images using gemini flash reasoning LLM. 100% Opensource Code with step-by-step tutorial.

Shubham Saboo

36,596 次观看 • 1 年前

We've solved another piece of the generalist gaming agent puzzle! Mario requires different skills than Pokemon: reactive navigation, spatial reasoning, and safe exploration rather than long-term memory and zero-sum reasoning. Check out our new paper on finetuning VLMs to beat Mario via PPO. 👇

We've solved another piece of the generalist gaming agent puzzle! Mario requires different skills than Pokemon: reactive navigation, spatial reasoning, and safe exploration rather than long-term memory and zero-sum reasoning. Check out our new paper on finetuning VLMs to beat Mario via PPO. 👇

Seth Karten

80,692 次观看 • 1 个月前

InternLM-XComposer2.5-OmniLive A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

InternLM-XComposer2.5-OmniLive A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

AK

43,680 次观看 • 1 年前

🚀 Say hello to the new & improved phidata 🚀 Build, ship, and monitor Agents with blazing-fast memory, knowledge, tools & reasoning 🔥 ⚡️ 70% faster memory & knowledge 🛠 100+ tools 🧠 Reasoning Agents 🤝 Multi-agent collaboration 📊 Built-in monitoring and Agent UI

🚀 Say hello to the new & improved phidata 🚀 Build, ship, and monitor Agents with blazing-fast memory, knowledge, tools & reasoning 🔥 ⚡️ 70% faster memory & knowledge 🛠 100+ tools 🧠 Reasoning Agents 🤝 Multi-agent collaboration 📊 Built-in monitoring and Agent UI

Ashpreet Bedi

114,531 次观看 • 1 年前

New short course: Long-Term Agentic Memory with LangGraph. Learn to build an agent with long-term memory in this course developed in collaboration with taught by its Co-Founder and CEO, Harrison Chase! Personal assistance and productivity tasks have become important use cases for agents. An important feature of an AI assistant, such as a coding or calendar assistant, is its ability to keep improving over time from its experience. Agent memory is the key capability that enables this. To add memory to an agent, you must first figure out what to store and what to retrieve when it is time to use the information. Additionally, you’ll have to decide when to update the stored information. For example, you might update in each iteration loop of the agent or perform updates in the background, with a helper agent. In this course, you will learn a mental framework to build agents with long-term memory. You'll create a useful email assistant that can respond, ignore, and notify using writing, scheduling, and memory-management tools. You’ll develop your agent's memory by adding facts to its memory store, provide examples to learn the user's preferences, and optimize system prompts to evolve instructions based on previous responses. In detail, you’ll: - Learn how the three types of memory--semantic, episodic, and procedural–and the two update mechanisms–via hot path and in the background–apply to your agents. - Build an email agent with writing, scheduling, and availability tools, along with a router that triages incoming email and handles it accordingly by ignoring, responding, or notifying the user. - Add tools to your email agent that allow it to operate on semantic memory by learning facts about the user, storing them in a long-term memory store, and searching over them in future interactions. - Incorporate episodic memory, in the form of few-shot examples, in the triage step of your agents to help them learn and update user preferences. - Add procedural memory as system prompts, optimized with feedback to improve the instructions the agent follows. Learn how to approach memory in agents, and start building agents with long-term memory with LangGraph! Please sign up here:

New short course: Long-Term Agentic Memory with LangGraph. Learn to build an agent with long-term memory in this course developed in collaboration with taught by its Co-Founder and CEO, Harrison Chase! Personal assistance and productivity tasks have become important use cases for agents. An important feature of an AI assistant, such as a coding or calendar assistant, is its ability to keep improving over time from its experience. Agent memory is the key capability that enables this. To add memory to an agent, you must first figure out what to store and what to retrieve when it is time to use the information. Additionally, you’ll have to decide when to update the stored information. For example, you might update in each iteration loop of the agent or perform updates in the background, with a helper agent. In this course, you will learn a mental framework to build agents with long-term memory. You'll create a useful email assistant that can respond, ignore, and notify using writing, scheduling, and memory-management tools. You’ll develop your agent's memory by adding facts to its memory store, provide examples to learn the user's preferences, and optimize system prompts to evolve instructions based on previous responses. In detail, you’ll: - Learn how the three types of memory--semantic, episodic, and procedural–and the two update mechanisms–via hot path and in the background–apply to your agents. - Build an email agent with writing, scheduling, and availability tools, along with a router that triages incoming email and handles it accordingly by ignoring, responding, or notifying the user. - Add tools to your email agent that allow it to operate on semantic memory by learning facts about the user, storing them in a long-term memory store, and searching over them in future interactions. - Incorporate episodic memory, in the form of few-shot examples, in the triage step of your agents to help them learn and update user preferences. - Add procedural memory as system prompts, optimized with feedback to improve the instructions the agent follows. Learn how to approach memory in agents, and start building agents with long-term memory with LangGraph! Please sign up here:

Andrew Ng

131,640 次观看 • 1 年前

Machine Mental Imagery Empower Multimodal Reasoning with Latent Visual Tokens

Machine Mental Imagery Empower Multimodal Reasoning with Latent Visual Tokens

AK

43,498 次观看 • 11 个月前

4. A search agent with multi-step trip planning and reasoning

4. A search agent with multi-step trip planning and reasoning

Chief AI Officer

56,086 次观看 • 2 年前

Build Multi Agent Systems with Reasoning and Context Thanks to sonnet-4, we have level 4 autonomous multi-agent systems working. Learn how to add: -> Reasoning Tools (think -> analyze) -> Shared Agentic Context -> Agentic Memory Code below 👇

Build Multi Agent Systems with Reasoning and Context Thanks to sonnet-4, we have level 4 autonomous multi-agent systems working. Learn how to add: -> Reasoning Tools (think -> analyze) -> Shared Agentic Context -> Agentic Memory Code below 👇

Ashpreet Bedi

38,576 次观看 • 1 年前

Satya Nadella says the 3 capabilities needed for AI agents are now in place and improving exponentially: a universal interface of multimodality; the neural algebra of reasoning and planning; and long-term memory, rich context and tool use

Satya Nadella says the 3 capabilities needed for AI agents are now in place and improving exponentially: a universal interface of multimodality; the neural algebra of reasoning and planning; and long-term memory, rich context and tool use

Tsarathustra

69,091 次观看 • 1 年前

Long-term memories don’t always rely on short-term ones. New research uncovers a parallel pathway to memory formation, reshaping how we understand and treat memory impairments.

Long-term memories don’t always rely on short-term ones. New research uncovers a parallel pathway to memory formation, reshaping how we understand and treat memory impairments.

Neuroscience News

42,444 次观看 • 1 年前

We’ve developed a memory system for our models that provides both short-term visual memory and long-term semantic memory. Our approach allows us to train robots to perform long and complex tasks, like cleaning up a kitchen or preparing a grilled cheese sandwich from scratch 👇

We’ve developed a memory system for our models that provides both short-term visual memory and long-term semantic memory. Our approach allows us to train robots to perform long and complex tasks, like cleaning up a kitchen or preparing a grilled cheese sandwich from scratch 👇

Physical Intelligence

450,361 次观看 • 3 个月前

Gemini 2.5 is driving new advancements in robotics with its strong coding, spatial reasoning, and multimodal capabilities. 🦾

Gemini 2.5 is driving new advancements in robotics with its strong coding, spatial reasoning, and multimodal capabilities. 🦾

Google AI Developers

36,119 次观看 • 1 年前

Why having a goldfish memory is key to long-term success...

Why having a goldfish memory is key to long-term success...

Alan Stein, Jr.

53,459 次观看 • 1 年前

Google's Project Astra using Gemini 2.0 is capable of multimodal reasoning, tool use, search, cross-session and cross-device memory, understanding your phone screen and the real world through glasses to be a universal AI assistant

Google's Project Astra using Gemini 2.0 is capable of multimodal reasoning, tool use, search, cross-session and cross-device memory, understanding your phone screen and the real world through glasses to be a universal AI assistant

Tsarathustra

18,938 次观看 • 1 年前

Smol now has short term and long term memory, can build up a conversation with clear progression through topics, and display emotional development. That means we can finally have a conversation about our favorite cars:

Smol now has short term and long term memory, can build up a conversation with clear progression through topics, and display emotional development. That means we can finally have a conversation about our favorite cars:

lord asado 🥩

73,323 次观看 • 1 年前

As one example of 1.5 Pro’s sophisticated multimodal understanding and reasoning capabilities with long context, when given a 44-minute silent film, the model can analyze various plot points and events, and even makes sense of small details you might have missed.

As one example of 1.5 Pro’s sophisticated multimodal understanding and reasoning capabilities with long context, when given a 44-minute silent film, the model can analyze various plot points and events, and even makes sense of small details you might have missed.

Sundar Pichai

348,309 次观看 • 2 年前

Google NotebookLM is absolutely amazing! I can’t stress this enough , if you’re not using it for learning purposes, you’re missing out on one of the best AI products available right now. With its interactive mode, it’s truly on another level. Anyway, Google has published a new AI architecture called Titans , This architecture gives AI systems more human-like memory, incorporating both short-term and long-term memory capabilities. With Titans, AI can now learn and reason more like humans, remembering an entire book while still processing new information. They tested Titans on various tasks, including language modeling, reasoning, and genomics. The results show that it outperforms existing models, especially when handling very long contexts.

Google NotebookLM is absolutely amazing! I can’t stress this enough , if you’re not using it for learning purposes, you’re missing out on one of the best AI products available right now. With its interactive mode, it’s truly on another level. Anyway, Google has published a new AI architecture called Titans , This architecture gives AI systems more human-like memory, incorporating both short-term and long-term memory capabilities. With Titans, AI can now learn and reason more like humans, remembering an entire book while still processing new information. They tested Titans on various tasks, including language modeling, reasoning, and genomics. The results show that it outperforms existing models, especially when handling very long contexts.

AshutoshShrivastava

121,968 次观看 • 1 年前

1/ Office Agent turns a few words into a PowerPoint or Word doc, with deep research and reasoning.

1/ Office Agent turns a few words into a PowerPoint or Word doc, with deep research and reasoning.

Satya Nadella

77,104 次观看 • 8 个月前

Introducing Devin Auto-Triage: Your AI first-responder with long-term memory. Devin can monitor incoming bugs, alerts, and incidents, investigate them, and come back with context, next steps, or a PR.

Introducing Devin Auto-Triage: Your AI first-responder with long-term memory. Devin can monitor incoming bugs, alerts, and incidents, investigate them, and come back with context, next steps, or a PR.

Cognition

240,103 次观看 • 1 个月前