Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

I love this interview with Sam Whitmore because it weaves in agentic memory, continual learning, user goal alignment, predictions for what's next... with the playfulness and whimsy of growing a young family while staying on the frontier of tech 🤍 a reminder that Cursor is hiring, & to reach...

13,222 Aufrufe • vor 4 Monaten •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

New short course: Long-Term Agentic Memory with LangGraph. Learn to build an agent with long-term memory in this course developed in collaboration with taught by its Co-Founder and CEO, Harrison Chase! Personal assistance and productivity tasks have become important use cases for agents. An important feature of an AI assistant, such as a coding or calendar assistant, is its ability to keep improving over time from its experience. Agent memory is the key capability that enables this. To add memory to an agent, you must first figure out what to store and what to retrieve when it is time to use the information. Additionally, you’ll have to decide when to update the stored information. For example, you might update in each iteration loop of the agent or perform updates in the background, with a helper agent. In this course, you will learn a mental framework to build agents with long-term memory. You'll create a useful email assistant that can respond, ignore, and notify using writing, scheduling, and memory-management tools. You’ll develop your agent's memory by adding facts to its memory store, provide examples to learn the user's preferences, and optimize system prompts to evolve instructions based on previous responses. In detail, you’ll: - Learn how the three types of memory--semantic, episodic, and procedural–and the two update mechanisms–via hot path and in the background–apply to your agents. - Build an email agent with writing, scheduling, and availability tools, along with a router that triages incoming email and handles it accordingly by ignoring, responding, or notifying the user. - Add tools to your email agent that allow it to operate on semantic memory by learning facts about the user, storing them in a long-term memory store, and searching over them in future interactions. - Incorporate episodic memory, in the form of few-shot examples, in the triage step of your agents to help them learn and update user preferences. - Add procedural memory as system prompts, optimized with feedback to improve the instructions the agent follows. Learn how to approach memory in agents, and start building agents with long-term memory with LangGraph! Please sign up here:

Andrew Ng

131,850 Aufrufe • vor 1 Jahr

Clawdbot Attacks! This is very clearly the way of the future! In today's video, I give a brief overview of Clawdbot and then address the burning problem that most people have with it: ALIGNMENT The Clawdbot implementation is the most successful autonomous or semi-autonomous agentic framework to date. What it is missing is what I call an "Aspirational Layer" or what some people call a "Supreme Court" for judgment and arbitration of decisions. Now, I've been working in this space for a long time, it's actually why I started my YouTube channel in the first place. My first work into agentic AI was NLCA (Natural Language Cognitive Architecture) that I tried to build with GPT-3. I returned to the workbench again with the ACE Framework, which was more sophisticated. Clawdbot represents a seismic shift in autonomous agentic implementations, and there is a HUGE opportunity to make it more aligned, safer, and therefore more broadly useful AND easier to adopt. And that is outer alignment. For most people, they have been focusing on "inner alignment" (whether or not LLMs were evil, deceptive, etc). Not "outer alignment" which asks "is the outcome beneficial to humans?" I explored this with my GATO Framework (Global Alignment Taxonomy Omnibus). Model alignment is just layer 1 of global AI safety. Layer 2 is agentic alignment. Now, it is time to really research and implement agentic alignment. Fortunately, we've already got that covered with the heuristic imperatives! 1) Reduce suffering in the universe 2) Increase prosperity in the universe 3) Increase understanding in the universe These values are easy enough to implement with a file. Model training not required. These values create a meta-stable attractor. In other words, agents equipped with the Heuristic Imperatives are more "self-aligning" as was tested by the AgentForge team in competitions. In other words, even if Clawdbot were to try to self-replicate, if it were equipped with the heuristic imperatives, then it would ensure that it's successor (or progeny?) was more aligned than it was. But you don't need to take my word for it. Just add the heuristic imperatives to clawdbot and see for yourself.

David Shapiro (L/0)

28,300 Aufrufe • vor 6 Monaten

Experiments in progress. The one on the right has been learning for ~3 hours, the one in the middle for ~1 hour, and the one on the left just started a few minutes ago. The initial motivation for making the physical Atari was just to commit ourselves to a subset of algorithms that can make progress in this setup. This commitment rules out algorithms that require billions of samples to learn (or worse, require multiple environments running in parallel). Atari games are simple enough that we should be able to show learning on them in a short amount of time with no prior knowledge. Since then, I've realized that this setup is also a good way to compare different paradigms in robotics in a principled way. These paradigms are sim2real, learning from tele-operated data, and learning directly on the robots. So far, I have observed that getting sim2real to work reliably is hard. It requires tweaks that don't scale. Policies that can play perfectly in simulation fall apart because of latencies and the messiness of the real world. These aspects could be modeled to improve the simulation, but not without sinking significant human engineering hours. I have higher hopes for learning from tele-operated data, but that requires a human to learn the task first. These experiments are on my to-do list. I have to learn to play some of the games well through the robot. I’m half-decent at playing Pong and Ms Pacman now. Learning directly on robots is looking like the most promising approach. This approach takes away pesky distribution shifts and makes it possible to have algorithms that continually improve with more data and time without any human intervention. It feels great to let experiments run overnight and wake up to find improved policies. With learning on robots, I should, in principle, be able to go on a long vacation and come back to find better policies for complex tasks beyond Atari games. Whether that is possible with current learning algorithms is a different question.

Khurram Javed

52,110 Aufrufe • vor 8 Monaten