Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Introducing Trajectories in LangSmith. A view of agent behavior that everyone on the team can understand at a glance.

LangChain

268,555 subscribers

25,015 Aufrufe • vor 12 Tagen •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

7 Kommentare

Profilbild von Anurag Bhagsain

Anurag Bhagsainvor 12 Tagen

@trylatitude already does this and @manuelnavid and team shipping everyday 🔥

Profilbild von Jan Kvaček

Jan Kvačekvor 10 Tagen

Readable trajectories are hugely useful, but I'd separate two questions: 1. What path did the agent take? 2. Did the task actually succeed? The trajectory explains process. A separate acceptance test should prove outcome. A perfect trace can still document a perfectly executed wrong result.

Profilbild von Tommy YC

Tommy YCvor 12 Tagen

A trajectory view turns agent debugging from replay archaeology into a team habit.

Profilbild von Hershal Rao

Hershal Raovor 12 Tagen

finally a visualization tool so PMs can watch my agent fail in real time

Profilbild von Enterprise Hub AI

Enterprise Hub AIvor 12 Tagen

A trajectory that shows the tool calls is useful — you can finally see what the agent tried. It seems the part that’s still missing on a real write is whether someone approved that version of the plan, under a scoped identity, and whether you can read the record back after commit. If the write never went through, does the trajectory say “refused,” or does it just stop?

Profilbild von Nikhil Bhade

Nikhil Bhadevor 12 Tagen

Telemetry FTW

Profilbild von Divyendra Singh

Divyendra Singhvor 12 Tagen

Can teams redact sensitive tool outputs before sending trajectories to SME annotation queues?

Ähnliche Videos

Insights Agent & Multi-turn Evals Agents run for a long period of time and have multiple interactions with users, tackling a wide variety of problems. Today we’re launching two new features in LangSmith, our agent engineering platform, so you can better understand your agent behavior: • Insights Agent is a new agent that automatically categorizes agent behavior patterns in LangSmith • Multi-turn Evals lets you evaluate agent trajectory across complete conversations, so you can see if the agent actually accomplished user goals Learn more:

Insights Agent & Multi-turn Evals Agents run for a long period of time and have multiple interactions with users, tackling a wide variety of problems. Today we’re launching two new features in LangSmith, our agent engineering platform, so you can better understand your agent behavior: • Insights Agent is a new agent that automatically categorizes agent behavior patterns in LangSmith • Multi-turn Evals lets you evaluate agent trajectory across complete conversations, so you can see if the agent actually accomplished user goals Learn more:

LangChain

13,322 Aufrufe • vor 11 Monaten

Introducing LangSmith Custom Apps Create any interface from your agent data with a prompt. If you can think it, LangSmith can build it. Now GA.

Introducing LangSmith Custom Apps Create any interface from your agent data with a prompt. If you can think it, LangSmith can build it. Now GA.

LangChain

16,654 Aufrufe • vor 12 Tagen

Introducing LangSmith Fleet. Agents for every team. → Build agents with natural language → Share and control who can edit, run, or clone each agent → Manage authentication with agent identity → Approve actions with human-in-the-loop → Track and audit actions with tracing in LangSmith Observability Try Fleet:

Introducing LangSmith Fleet. Agents for every team. → Build agents with natural language → Share and control who can edit, run, or clone each agent → Manage authentication with agent identity → Approve actions with human-in-the-loop → Track and audit actions with tracing in LangSmith Observability Try Fleet:

LangChain

9,398,037 Aufrufe • vor 6 Monaten

🤖LangSmith Agent Builder Technical Highlights Yesterday we launched LangSmith Agent Builder. Here's a quick technical overview at what is going on under the hood (from memory to an innovative UX):

🤖LangSmith Agent Builder Technical Highlights Yesterday we launched LangSmith Agent Builder. Here's a quick technical overview at what is going on under the hood (from memory to an innovative UX):

LangChain

27,135 Aufrufe • vor 8 Monaten

🚀Announcing LangGraph Studio: The first agent IDE LangGraph Studio offers a new way to develop LLM applications by providing a specialized agent IDE that enables visualization, interaction, and debugging of complex agentic applications With visual graphs and the ability to edit state, you can better understand agent workflows and iterate faster. LangGraph Studio integrates with LangSmith so you can collaborate with teammates to debug failure modes LangGraph Studio is available for free to all LangSmith users on any plan tier during its early development. Read more about it here: Watch a YouTube walkthrough: Try out LangGraph Studio for free here: Sign up for a LangSmith account:

🚀Announcing LangGraph Studio: The first agent IDE LangGraph Studio offers a new way to develop LLM applications by providing a specialized agent IDE that enables visualization, interaction, and debugging of complex agentic applications With visual graphs and the ability to edit state, you can better understand agent workflows and iterate faster. LangGraph Studio integrates with LangSmith so you can collaborate with teammates to debug failure modes LangGraph Studio is available for free to all LangSmith users on any plan tier during its early development. Read more about it here: Watch a YouTube walkthrough: Try out LangGraph Studio for free here: Sign up for a LangSmith account:

LangChain

185,928 Aufrufe • vor 2 Jahren

🔗 New LangChain Academy Course: Introduction to LangChain (Python) 🔗 Learn how to build with LangChain – our open source framework that makes it easy to start building agents with any model provider. In this course, you’ll create agents that can reason, use tools, and take action, and learn how to debug their behavior with LangSmith. Along the way, you’ll: - Build an agent with the `create_agent` abstraction - Use LangChain’s core building blocks: Models, Messages, Memory, and Tools - Customize your agent with middleware - Debug your agent with LangSmith Observability & Studio By the end of the course, you’ll have assembled a full team of personal assistants. Enroll for free ➡️

🔗 New LangChain Academy Course: Introduction to LangChain (Python) 🔗 Learn how to build with LangChain – our open source framework that makes it easy to start building agents with any model provider. In this course, you’ll create agents that can reason, use tools, and take action, and learn how to debug their behavior with LangSmith. Along the way, you’ll: - Build an agent with the `create_agent` abstraction - Use LangChain’s core building blocks: Models, Messages, Memory, and Tools - Customize your agent with middleware - Debug your agent with LangSmith Observability & Studio By the end of the course, you’ll have assembled a full team of personal assistants. Enroll for free ➡️

LangChain

41,214 Aufrufe • vor 9 Monaten

Today, we’re shipping new ways to observe, analyze, and debug agents with LangSmith: • Polly: an AI assistant for AI engineering that helps you understand traces, threads, and improve prompts • LangSmith Fetch: a CLI for pulling trace & thread data straight into your terminal or coding agent Agents are running longer and getting more complex, which demands new debugging workflows beyond simple LLM apps. We wrote a blog on the trends behind this shift— and why tools like Polly and LangSmith Fetch are needed. Shipping reliable agents requires full visibility into agent behavior, with tooling that helps you reason over that data in the UI, the terminal, or alongside coding agents. 📔Learn more about Polly: 📔Learn more about LangSmith Fetch: 📔How to observe deep agents: 📽️ Polly video tutorial: 📽️ LangSmith Fetch video tutorial:

Today, we’re shipping new ways to observe, analyze, and debug agents with LangSmith: • Polly: an AI assistant for AI engineering that helps you understand traces, threads, and improve prompts • LangSmith Fetch: a CLI for pulling trace & thread data straight into your terminal or coding agent Agents are running longer and getting more complex, which demands new debugging workflows beyond simple LLM apps. We wrote a blog on the trends behind this shift— and why tools like Polly and LangSmith Fetch are needed. Shipping reliable agents requires full visibility into agent behavior, with tooling that helps you reason over that data in the UI, the terminal, or alongside coding agents. 📔Learn more about Polly: 📔Learn more about LangSmith Fetch: 📔How to observe deep agents: 📽️ Polly video tutorial: 📽️ LangSmith Fetch video tutorial:

LangChain

31,193 Aufrufe • vor 10 Monaten

Introducing On-Call Copilot - a new agent template in LangSmith Fleet → Triages every alert and investigates root cause across your code and traces → Manages tickets and routes every incident to the right channels → Continuously learns from your runbooks, escalation rules, and noise patterns

Introducing On-Call Copilot - a new agent template in LangSmith Fleet → Triages every alert and investigates root cause across your code and traces → Manages tickets and routes every incident to the right channels → Continuously learns from your runbooks, escalation rules, and noise patterns

LangChain

14,235 Aufrufe • vor 3 Monaten

Introducing LangSmith Fleet: an enterprise workspace for creating, using, and managing your fleet of agents. Fleet agents have their own memory, access to a collection of tools and skills, and can be exposed through the communication channels your team uses every day. Fleet includes: → Agent identity and credential management with “Claws” and “Assistants” → Sharing and permissions to control who can run, clone, and edit (just like Google Docs) → Custom Slack bots so each agent has its own identity in Slack Try Fleet: Read the announcement:

Introducing LangSmith Fleet: an enterprise workspace for creating, using, and managing your fleet of agents. Fleet agents have their own memory, access to a collection of tools and skills, and can be exposed through the communication channels your team uses every day. Fleet includes: → Agent identity and credential management with “Claws” and “Assistants” → Sharing and permissions to control who can run, clone, and edit (just like Google Docs) → Custom Slack bots so each agent has its own identity in Slack Try Fleet: Read the announcement:

LangChain

149,127 Aufrufe • vor 6 Monaten

LangSmith Agent Builder is generally available 🎉 It’s surprisingly easy to build agents now. Even a VC can do it…👇 Try it free: Read the announcement:

LangSmith Agent Builder is generally available 🎉 It’s surprisingly easy to build agents now. Even a VC can do it…👇 Try it free: Read the announcement:

LangChain

111,687 Aufrufe • vor 8 Monaten

.Clay uses LangSmith to manage 300M agent runs a month, with an average 10-30 steps each. Harrison Chase’s conversation with Clay’s Head of AI Jeff Barg on how they run this at scale →

.Clay uses LangSmith to manage 300M agent runs a month, with an average 10-30 steps each. Harrison Chase’s conversation with Clay’s Head of AI Jeff Barg on how they run this at scale →

LangChain

45,436 Aufrufe • vor 5 Monaten

🚀 Announcing LangSmith Skills + CLI 🚀 Agent improvements are increasingly driven by coding agents themselves. We're releasing LangSmith Skills alongside the LangSmith CLI to make coding agents experts at the agent engineering lifecycle. LangSmith Skills enable agents to debug traces, create datasets, and run experiments - and thanks to the CLI, agents are able to do it all natively through the terminal, where they're most comfortable. Try out LangSmith Skills and the CLI with your own coding agents! ➡️ Skills: ➡️ CLI:

🚀 Announcing LangSmith Skills + CLI 🚀 Agent improvements are increasingly driven by coding agents themselves. We're releasing LangSmith Skills alongside the LangSmith CLI to make coding agents experts at the agent engineering lifecycle. LangSmith Skills enable agents to debug traces, create datasets, and run experiments - and thanks to the CLI, agents are able to do it all natively through the terminal, where they're most comfortable. Try out LangSmith Skills and the CLI with your own coding agents! ➡️ Skills: ➡️ CLI:

LangChain

49,662 Aufrufe • vor 7 Monaten

Product Manager @BenTannyhill on why LangSmith Engine routes trace investigation through screener + verifier sub agents instead of letting the main agent read everything.

Product Manager @BenTannyhill on why LangSmith Engine routes trace investigation through screener + verifier sub agents instead of letting the main agent read everything.

LangChain

11,353 Aufrufe • vor 3 Monaten

✨New LangChain Academy Course: Learn to build with LangSmith Agent Builder 🪄 Learn how to build your own agents with LangSmith Agent Builder. Anyone can now build agents for complex daily tasks, without writing code. We built Agent Builder for anyone whose day gets swallowed by routine work. The research, follow-ups, updates, scheduling, and status checks that are essential to your operations, but quickly take over your calendar. Agent Builder is different from traditional workflow automations. You don’t need to map every step, tinker with if-this-then-that branching, or babysit dependencies. You just give it feedback like you would a teammate, and the agent learns using its memory. In this quickstart course, you'll learn how to: - Build an email agent - Understand what agents can do - Improve your agent - Set up triggers and your Agent Inbox Enroll for free ➡️

✨New LangChain Academy Course: Learn to build with LangSmith Agent Builder 🪄 Learn how to build your own agents with LangSmith Agent Builder. Anyone can now build agents for complex daily tasks, without writing code. We built Agent Builder for anyone whose day gets swallowed by routine work. The research, follow-ups, updates, scheduling, and status checks that are essential to your operations, but quickly take over your calendar. Agent Builder is different from traditional workflow automations. You don’t need to map every step, tinker with if-this-then-that branching, or babysit dependencies. You just give it feedback like you would a teammate, and the agent learns using its memory. In this quickstart course, you'll learn how to: - Build an email agent - Understand what agents can do - Improve your agent - Set up triggers and your Agent Inbox Enroll for free ➡️

LangChain

26,513 Aufrufe • vor 8 Monaten

Clay uses LangSmith to reconcile 99.5% of its AI spend. Head of AI Jeff Barg on why cost observability finally clicked once LangSmith was in place.

Clay uses LangSmith to reconcile 99.5% of its AI spend. Head of AI Jeff Barg on why cost observability finally clicked once LangSmith was in place.

LangChain

16,837 Aufrufe • vor 1 Monat

Stop manually triaging agent failures. Let LangSmith Engine fix it.

Stop manually triaging agent failures. Let LangSmith Engine fix it.

LangChain

62,563 Aufrufe • vor 4 Monaten

Polly is our AI assistant built directly into LangSmith to help you debug, analyze, and improve your agents — now generally available. Now, Polly lives on every page of LangSmith, remembers your full session as you navigate, and can take action to update prompts, compare experiments, write evaluators, and more. Read the blog: See the docs: Try Polly in LangSmith:

Polly is our AI assistant built directly into LangSmith to help you debug, analyze, and improve your agents — now generally available. Now, Polly lives on every page of LangSmith, remembers your full session as you navigate, and can take action to update prompts, compare experiments, write evaluators, and more. Read the blog: See the docs: Try Polly in LangSmith:

LangChain

12,595 Aufrufe • vor 6 Monaten

🎨 Introducing Prompt Canvas — a novel UX for prompt engineering Building LLM applications requires new and dedicated tools for prompt engineering. With Prompt Canvas in LangSmith, you can: • Collaborate with an AI agent to draft, refine, and edit your prompts • Define custom quick actions to standardize prompting strategies used across the org ✍️ Learn more: ➡️ Try it out:

🎨 Introducing Prompt Canvas — a novel UX for prompt engineering Building LLM applications requires new and dedicated tools for prompt engineering. With Prompt Canvas in LangSmith, you can: • Collaborate with an AI agent to draft, refine, and edit your prompts • Define custom quick actions to standardize prompting strategies used across the org ✍️ Learn more: ➡️ Try it out:

LangChain

43,733 Aufrufe • vor 1 Jahr

🔍New in LangGraph Studio: Trace mode View your LangSmith traces in real time right inside Studio. Annotate runs, and add them to datasets or annotation queues, bringing the power of LangSmith tracing directly into your workflow. Debug faster and dig deeper, without any of the context switching. Try it today!

🔍New in LangGraph Studio: Trace mode View your LangSmith traces in real time right inside Studio. Annotate runs, and add them to datasets or annotation queues, bringing the power of LangSmith tracing directly into your workflow. Debug faster and dig deeper, without any of the context switching. Try it today!

LangChain

25,866 Aufrufe • vor 1 Jahr

Our latest LangChain Academy course – Building Ambient Agents with LangGraph – is now available! Most agents today handle one request at a time through chat interfaces. But as models have improved, agents can now run in the background – and take on long-running, complex tasks. LangGraph is built for these “ambient agents,” with support for human-in-the-loop workflows and memory. LangGraph Platform provides the infrastructure to run these agents at scale, and LangSmith helps you observe, evaluate, and improve your agents. Together, they make it easier to build reliable, production-ready agents. In this course, you’ll: 📩 Learn the fundamentals of LangGraph and how to build your own email agent 📊 Evaluate your agent using LangSmith ✅ Add human-in-the-loop for reviews, and memory so your agent adapts over time 🚀 Deploy your agent with LangGraph Platform and connect it to Gmail

Our latest LangChain Academy course – Building Ambient Agents with LangGraph – is now available! Most agents today handle one request at a time through chat interfaces. But as models have improved, agents can now run in the background – and take on long-running, complex tasks. LangGraph is built for these “ambient agents,” with support for human-in-the-loop workflows and memory. LangGraph Platform provides the infrastructure to run these agents at scale, and LangSmith helps you observe, evaluate, and improve your agents. Together, they make it easier to build reliable, production-ready agents. In this course, you’ll: 📩 Learn the fundamentals of LangGraph and how to build your own email agent 📊 Evaluate your agent using LangSmith ✅ Add human-in-the-loop for reviews, and memory so your agent adapts over time 🚀 Deploy your agent with LangGraph Platform and connect it to Gmail

LangChain

33,192 Aufrufe • vor 1 Jahr