正在加载视频...

视频加载失败

How we're using AI agents at Wallaroo Media to improve performance for clients, part 5: Implementing Triple Whale 🐳's Web Performance Agent to find actionable improvements to increase mobile conversion rates and client revenue 📊

1,349,973 次观看 • 1 年前 •via X (Twitter)

7 条评论

Brandon Doyle (🦘,🦘) 的头像
Brandon Doyle (🦘,🦘)1 年前

@AY_Orbach

NICK 的头像
NICK1 年前

@WallarooMedia @triplewhale

Jenna (Weiner) Crane 的头像
Jenna (Weiner) Crane1 年前

@WallarooMedia @triplewhale 🔥

Arvo Digital 的头像
Arvo Digital1 年前

@WallarooMedia @triplewhale Super smart 🧠

Wallaroo Media 的头像
Wallaroo Media1 年前

@triplewhale

Jerry Dearden 的头像
Jerry Dearden1 年前

@WallarooMedia @triplewhale This is amazing!

Brandon Doyle (🦘,🦘) 的头像
Brandon Doyle (🦘,🦘)1 年前

@WallarooMedia @triplewhale 🫡

相关视频

New short course: Evaluating AI Agents! Evals are important for driving AI system improvements, and in this course you'll learn to systematically assess and improve an AI agent’s performance. This is built in partnership with Arize AI and taught by John Gilhuly, Head of Developer Relations, and , Director of Product. I've often found evals to be a critical tool in the agent development process - they can be the difference between picking the right thing to work on vs. wasting weeks of effort. Whether you’re building a shopping assistant, coding agent, or research assistant, having a structured evaluation process helps you refine its performance systematically, rather than relying on random trial and error. This course shows you how to structure your evals to assess the performance of each component of an agent and its end-to-end performance. For each component, you select the appropriate evaluators, test examples, and performance metrics. This helps you identify areas for improvement both during development and in production. (If you're familiar with error analysis in supervised learning, think of this as adapting those ideas to agentic workflows.) In this course, you'll build an AI agent, and add observability to visualize and debug its steps. You’ll learn about code-based evals, in which you write code explicitly to test a certain step, as well as LLM-as-a-Judge evals, in which you prompt an LLM to efficiently come up with ways to evaluate more open-ended outputs. In detail, you’ll: - Understand key differences between evaluating LLM-based systems and traditional software testing. - Add observability to an agent by collecting traces of the steps taken by the agent and visualizing them - Choose the appropriate evaluator - code-based, LLM-as-a-Judge, human-annotation based - for each component. - Compute a convergence score to evaluate if your agent can respond to a query in an efficient number of steps. - Run structured experiments to improve the agent’s performance by exploring changes to the prompt, LLM model, or the agent’s logic. - Understand how to deploy these evaluation techniques to monitor the agent’s performance in production. By the end of this course, you’ll know how to trace AI agents, systematically evaluate them, and improve their performance. Please sign up here:

Andrew Ng

126,559 次观看 • 1 年前