正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Introduction to Verification Engineering In this video, you'll learn: → How to build an agentic loop with @testerarmy's e2e open source testing framework → Run this loop on every PR → What makes e2e different: deterministic AND agentic → The future of agentic development

Expo

89,992 subscribers

50,330 次观看 • 1 天前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

12 条评论

Expo 的头像

Expo1 天前

Chapters: 00:00 Why is Verification Engineering a thing 00:28 The agentic loop we will build 01:09 Evergreen tests, agent-device, and what e2e adds 01:57 Exploring an example test file 02:30 What exactly happens in there 03:03 The powerful caching mechanism 03:24 Set it up on your machine in two minutes 04:17 Run it on every PR: the workflow 04:46 The infra: GitHub, Expo Workflows, and Simulator 06:11 What this unlocks: cost and time 07:23 The future of agentic development

Expo 的头像

Expo1 天前

useful links: → Excalidraw: → PR being demoed: → Get started with e2e & Expo:

Waseem Khalo 的头像

Waseem Khalo1 天前

@TesterArmy I feel like I need this 🥲😂

Aditya Shukla 的头像

Aditya Shukla1 天前

@TesterArmy Very cool! Played around with a simple version of this on a personal app. Wanna try it for some agent-as-judge evals too and see if I can use e2e instead

Expo 的头像

Expo1 天前

@TesterArmy let us know how it goes Aditya!

Kaya Jones 的头像

Kaya Jones1 天前

@TesterArmy oh this is cool

TesterArmy (YC P26) 的头像

TesterArmy (YC P26)1 天前

Great video @rami__maalouf 🙌

Changuro 的头像

Changuro1 天前

@TesterArmy Can you share the excalidraw? 🙏🏻

Kevin Brown 的头像

Kevin Brown1 天前

The interesting shift is moving verification from a final CI gate into the development loop itself. If agents can generate changes and deterministic tests can continuously challenge those changes, the feedback cycle gets much tighter. The hard part will be keeping the verification layer trustworthy as the agent becomes more autonomous. Lets connect.

Tmac Luo 的头像

Tmac Luo1 天前

@TesterArmy Does it works only for UI based app? What if it is a pure backend service?

Loay 的头像

Loay1 天前

@TesterArmy An agentic e2e loop on every PR only pays off if the app under test is deterministic. On React Native the flake sources are usually network timing, native animations, and background tasks. Seed mocks and pin a fixed emulator image before letting the agent pass the verdict.

seridarivus 🇷🇴 的头像

seridarivus 🇷🇴1 天前

@TesterArmy An agentic loop that runs on every PR only works if the e2e tests stay deterministic. Flaky agent plus flaky test is just a slot machine with a CI badge.

相关视频

Andrew Ng just released a 1-hour course on building agentic knowledge Graphs from scratch: • 00:00 - Introduction to agentic knowledge Graphs • 03:07 - Construction of agentic Graphs • 14:00 - Architecture of multi-agent systems • 23:00 - Building agentic graphs with Google ADK • 01:06:03 - Why Graphsare the future of agentic AI Worth more than 10 articles on loop engineering. Watch it today, then read how to become a graph engineer in the article below.

Andrew Ng just released a 1-hour course on building agentic knowledge Graphs from scratch: • 00:00 - Introduction to agentic knowledge Graphs • 03:07 - Construction of agentic Graphs • 14:00 - Architecture of multi-agent systems • 23:00 - Building agentic graphs with Google ADK • 01:06:03 - Why Graphsare the future of agentic AI Worth more than 10 articles on loop engineering. Watch it today, then read how to become a graph engineer in the article below.

Codez

468,289 次观看 • 2 个月前

New AI Agentic course! Learn to use LangGraph to build single and multi-agent LLM applications in AI Agents in LangGraph. This short course, taught by LangChain founder Harrison Chase Harrison Chase and Tavily founder @weiss_rotem, shows how to integrate agentic search to enhance an agent's knowledge with query-focused answers in predictable formats. Also learn to implement agentic memory to save state for reasoning and debugging, and see how human-in-the-loop input can guide agents at key junctures. You'll build an agent from scratch, then reconstruct it with LangGraph to thoroughly understand the framework. Finally, you'll build a sophisticated essay-writing agent that incorporates all the learnings from the course. Sign up here!

New AI Agentic course! Learn to use LangGraph to build single and multi-agent LLM applications in AI Agents in LangGraph. This short course, taught by LangChain founder Harrison Chase Harrison Chase and Tavily founder @weiss_rotem, shows how to integrate agentic search to enhance an agent's knowledge with query-focused answers in predictable formats. Also learn to implement agentic memory to save state for reasoning and debugging, and see how human-in-the-loop input can guide agents at key junctures. You'll build an agent from scratch, then reconstruct it with LangGraph to thoroughly understand the framework. Finally, you'll build a sophisticated essay-writing agent that incorporates all the learnings from the course. Sign up here!

Andrew Ng

152,816 次观看 • 2 年前

Enjoy this introduction into E2E testing from my latest workshop "React End-to-End Testing with Playwright"! 🎉 Let's talk about what E2E testing is, how it has nothing to do with the browser, and what is its true goal.

Enjoy this introduction into E2E testing from my latest workshop "React End-to-End Testing with Playwright"! 🎉 Let's talk about what E2E testing is, how it has nothing to do with the browser, and what is its true goal.

Artem Zakharchenko

10,187 次观看 • 4 个月前

Start this year with an agentic advantage. 🎯 Learn how to get ahead at our AI and Agentic Automation Trends Webinar:

Start this year with an agentic advantage. 🎯 Learn how to get ahead at our AI and Agentic Automation Trends Webinar:

UiPath

13,397,265 次观看 • 8 个月前

e2e blow up on X yesterday. I recorded a quick video on the philosophy behind the framework, how it fits into your software development workflow, and what you can build with it. ~/ npx e2e init

e2e blow up on X yesterday. I recorded a quick video on the philosophy behind the framework, how it fits into your software development workflow, and what you can build with it. ~/ npx e2e init

Oskar

24,558 次观看 • 3 天前

OpenAI engineer: “90% of our engineers use Codex subagent harnesses + loops to ship code 5× faster. close the agent loop. Give an agent a way to verify its own output.” in 30-minute talk, an OpenAI engineer explains how to build self-improving agentic systems with harnesses. Worth more than a $500 agentic course online. Watch it today, then read how hedge funds apply loop engineering in trading.

OpenAI engineer: “90% of our engineers use Codex subagent harnesses + loops to ship code 5× faster. close the agent loop. Give an agent a way to verify its own output.” in 30-minute talk, an OpenAI engineer explains how to build self-improving agentic systems with harnesses. Worth more than a $500 agentic course online. Watch it today, then read how hedge funds apply loop engineering in trading.

Movez

41,773 次观看 • 3 个月前

Anthropic just dropped 1-hour workshop on loop engineering: 1 spec → the loop → 200 features from 0% to 100%: • 10% → 5:31 - Building memory for agentic loops • 30% → 8:22 - Four files for each Loop: features.json, standards.md, progress.md, • 55% → 11:02 - The Loop: check environment → run tests → pick feature → build → test → commit • 80% → 13:06 - one feature per loop. try everything at once and context dies mid-build • 100% → 33:03 - MVP in 1 hour, every next loop under 30 minutes most people build an agent that finishes a task -Anthropic ships agentic loops that can run for days without you. watch it today - then read the full loop engineering playbook below ↓

Anthropic just dropped 1-hour workshop on loop engineering: 1 spec → the loop → 200 features from 0% to 100%: • 10% → 5:31 - Building memory for agentic loops • 30% → 8:22 - Four files for each Loop: features.json, standards.md, progress.md, • 55% → 11:02 - The Loop: check environment → run tests → pick feature → build → test → commit • 80% → 13:06 - one feature per loop. try everything at once and context dies mid-build • 100% → 33:03 - MVP in 1 hour, every next loop under 30 minutes most people build an agent that finishes a task -Anthropic ships agentic loops that can run for days without you. watch it today - then read the full loop engineering playbook below ↓

Codez

18,398 次观看 • 2 个月前

Thrilled to see Amazon Web Services making a major contribution to the open source AI community with the launch of the Strands Agents, an open source AI agents SDK! The core of Strands is the simple agentic loop that connects the model and tools together, like the two strands of DNA. This model-driven approach to agent building eliminates the need for complex agent orchestration by embracing the capabilities of state-of-the-art models to plan, chain thoughts, call tools, and reflect. Providing open source tools and interoperability with open source protocols is an important part of our strategy to enable an agentic future. Can't wait to see what you build with Strands!

Thrilled to see Amazon Web Services making a major contribution to the open source AI community with the launch of the Strands Agents, an open source AI agents SDK! The core of Strands is the simple agentic loop that connects the model and tools together, like the two strands of DNA. This model-driven approach to agent building eliminates the need for complex agent orchestration by embracing the capabilities of state-of-the-art models to plan, chain thoughts, call tools, and reflect. Providing open source tools and interoperability with open source protocols is an important part of our strategy to enable an agentic future. Can't wait to see what you build with Strands!

Swami Sivasubramanian

32,296 次观看 • 1 年前

Anthropic engineer: "At Antropic, >80% of our engineers are building with self-improving loops. in 3-6 months, it will be 100%. my agentic loops can run for hours without spending hundreds of $$$." in 30-minute podcast, an Antropic engineer shows how to build the right spec for an agentic loop. Loop + plan + PRDs + spec + markdown - that’s the secret stack. Worth more than a $500 agentic course on the internet. Watch it now, then read how quants are building trading loops from scratch.

Anthropic engineer: "At Antropic, >80% of our engineers are building with self-improving loops. in 3-6 months, it will be 100%. my agentic loops can run for hours without spending hundreds of $$$." in 30-minute podcast, an Antropic engineer shows how to build the right spec for an agentic loop. Loop + plan + PRDs + spec + markdown - that’s the secret stack. Worth more than a $500 agentic course on the internet. Watch it now, then read how quants are building trading loops from scratch.

Movez

283,147 次观看 • 3 个月前

Google engineer: "Build self-learning agentic workflows that work for you 24/7 with loops and graphs - that's the new job! at Google, 90% of engineers are running at least 50 agentic workflows, that's the new "era of engineering" in 1-hour interview, a Google engineer explains how the future of AI engineering will look like worth more than 10 paid agentic courses watch it today, then read how to run a self-improving agentic system in the article below

Google engineer: "Build self-learning agentic workflows that work for you 24/7 with loops and graphs - that's the new job! at Google, 90% of engineers are running at least 50 agentic workflows, that's the new "era of engineering" in 1-hour interview, a Google engineer explains how the future of AI engineering will look like worth more than 10 paid agentic courses watch it today, then read how to run a self-improving agentic system in the article below

Movez

12,927 次观看 • 1 个月前

.@emdashsh is building an open-source Agentic Development Environment (ADE). Run multiple coding agents in parallel. Congrats on the launch raban and Arne Strickmann!

.@emdashsh is building an open-source Agentic Development Environment (ADE). Run multiple coding agents in parallel. Congrats on the launch raban and Arne Strickmann!

Y Combinator

58,602 次观看 • 7 个月前

IBM just released a 1-hour course on building agentic knowledge graphs from scratch: • 00:00 - Introduction to knowledge graphs • 05:35 - Building your first agentic graph • 19:59 - Agentic memory powered by graphs • 30:39 - Graphs for multi-agent orchestration This 1-hour watch will replace 10 paid courses on agentic engineering. Watch it today, then learn how to become a knowledge graph engineer in the article below.

IBM just released a 1-hour course on building agentic knowledge graphs from scratch: • 00:00 - Introduction to knowledge graphs • 05:35 - Building your first agentic graph • 19:59 - Agentic memory powered by graphs • 30:39 - Graphs for multi-agent orchestration This 1-hour watch will replace 10 paid courses on agentic engineering. Watch it today, then learn how to become a knowledge graph engineer in the article below.

Codez

277,296 次观看 • 2 个月前

Google Engineers just dropped a 1-hour course on agentic engineering from scratch: 0% - 00:00 – How to build your first AI agent 25% - 08:24 – Build agent memory (short, persistent, long) 50% - 28:34 – Agentic loops, long-running AI agents 100% - 1:00:22 – Multi-agentic systems This 1-hour guide will replace 10 paid agentic courses on the internet. Watch it today, then read how to run multiple agents in the article below.

Google Engineers just dropped a 1-hour course on agentic engineering from scratch: 0% - 00:00 – How to build your first AI agent 25% - 08:24 – Build agent memory (short, persistent, long) 50% - 28:34 – Agentic loops, long-running AI agents 100% - 1:00:22 – Multi-agentic systems This 1-hour guide will replace 10 paid agentic courses on the internet. Watch it today, then read how to run multiple agents in the article below.

Ricker

11,708 次观看 • 1 个月前

Google just released a 1-hour course on building agentic knowledge Graphs from scratch: • 00:00 - Introduction to AI agents • 08:09 - Foundations of multi-agent systems • 13:25 - Introduction to Graph engineering • 23:27 - Environment setup for agentic Graphs • 47:43 - Building Graph RAG agents • 1:25:14 - Agent memory bank with graphs Worth more than 10 articles on loop engineering. Watch it today, then read how to become a graph engineer in the article below.

Google just released a 1-hour course on building agentic knowledge Graphs from scratch: • 00:00 - Introduction to AI agents • 08:09 - Foundations of multi-agent systems • 13:25 - Introduction to Graph engineering • 23:27 - Environment setup for agentic Graphs • 47:43 - Building Graph RAG agents • 1:25:14 - Agent memory bank with graphs Worth more than 10 articles on loop engineering. Watch it today, then read how to become a graph engineer in the article below.

Codez

197,514 次观看 • 2 个月前

Claude Code creator Boris Cherny: "Verification is the single most important part of closed-loop development" "Companies underinvest in it, and that is the biggest mistake" In a 26-minute talk, Boris breaks down real AI coding loops with Spotify's Chief Engineer: 00:00 - Closed-loop development 08:33 - Why one-shot code generation fails 10:02 - Agentic verifier and PR success rate 12:00 - Verification loops without humans in the loop 14:00 - Tests, skills, CLAUDE.md, and MCP as the loop infrastructure 20:11 - Why consistent codebases make agents work better This one video is worth more than 100 Claude coding setup tutorials Bookmark and watch it today Then read the full guide on loop engineering below

Claude Code creator Boris Cherny: "Verification is the single most important part of closed-loop development" "Companies underinvest in it, and that is the biggest mistake" In a 26-minute talk, Boris breaks down real AI coding loops with Spotify's Chief Engineer: 00:00 - Closed-loop development 08:33 - Why one-shot code generation fails 10:02 - Agentic verifier and PR success rate 12:00 - Verification loops without humans in the loop 14:00 - Tests, skills, CLAUDE.md, and MCP as the loop infrastructure 20:11 - Why consistent codebases make agents work better This one video is worth more than 100 Claude coding setup tutorials Bookmark and watch it today Then read the full guide on loop engineering below

rari

73,236 次观看 • 2 个月前

Andrew Ng: "The most important trend in AI is agentic AI." in 30-minutes talk he breaks down the agentic orchestration layer and how he actually builds with agents: step 1 → prototype fast. what used to take 3 engineers and 6 months - his team builds in an afternoon step 2 → run evals, not vibes. "new model comes out → run evals → switch in two days" step 3 → iterate in loops. outline → search → draft → revise → loop. "this is the heart of agentic systems" Worth more than any paid course on building agents. Watch the talk, then read the guide on building self-improving agentic systems below.

Andrew Ng: "The most important trend in AI is agentic AI." in 30-minutes talk he breaks down the agentic orchestration layer and how he actually builds with agents: step 1 → prototype fast. what used to take 3 engineers and 6 months - his team builds in an afternoon step 2 → run evals, not vibes. "new model comes out → run evals → switch in two days" step 3 → iterate in loops. outline → search → draft → revise → loop. "this is the heart of agentic systems" Worth more than any paid course on building agents. Watch the talk, then read the guide on building self-improving agentic systems below.

Movez

16,545 次观看 • 2 个月前

You’re wasting insane amounts of money on all of your agentic workflows. I calculated the cost, it is staggering. You could be saving over 100x in tokens by changing the workflow’s orchestration loop by just adding one extra step into your agentic workflow setup. This completely changes the economics of deploying agentic systems for both simple and complex agentic workflows. I am writing an article on this right now to teach you how to do it so you can save money on your agentic workflows. Errrrrm… back to typing I guess? Turn my notifications on as I’m aiming to post it later on tonight. Speak to you shortly.

You’re wasting insane amounts of money on all of your agentic workflows. I calculated the cost, it is staggering. You could be saving over 100x in tokens by changing the workflow’s orchestration loop by just adding one extra step into your agentic workflow setup. This completely changes the economics of deploying agentic systems for both simple and complex agentic workflows. I am writing an article on this right now to teach you how to do it so you can save money on your agentic workflows. Errrrrm… back to typing I guess? Turn my notifications on as I’m aiming to post it later on tonight. Speak to you shortly.

hoeem

16,427 次观看 • 4 个月前