Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Matt Pocock (TypeScript wizard, ex-Vercel): "Opus 5 got addicted to writing tests that just repeat the code back to itself." in a 22-min talk at AI Engineer Paris, Matt walks through how to stop AI PRs from turning your repo into a slop cannon: 5:30 → the tests AI...

174,215 görüntüleme • 18 gün önce •via X (Twitter)

35 Yorum

Squizer profil fotoğrafı
Squizer18 gün önce

the reviewer-should-commit-not-comment point is underrated. most AI review setups still route fixes back through a human typing the same patch by hand, which defeats half the point of having a reviewer agent

Shoopy profil fotoğrafı
Shoopy18 gün önce

spot on, reviewer that comments instead of committing just creates more work

Anders Abjorn | sales → AI profil fotoğrafı
Anders Abjorn | sales → AI18 gün önce

Tests that echo the code are a quiet fail. I ask for a case that would break if the function lied. Mirror tests feel green and teach nothing.

Shoopy profil fotoğrafı
Shoopy18 gün önce

"mirror tests feel green and teach nothing" is a great way to put it

Anders Abjorn | sales → AI profil fotoğrafı
Anders Abjorn | sales → AI18 gün önce

Yeah, I believe so. 😊

Daniel Nim profil fotoğrafı
Daniel Nim18 gün önce

The idea of making the reviewer fix things instead of just leaving comments is huge!

Shoopy profil fotoğrafı
Shoopy18 gün önce

right? half my review time used to be reading bot comments i then fixed myself

half_cto profil fotoğrafı
half_cto18 gün önce

I wonder what has he built? Ohh right he's just talking, thats enough.

Shoopy profil fotoğrafı
Shoopy18 gün önce

fair to judge the ideas, not the guy. the reviewer-commits-fixes part works regardless of who said it

half_cto profil fotoğrafı
half_cto18 gün önce

yeah you are right, i'm just puzzled what have people been doing if this is something new? I get dude is "announcing skills" for "real engineers" though is he one? If i would like to be influencer there is a lot to learn from him, can't deny that.

Shoopy profil fotoğrafı
Shoopy17 gün önce

full 3-layer system in one image ↓

Alexey Samoylov profil fotoğrafı
Alexey Samoylov18 gün önce

That guy has a slop skill set and nothing more. He knows very little about the AI pull request review.

Shoopy profil fotoğrafı
Shoopy18 gün önce

what would you do differently? genuinely curious what's working for you on AI PR review

Alexey Samoylov profil fotoğrafı
Alexey Samoylov18 gün önce

I got my own AI review solution with the "bring your own agent" approach. It writes summaries and comments, performs issues classification, does the PR gating on the github/azure/gitlab.

Abdul Ahad profil fotoğrafı
Abdul Ahad18 gün önce

@grok from this video explain step by step the whole process so i can replicate it

Crio Songo profil fotoğrafı
Crio Songo18 gün önce

These points hit exactly the pain points of current AI coding. I'm gonna go watch this full talk right now.

Shoopy profil fotoğrafı
Shoopy18 gün önce

the part at 15:34 is the one to steal first, reviewer commits instead of commenting

Akos profil fotoğrafı
Akos18 gün önce

this was happening with older models too - 4.8. we also figured out what was the problem and created domain specific review agents which fixed the entire set of the problems!

Shoopy profil fotoğrafı
Shoopy18 gün önce

domain-specific reviewers is the move. how many did you end up with, one per area of the codebase?

chuplung profil fotoğrafı
chuplung18 gün önce

this talk is way more useful than most ai coding advice

Shoopy profil fotoğrafı
Shoopy18 gün önce

glad it landed, practical > theoretical every time

࣪˖ sofi z, profil fotoğrafı
࣪˖ sofi z,18 gün önce

Couldn't agree more

Shoopy profil fotoğrafı
Shoopy18 gün önce

thanks

soooz profil fotoğrafı
soooz18 gün önce

5 is the slide number. The permission story is still the footnote.

Shoopy profil fotoğrafı
Shoopy18 gün önce

true, permissions get the headlines but the tests are the silent risk

qwinsi profil fotoğrafı
qwinsi18 gün önce

Thx for sharing this broski, saved

Shoopy profil fotoğrafı
Shoopy18 gün önce

appreciate it

CryptoNinjas profil fotoğrafı
CryptoNinjas18 gün önce

Watching that exact part now and circular test generation is way too common lately.

Shoopy profil fotoğrafı
Shoopy18 gün önce

circular tests are everywhere now. green CI, zero coverage of what the code actually does

GratefulPle₿ 🏴‍☠️⚡️ profil fotoğrafı
GratefulPle₿ 🏴‍☠️⚡️18 gün önce

Ex vercel? Wasn’t it ex-voice coach now building hobby apps with ai?

Shoopy profil fotoğrafı
Shoopy18 gün önce

both actually. voice coach before he got into typescript, then vercel. the talk still slaps either way

Konrad profil fotoğrafı
Konrad18 gün önce

what happend to him

Shoopy profil fotoğrafı
Shoopy18 gün önce

reviewed one too many AI PRs lol

Alex Martossy profil fotoğrafı
Alex Martossy17 gün önce

Saying Matt is ex-Vercel is like how Lex Fridman is ex-MIT.

Gaetan Semet profil fotoğrafı
Gaetan Semet18 gün önce

Thanks @mattpocockuk for this good video. Couple remarks: - "coding standards belong in a separate review agent" => yes, this confirms recent changes in all major "SDD" frameworks, converging to way I called "The Canonical Implementation Loop". You have a Coder agent and a Reviewer Agent. - "AI reviewer shouldn't comment. it should commit the fixes" => ok for the review once the PR is created, but I won't say that for the in-loop reviewer (I called "Task Inspector"). If you start an implementation loop in the reviewer, it can starts drifting from its goal of findings all the missed acceptance criteria and do it properly. It can "try" to do the fix if it is very small issue, to avoid restarting a new coder to fix the issue, but things like incomplete feature, it should sent the task back to the coder agent.

Benzer Videolar

this AI agentic stack is f*cking crazy 8 open-source repos that cover everything you need to run AI agents for free. not a random "top tools" dump. each one handles a different part of the job: BUILD > video-use - drop raw footage in a folder, tell Claude Code "make a launch video", get back final.mp4. it cuts filler words, adds subtitles, grades color > > Univer - a full office suite made for agents. they edit your sheets, docs and slides in a draft, you review and merge > ORCHESTRATE > Superpowers - stops your coding agent from writing code blindly. it plans first, splits work into 2–5 min tasks, tests everything > > Treg - OpenRouter, but for agent tools. one key, ~2,600 endpoints from 40+ providers: scraping, SEO, email finding > ACT > Mobile MCP - your agent controls a real iPhone or Android. taps, swipes, installs apps, records the screen > > security-audit-skill - Cloudflare's own skill that turns your coding agent into a security auditor. one agent hunts bugs, a different one double-checks every finding > REMEMBER · TEST · SHIP > Hindsight - memory that actually learns. it doesn't just recall old chats, it builds beliefs and updates them over time > > Graphify - turns your whole codebase into a map your agent can query instead of grepping files blindly. zero LLM cost to build it > the cool part isn't any single repo. it's that your agent can now: edit video -> work in Excel -> plan like a senior dev -> use 2,600 tools -> drive a phone -> audit its own code -> learn -> know your codebase you don't have to build an AI employee from scratch anymore. every part is already on GitHub. you just put it together. bookmark this before you start your next agent.

kiosa

12,887 görüntüleme • 16 gün önce