Loading video...

Video Failed to Load

Go Home

The best change to 10x Claude Code is adding verification skills. Verification is domain specific; here's ours. Chaos Labs is a financial portfolio agent. I spin up users that simulate user/agent convos. With cc hooks, this runs on every pr. Code gen needs verification!

21,023 views • 10 months ago •via X (Twitter)

16 Comments

Kydo's profile picture
Kydo10 months ago

@chaoslabs the ui looks so smooth!

DeFi Andree's profile picture
DeFi Andree10 months ago

@chaoslabs Spot on! Verification is crucial for solid code gen

Dina's profile picture
Dina10 months ago

@chaoslabs runs like a safety net

Omer Goldberg's profile picture
Omer Goldberg10 months ago

@chaoslabs risk guardrails should always be as deterministic as possible!

Timur Yessenov's profile picture
Timur Yessenov10 months ago

@chaoslabs Verification as a first-class citizen is underrated. Most people treat Claude Code like a magic output machine. Building domain-specific checks into the workflow via hooks is the difference between "cool demo" and "production-ready". The simulated user convos approach is clever.

Omer Goldberg's profile picture
Omer Goldberg10 months ago

@chaoslabs guardrails should be as deterministic as possible!

Timur Yessenov's profile picture
Timur Yessenov10 months ago

@chaoslabs This. Regex > LLM for pattern matching. Deterministic first, probabilistic only when you need judgment.

Omer Goldberg's profile picture
Omer Goldberg10 months ago

@chaoslabs exactly, and even when you need judgement, try to keep it binary. will be sharing a write up and some benchmarking we've done internally on llm-as-a-judge soon

Timur Yessenov's profile picture
Timur Yessenov10 months ago

@chaoslabs Binary outputs + clear rubrics = way more consistent evals. Looking forward to the benchmarks. curious how you handle edge cases where confidence is low.

Himanshu Kumar's profile picture
Himanshu Kumar10 months ago

@chaoslabs Verification skills are critical for financial agent code generation.

Omer Goldberg's profile picture
Omer Goldberg10 months ago

@chaoslabs most enterprise flows!

Rudy Ruiz's profile picture
Rudy Ruiz10 months ago

@chaoslabs 哈哈哈对啊 验证直接决定代码能不能上线啊!

Shreyas Shinde's profile picture
Shreyas Shinde10 months ago

@chaoslabs Review driven design

Onepie2279's profile picture
Onepie227910 months ago

@chaoslabs domain specific is key

shaped's profile picture
shaped10 months ago

@chaoslabs The custom ASCII art for each cc mirror looks so nice

Stephen Rayner's profile picture
Stephen Rayner10 months ago

@chaoslabs Any repo to link to?

Related Videos