New eval! Code duels for LMs ⚔️
John Yang
Visit on X@jyangballin7.7K followers
106,074 views
New eval! Code duels for LMs ⚔️
Current evals test LMs on *tasks*: "fix this bug," "write a test"
But we code to achieve *goals*: maximize revenue, cut costs, win users
Meet CodeClash: LMs compete via their codebases across multi-round tournaments to achieve high-level goals
Comments
Comments from the original post on X (Twitter)
No comments yet
