Skip navigation
New eval! Code duels for LMs ⚔️
0:00 / 0:17

New eval! Code duels for LMs ⚔️

John Yang

@jyangballin7.7K followers

Visit on X

106,074 views

New eval! Code duels for LMs ⚔️ Current evals test LMs on *tasks*: "fix this bug," "write a test" But we code to achieve *goals*: maximize revenue, cut costs, win users Meet CodeClash: LMs compete via their codebases across multi-round tournaments to achieve high-level goals

Comments

Comments from the original post on X (Twitter)

No comments yet