Traditional coding benchmarks do not reflect how software is actually built and maintained. That's why we built a new benchmark, APEX-SWE, in partnership with Cognition. It measures whether AI models can perform complex, real-world software engineering work to ship systems that work and debug them when they don't. OpenAI... GPT 5.3 Codex (High) tops the leaderboard at 41.5% on Pass@1.show more

APEX-SWE Leaderboard | Pass@1 🥇@OpenAI GPT-5.3 Codex (High) at 41.5% 🥈@AnthropicAI Opus 4.6 (High) at 40.5% 🥉@AnthropicAI Opus 4.5 (High) at 38.7% Every frontier model fails on nearly 60% of real production tasks. Check out the full APEX-SWE leaderboard:

We have an open-source dev set on @huggingface: And, our eval harness on @GitHub:

You can read more about APEX-SWE here:

@cognition Let the hill climbing begin!

@cognition APEX-SWE is a much better proxy for real engineering work than toy coding benchmarks—testing whether models can actually build, ship, and debug working systems. Great to see GPT 5.3 Codex (High) leading at 41.5% Pass@1.

@cognition :o our quants

@cognition Very exciting

@cognition 🚀

@cognition super insightful stuff

@cognition congrats!

@cognition i am surprised to know that OpenAi is winning in this when i thought it gonna be claude opus 4.6

@suryamidha @cognition Go @AbhiKottamasu!

@cognition any chance of adding xhigh for 5.4 and 5.3 codex?

@cognition Amazing @OpenAI @AnthropicAI 🚀

@cognition The companies most motivated to prove AI can replace developers built the benchmark measuring it. Mercor does AI hiring. Cognition made Devin. These are not neutral observers. The incentive structure is baked into the methodology.

@cognition opus 4.5 > opus 4.6? lol

@cognition Congrats Adarsh & team!

@rhythmrg @cognition oh this is fire

@cognition ultimate indians + asians collab

@cognition ????

@cognition 🚀🚀

@cognition 🔥

@cognition Definitely makes sense, appreciate your take!

@cognition congrats! Seems great

@cognition Great share

@cognition Very insightful! APEX-SWE sets a new standard for evaluating AI in software engineering. It's crucial that our benchmarks reflect real-world challenges, as almost 60% of models struggle with production tasks. Exciting times ahead! 🚀

@cognition Real-world complexity is where most models struggle.

@cognition Finally measuring what matters

@cognition Great one

@cognition Numbers aside, the direction here matters more.

@cognition 🔥🔥🔥

@cognition All

@cognition 🔥🔥🔥