How to read CursorBench π
@mattyp134K followers
64,336 views
31 Comments
Comments from the original post on X (Twitter)

@mattyp
See the full benchmark & learn more here:
25 likes

@JayAndAI
This is really helpful, especially for a beginner like me, thanks Matt.
3 likes

@mattyp
glad I could help!
1 like

@itscali_ai
Would love CursorBench split by task type. The model that wins big refactors isn't always the one that nails a quick webhook fix or a UI tweak. A "best model for this kind of task" view would save a ton of trial and error.
2 likes

@AngeloLSobrinho
Do you intend to release a Composer 3? Composer 2.5 has a great cost-benefit ratio compared to Grok 4.7. I miss a cheap model in the Ultra X.
1 like

@vamsibatchuk
@tri333 your explainers are just so good, Matt ! π₯
1 like

@bnistordev
this is quite simple to understand for everyone, i'll take it and use it for the next event.
1 like

@The_CozyDev
Amazing. This is super useful, thank you Matt π
1 like

@mattyp
thank YOU
1 like

@davidwong
Super useful and exciting to see. Thanks, Matt!
1 like

@mattyp
Thanks david!
1 like

@Vuojolahti
Putting that zero into the right corner is not the way man
1 like

@XorDev
My one critique of auto routing models is that the task may be technically simple (e.g. UI adjustments), but a larger model tends to understand the context better, resulting in a better layout, formatting, UX, etc. I often find auto underperforms
1 like

@markusglob
cost should increase from left to right. c'mon bro , common sense!

@P7602604897993
Is this coming to Grok bot? I would love for a cheaper model to wake my bots and also bots using the cheapest model to share a message or communicate with each other. Iβm on ultra, and my usage doesnβt go past 2 daysβ¦.

@PalmBeachAI
Now, add in prompt caching, because this can flip the script on costs.

@loccoai
I'd suggest modifying the axes labels as follows: x-axis: Average cost per task (lower is better) y-axis: Score (higher is better) Yes, yes, in hindsight, this is trivial but when I first look at charts, I want to understand the axes right away, and more importantly, I want to know right away what the best "measurements" are. Also, it helps A LOT when comparing too, imo!

@mattyp
good feedback
1 like

@loccoai
that's why they pay me the big money, Matt! π

@timthyne
I missed everything because ADHD brain was fixated on the inverse x axis.










