Video wird geladen...
Video konnte nicht geladen werden
I have built a Windows x64 sampling profiler for native code+C# to be used by coding agents. Why? Because it is irresponsible to let computers write code but give them no tools to evaluate the performance of their code. Stop guessing, start measuring. -> How does it work? Just... show more
13,130 Aufrufe • vor 6 Monaten •via X (Twitter)
9 Kommentare

Trying this out. It's pretty sweet so far! Already surfaced an unoptimized code path I wasn't even aware of. However, the resolve phase is quite slow. For a <2min trace it's taking 20-30min to resolve.

Yes! Then how about equipping agents with proper debuggers - would they be able to place break points to inspect the process in a similar way a dev would, rather than print-guessing and wiring in logging here and there?

Potential stupid question (and I'll give it a go as well) - what is the benefit over letting an agent have programatic access to a profile? Less token use and faster convergence by providing better high level analysis?

It could also be programmatic access; I don't think there's an inherent advantage to going CLI vs. programmatic access. But then again there's no tool that gives programmatic access to this kind of data either :)

well - one can get very far with etw/wpa/xperf on windows

When I last checked, the APIs for WPA weren't even correct :( -- Then if you want it actually fast at scale, you have to sidestep WPA anyway. You also have to build the timing on top to actually get a timeline model (with stuff like "blocked by file I/O"). Then there's the question of really big traces, which I admittedly haven't tried with WPA (because I already had most of the low level plumbing work done from some years ago). Then you'll have to add the actual analysis work and the guidance for agents, etc. - it's mostly a long list of details, but conceptually it's not hard, as with most things.

If I use it personally for non-commercial purposes, what’s the pricing? There are only two options on your website (7-day free trial and commercial license).

We would need Windows ARM64 support also. Thanks

Yeah this is the sane direction. Letting coding agents 'optimise' without profiler data is basically inviting decorative micro-optimisations and a little fiction. Give them a sampling trace and at least the mistake budget gets smaller.

