Gezinmeyi atla
Your JEV agent knows the answer. It doesn't know whether it should act on it
0:00 / 0:24

Your JEV agent knows the answer. It doesn't know whether it should act on it

rody

@0x_rody4,9 B takipçi

X profili
288 beğeniİndirOrijinal gönderi

30.276 görüntüleme

Your JEV agent knows the answer. It doesn't know whether it should act on it every call returns two things: the answer, and the confidence behind it. most setups only read the first one. confidence comes from the spread. same 4 options, one distribution concentrated at 0.91, one flat at 0.22. identical answer, completely different decision. the fix is a bar that rises with the stakes: read-only 0.5 → refund 0.7 → escalation 0.8 → destructive 0.9 below 0.5 the ticket goes to a human. no guessing. two traps most people miss. a noul of 0.5 means "as likely yes as no", not "medium". and a confident "done" doesn't prove the file was saved. confidence is not permission, check the outcome. pin the version. aliases move, and thresholds tuned on one version quietly break on the next. check out the full article on Jev below ↓ ↓

14 Yorum

Yorumlar X (Twitter) üzerindeki orijinal gönderiden alınmıştır

  • PolyBender profil fotoğrafı

    @p0lybender

    jev always knows the right answer

    1 beğeni

  • rody profil fotoğrafı

    @0x_rody

    much appreciated!

    1 beğeni

  • Amir profil fotoğrafı

    @AmirNik73

    that point about confidence versus permission hit home because we assumed a high score meant the job actually saved

    1 beğeni

  • Moysha profil fotoğrafı

    @mmoyshaa

    booked this

    1 beğeni

  • rody profil fotoğrafı

    @0x_rody

    thank you fam!

    1 beğeni

  • Hussain Hashim | Building SundayBack profil fotoğrafı

    @itsthedonhashim

    @0x_rody missed opportunities in planning for that spread. not enough people analyze it post-call.

    1 beğeni

  • cloutusf profil fotoğrafı

    @kranthi95223317

    0.91 confidence that it's done, and the file's still sitting there unsaved. Somehow both show up on the same call.

  • Brian Hadu profil fotoğrafı

    @BrianHaDu

    how do you see teams effectively using the confidence metric in practice?

  • magsimich profil fotoğrafı

    @magsimich

    The confidence part is easy to overlook

  • Fajar M Reza profil fotoğrafı

    @FReza1984

    Confidence estimates make agent actions easier to govern than answers alone.

  • Len profil fotoğrafı

    @Len_079

    Fake

  • Sharapov Andrei profil fotoğrafı

    @AdrasSad

    Pinning the model version isn't enough if the choice set changes. Confidence is computed from the spread over K options — add a hedge choice and last week's 0.91 is no longer the same refund bar.

  • BonBonaz profil fotoğrafı

    @BonBona9z

    my confidence comes from hopium not spread

  • heath profil fotoğrafı

    @HeathGerrald

    the confident “done” without checking the file is terrifying lol. I built helix to manage my AI agents, and this is exactly the kind of action boundary I want visible.