Загрузка видео...

Не удалось загрузить видео

На главную

Your JEV agent knows the answer. It doesn't know whether it should act on it every call returns two things: the answer, and the confidence behind it. most setups only read the first one. confidence comes from the spread. same 4 options, one distribution concentrated at 0.91, one flat...

30,276 просмотров • 1 месяц назад •via X (Twitter)

Комментарии: 14

Фото профиля PolyBender
PolyBender1 месяц назад

jev always knows the right answer

Фото профиля rody
rody1 месяц назад

much appreciated!

Фото профиля Amir
Amir1 месяц назад

that point about confidence versus permission hit home because we assumed a high score meant the job actually saved

Фото профиля Moysha
Moysha1 месяц назад

booked this

Фото профиля rody
rody1 месяц назад

thank you fam!

Фото профиля Hussain Hashim | Building SundayBack
Hussain Hashim | Building SundayBack1 месяц назад

@0x_rody missed opportunities in planning for that spread. not enough people analyze it post-call.

Фото профиля cloutusf
cloutusf1 месяц назад

0.91 confidence that it's done, and the file's still sitting there unsaved. Somehow both show up on the same call.

Фото профиля Brian Hadu
Brian Hadu1 месяц назад

how do you see teams effectively using the confidence metric in practice?

Фото профиля magsimich
magsimich1 месяц назад

The confidence part is easy to overlook

Фото профиля Fajar M Reza
Fajar M Reza1 месяц назад

Confidence estimates make agent actions easier to govern than answers alone.

Фото профиля Len
Len1 месяц назад

Fake

Фото профиля Sharapov Andrei
Sharapov Andrei1 месяц назад

Pinning the model version isn't enough if the choice set changes. Confidence is computed from the spread over K options — add a hedge choice and last week's 0.91 is no longer the same refund bar.

Фото профиля BonBonaz
BonBonaz1 месяц назад

my confidence comes from hopium not spread

Фото профиля heath
heath1 месяц назад

the confident “done” without checking the file is terrifying lol. I built helix to manage my AI agents, and this is exactly the kind of action boundary I want visible.

Похожие видео

LLMs vs. Jev, clearly explained! LLMs are great, and the ceiling is one you can watch scroll past: an LLM writes the answer one token at a time. give it a failed deploy and four decisions, and it produces a small JSON object where every token depends on the one before it. token nine cannot exist until token eight does, so four decisions that had nothing to do with each other just stood in a queue. then your code parses it, validates the shape, and retries when the shape is wrong. Jev fixes this without being a smaller or faster model: it removes the order. one turn on that deploy has to know: → whether the incident is urgent → which team owns it → whether the next command is risky → whether the task is actually done you declare the questions and the answer type upfront, and all four come back together, typed, with a probability on each. three primitives cover almost every fork in an agent: 1. **Choice** picks one of up to 255 options you define, like engineering, billing or sales. 2. **Score** places the state on an ordered scale you define, like low, medium or high risk. 3. **Noul** returns the probability that a yes-or-no condition is true. here is the sentence that resolves the whole confusion: text is a line you have to walk. an answer space is a room you see all of at once. ↳ generation: one order you cannot change, one string at the end, a shape you hope holds ↳ evaluation: no order at all, typed answers, a probability on every option Prompts → Agents → Loops → Graphs → Jev the probabilities matter more than the answer. ↳ engineering at 0.91 against billing at 0.09 is a route you can automate ↳ 0.52 against 0.46 is a coin flip wearing a label, and the label alone never told you which one you got that last one catches careful people. an LLM would have said "engineering" in a confident sentence and given you no way to know the race was that close. thresholds live in your code, one per action, scaled to what being wrong costs. it works when the options are known and the call depends on meaning. it is not for writing, code, arithmetic, or anything where question two needs the answer to question one. and the one that eats whole nights: type safety prevents malformed output, not incorrect judgment. Jev cannot return an option outside your schema, and it can still pick the wrong valid one with confidence. a schema-valid mistake refunds the wrong customer just as fast. an LLM writes new language when the answer space is open. Jev evaluates known paths when the answer space is closed. below i have quoted my full breakdown on Jev. it covers the three primitives, the parallel battery, the thresholds, and where it does not belong. save this and read it below ↓

Hanako

44,238 просмотров • 1 месяц назад

David Jerison, the mathematician who spent decades teaching the exact method for finding the optimal choice when the odds are stacked against you: "I used to think the best decision was whichever option looked strongest at first glance. Then I proved that the real answer almost always hides at a point nobody would guess just by looking, and checking only the obvious choices gets you the worst possible outcome, not the best." this is the exact method quant desks lean on to find the one allocation that survives every constraint thrown at it, and it's been sitting free in a public MIT lecture for almost twenty years. strip away the notation and the mechanism is simple. every optimization problem has a handful of candidate points where the best or worst answer could be hiding, and the obvious middle-of-the-road guess is almost never one of them. check only the points that feel natural, and you don't just miss the best answer. you can land on the exact opposite, the worst possible one, without ever realizing it. nobody presenting a "risk-optimized" portfolio out loud admits how easy it is to stop checking one step too early. zoom out to how this plays out sizing a position or allocating risk under real constraints today. the instinct is to test the option that feels balanced and call it done, when the actual edge is almost always sitting at an extreme nobody thought to check. the industry sells a clean, confident number as proof an allocation is optimal. but that number means nothing until every boundary has been checked, because the same method that finds the best case can just as easily hand you the worst one in disguise. the right answer was never the one that looked most reasonable. it was the one nobody bothered to check.

MindArch

16,232 просмотров • 2 месяцев назад

this is crazy... the guy reverse-engineered his Meta Ray-Bans 3 with Opus 5.5 into a 3,000+ Elo chess engine he built AI chess cheat glasses on Opus 5.5 + Jev and open-sourced the whole workflow here's how it works step by step: step 1 → install it on your Mac with one command: npx chesshacker setup. It downloads Stockfish from GitHub and verifies the checksum step 2 → put on Meta Ray-Bans and video-call your own Mac on WhatsApp. The glasses see the board, the Mac sees what the glasses see step 3 → the Mac grabs frames straight from the call window. About 1 per second while it waits for the opponent, 1 every 3 seconds on your turn step 4 → Jev runs a cheap pre-check on every frame: is the board readable, is a hand over it, did a piece move? No change means no expensive AI call step 5 → only then Opus 5.5 reads the board. The app compares it with the position it already knows and accepts a move only if it's legal step 6 → Stockfish thinks for half a second and picks the best reply, with an eval like +1.5 or "mate in 3" step 7 → macOS speaks it through a virtual mic into the WhatsApp call: "Rook a to d1". You hear it in your ear step 8 → on the Mac a command center shows everything live: whose turn it is, the suggested move with a confidence bar, the move list and a log under the hood: → if Opus loses track of the board, the glasses say "Lost track of the board" and you fix it with undo or by typing the move → if Stockfish crashes, it restarts once and says "Something went wrong. Still trying" → every game is saved as a PGN file, API keys live in the macOS Keychain → an overlay draws the suggested move as an arrow on the live video, ready for OBS Clone his workflow below Then read the guide on how to reverse-engineer anything with Opus 5.5.

Movez

398,388 просмотров • 7 дней назад

your agent reviewing its own work is not a check. it is a second opinion from the same source. this is the most common gap in agent systems and it hides in plain sight, because the step exists. there is a review. it just cannot do the thing you think it does. here is the mechanism. the model produced an output from a context. you then ask the same model, holding the same context, whether that output is correct. it answers fluently, because that is what it does. and the answer is drawn from the same distribution that produced the thing being judged. same weights, same window, same blind spots. if the reason the output is wrong is something the model does not know, the review does not know it either. if the reason is something the context does not contain, the review has the same context. the failure mode and the detector share a cause. > why it feels like it works because most of the time the output is fine, and the review says fine. agreement is not evidence of detection. a reviewer that says pass on everything agrees with reality most of the time too. what you actually want to measure is what happens on the cases that are wrong. that is the only place a check earns its name, and it is exactly the place where a self-review is weakest. there is research on this. Huang and colleagues at DeepMind showed at ICLR 2024 that intrinsic self-correction, revising without external grounding, does not reliably help and often makes things worse. > what to actually do move the check outside the model. a test that runs, a schema that validates, a file that exists or does not, an exit code from something you did not write. these are not smarter than the model. they are just not correlated with it, and that is the entire value. when the judgement genuinely needs a model, at minimum use a different family. same family means shared blind spots, and frontier judges measurably inflate scores for outputs that look like their own. and split the work by kind. anything objectively checkable goes to code. only the genuinely semantic calls go to a judge, and those get a rubric written as one line. a review inside the loop tells you the model is confident. a check outside it tells you whether the work is done. save this - then read the eval setup below

Hanako

14,325 просмотров • 2 месяцев назад

stop scrolling and clone this before it gets paywalled. someone put their entire trading loop on GitHub. the model, the order logic, the dashboard. all of it. it makes one decision every ~300 milliseconds and quotes a fresh limit order on every single block. the brain is Jev. it can't write a word. it looks at the order book and returns buy or sell with a probability. what the loop does each block: -> reads the live order book -> asks Jev: buy or sell? -> posts a post-only limit order one tick inside the touch -> replaces the last order -> waits for a taker to hit it the useful part: it never crosses the spread. fills only happen when someone else takes the order, so the bot is built to earn the spread instead of paying it. and every block is logged: the decision, the probabilities, the latency, the quote. the setup: git clone cp .env.example .env bun install bun run start -> with no private key it dry-runs: real book, real decisions, simulated fills then in .env: MODEL=jev TYPESAFE_AI_API_KEY=your-key -> swaps the built-in momentum stand-in for Jev want the full desk instead of one loop? -> QuantDinger ships Jev as a pre-trade gate: research, Python strategies, backtest, paper and live the workflow: order book in -> Jev decides -> code prices the order -> the market fills it or doesn't start here: one clone -> dry run -> watch 1,000 blocks of decisions before a single real order the catch: fast is not the same as right. quoting inside the spread can still lose money when the price moves against you. none of this is an ATM. > let the big model do the research. > let Jev make the call. > let code place the order. clone it now. dry-run it tonight. decide tomorrow.

kiosa

21,466 просмотров • 21 дней назад

Agents vs. Graphs, clearly explained! spawning more agents is great, but it has a ceiling nobody says out loud: five agents is a count. a graph is a shape. only one of them changes the answer. point five agents at the same pile with the same window and they converge. the first one writes a finding, the rest read it, and all five reports centre on the same thing. you paid five times for one opinion with four echoes. Graph engineering fixes this by moving the decision up a layer: not how many agents, but who is allowed to look at what. you need both. here's how it works: ↳ the count buys you throughput. five things happening instead of one ↳ the shape buys you coverage. five different things happening instead of the same one five times Prompts → Context → Harness → Agents → Graphs the node that does this is the splitter, and it decides more than any other node in the system. cut a repository by folder and four workers audit the same three files. cut it by blast radius and each one sees something the others cannot. the trick is being selective about what each lane is allowed to see. separate contexts are not a nice-to-have, they are the mechanism. if two agents are meant to produce different things, they must not share a window. if they are meant to produce the same thing, you did not need two agents. one thing to know before you scale it. a branch that throws does not reject the batch. it resolves to null, and that is the containment. which means your merge quietly receives a short list. ↳ filter the nulls before the merge, or one dead lane poisons the whole result ↳ never index a merge by position. eight good branches and one failure will shift everything by one, silently skip that and the run looks like it worked. the output is just missing a lane, and nothing errored. and the one that eats whole nights: multi-agent setups can use up to fifteen times the total tokens of a single chat, because every lane reloads its own core. you are trading total tokens for a clean main window. usually the right trade, always a choice. below i have quoted my full guide on graph engineering. it covers the three topologies, the verifier patterns, and where the gate should actually open. save this and read it below ↓

Hanako

97,154 просмотров • 2 месяцев назад