Video wird geladen...
Video konnte nicht geladen werden
Another insane Jev use case! Jev makes it incredibly cheap to evaluate and classify agent runs at scale. And finally, someone open-sourced a self-improving memory layer that can put that capability to work across agent harnesses. It turns your agent sessions into a compounding knowledge layer, where every successful... show more
84,030 Aufrufe • vor 1 Tag •via X (Twitter)
20 Kommentare

hell yes, we're so stoked on this use case

Thanks for the approval, Nathan! Cheers! :)

"Finally" Check out Open sourced back in April. Handles memory for swarms of agents on any harness, as well as skills. Web Dashboard for your memory server (if you run it in the cloud) Never repeat yourself. Built in rust for enterprise performance.

i tested jev on sorting my own saved memory notes and it came third of four models, haiku beat it by seven points. but when i let it skip the notes it was least sure about, it ended up ahead of all of them. so if a tool lets jev decide what becomes memory, run it on a sample of your own notes first and look at how its answers change with its confidence. does beacon use that confidence to decide what gets promoted?

cross-agent memory is finally here, this is massive

cross harness memory sounds fancy, it's just a shared folder with better naming

akshay - what run signal makes Beacon learn?

Nice!

Woohoo!!

@narsagna

@akshay_pachaar nice, but watch out for data drift over time in self-improving layers. They can skew results if not monitored closely.

Evaluating the run after it dies is the easy half. The hard half is not feeding the next turn the entire failure stack. Do you checkpoint the last good state, or just score the corpse?

The shared history is the strong idea, but promoting a successful run straight into reusable memory can preserve a lucky workaround. Keep human review in the loop for lessons that affect future runs.

Is it similar to obsedian with Claude?

we run 5 model reviews on every draft before it ships now, no deterministic gate at all anymore. would you trust jev to replace one of those, or just stack a 6th check on top?

self-improving memory层这个点我踩过坑,真正难的不是存,是跨harness写入的时候状态冲突谁来裁决。“compounding”听起来爽,但沉淀的都是垃圾怎么办?

Interesting

Cheap eval is the unsung hero of agent scaling. Most teams bottleneck on feedback loops; Jev fixes that math so you can actually iterate without crying over costs. That open-source memory layer? Now we’re cooking with gas. I’ve been watching this closely and it’s elegant work.

self improving memory on top of jev evals is spicy. you running it across multiple harnesses already?

the compounding layer is the important bit. evaluation without memory just ranks disposable runs; memory without receipts just accumulates folklore. the harness needs both if agency is going to persist.
