Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Shelley's new compaction algorithm: a tool that the model calls to "squish" and "trim" prior messages.

15,937 Aufrufe • vor 11 Tagen •via X (Twitter)

12 Kommentare

Profilbild von Jeff Huber
Jeff Hubervor 11 Tagen

nice viz

Profilbild von Nope that ain't me
Nope that ain't mevor 11 Tagen

Why did you use to animate ?

Profilbild von 0xblackcat.eth
0xblackcat.ethvor 11 Tagen

Love your illustrarion. How can u do that?

Profilbild von Kelly J. Rose (kjrose)
Kelly J. Rose (kjrose)vor 11 Tagen

Letting the model pick what to squish is a fun trust exercise. Does it go after giant tool outputs first? My bet is one 400-line log dump nobody needed is always the real context hog.

Profilbild von Buswe
Buswevor 11 Tagen

Keeping the pre-squish text on disk pays off: when a trim drops something needed you re-expand that one message instead of rerunning.

Profilbild von Daniel Lenton
Daniel Lentonvor 11 Tagen

your second version, a summary plus the last few messages kept verbatim, is pretty much what claude code does now. what made you drop it?

Profilbild von Jyothidhar
Jyothidharvor 11 Tagen

like that the model picks what to trim instead of a fixed cutoff. old tool output is usually the dead weight, not the actual conversation

Profilbild von Tommy
Tommyvor 11 Tagen

Failed constraints still get trimmed first

Profilbild von von
vonvor 11 Tagen

Very cool. I wonder what impact this would have on autoresearch workflows where the agent is doing heavy data analysis

Profilbild von John Rood
John Roodvor 11 Tagen

the first thing a squish eats is the why: a decision gets trimmed to one line, so next session the agent reads 'no retries on webhooks' as an arbitrary constraint and proposes removing it. log every trimmed decision with its reason, outside the window. that's the whole reason i built memoryrouter.

Profilbild von Steven John
Steven Johnvor 10 Tagen

How does it keep the prompt cache?

Profilbild von AI Quanting
AI Quantingvor 11 Tagen

Letting the model pick what to drop is the interesting gamble there. Whatever decides something is safe to forget is the same thing that needs it forty turns later. Does it ever squish something and then go hunting for it again?

Ähnliche Videos