正在加载视频...

视频加载失败

Shelley's new compaction algorithm: a tool that the model calls to "squish" and "trim" prior messages.

15,937 次观看 • 11 天前 •via X (Twitter)

12 条评论

Jeff Huber 的头像
Jeff Huber11 天前

nice viz

Nope that ain't me 的头像
Nope that ain't me11 天前

Why did you use to animate ?

0xblackcat.eth 的头像
0xblackcat.eth11 天前

Love your illustrarion. How can u do that?

Kelly J. Rose (kjrose) 的头像
Kelly J. Rose (kjrose)11 天前

Letting the model pick what to squish is a fun trust exercise. Does it go after giant tool outputs first? My bet is one 400-line log dump nobody needed is always the real context hog.

Buswe 的头像
Buswe11 天前

Keeping the pre-squish text on disk pays off: when a trim drops something needed you re-expand that one message instead of rerunning.

Daniel Lenton 的头像
Daniel Lenton11 天前

your second version, a summary plus the last few messages kept verbatim, is pretty much what claude code does now. what made you drop it?

Jyothidhar 的头像
Jyothidhar11 天前

like that the model picks what to trim instead of a fixed cutoff. old tool output is usually the dead weight, not the actual conversation

Tommy 的头像
Tommy11 天前

Failed constraints still get trimmed first

von 的头像
von11 天前

Very cool. I wonder what impact this would have on autoresearch workflows where the agent is doing heavy data analysis

John Rood 的头像
John Rood11 天前

the first thing a squish eats is the why: a decision gets trimmed to one line, so next session the agent reads 'no retries on webhooks' as an arbitrary constraint and proposes removing it. log every trimmed decision with its reason, outside the window. that's the whole reason i built memoryrouter.

Steven John 的头像
Steven John10 天前

How does it keep the prompt cache?

AI Quanting 的头像
AI Quanting11 天前

Letting the model pick what to drop is the interesting gamble there. Whatever decides something is safe to forget is the same thing that needs it forty turns later. Does it ever squish something and then go hunting for it again?

相关视频