Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Shelley's new compaction algorithm: a tool that the model calls to "squish" and "trim" prior messages.

15,937 görüntüleme • 19 gün önce •via X (Twitter)

12 Yorum

Jeff Huber profil fotoğrafı
Jeff Huber18 gün önce

nice viz

Nope that ain't me profil fotoğrafı
Nope that ain't me18 gün önce

Why did you use to animate ?

0xblackcat.eth profil fotoğrafı
0xblackcat.eth19 gün önce

Love your illustrarion. How can u do that?

Kelly J. Rose (kjrose) profil fotoğrafı
Kelly J. Rose (kjrose)19 gün önce

Letting the model pick what to squish is a fun trust exercise. Does it go after giant tool outputs first? My bet is one 400-line log dump nobody needed is always the real context hog.

Buswe profil fotoğrafı
Buswe19 gün önce

Keeping the pre-squish text on disk pays off: when a trim drops something needed you re-expand that one message instead of rerunning.

Daniel Lenton profil fotoğrafı
Daniel Lenton18 gün önce

your second version, a summary plus the last few messages kept verbatim, is pretty much what claude code does now. what made you drop it?

Jyothidhar profil fotoğrafı
Jyothidhar18 gün önce

like that the model picks what to trim instead of a fixed cutoff. old tool output is usually the dead weight, not the actual conversation

Tommy profil fotoğrafı
Tommy18 gün önce

Failed constraints still get trimmed first

von profil fotoğrafı
von19 gün önce

Very cool. I wonder what impact this would have on autoresearch workflows where the agent is doing heavy data analysis

John Rood profil fotoğrafı
John Rood19 gün önce

the first thing a squish eats is the why: a decision gets trimmed to one line, so next session the agent reads 'no retries on webhooks' as an arbitrary constraint and proposes removing it. log every trimmed decision with its reason, outside the window. that's the whole reason i built memoryrouter.

Steven John profil fotoğrafı
Steven John18 gün önce

How does it keep the prompt cache?

AI Quanting profil fotoğrafı
AI Quanting18 gün önce

Letting the model pick what to drop is the interesting gamble there. Whatever decides something is safe to forget is the same thing that needs it forty turns later. Does it ever squish something and then go hunting for it again?

Benzer Videolar