Loading video...

Video Failed to Load

Go Home

codename: snake_oil for the skeptics - ran it again on fastapi vanilla vs snake_oil 92.5% token reduction 139k → 10k tokens $0.42 → $0.03 welcome to the game, kid

88,463 views • 10 months ago •via X (Twitter)

44 Comments

Tom Davenport's profile picture
Tom Davenport10 months ago

Guessing this is like DSPy where a small model gets looped against a high model response. I've started building something similar but looking forward to trying this when released

dei's profile picture
dei10 months ago

nope

symmetry's profile picture
symmetry10 months ago

bro where's the repo?!

contextty's profile picture
contextty10 months ago

Ooo looks like you made a more efficient version of my intent layer And created a way to quantify the gains! Codemaps was always a better name than intent layer

AM's profile picture
AM10 months ago

How does this change tool usage and code accuracy?

dei's profile picture
dei10 months ago

how does a sharper sight affect the archers ability to hit the target?

Conwic's profile picture
Conwic10 months ago

Oh, you wild, wild

Derk 🇦🇺's profile picture
Derk 🇦🇺10 months ago

Will this diminish code quality?

dei's profile picture
dei10 months ago

improves it

Derk 🇦🇺's profile picture
Derk 🇦🇺10 months ago

How much are you going to charge for v3?

dei's profile picture
dei10 months ago

who said I was charging

Derk 🇦🇺's profile picture
Derk 🇦🇺10 months ago

🫣

ManiGupt's profile picture
ManiGupt10 months ago

I use a project agnostic script which ingests a codebase of any size and algorithmically generate a 2 layer codebase atlas md file in 5 seconds.

Sven Fontijn's profile picture
Sven Fontijn10 months ago

Now rename it

Theo Borges's profile picture
Theo Borges10 months ago

Is it only for claude code or can I use it with opencode?

dei's profile picture
dei10 months ago

yeah you can use as an mcp fyi i've only tested on claude code and its rigged with custom hooks using tldr but the same should be simple to setup for opencode

Theo Borges's profile picture
Theo Borges10 months ago

Interesting. Will test soon. If I understood this project correctly, I just have to talk to Claude as always, but it will increase its knowledge about the project session by session and drastically decrease the amount of token use?

dei's profile picture
dei10 months ago

yeah tldr blocks grep/reads and injects layers knowledge to reduce token consumption in session the memory system over time extracts learnings from Claudes thinking blocks from the session and since it runs via hooks its automatic only caveat is for each new project, run 'tldr semantic index .' i've added an update to the session start hook to warn if there isn't one now too just incase otherwise semantic search won't work

dei's profile picture
dei10 months ago

tldr has semantic search built in for free and the hooks pipe in the info when Claude reaches for grep so there’s no reason to pay for something you can do natively optionally outside of hook, gonna explore if tldr as a native mcp tool works better but that’s a test for next week

Vincent Koc's profile picture
Vincent Koc10 months ago

Have you uploaded v3 yet?

Taras Kornichuk's profile picture
Taras Kornichuk10 months ago

its huge!

Artificially Inclined™'s profile picture
Artificially Inclined™10 months ago

This is legendary. May I token token-squanch with u

Anarchon's profile picture
Anarchon10 months ago

Make a comparison with @morphllm's warpgrep tool please

Jithin Palepu's profile picture
Jithin Palepu10 months ago

that’s some wild efficiency right there. those numbers speak volumes. makes you wonder how much more we can streamline marketing too. maybe First100 can help with that, right?

toni's profile picture
toni10 months ago

that's nice, but you're measuring the wrong thing token count drops when you cache repetitive docs. The real test is how much semantic info you actually kept vs compressed away what was the recall on specific details?

Glenn Digz's profile picture
Glenn Digz10 months ago

Releasing soon?

Stephen Rayner's profile picture
Stephen Rayner10 months ago

LSP / tree-sitter?

MrSane's profile picture
MrSane10 months ago

@grok how would this work exactly? Let’s see if you’re smart.

lucid's profile picture
lucid10 months ago

Followed

am.will's profile picture
am.will10 months ago

me watching the vid 🔊

Raymond Weitekamp's profile picture
Raymond Weitekamp10 months ago

ready when you are!

M's profile picture
M10 months ago

Ia this based on a RLM model ?

Halo3.eth's profile picture
Halo3.eth10 months ago

hub me daddy

Mark James Francis's profile picture
Mark James Francis10 months ago

How close are you to release? I assume you ran into some issues over the past few weeks?

Sam's profile picture
Sam10 months ago

I am too dumb to understand how to use it and integrate into my flow. Will go ask CC...

Squeesh's profile picture
Squeesh10 months ago

🔥 ur cooking

Carlo Edoardo Ferraris's profile picture
Carlo Edoardo Ferraris10 months ago

Wow

Sean Tes's profile picture
Sean Tes10 months ago

Awaiting v3 eagerly @parcadei

Psycho illogic's profile picture
Psycho illogic10 months ago

Are you selling this anywhere?

Anarchon's profile picture
Anarchon10 months ago

Countdown till the release?

Good Adam's profile picture
Good Adam10 months ago

Very Keen, could the system be adapted to be leveraged by codex? I've been working on semantic search tools and even those can be a huge boost.

James's profile picture
James10 months ago

AST grep

cheaty's profile picture
cheaty10 months ago

hell yeah

Omar Farooq's profile picture
Omar Farooq10 months ago

put it on the hub

Related Videos