Loading video...
Video Failed to Load
We've created a comprehensive Retrieval Harness for modern agentic retrieval in 2026. The harness provides a persistent data pipeline that can connect to a data source, index and update a large knowledge base, and expose a broad set of tools akin to filesystem operations (semantic/keyword search, regex grep, file... show more
57,248 views • 3 months ago •via X (Twitter)
24 Comments

btw the GitHub doesn't seem public yet

sorry about the above - just made it public!

This looks very promising for AI legal apps and ESI analysis.

Have you tested it on OBLIQ-Bench?

hybrid search across the whole index with read, grep, and find is basically giving an agent the same tools a developer would use on a local filesystem

@jerryjliu0 i haven't been able to find a bug bounty / security program link on gh/llama's official site - got a link?

jerry,dropped you a DM about a paid collab

Treating retrieval as a persistent tool surface, with search, grep, file search, and read operations, feels much closer to how agents actually investigate large knowledge bases than one-shot RAG calls.

The filesystem metaphor is the right abstraction. Moving from "query the index" to "navigate the knowledge base" made agents far more predictable — they scope reads before writing, like a good engineer. Partial-update primitives, or is re-index always full corpus?

Persistent pipeline plus a bounded, filesystem-like tool surface is a strong combo here. The reliability jump comes when each tool call returns a typed result the next step can rely on, not free-form text the agent has to re-parse every run.

The filesystem-style tools were never my bottleneck. Index freshness was. "Index and update a large KB" buries the ugly part: an agent retrieving mid-reindex and answering off a stale chunk. Does the harness guarantee read-during-update consistency?

The persistent pipeline is the right call. Most "agentic retrieval" pain isn't recall — it's the agent re-indexing the world every run because nothing survives between calls. The harder half: teaching it when it has enough to stop retrieving.

persistent data pipeline opens up new possibilities

Your harness builds a fresh index, but it never flags when a source document drifts. Staleness is a harder problem than retrieval. A vector store can answer a query, yet it has no idea the underlying truth moved two weeks ago. If you attach a provenance check on each update, the agent can decide whether to trust the result.

The quiet shift here is that retrieval starts looking more like an agent exploring a filesystem: search, grep, read, follow the thread. That's much closer to how people actually research a case

agentic retrieval feels like giving an agent a local filesystem watching legal agents actually crawl PDFs is next‑level

The persistent-pipeline framing matches what we hit with travel data: static snapshots rot fast, so continuous dedup plus per-row source tags are what keep agent citations honest. Curious how the harness handles provenance when two indexed sources conflict, do you keep both with lineage or resolve to one?

👍🏻

index v2 will live or die on permission drift, not tool breadth

agents out here getting a whole filing cabinet meanwhile i still cant find my keys 😭

Another OCR. Sweet, is there a paper attached?

Retrieval is becoming less about finding information. It's becoming the workspace where agents think and act.

curious how it handles drift tho like the knowledge base updates mid-task and the agent already cached stale context

ngl 'filesystem operations but for vibes' is actually the unlock agents been fumbling retrieval tasks for too long fr 🔥
