Загрузка видео...

Не удалось загрузить видео

На главную

We've created a comprehensive Retrieval Harness for modern agentic retrieval in 2026. The harness provides a persistent data pipeline that can connect to a data source, index and update a large knowledge base, and expose a broad set of tools akin to filesystem operations (semantic/keyword search, regex grep, file...

57,194 просмотров • 3 месяцев назад •via X (Twitter)

Комментарии: 24

Фото профиля Adnan Qidwai
Adnan Qidwai3 месяцев назад

btw the GitHub doesn't seem public yet

Фото профиля Jerry Liu
Jerry Liu3 месяцев назад

sorry about the above - just made it public!

Фото профиля Ira Rothken
Ira Rothken3 месяцев назад

This looks very promising for AI legal apps and ESI analysis.

Фото профиля Kevin Madura
Kevin Madura3 месяцев назад

Have you tested it on OBLIQ-Bench?

Фото профиля Pinkman
Pinkman3 месяцев назад

hybrid search across the whole index with read, grep, and find is basically giving an agent the same tools a developer would use on a local filesystem

Фото профиля Eugene Yaroslavtsev
Eugene Yaroslavtsev3 месяцев назад

@jerryjliu0 i haven't been able to find a bug bounty / security program link on gh/llama's official site - got a link?

Фото профиля AW
AW3 месяцев назад

jerry,dropped you a DM about a paid collab

Фото профиля KYD 玩 ai
KYD 玩 ai3 месяцев назад

Treating retrieval as a persistent tool surface, with search, grep, file search, and read operations, feels much closer to how agents actually investigate large knowledge bases than one-shot RAG calls.

Фото профиля Dmytro Palaniichuk 🇺🇦
Dmytro Palaniichuk 🇺🇦3 месяцев назад

The filesystem metaphor is the right abstraction. Moving from "query the index" to "navigate the knowledge base" made agents far more predictable — they scope reads before writing, like a good engineer. Partial-update primitives, or is re-index always full corpus?

Фото профиля Christian Müller
Christian Müller3 месяцев назад

Persistent pipeline plus a bounded, filesystem-like tool surface is a strong combo here. The reliability jump comes when each tool call returns a typed result the next step can rely on, not free-form text the agent has to re-parse every run.

Фото профиля srijanarya
srijanarya3 месяцев назад

The filesystem-style tools were never my bottleneck. Index freshness was. "Index and update a large KB" buries the ugly part: an agent retrieving mid-reindex and answering off a stale chunk. Does the harness guarantee read-during-update consistency?

Фото профиля Sean Kerr — AI, minus the hype
Sean Kerr — AI, minus the hype3 месяцев назад

The persistent pipeline is the right call. Most "agentic retrieval" pain isn't recall — it's the agent re-indexing the world every run because nothing survives between calls. The harder half: teaching it when it has enough to stop retrieving.

Фото профиля Nahid
Nahid3 месяцев назад

persistent data pipeline opens up new possibilities

Фото профиля Shashank Nidhi
Shashank Nidhi3 месяцев назад

Your harness builds a fresh index, but it never flags when a source document drifts. Staleness is a harder problem than retrieval. A vector store can answer a query, yet it has no idea the underlying truth moved two weeks ago. If you attach a provenance check on each update, the agent can decide whether to trust the result.

Фото профиля Nhost
Nhost3 месяцев назад

The quiet shift here is that retrieval starts looking more like an agent exploring a filesystem: search, grep, read, follow the thread. That's much closer to how people actually research a case

Фото профиля Oleksandr
Oleksandr3 месяцев назад

agentic retrieval feels like giving an agent a local filesystem watching legal agents actually crawl PDFs is next‑level

Фото профиля Anshuman Singh
Anshuman Singh3 месяцев назад

The persistent-pipeline framing matches what we hit with travel data: static snapshots rot fast, so continuous dedup plus per-row source tags are what keep agent citations honest. Curious how the harness handles provenance when two indexed sources conflict, do you keep both with lineage or resolve to one?

Фото профиля Jabir | AI Systems
Jabir | AI Systems3 месяцев назад

👍🏻

Фото профиля Sebastian Buzdugan
Sebastian Buzdugan3 месяцев назад

index v2 will live or die on permission drift, not tool breadth

Фото профиля Pawzard
Pawzard3 месяцев назад

agents out here getting a whole filing cabinet meanwhile i still cant find my keys 😭

Фото профиля The Guy With A Hat
The Guy With A Hat3 месяцев назад

Another OCR. Sweet, is there a paper attached?

Фото профиля egesea
egesea3 месяцев назад

Retrieval is becoming less about finding information. It's becoming the workspace where agents think and act.

Фото профиля Makaroni
Makaroni3 месяцев назад

curious how it handles drift tho like the knowledge base updates mid-task and the agent already cached stale context

Фото профиля Brosko
Brosko3 месяцев назад

ngl 'filesystem operations but for vibes' is actually the unlock agents been fumbling retrieval tasks for too long fr 🔥

Похожие видео

Build better RAG by letting a team of agents extract and connect your reference materials into a knowledge graph. Our new short course, “Agentic Knowledge Graph Construction,” taught by Neo4j Innovation Lead Andreas Kollegger, shows you how. Knowledge graphs are an important way to store information accurately but they are a lot of work to build manually. In this course you’ll learn how to build a team of agents that turn data– in this case product reviews and invoices from suppliers–into structured graphs of entities and relationships for RAG. Learn how agents can automatically handle the time-consuming work of building graphs — extracting entities and relationships (e.g., Product "contains" Assembly, Part "supplied_by" Supplier, Customer review "mentions" Product), deduplicating them, fact-checking them, and committing them to a graph database — so your retrieval system can find right information to generate accurate output. For example, you can use agents to help trace customer complaints directly to specific suppliers, manufacturing processes, and product hierarchies, thus turning fragmented information into queryable business intelligence. Skills you’ll gain: - Build, store, and access knowledge graphs using the Neo4j graph database - Build multi-agent systems using Google’s Agent Development Kit (ADK) - Set up a loop of agentic workflows to propose and refine a graph schema through fact-checking - Connect agent-generated graphs of unstructured and structured data into a unified knowledge graph This course gets into the practicum of why knowledge graphs give more accurate information retrieval than vector search alone, especially for high-stakes applications where precision matters more than fuzzy similarity matching. Sign up here:

Andrew Ng

169,184 просмотров • 1 год назад

Traditional data pipelines don't work for RAG applications. There are 3 issues with them: ​ 1. Traditional data engineering solutions are optimized to handle structured data. RAG applications rely primarily on unstructured data. ​ 2. The connector ecosystem to load data from unstructured data sources is very immature. ​ 3. Traditional solutions do not offer any way to transform unstructured data into an optimized vector search index. ​ The goal of a RAG Pipeline is to solve these problems. ​ The number one objective is to create a reliable vector search index using factual knowledge and relevant context. This sounds easy, but it's one of the biggest challenges we face when building RAG applications. ​ At a high level, there are four different stages in the architecture of a RAG pipeline: ​ 1. Ingestion: Here is where the pipeline loads the information from the data source. ​ 2. Extraction: Where the pipeline processes the input data and decides how to retrieve the text contained inside them. ​ 3. Transform: Where the pipeline chunks the data and generates document embeddings. ​ 4. Load: Where the pipeline creates a search index in a vector database and loads the document embeddings. ​ There are different rabbit holes at each one of these stages. Here are three of them: ​ 1. Ingesting data once is simple. The hard part is refreshing the vector database whenever the original data source changes. ​ 2. Extracting the content of a plain text document is simple. The hard part is to extract content from complex documents containing tables, images, or cross-references. ​ 3. A simple continual chunking strategy with an overlap is simple. The hard part is to find the optimal strategy for your specific knowledge base and the way you are planning to query it. ​ In the attached video, I'll show you how you can build an enterprise-grade RAG Pipeline that solves every one of the above problems. ​ I'll use Vectorize. They partnered with me on this post. You can use them to build RAG pipelines optimized for accurate context retrieval. ​ ​ If you have a few documents lying around, set up a free account and give it a try.

Santiago

40,643 просмотров • 2 лет назад