Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

LiteParse Samples ๐Ÿ“„๐Ÿง‘โ€๐Ÿซ LiteParse is our free and fast document parser that can parse text with bounding boxes from any document. Iโ€™ve created a new repository that contains some demos on how you can make use of its outputs! โœ… Comparison against PyPDF and PyMuPDF โœ… Visual Citations: search...

13,196 Aufrufe โ€ข vor 6 Monaten โ€ขvia X (Twitter)

0 Kommentare

Keine Kommentare verfรผgbar

Kommentare vom Original-Post werden hier angezeigt

ร„hnliche Videos

The latest RAG trend for the current agent harnesses (Codex, Cowork) is to do two passes of document processing to solve a knowledge work task over a data room of documents: 1๏ธโƒฃ A fast and light pass, oftentimes using a free/OSS doc parsing tool. This can be cheaply run across 10-100-1kโ€™s of files, and enables the agent to then do retrieval (e.g. grep, semantic) to find relevant subsets of context. 2๏ธโƒฃ A โ€œjust-in-timeโ€ VLM-based pass. Once the agent finds the relevant pages of context, it will screenshot the documents can call its own VLM (or write code) to dissect the pages. The issue with only using VLM-based OCR tools over massive ad-hoc customer file dumps is that itโ€™s slow and expensive. Doing JIT VLM OCR allows the agent to filter through the data cheaply, but still preserve accuracy for the context thatโ€™s needed for the task. The agent harnesses do two-pass document processing by default using off the shelf-tools: pdf2text as the first pass, and using itself (Opus 5) as the second pass. See the below video where Cowork runs over a bunch of PDFs to answer a question about a benchmark graph in the Kimi k3 paper. The main issues here with the โ€œout of the boxโ€ doc processing these agents offer are: * Opus 5 is not the best VLM for OCR. It is also way too expensive at scale and lacks grounding * The OSS tools like pypdf, pdf2text, may not be versatile enough as the first pass. * The agent will write a lot of throwaway code to rewrite things an OCR tool wouldโ€™ve provided out of the box, like chart processing, bounding boxes, confidence scores, leading to increased cost and speed. We have all the tools within LlamaIndex ๐Ÿฆ™ to help any agent do two-pass document processing with higher accuracy and lower cost. 1๏ธโƒฃ We have liteparse for the first pass - a free/OSS parser written in Rust thatโ€™s faster/more accurate than other OSS parsers, and supports 50+ document types 2๏ธโƒฃ We have LlamaParse for the second pass - an agentic document engine that uses VLMs+harnesses to achieve SOTA in accuracy and cost across various doc parsing and extraction tasks. It can be called from any agent harness as an MCP or skill. It takes in page numbers as input, so that the agent can choose to run LlamaParse over a subset of the doc instead of the full doc as a โ€œzoom-inโ€ pass. Come check it out! LiteParse: LlamaParse: All the relevant docs, including MCP, are here:

Jerry Liu

23,239 Aufrufe โ€ข vor 2 Monaten