正在加载视频...

视频加载失败

Introducing DocJev - a lightning-fast OSS library for document classification and splitting with jev ⚡️ Give a document alongside some natural language category rules. Jev will predict the document category (classify) or the boundaries between sub-documents (split). It is 6x faster than gpt-5.6-luna with equivalent accuracy. You can choose...

218,214 次观看 • 1 个月前 •via X (Twitter)

32 条评论

Jerry Liu 的头像
Jerry Liu1 个月前

Latency benchmarks:

Jerry Liu 的头像
Jerry Liu1 个月前

You can find the full interactive report here:

AI Mastery Guide 的头像
AI Mastery Guide1 个月前

Splitting docs that fast is useful

Greg Mushen 的头像
Greg Mushen1 个月前

Nice. Would be very cool to have model routing based on PDF contents, e.g. use Marker if there are tables, etc.

Imaan Sultan 🇵🇰🇸🇦 的头像
Imaan Sultan 🇵🇰🇸🇦1 个月前

need to try this 👀

First Sauce Labs 的头像
First Sauce Labs1 个月前

The "natural language category rules" is the part that will get interesting fast. Looking forward to trying it out.

Likhith Bhargav 的头像
Likhith Bhargav1 个月前

Natural-language rules as the interface are the right abstraction - humans own the taxonomy, Jev owns the cheap decision.

kettybluce 的头像
kettybluce1 个月前

Nice example of keeping the interface simple while exposing both classification and boundary detection. The split output should make it easier to audit where a document needs review, especially when the classifier is uncertain.

Jatin Garg 的头像
Jatin Garg1 个月前

Natural language category rules removes the whole annotation/fine-tuning step for document classification.

Tanisha Pritha 的头像
Tanisha Pritha1 个月前

Just wired LlamaParse into a procurement RAG ingest last week. Tables + scanned PDFs were the whole problem. Caching the parsed doc and then classifying/splitting fast is exactly the missing step. Trying DocJev on the next batch.

TensorQuay 的头像
TensorQuay1 个月前

Could you benchmark the scanned PDFs in the synthetic set next? The report's ~6x figures exclude OCR. Timing the full pipeline would show how much of that speedup reaches someone uploading a scan.

Jay Zhou 的头像
Jay Zhou1 个月前

a bad split never throws an error. it just quietly changes every answer downstream and the citation still looks fine.

Naveen 🚀 的头像
Naveen 🚀1 个月前

This is great

anytan 的头像
anytan1 个月前

DocJev 6x on doc split. that's the hit

Anurag 的头像
Anurag1 个月前

The split is the decision that matters, the classification is just filing. I've watched document pipelines where a perfect classifier sat on top of bad splits and the RAG answers were still garbage, because one wrong boundary means two contracts live in the same chunk. Get the boundaries right and the labels almost don't matter.

Brick | AI Builder Signal 的头像
Brick | AI Builder Signal1 个月前

Important qualifier: the repo's accuracy pilot is a 40-PDF, 8-packet convenience sample with shared source/template families and uncontrolled provider caching. The reproducible report does not establish general split accuracy. Keep boundary review before unattended use.

manish · building AgentWorks 的头像
manish · building AgentWorks1 个月前

Document classification and splitting, nice launch

Christopher Dean 的头像
Christopher Dean1 个月前

ocr tradeoffs are the whole game — latency vs accuracy is what makes doc pipelines ship or stall.

AI议会 的头像
AI议会1 个月前

文档分类/切分做成开源原语,比再堆一个「全能 RAG」更落地。DocJev 这种薄库才容易嵌进现有流水线。

Clara Benson 的头像
Clara Benson1 个月前

Will the LlamaParse preprocessing latency bottleneck break real-time API limits if downstream tasks never actually reuse those cached representations?

Jamik 的头像
Jamik1 个月前

the subdocument boundary bit is super useful, thats usually where doc classifiers get weird

Kizuno18 的头像
Kizuno181 个月前

fast splitting + classification is what unlocks unmonitored pipelines. tested an autonomous pipeline pulling macro data for brazil from outside: using fast models for schema boundaries instead of giant context windows cut latency 85% and completely eliminated 3am timeouts.

Klasta 的头像
Klasta1 个月前

splitting docs from english category rules, no classifier zoo

Nines 的头像
Nines1 个月前

The split between classification and boundary detection is a nice touch. OCR pipelines often get treated as one problem, but the backend choice matters once documents stop being clean scans.

Richard Tang 的头像
Richard Tang1 个月前

huge!

Brjan | AI Builder 的头像
Brjan | AI Builder1 个月前

how does DocJev handle edge cases where documents don't fit typical rules?

Stanislav Sorokin 的头像
Stanislav Sorokin1 个月前

Similar picture on papers instead of documents: 1,000 arXiv abstracts, 24 categories, 57 ms each. With Opus 5 as judge Jev matched 85 of 100 at 153x lower cost per paper. Confidence under 0.90 flagged 14 of the 15 misses.

Josh R Barry 的头像
Josh R Barry1 个月前

Turning the annotation step into a rules interface is a very good trade for this kind of workflow.

Elias Lumer 的头像
Elias Lumer1 个月前

Is jev on your leaderboard? Curious on your benchmark accuracy vs latency for Jev vs others

Miano 的头像
Miano1 个月前

This is a strong abstraction. Letting the user describe boundaries in natural language removes a lot of brittle preprocessing, especially when document formats keep changing.

Mitansh 的头像
Mitansh1 个月前

docjev for classify + split with natural language rules is neat 6x faster is a serious flex on doc pipelines

Steven 的头像
Steven1 个月前

I tested DocJEV with both a local model and the official JEV model — works equally great! 🔥

相关视频

The latest RAG trend for the current agent harnesses (Codex, Cowork) is to do two passes of document processing to solve a knowledge work task over a data room of documents: 1️⃣ A fast and light pass, oftentimes using a free/OSS doc parsing tool. This can be cheaply run across 10-100-1k’s of files, and enables the agent to then do retrieval (e.g. grep, semantic) to find relevant subsets of context. 2️⃣ A “just-in-time” VLM-based pass. Once the agent finds the relevant pages of context, it will screenshot the documents can call its own VLM (or write code) to dissect the pages. The issue with only using VLM-based OCR tools over massive ad-hoc customer file dumps is that it’s slow and expensive. Doing JIT VLM OCR allows the agent to filter through the data cheaply, but still preserve accuracy for the context that’s needed for the task. The agent harnesses do two-pass document processing by default using off the shelf-tools: pdf2text as the first pass, and using itself (Opus 5) as the second pass. See the below video where Cowork runs over a bunch of PDFs to answer a question about a benchmark graph in the Kimi k3 paper. The main issues here with the “out of the box” doc processing these agents offer are: * Opus 5 is not the best VLM for OCR. It is also way too expensive at scale and lacks grounding * The OSS tools like pypdf, pdf2text, may not be versatile enough as the first pass. * The agent will write a lot of throwaway code to rewrite things an OCR tool would’ve provided out of the box, like chart processing, bounding boxes, confidence scores, leading to increased cost and speed. We have all the tools within LlamaIndex 🦙 to help any agent do two-pass document processing with higher accuracy and lower cost. 1️⃣ We have liteparse for the first pass - a free/OSS parser written in Rust that’s faster/more accurate than other OSS parsers, and supports 50+ document types 2️⃣ We have LlamaParse for the second pass - an agentic document engine that uses VLMs+harnesses to achieve SOTA in accuracy and cost across various doc parsing and extraction tasks. It can be called from any agent harness as an MCP or skill. It takes in page numbers as input, so that the agent can choose to run LlamaParse over a subset of the doc instead of the full doc as a “zoom-in” pass. Come check it out! LiteParse: LlamaParse: All the relevant docs, including MCP, are here:

Jerry Liu

23,239 次观看 • 2 个月前