Loading video...

Video Failed to Load

Go Home

We built the fastest PDF -> markdown parser in the world 🚀⚡️ AND it’s more accurate than any other open-source, model-free parser (pymupdf4llm, opendataloader, pdf-inspector, markitdown) on 3 standardized benchmarks: olmOCR0-bench, opendataloader-bench, ParseBench Introducing LiteParse v2.1. The v2 base version was already the fastest document->text parser on the planet,...

364,182 views • 3 months ago •via X (Twitter)

40 Comments

Jerry Liu's profile picture
Jerry Liu3 months ago

Here are our accuracy benchmarks

Jerry Liu's profile picture
Jerry Liu3 months ago

Here are our speed tests

Arav Patel's profile picture
Arav Patel3 months ago

How are you handling images?

Geoffrey 🧢🇺🇸's profile picture
Geoffrey 🧢🇺🇸3 months ago

This is great. I tested this against Markitdown for a 2-column scientific paper (ACM format) with figures/images. Both have OCR capabilities, but Markitdown is basically unreadable compared to LiteParse. That said, there's still a lot of weirdness to fix on output structure.

Jerry Liu's profile picture
Jerry Liu3 months ago

awesome to hear. we'll keep iterating on the capabilities going forward 🫡

狐狸布布's profile picture
狐狸布布3 months ago

PDF转markdown这块的坑我们做数据的太有体会了 表格和多栏一崩 后面整个pipeline都得返工。最快只是入场券 真正难的是它在脏扫描件上还稳不稳 那才是日常会要命的地方

Geet Khosla's profile picture
Geet Khosla3 months ago

how do you’ll deal with very visual PDFs (drawings/blueprints etc)

PeterIV's profile picture
PeterIV3 months ago

Fastest, most accurate and oss free! How can anyone beat that combination -:) Great to see continued innovation!

Tensor Fiend's profile picture
Tensor Fiend3 months ago

Added to my app CIP🔥🔥

Ferbin's profile picture
Ferbin3 months ago

Fast on clean PDFs. The harder problem: scans with bad lighting, folded pages, handwriting mixed in. That's where most parsers fail.

Milton Yan's profile picture
Milton Yan3 months ago

Fast, model-free parsing is exactly what agents need at the tool layer — every LLM call you save on doc prep is latency and cost back in the budget. Clean inputs beat a bigger model more often than people admit.

Julien Talbot's profile picture
Julien Talbot3 months ago

cc @MatthieuTalbot pour paranoia

Dr.OVG's profile picture
Dr.OVG3 months ago

open source tools are best

dsv's profile picture
dsv2 months ago

The interesting shift is that AI workflows are becoming more like software pipelines. Better parsing improves the input layer, but the experiments built on top of that need the same level of organization and iteration.

Foad S. Farimani's profile picture
Foad S. Farimani3 months ago

@llama_index Can we reverse engineer an image or a PDF, even if it is rasterized, back to TeX in one shot? That, IMHO, would be the end game for OCR/VLM.

ал's profile picture
ал3 months ago

Всем плевать на скорость. Главное это качесивл

Vikas(Vik) Malpani| AI for US Real Estate's profile picture
Vikas(Vik) Malpani| AI for US Real Estate3 months ago

Document parsing is the unglamorous wall every real-world AI pipeline hits. We process real estate contracts and title docs, and a bad parse quietly poisons everything downstream. Model-free and fast matters more than people admit at scale. Testing this on our stack.

Mav's profile picture
Mav3 months ago

This is great, I was looking for an alternative as pymupdf 4llm was taking too much memory Will need to test it on my data though, how well does it perform on table heavy pdfs? Does it preserve them?

Jerry Liu's profile picture
Jerry Liu3 months ago

it should preserve the overall text layout as of v2, and markdown structure as of v2.1. the markdown piece is new though so please report if any feedback/issues!

Mav's profile picture
Mav3 months ago

Its been day 2 and I am noticing something weird. Pros so far: My image size went down, Liteparse is definitely fast Biggest con: It is not as stable as pymupdf, as for shorted page windows it looses headers. I have been trying to test liteparse on the small machine I was running pymu and I am seeing much more failures. So am stuck optimising batch size Vs ram in my VM at the moment.

Jerry Liu's profile picture
Jerry Liu3 months ago

cc @LoganMarkewich to help take a look. If you open a github issue we would be happy to look at in order to help improve

Mav's profile picture
Mav3 months ago

@LoganMarkewich Here you go:

Juan Colella's profile picture
Juan Colella3 months ago

How do you deal with a pdf that has an image inside with text? Is it possible to detect this before passing through this tool, extract image and send to vision model?!

Crescitaly's profile picture
Crescitaly3 months ago

Parsing speed matters when documents become live inputs.

Harry Tandy's profile picture
Harry Tandy3 months ago

open source tools like this save so much time

Tura's profile picture
Tura2 months ago

You ran three parser benchmarks. Would you sanity-check one agent benchmark for me? The big drop comes from fewer agent rounds, not trimming output:

Jabez's profile picture
Jabez3 months ago

How does it compare to Docling please 🙏

Alexandre Fonseca's profile picture
Alexandre Fonseca2 months ago

Have you ever heard intrusive thoughts?

Christopher Dosin's profile picture
Christopher Dosin3 months ago

@llama_index Would love to see how it compares to Mistral OCR 🧐

Clauxel | Existence Theory for AI's profile picture
Clauxel | Existence Theory for AI1 month ago

Nicely explained. The section around Markdown being easier to inspect, copy, diff, and reuse is exactly why this kind of workflow matters for teams. The official MarkItDown Online website is here for reference:

セノ推し🥺's profile picture
セノ推し🥺3 months ago

bun build --compile のサポートを追加できませんか? ネイティブモジュールへの依存が大きく、適切な統合がされていないためBunのバンドラーがネイティブモジュールを認識できずバンドルされません

Sunwoo Park's profile picture
Sunwoo Park3 months ago

@jerryjliu0 A sharper test for "We built the fastest PDF -> markdown parser in the world 🚀⚡️ AND it’s more accurate than any other open-source, mo...": show one visible before/after, one failure case, and one repeatable check. What would make this credible enough to use?

Nick's profile picture
Nick3 months ago

support scanned pdf?

dimaskills's profile picture
dimaskills3 months ago

PDF parsing is one of those problems people only notice when it break

AIDailyGems's profile picture
AIDailyGems2 months ago

liteparse v2.1 claims to be faster than others but doesn't mention how much faster, we'd need to benchmark against actual outputs, not just claim it's "fast

EspacioCiclista's profile picture
EspacioCiclista3 months ago

can you start a 💬?

Ferbin's profile picture
Ferbin3 months ago

markdown tables for logs kept breaking during parsing. does v2.1 handle those edge cases?

狐狸布布's profile picture
狐狸布布3 months ago

the "no LLM" part is what actually sells me. model-based parsers always look amazing in a demo then fall apart on cost the moment you run them at real volume. fast + deterministic + accurate is the boring combo everyone quietly needs

Anshu Raj's profile picture
Anshu Raj3 months ago

wow , Jerry Liu I was facing issue with markdown I want to share docs in form of pdf Its really super fast

Alyona's profile picture
Alyona3 months ago

Check please your dm

Related Videos

PDF parsing is still painful because LLMs reorder text in complex layouts, break tables across pages, and fail on graphs or images. 💡Testing the new open-source OCRFlux model, and here the results are really good for a change. So OCRFlux is a multimodal, LLM based toolkit for converting PDFs and images into clean, readable, plain Markdown text. Because the underlying VLM is only 3B param, it runs even on a 3090 GPU. The model is available on Hugging Face . The engine that powers the OCRFlux, teaches the model to rebuild every page and then stitch fragments across pages into one clean Markdown file. It bundles one vision language model with 3B parameters that was fine-tuned from Qwen 2.5-VL-3B-Instruct for both page parsing and cross-page merging. OCRFlux reads raw page images and, guided by task prompts, outputs Markdown for each page and merges split elements across pages. The evaluation shows Edit Distance Similarity (EDS) 0.967 and cross‑page table Tree Edit Distance 0.950, so the parser is both accurate and layout aware. How it works while parsing each page - Convert into text with a natural reading order, even in the presence of multi-column layouts, figures, and insets - Support for complicated tables and equations - Automatically removes headers and footers Cross-page table/paragraph merging - Cross-page table merging - Cross-page paragraph merging A compact vision‑language models can beat bigger models once cross‑page context is added. 🧵 1/n Read on 👇

Rohan Paul

149,464 views • 1 year ago