Loading video...

Video Failed to Load

Go Home

Parse PDFs at lightspeed (this video is at 1x) Absolute cinema

144,675 views • 5 months ago •via X (Twitter)

27 Comments

Pratik's profile picture
Pratik5 months ago

Parsing PDFs is not that difficult if you don’t obsess about the format. Problems appear when the PDF is not OCR’d and is some random image taken from some random app but in PDF format. I’m not sure if liteparse fixes that

Saeejith Nair's profile picture
Saeejith Nair5 months ago

hey i think there's a bug in your bbox generation for pages with rotated text columns (like the arxiv watermark). i just tried it with random papers and it extracted text for the first page but the bboxes are all offset.

Jerry Liu's profile picture
Jerry Liu5 months ago

ooh cc @LoganMarkewich for visibility

m̴̧͇͈̫͈̈͑̓̏͘i̴̧̯̪̗̍̎̊͗͜͝k̸̢̲̪̳̰͗̇̒̑̚e̵̡̖̼̦̘͒̊̍͐͘y̷'s profile picture
m̴̧͇͈̫͈̈͑̓̏͘i̴̧̯̪̗̍̎̊͗͜͝k̸̢̲̪̳̰͗̇̒̑̚e̵̡̖̼̦̘͒̊̍͐͘y̷5 months ago

Unfortunately rather useless if it cannot output into markdown preserving structure.

Jerry Liu's profile picture
Jerry Liu5 months ago

we are working on markdown

m̴̧͇͈̫͈̈͑̓̏͘i̴̧̯̪̗̍̎̊͗͜͝k̸̢̲̪̳̰͗̇̒̑̚e̵̡̖̼̦̘͒̊̍͐͘y̷'s profile picture
m̴̧͇͈̫͈̈͑̓̏͘i̴̧̯̪̗̍̎̊͗͜͝k̸̢̲̪̳̰͗̇̒̑̚e̵̡̖̼̦̘͒̊̍͐͘y̷5 months ago

Would also be interesting if you could benchmark against @firecrawl pdf-inspector, also built in rust

Winston B.'s profile picture
Winston B.5 months ago

Nice work @jerryjliu0 and team. So snappy.

Aaryan Kakad's profile picture
Aaryan Kakad5 months ago

@llama_index is it open source?

Jerry Liu's profile picture
Jerry Liu5 months ago

@llama_index yes!

Sumit Sahoo's profile picture
Sumit Sahoo5 months ago

This is amazing

Benjamin André-Micolon's profile picture
Benjamin André-Micolon5 months ago

Brilliant work! We’ll definitely give it a go and possibly replace our existing custom parsing logic with it!

Erin Connors's profile picture
Erin Connors5 months ago

Honestly, this is the sort of speed that changes the feel of agents. A model-free parser ripping through a resume at 1x is funny because the model finally gets to do the clever bit instead of waiting for page 47 to become text.

Obiwan Santobi's profile picture
Obiwan Santobi5 months ago

But the tables bro, what about the tables?

0xVox's profile picture
0xVox5 months ago

Pain resolved😭

Meris Dabhi's profile picture
Meris Dabhi5 months ago

Interesting

Dawood Saleh's profile picture
Dawood Saleh5 months ago

Did it support arabic language?

Mohammad H. Sattarian 🎒's profile picture
Mohammad H. Sattarian 🎒5 months ago

Does it support RTL languages? I tested it on a Persian/Farsi PDF file and the output text wasn't quite right.

imzeeshan's profile picture
imzeeshan5 months ago

Can we just stop producing PDFs :)

Brandon Tyler's profile picture
Brandon Tyler5 months ago

@grok with my Opus4.8 kiro-cli agent is it better to just let the model parse a pdf or let the model use lightparse v2 as a tool. Frontier models can parse PDFs themselves but these tools might offer better parsing than the model. Do research, think hard, take your time.

Watcher's profile picture
Watcher5 months ago

I triex it.. It working good but is there any way to convert it into html like docling or open data loader?

Dishant's profile picture
Dishant5 months ago

the speed difference in the video is wild. I've been waiting for a parser that doesn't make me wait

WillyV3's profile picture
WillyV35 months ago

the model-free angle is the whole game. parse extraction that doesnt depend on a vendor is exactly what agent workflows need to be reliable.

Tito Costa's profile picture
Tito Costa5 months ago

Impressive, is the output markdown?

Abhishek Choudhury's profile picture
Abhishek Choudhury5 months ago

looks amazing, thanks a lot!

Chexxe's profile picture
Chexxe5 months ago

brb watching this on loop, that pdf parse is clean

Dr.OVG's profile picture
Dr.OVG5 months ago

Going to save so much time with this

TheIndieBuilder's profile picture
TheIndieBuilder5 months ago

How does it do for pdfs created through tools like AutoCAD? The fact that they contains diagrams mostly

Related Videos