Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Parse PDFs at lightspeed (this video is at 1x) Absolute cinema

144,675 Aufrufe • vor 5 Monaten •via X (Twitter)

27 Kommentare

Profilbild von Pratik
Pratikvor 5 Monaten

Parsing PDFs is not that difficult if you don’t obsess about the format. Problems appear when the PDF is not OCR’d and is some random image taken from some random app but in PDF format. I’m not sure if liteparse fixes that

Profilbild von Saeejith Nair
Saeejith Nairvor 5 Monaten

hey i think there's a bug in your bbox generation for pages with rotated text columns (like the arxiv watermark). i just tried it with random papers and it extracted text for the first page but the bboxes are all offset.

Profilbild von Jerry Liu
Jerry Liuvor 5 Monaten

ooh cc @LoganMarkewich for visibility

Profilbild von m̴̧͇͈̫͈̈͑̓̏͘i̴̧̯̪̗̍̎̊͗͜͝k̸̢̲̪̳̰͗̇̒̑̚e̵̡̖̼̦̘͒̊̍͐͘y̷
m̴̧͇͈̫͈̈͑̓̏͘i̴̧̯̪̗̍̎̊͗͜͝k̸̢̲̪̳̰͗̇̒̑̚e̵̡̖̼̦̘͒̊̍͐͘y̷vor 5 Monaten

Unfortunately rather useless if it cannot output into markdown preserving structure.

Profilbild von Jerry Liu
Jerry Liuvor 5 Monaten

we are working on markdown

Profilbild von m̴̧͇͈̫͈̈͑̓̏͘i̴̧̯̪̗̍̎̊͗͜͝k̸̢̲̪̳̰͗̇̒̑̚e̵̡̖̼̦̘͒̊̍͐͘y̷
m̴̧͇͈̫͈̈͑̓̏͘i̴̧̯̪̗̍̎̊͗͜͝k̸̢̲̪̳̰͗̇̒̑̚e̵̡̖̼̦̘͒̊̍͐͘y̷vor 5 Monaten

Would also be interesting if you could benchmark against @firecrawl pdf-inspector, also built in rust

Profilbild von Winston B.
Winston B.vor 5 Monaten

Nice work @jerryjliu0 and team. So snappy.

Profilbild von Aaryan Kakad
Aaryan Kakadvor 5 Monaten

@llama_index is it open source?

Profilbild von Jerry Liu
Jerry Liuvor 5 Monaten

@llama_index yes!

Profilbild von Sumit Sahoo
Sumit Sahoovor 5 Monaten

This is amazing

Profilbild von Benjamin André-Micolon
Benjamin André-Micolonvor 5 Monaten

Brilliant work! We’ll definitely give it a go and possibly replace our existing custom parsing logic with it!

Profilbild von Erin Connors
Erin Connorsvor 5 Monaten

Honestly, this is the sort of speed that changes the feel of agents. A model-free parser ripping through a resume at 1x is funny because the model finally gets to do the clever bit instead of waiting for page 47 to become text.

Profilbild von Obiwan Santobi
Obiwan Santobivor 5 Monaten

But the tables bro, what about the tables?

Profilbild von 0xVox
0xVoxvor 5 Monaten

Pain resolved😭

Profilbild von Meris Dabhi
Meris Dabhivor 5 Monaten

Interesting

Profilbild von Dawood Saleh
Dawood Salehvor 5 Monaten

Did it support arabic language?

Profilbild von Mohammad H. Sattarian 🎒
Mohammad H. Sattarian 🎒vor 5 Monaten

Does it support RTL languages? I tested it on a Persian/Farsi PDF file and the output text wasn't quite right.

Profilbild von imzeeshan
imzeeshanvor 5 Monaten

Can we just stop producing PDFs :)

Profilbild von Brandon Tyler
Brandon Tylervor 5 Monaten

@grok with my Opus4.8 kiro-cli agent is it better to just let the model parse a pdf or let the model use lightparse v2 as a tool. Frontier models can parse PDFs themselves but these tools might offer better parsing than the model. Do research, think hard, take your time.

Profilbild von Watcher
Watchervor 5 Monaten

I triex it.. It working good but is there any way to convert it into html like docling or open data loader?

Profilbild von Dishant
Dishantvor 5 Monaten

the speed difference in the video is wild. I've been waiting for a parser that doesn't make me wait

Profilbild von WillyV3
WillyV3vor 5 Monaten

the model-free angle is the whole game. parse extraction that doesnt depend on a vendor is exactly what agent workflows need to be reliable.

Profilbild von Tito Costa
Tito Costavor 5 Monaten

Impressive, is the output markdown?

Profilbild von Abhishek Choudhury
Abhishek Choudhuryvor 5 Monaten

looks amazing, thanks a lot!

Profilbild von Chexxe
Chexxevor 5 Monaten

brb watching this on loop, that pdf parse is clean

Profilbild von Dr.OVG
Dr.OVGvor 5 Monaten

Going to save so much time with this

Profilbild von TheIndieBuilder
TheIndieBuildervor 5 Monaten

How does it do for pdfs created through tools like AutoCAD? The fact that they contains diagrams mostly

Ähnliche Videos