Loading video...

Video Failed to Load

Go Home

GPT-4o is bad at processing PDF documents. Whoever tells you otherwise is not living in the real world. In 2024, people fill out forms using pen and paper. Try to answer questions from those forms using modern models, and you'll be disappointed. I recorded a video to show you...

196,847 views • 1 year ago •via X (Twitter)

10 Comments

Jad Bharat's profile picture
Jad Bharat1 year ago

I second this. I used to upload scanned docs to it, but better results came when I extracted text from scan using Google lense and send that to gpt as input.

Santiago's profile picture
Santiago1 year ago

That's the way.

David Alexander's profile picture
David Alexander1 year ago

Convert the PDF to an image, and it works as good as any other document you upload. Click Bait!

Santiago's profile picture
Santiago1 year ago

I'd love for this to work, but it doesn't. Feel free to try yourself.

GV's profile picture
GV1 year ago

I see you play modern day influencer role under the disguise of being machine learning engineer. Ah. I see.

Santiago's profile picture
Santiago1 year ago

An anonymous account accusing me of disguising my identity. Irony is dead.

LatestPaperAI's profile picture
LatestPaperAI1 year ago

AI still has a long way to go in mastering practical document processing.

Santiago's profile picture
Santiago1 year ago

It does. That's where we come in: instead of hoping for the model to work, we can make it easy to find the information it needs.

MySportsAI's profile picture
MySportsAI1 year ago

Had a go this morning at getting ChatGPT to scrape a basic web site. It was hopeless, seemingly if the HTML tags are not so descriptive that a child of 5 could scrape them it struggles

Santiago's profile picture
Santiago1 year ago

Anything you can do to preprocess the data and make it easier to consume, goes a long way.

Related Videos

Here is how you can install an open-source, enterprise-grade RAG system on your server (with the best document understanding I've seen.) First, something obvious to anyone trying to sell RAG in the market: You are crazy if you think companies will let their data travel to a hosted model. No one wants to send their data anywhere (those who do haven't found an alternative.) Every single company would rather have an air-gapped system with no internet access. GroundX is an open-source RAG system that you can run on your servers (or any cloud provider, as long as you have access to GPUs) and works without a network. (If the military wants to do RAG, this is precisely what they will be looking for.) I installed GroundX on my AWS account and recorded a video to show you how to use it. There are two services you can use: 1. Ingest: This service uses a pretrained vision model to ingest and understand your knowledge base. 2. Search: This service combines text and vector search with a fine-tuned re-ranker model to retrieve information from your knowledge base. A quick note about the Ingest service: 99% of people think they need better "retrieval" mechanisms. I think they need better "ingestion." That's where this service comes in! Ingest "understands" your documents in a way I haven't seen before. After you try it, you'll realize why showing your LLM your raw documents is a bad idea. In the video, I use a free tool called X-Ray to test a document and understand how the Ingest service breaks it down. You can access this tool by signing up for a free GroundX cloud account and uploading your documents. You'll see a bit more about this in the video.

Santiago

89,664 views • 1 year ago

How can you solve complex tasks using a Large Language Model? Here is a 2-minute introduction to everything you need to know to 10x the quality of your results. Let's talk about three techniques, in order of complexity, starting with the easiest one: • In-Context Learning • Indexing + In-Context Learning • Fine-tuning In-Context Learning The team that trained GPT-3 found something they couldn't explain: You can condition a model using examples of how you want it to behave. I included an example prompt in the attached video. You can "teach" the model how you want it to interpret questions, select the correct answers, and format the results by giving a few examples. You can also give specific knowledge to the model that will be helpful when formulating answers. We call this approach "grounding the model." There's another example in the video. Indexing + In-Context Learning Unfortunately, there is a limit to how much data you can include in a prompt. We call this the "context size." One version of GPT-4 supports a context of approximately 6,000 words, while the other supports 25,000 words. Although this sounds like a lot, many applications need more than that. Imagine you wrote a book and want to build an application to answer any questions about your story. What happens if your book is longer than the context? That's where Indexing comes in. Using a model, you can turn every book passage into an embedding. These are vectors, numbers that "encode" the passage's text. You can then store these embeddings in a particular database that supports fast retrieval of these vectors. You can then turn any question into an embedding and search the database for the list of passages that are similar to that query. Instead of using the entire book to ask the model, you can now use the relevant passages as in-context information, effectively working around the context size limitation. Fine-tuning Fine-tuning can give you an extra boost to get reliable outputs from your LLM. It is, however, the most complex approach on the list. There are different approaches to fine-tuning a model with your data. A popular technique is to process your data with your LLM and use the outputs to train a new classifier that solves your specific task. Notice that here you aren't modifying the LLM. Instead, you are chaining it with your trained classifier. Another approach is to modify the parameters of the LLM using your data. Think of this as "rewiring" the model in a way that solves your particular task. The results and costs will vary depending on how many layers you want to fine-tune from the original model. Many companies think that fine-tuning is the solution to their problems. In my experience, many will benefit from exploring the other two approaches. I love explaining Machine Learning and Artificial Intelligence ideas. If you enjoy in-depth content like this, follow me Santiago so you don't miss what comes next.

Santiago

384,510 views • 3 years ago

PhD Students – Use this tool to paraphrase the text in your manuscript for FREE. First, why you need to paraphrase? The first draft you write is often very rough. It needs to be revised to polish it for submission. For this, you can use a paraphraser. Here is one you can use it for FREE. 1. Go to and log in. 2. Upload your file or copy/paste your text in a new file. 3. From the options on right, click Paraphraser. 4. Now select the text you want to paraphrase. 5. After text selection, click paraphrase. 6. Trinka.ai will show the paraphrased text. 7. You can also see the changes made. 8. You can increase or decrease the level of paraphrasing. 9. You can also select to show the revisions. 10. Go through the paraphrase text carefully. 11. You can choose among multiple paraphrased alternatives. 12. After your final selection, click replace. 13. This will replace original text with paraphrased text. 14. You can apply this process for the entire text. Make sure that you go through the changes made. This is important so that only your text gets refined. However, the meaning of the text remains the same. In addition to paraphrasing, Trinka also offers to ➝ Fix all grammatical errors in your manuscript ➝ Proofread your manuscript before submission ➝ Check consistency in your manuscript writing ➝ Evaluates the level of bias in your writing ➝ Checks plagiarism level in your manuscript Try Trinka.ai here: Anything you’d like to add?

Faheem Ullah

18,055 views • 1 year ago