Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Every company I talk to is literally trying to solve this problem: How to automatically extract structured data from unstructured documents. For example, they want to process driver's licenses, no matter the file type or format. I recorded the solution for this:

svpino's profile picture

Santiago

455,604 subscribers

193,693 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Why aren't more people talking about how difficult it is to turn documents into structured data? This is literally a problem that every single company I talk to is trying to solve. They have a buttload of documents with forms and tables, and they want to turn them into usable data. Let me show you how you can do this using Tensorlake. Probably the best parser I've found:
6:41

Why aren't more people talking about how difficult it is to turn documents into structured data? This is literally a problem that every single company I talk to is trying to solve. They have a buttload of documents with forms and tables, and they want to turn them into usable data. Let me show you how you can do this using Tensorlake. Probably the best parser I've found:

Santiago

46,413 Aufrufe • vor 1 Jahr

PhD Students – How to automatically extract data from papers for your literature review? Extracting relevant data from papers is challenging. However, this process can be automated. Meet AnswerThis – a tool that extracts data in seconds. Here is how it works. 1. Go to and log in. 2. After logging in, click on 𝐸𝑥𝑡𝑟𝑎𝑐𝑡 𝑑𝑎𝑡𝑎. 3. Then click on 𝑈𝑝𝑙𝑜𝑎𝑑 𝑃𝐷𝐹 and upload your papers. 4. These are the papers from which you want to extract data. 5. After uploading papers, select data you want to extract. 6. The predefined options are - Key findings - Research gaps - Methodology - Limitations - Future work - Contributions - Practical implications 7. You can also extract custom data e.g., dataset used. 8. For example, I want to extract methodology used in these papers. 9. I selected 𝑀𝑒𝑡ℎ𝑜𝑑𝑜𝑙𝑜𝑔𝑦 and clicked on 𝐴𝑑𝑑 𝐶𝑜𝑙𝑢𝑚𝑛. 10. AnswerThis extract data about methodology used in the papers. 11. You can change data view from normal to Table View. 12. For this, scroll back to top and click on 𝑇𝑎𝑏𝑙𝑒 𝑉𝑖𝑒𝑤. 13. Now for instance, you want to extract more data from these papers. 14. Go back to the top and click on 𝐸𝑥𝑡𝑟𝑎𝑐𝑡 𝑑𝑎𝑡𝑎. 15. Select the data type you want to extract. 16. For example, I want to extract data about future work. 17. So I click on 𝐹𝑢𝑡𝑢𝑟𝑒 𝑊𝑜𝑟𝑘 and then clicked on 𝐴𝑑𝑑 𝑐𝑜𝑙𝑢𝑚𝑛. 18. AnswerThis extracted data about future work from the papers. 19. After extracting the desired data, you can export it. 20. Select the data you want to extract. 21. Then click on 𝐸𝑥𝑝𝑜𝑟𝑡 𝑑𝑎𝑡𝑎. 22. Your data will be exported in CSV format. You can then analyze this data for your literature review. Try AnswerThis today: Anything you'd like to add?
0:48

PhD Students – How to automatically extract data from papers for your literature review? Extracting relevant data from papers is challenging. However, this process can be automated. Meet AnswerThis – a tool that extracts data in seconds. Here is how it works. 1. Go to and log in. 2. After logging in, click on 𝐸𝑥𝑡𝑟𝑎𝑐𝑡 𝑑𝑎𝑡𝑎. 3. Then click on 𝑈𝑝𝑙𝑜𝑎𝑑 𝑃𝐷𝐹 and upload your papers. 4. These are the papers from which you want to extract data. 5. After uploading papers, select data you want to extract. 6. The predefined options are - Key findings - Research gaps - Methodology - Limitations - Future work - Contributions - Practical implications 7. You can also extract custom data e.g., dataset used. 8. For example, I want to extract methodology used in these papers. 9. I selected 𝑀𝑒𝑡ℎ𝑜𝑑𝑜𝑙𝑜𝑔𝑦 and clicked on 𝐴𝑑𝑑 𝐶𝑜𝑙𝑢𝑚𝑛. 10. AnswerThis extract data about methodology used in the papers. 11. You can change data view from normal to Table View. 12. For this, scroll back to top and click on 𝑇𝑎𝑏𝑙𝑒 𝑉𝑖𝑒𝑤. 13. Now for instance, you want to extract more data from these papers. 14. Go back to the top and click on 𝐸𝑥𝑡𝑟𝑎𝑐𝑡 𝑑𝑎𝑡𝑎. 15. Select the data type you want to extract. 16. For example, I want to extract data about future work. 17. So I click on 𝐹𝑢𝑡𝑢𝑟𝑒 𝑊𝑜𝑟𝑘 and then clicked on 𝐴𝑑𝑑 𝑐𝑜𝑙𝑢𝑚𝑛. 18. AnswerThis extracted data about future work from the papers. 19. After extracting the desired data, you can export it. 20. Select the data you want to extract. 21. Then click on 𝐸𝑥𝑝𝑜𝑟𝑡 𝑑𝑎𝑡𝑎. 22. Your data will be exported in CSV format. You can then analyze this data for your literature review. Try AnswerThis today: Anything you'd like to add?

Faheem Ullah

21,390 Aufrufe • vor 10 Monaten

This Ramadan, we focused on trying to solve one problem: How do we fix Islamic finance? I think we've found the solution.
0:58

This Ramadan, we focused on trying to solve one problem: How do we fix Islamic finance? I think we've found the solution.

Tariq | Goldsand

63,585 Aufrufe • vor 6 Monaten

In the next 2-3 years, the skills you need to build an ETL process will fundamentally differ from anything we've done in the last decade. The EXTRACT and LOAD steps of an ETL pipeline have been solved forever. They are boring, and I suspect they will continue to be boring. But the TRANSFORM step is where the money is at (and where innovation will continue happening!) An ETL pipeline that can use Large Language Models effectively to transform data is a whole new ballgame. I recorded a video to talk about this. And more importantly, I talk about how you can build ETL pipelines to transform UNSTRUCTURED data (the kind of data that's really hard to handle).
5:39

In the next 2-3 years, the skills you need to build an ETL process will fundamentally differ from anything we've done in the last decade. The EXTRACT and LOAD steps of an ETL pipeline have been solved forever. They are boring, and I suspect they will continue to be boring. But the TRANSFORM step is where the money is at (and where innovation will continue happening!) An ETL pipeline that can use Large Language Models effectively to transform data is a whole new ballgame. I recorded a video to talk about this. And more importantly, I talk about how you can build ETL pipelines to transform UNSTRUCTURED data (the kind of data that's really hard to handle).

Santiago

56,412 Aufrufe • vor 1 Jahr

How to match the complexity of the problem you want to solve with the proper model. You want an inference router. In the video, I show you how simple and powerful this is. After this, you'll never talk directly to a model ever again.
8:53

How to match the complexity of the problem you want to solve with the proper model. You want an inference router. In the video, I show you how simple and powerful this is. After this, you'll never talk directly to a model ever again.

Santiago

11,944 Aufrufe • vor 3 Monaten

Senator Mike Lee ROASTS Barack Obama LIVE On Air Over Resurfaced Footage of Him Showing ID to Vote While Democrats Call the SAVE America Act 'Jim Crow 2.0' "Benny I am shaking... Schumer says that is Jim Crow... Why wouldn't civil disobedience be in order?" "We now have nearly every state issuing driver's licenses to non-citizens and we have 19 states willing to issue driver's licenses even to known illegal immigrants... the whole point of the NVRA was to allow people to register automatically to vote when they apply for a driver's license... all they have to do is check a box saying I want to register to vote and sign their name by the way I am eligible to vote... That is a problem."
4:50

Senator Mike Lee ROASTS Barack Obama LIVE On Air Over Resurfaced Footage of Him Showing ID to Vote While Democrats Call the SAVE America Act 'Jim Crow 2.0' "Benny I am shaking... Schumer says that is Jim Crow... Why wouldn't civil disobedience be in order?" "We now have nearly every state issuing driver's licenses to non-citizens and we have 19 states willing to issue driver's licenses even to known illegal immigrants... the whole point of the NVRA was to allow people to register automatically to vote when they apply for a driver's license... all they have to do is check a box saying I want to register to vote and sign their name by the way I am eligible to vote... That is a problem."

Benny Johnson

181,192 Aufrufe • vor 7 Monaten

Again, for the third time, I find myself saying, they are doing what they believe is right No matter how misguided I wonder if this is applicable to the Ascians too, in trying to bring forth Zodiark
0:45

Again, for the third time, I find myself saying, they are doing what they believe is right No matter how misguided I wonder if this is applicable to the Ascians too, in trying to bring forth Zodiark

Brendzun

47,324 Aufrufe • vor 3 Monaten

this is how i want to solve the problems in my life
0:30

this is how i want to solve the problems in my life

✮ CVR

75,191 Aufrufe • vor 1 Monat

Keith Rabois on the “one person, one problem" framework he learned from Peter Thiel “You need to spend a lot of time focusing people. This is something I learned from Peter Thiel. He used to insist at PayPal that every single person could only do exactly one thing. And we all rebelled. You feel like it’s insulting to be asked to do just one thing, but Peter would enforce this pretty strictly.” Thiel would say: “I will not talk to you about anything else except for this one thing that I’ve assigned to you. I don’t want to hear about how great your doing in this other area. Just focus until you conquer this one problem.” Keith explains: “The insight behind this is that most people will solve problems that they understand how to solve. Roughly speaking, they will solve B+ problems instead of A+ problems. A+ problems are high-impact problems for your company but they’re difficult—you don’t wake up in the morning with a solution to them, so you tend to procrastinate… If you have a company that’s always solving B+ problems, you’ll grow and add value, but you’ll never create the breakthrough idea because no one is spending 100% of their time banging their head against the wall every day until they solve it.” Video source: Y Combinator (2014)
1:02

Keith Rabois on the “one person, one problem" framework he learned from Peter Thiel “You need to spend a lot of time focusing people. This is something I learned from Peter Thiel. He used to insist at PayPal that every single person could only do exactly one thing. And we all rebelled. You feel like it’s insulting to be asked to do just one thing, but Peter would enforce this pretty strictly.” Thiel would say: “I will not talk to you about anything else except for this one thing that I’ve assigned to you. I don’t want to hear about how great your doing in this other area. Just focus until you conquer this one problem.” Keith explains: “The insight behind this is that most people will solve problems that they understand how to solve. Roughly speaking, they will solve B+ problems instead of A+ problems. A+ problems are high-impact problems for your company but they’re difficult—you don’t wake up in the morning with a solution to them, so you tend to procrastinate… If you have a company that’s always solving B+ problems, you’ll grow and add value, but you’ll never create the breakthrough idea because no one is spending 100% of their time banging their head against the wall every day until they solve it.” Video source: Y Combinator (2014)

Startup Archive

81,796 Aufrufe • vor 1 Jahr

Mike Sullivan says it's concerning about the Rangers' lack of scoring "If I had the solution, we would certainly bring it. We're doing our best to control the process. We're trying to solve it, for sure. Is it a little bit concerning at this point? Yeah"
1:18

Mike Sullivan says it's concerning about the Rangers' lack of scoring "If I had the solution, we would certainly bring it. We're doing our best to control the process. We're trying to solve it, for sure. Is it a little bit concerning at this point? Yeah"

SNY Rangers

22,956 Aufrufe • vor 9 Monaten

The bottom line is this administration wants to do everything in their power, no matter how they get there, no matter how many rules they break, to stop Congress from holding them accountable. I showed up to protect the people that I represent. I plan on continuing to do that.
2:35

The bottom line is this administration wants to do everything in their power, no matter how they get there, no matter how many rules they break, to stop Congress from holding them accountable. I showed up to protect the people that I represent. I plan on continuing to do that.

Rep. LaMonica McIver

24,520 Aufrufe • vor 9 Monaten

“I left Test cricket because I felt my team didn’t want me to be a part of the team. They weren’t welcoming.” ~Virat Kohli 😲 Mohammad Kaif: “Virat Kohli has left the Test format, which is very disheartening. Recently, I saw his statement where he said that he left the format because he wasn’t feeling welcomed by his team and felt that they didn’t want him to be a part of the team. So, is that the reason he left the Test format? Otherwise, he knew how difficult and important the format was. He always wanted to set an example for the world that this is the real format, and this is the format I can play.”
0:32

“I left Test cricket because I felt my team didn’t want me to be a part of the team. They weren’t welcoming.” ~Virat Kohli 😲 Mohammad Kaif: “Virat Kohli has left the Test format, which is very disheartening. Recently, I saw his statement where he said that he left the format because he wasn’t feeling welcomed by his team and felt that they didn’t want him to be a part of the team. So, is that the reason he left the Test format? Otherwise, he knew how difficult and important the format was. He always wanted to set an example for the world that this is the real format, and this is the format I can play.”

Kshitij

57,514 Aufrufe • vor 10 Tagen

Watch this video guys!!! People are calling out Soludo for sending his men to come and destroy the road constructed by Tony Nwonye. I want every Onye Anambra to take this matter up! This is the type of madness cannot be allowed to continue!
1:00

Watch this video guys!!! People are calling out Soludo for sending his men to come and destroy the road constructed by Tony Nwonye. I want every Onye Anambra to take this matter up! This is the type of madness cannot be allowed to continue!

Anambra 1st son

58,999 Aufrufe • vor 3 Monaten

Illegal immigrants should never be given a driver's license in the United States. That's common sense. Today I introduced the No Licenses for Illegal Drivers or Truckers Act to require states verify that every person receiving a driver's license prove that they are here legally.
1:18

Illegal immigrants should never be given a driver's license in the United States. That's common sense. Today I introduced the No Licenses for Illegal Drivers or Truckers Act to require states verify that every person receiving a driver's license prove that they are here legally.

Sen. John Barrasso

29,037 Aufrufe • vor 5 Monaten

Zelensky: Today the issue is air defense. This is the most difficult problem. Unfortunately, our partners still do not grant licenses for us to produce systems ourselves, for example, Patriot systems, or even missiles for the systems we already have.
0:39

Zelensky: Today the issue is air defense. This is the most difficult problem. Unfortunately, our partners still do not grant licenses for us to produce systems ourselves, for example, Patriot systems, or even missiles for the systems we already have.

Clash Report

10,964 Aufrufe • vor 6 Monaten

GPT-4o is bad at processing PDF documents. Whoever tells you otherwise is not living in the real world. In 2024, people fill out forms using pen and paper. Try to answer questions from those forms using modern models, and you'll be disappointed. I recorded a video to show you how to fix this. The answer is simple: stop letting the model see your PDF document. Instead, preprocess it and stick to showing the model text. Watch the video. You'll go from "THIS IS CRAP" to "EXCELLENT" in no time. I'm using Unstract to turn the documents into text while keeping the original format (this is crucial!) You can use them to process up to 100 pages for free. They collaborated with me on this post. You can find the code I wrote right here:
6:27

GPT-4o is bad at processing PDF documents. Whoever tells you otherwise is not living in the real world. In 2024, people fill out forms using pen and paper. Try to answer questions from those forms using modern models, and you'll be disappointed. I recorded a video to show you how to fix this. The answer is simple: stop letting the model see your PDF document. Instead, preprocess it and stick to showing the model text. Watch the video. You'll go from "THIS IS CRAP" to "EXCELLENT" in no time. I'm using Unstract to turn the documents into text while keeping the original format (this is crucial!) You can use them to process up to 100 pages for free. They collaborated with me on this post. You can find the code I wrote right here:

Santiago

196,861 Aufrufe • vor 2 Jahren

This is Tesla's biggest marketing problem & how to solve it. The problem is Autopilot. And not just in Europe... And the solution is simple. Let Elon Musk see this please.
3:09

This is Tesla's biggest marketing problem & how to solve it. The problem is Autopilot. And not just in Europe... And the solution is simple. Let Elon Musk see this please.

robot*irl

175,562 Aufrufe • vor 1 Jahr