Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Gemini has always been my go-to LLM for document extraction - but accurate bounding boxes with agentic vision are a huge value-add in the latest Gemini models. Shown: extracting structured data from an oil & gas lease in Ector County Texas with the best bboxes I've seen yet.

Kyle Walker

19,668 subscribers

79,646 Aufrufe • vor 7 Monaten •via X (Twitter)

Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

See Google’s Gemini 2.5 Pro in action with the Box AI API! We put it to the test on complex invoice calculations and analyzing 10-K financial documents. Leverage Gemini 2.5 Pro via the Box AI API for advanced document processing, data extraction, and Q&A in your applications.

See Google’s Gemini 2.5 Pro in action with the Box AI API! We put it to the test on complex invoice calculations and analyzing 10-K financial documents. Leverage Gemini 2.5 Pro via the Box AI API for advanced document processing, data extraction, and Q&A in your applications.

Box

489,097 Aufrufe • vor 1 Jahr

Announcing: Agentic Document Extraction! PDF files represent information visually - via layout, charts, graphs, etc. - and are more than just text. Unlike traditional OCR and most PDF-to-text approaches, which focus on extracting the text, an agentic approach lets us break a document down into components and reason about them, resulting in more accurate extraction of the underlying meaning for RAG and other applications. Watch the video for details.

Announcing: Agentic Document Extraction! PDF files represent information visually - via layout, charts, graphs, etc. - and are more than just text. Unlike traditional OCR and most PDF-to-text approaches, which focus on extracting the text, an agentic approach lets us break a document down into components and reason about them, resulting in more accurate extraction of the underlying meaning for RAG and other applications. Watch the video for details.

Andrew Ng

689,741 Aufrufe • vor 1 Jahr

Here we go: Gemini 3.0 is live! Thankfully, I was able to be an early tester. It's the best model I've ever tested - nothing comes even close to it. OpenAI will have a very hard time to keep up with Google, because Gemini 3.0 will now be the benchmark for all future models. I have been invited by Google DeepMind / Google - Thanks to Google DeepMind for the #EarlyAccess Here's a summary of Gemini 3.0 with all the important benchmark evals:

Here we go: Gemini 3.0 is live! Thankfully, I was able to be an early tester. It's the best model I've ever tested - nothing comes even close to it. OpenAI will have a very hard time to keep up with Google, because Gemini 3.0 will now be the benchmark for all future models. I have been invited by Google DeepMind / Google - Thanks to Google DeepMind for the #EarlyAccess Here's a summary of Gemini 3.0 with all the important benchmark evals:

Chubby♨️

108,611 Aufrufe • vor 10 Monaten

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Google AI

493,436 Aufrufe • vor 10 Monaten

Today, we're introducing not one but TWO new models, striking the balance between efficiency and quality to enable you to build production AI agents. — Gemini 3.6 Flash: Addresses efficiency feedback we received from Gemini 3.5 Flash with upgrades in coding, knowledge work, and multimodal tasks faster, more accurately, and with substantially fewer tokens per task — Gemini 3.5 Flash-Lite: Our fastest, most cost-effective 3.5-class model yet built for agentic workflows, hitting ~350 output tokens/sec with improved coding and overall quality Start building with these today via the Gemini API in Google AI Studio or try them out in the Google Gemini

Today, we're introducing not one but TWO new models, striking the balance between efficiency and quality to enable you to build production AI agents. — Gemini 3.6 Flash: Addresses efficiency feedback we received from Gemini 3.5 Flash with upgrades in coding, knowledge work, and multimodal tasks faster, more accurately, and with substantially fewer tokens per task — Gemini 3.5 Flash-Lite: Our fastest, most cost-effective 3.5-class model yet built for agentic workflows, hitting ~350 output tokens/sec with improved coding and overall quality Start building with these today via the Gemini API in Google AI Studio or try them out in the Google Gemini

Google AI

439,023 Aufrufe • vor 2 Monaten

New course: Document AI: From OCR to Agentic Doc Extraction, built with LandingAI, where I'm executive chairman, and taught by David Park and Andrea Kropp. Much of the world's data is locked in PDFs, JPEGs, and other documents. This short course shows you how to build agentic workflows that process documents accurately: breaking them into parts, examining each piece carefully, and extracting information through multiple iterations. Traditional Optical Character Recognition (OCR) captures text but loses context from table headers, chart captions, or reading order of columns. After exploring OCR's limitations, you’ll use LandingAI's Agentic Document Extraction (ADE) framework to process documents. ADE treats pages as visually -- as images -- to parse information and extract fields. Skills you'll gain: - Build agents to convert unstructured files into structured Markdown/HTML and JSON - Use ADE to parse complex data like forms, handwriting, or equations - Map extracted information to named fields using a specified schema, with bounding boxes for grounding and validation - Deploy RAG applications with event-driven document processing Come learn about the best tools for processing documents like financial invoices, medical records, or academic papers intelligently:

New course: Document AI: From OCR to Agentic Doc Extraction, built with LandingAI, where I'm executive chairman, and taught by David Park and Andrea Kropp. Much of the world's data is locked in PDFs, JPEGs, and other documents. This short course shows you how to build agentic workflows that process documents accurately: breaking them into parts, examining each piece carefully, and extracting information through multiple iterations. Traditional Optical Character Recognition (OCR) captures text but loses context from table headers, chart captions, or reading order of columns. After exploring OCR's limitations, you’ll use LandingAI's Agentic Document Extraction (ADE) framework to process documents. ADE treats pages as visually -- as images -- to parse information and extract fields. Skills you'll gain: - Build agents to convert unstructured files into structured Markdown/HTML and JSON - Use ADE to parse complex data like forms, handwriting, or equations - Map extracted information to named fields using a specified schema, with bounding boxes for grounding and validation - Deploy RAG applications with event-driven document processing Come learn about the best tools for processing documents like financial invoices, medical records, or academic papers intelligently:

Andrew Ng

200,844 Aufrufe • vor 8 Monaten

If you’re building an “agent over your PDFs” in 2026, one of the most underrated things you can do is to provide exact grounding back to the source document for any agentic answers. Specifically, showing the exact word, line, or region that the answer came from. Frontier vision models do a terrible job at this. They have a hard time predicting exact bounding boxes over region, tying it back to the source answer, and surfacing it as context in a cost-effective and accurate manner. Dedicated VLM-based document OCR/extraction tools like LlamaParse are a lot better at visual grounding and specifically tying it to extracted outputs. One of our main evaluation areas in ExtractBench, our recently released real-world benchmark, is to evaluate the visual grounding capabilities of document extraction. ExtractBench: If you want to give LlamaParse a shot, come check it out:

If you’re building an “agent over your PDFs” in 2026, one of the most underrated things you can do is to provide exact grounding back to the source document for any agentic answers. Specifically, showing the exact word, line, or region that the answer came from. Frontier vision models do a terrible job at this. They have a hard time predicting exact bounding boxes over region, tying it back to the source answer, and surfacing it as context in a cost-effective and accurate manner. Dedicated VLM-based document OCR/extraction tools like LlamaParse are a lot better at visual grounding and specifically tying it to extracted outputs. One of our main evaluation areas in ExtractBench, our recently released real-world benchmark, is to evaluate the visual grounding capabilities of document extraction. ExtractBench: If you want to give LlamaParse a shot, come check it out:

Jerry Liu

14,515 Aufrufe • vor 1 Monat

We tuned an AI agent that can do large-scale document extraction from long docs (50+ pages, some with 10k-100k fields) with 94%+ accuracy 📈 It uses a harness + model set that is tuned specifically for reasoning over extracting out complex information from complex docs. Each extracted field comes with a confidence score as well as a bounding box denoting where it came from. It does 10-20% better in accuracy than generalized coding agent harnesses (e.g. Claude Code Opus 4.8 and Codex GPT-5.6). Check out the video below for a demo. The mode is called LlamaExtract Agentic Plus. Learn more about our extraction benchmark and agentic plus mode here: If you have very complex document extraction needs, come check out LlamaParse!

We tuned an AI agent that can do large-scale document extraction from long docs (50+ pages, some with 10k-100k fields) with 94%+ accuracy 📈 It uses a harness + model set that is tuned specifically for reasoning over extracting out complex information from complex docs. Each extracted field comes with a confidence score as well as a bounding box denoting where it came from. It does 10-20% better in accuracy than generalized coding agent harnesses (e.g. Claude Code Opus 4.8 and Codex GPT-5.6). Check out the video below for a demo. The mode is called LlamaExtract Agentic Plus. Learn more about our extraction benchmark and agentic plus mode here: If you have very complex document extraction needs, come check out LlamaParse!

Jerry Liu

18,359 Aufrufe • vor 1 Monat

Americans are getting hit with another spike in oil and gas prices, with the national average for a gallon of gas at $4.30 — up $0.25 from last month’s average. ABC News’ Andrew Dymburt has the latest.

Americans are getting hit with another spike in oil and gas prices, with the national average for a gallon of gas at $4.30 — up $0.25 from last month’s average. ABC News’ Andrew Dymburt has the latest.

ABC News

31,637 Aufrufe • vor 12 Tagen

Parsing a document accurately is one thing. Proving where every value came from is another. When a compliance team reviews an AI extraction, or an auditor needs to sign off on a figure pulled from a financial filing, "it came from this document" isn't enough. They need to see exactly where. The specific cell in the table, the exact line on the page, the precise word the agent used. Most parsers can get you to a paragraph or a table block. That's where the trail ends. Today we're shipping Granular Bounding Boxes in LlamaParse — word, line, and cell level coordinates for every value in your document. The result is a complete, verifiable trail from every extracted value back to its exact source in the document. Built for audit workflows, compliance review, and any pipeline where verification isn't optional. Read the full announcement →

Parsing a document accurately is one thing. Proving where every value came from is another. When a compliance team reviews an AI extraction, or an auditor needs to sign off on a figure pulled from a financial filing, "it came from this document" isn't enough. They need to see exactly where. The specific cell in the table, the exact line on the page, the precise word the agent used. Most parsers can get you to a paragraph or a table block. That's where the trail ends. Today we're shipping Granular Bounding Boxes in LlamaParse — word, line, and cell level coordinates for every value in your document. The result is a complete, verifiable trail from every extracted value back to its exact source in the document. Built for audit workflows, compliance review, and any pipeline where verification isn't optional. Read the full announcement →

LlamaIndex 🦙

29,090 Aufrufe • vor 3 Monaten

Most organizations run on unstructured content, but it’s the data locked within that content moves business forward. Box Extract is now generally available, delivering agentic data extraction at scale for smart process automation. Combining the latest AI models with advanced OCR capabilities, and agentic approaches that understand document structure and meaning, Box Extract automatically and accurately extracts high quality data from a variety of content to automate workflows, speed content discovery, and drive smarter business decisions.

Most organizations run on unstructured content, but it’s the data locked within that content moves business forward. Box Extract is now generally available, delivering agentic data extraction at scale for smart process automation. Combining the latest AI models with advanced OCR capabilities, and agentic approaches that understand document structure and meaning, Box Extract automatically and accurately extracts high quality data from a variety of content to automate workflows, speed content discovery, and drive smarter business decisions.

Box

759,033 Aufrufe • vor 8 Monaten

The Opera Neon browser impressed me with how seamlessly it fits into my workflow. One agentic browser. No subscription juggling. Access to top models like Gemini 3 Pro, GPT-5.2, Sora 2, Grok & more. See it in action finding the best flight → #collab

The Opera Neon browser impressed me with how seamlessly it fits into my workflow. One agentic browser. No subscription juggling. Access to top models like Gemini 3 Pro, GPT-5.2, Sora 2, Grok & more. See it in action finding the best flight → #collab

Mukul Sharma

65,852 Aufrufe • vor 8 Monaten

With our new Ask Maps feature, you can truly ask anything about anywhere, with help from the latest Gemini models. Ready to roll? Try asking for a walking ghost tour in your city. 👻 Now rolling out in the US and India.

With our new Ask Maps feature, you can truly ask anything about anywhere, with help from the latest Gemini models. Ready to roll? Try asking for a walking ghost tour in your city. 👻 Now rolling out in the US and India.

Google Maps

70,261 Aufrufe • vor 6 Monaten

Learning from Human Demonstrations: Show the Robot How to Act! The pipeline is very similar to older experiments using Gemini & pi0 with LeRobot. Pi-zero runs locally, while Gemini Flash generates the affordances and the high-level task. (More details are in the thread.) The new component is learning from demonstrations via Gemini 2.5 Pro. I capture a video while demoing & take one of the last frames. Gemini 2.5 Pro then extracts the instructions & passes them to Gemini Flash to process the scene. The fun part is that there's no fancy insight that came from me; other than the days spent figuring out the right prompts. It's the bitter lesson hitting you in the face -> Enhanced Gemini capabilities make this possible. For example, Gemini Flash cannot do Russian doll stacking, but Gemini 2.5 Pro can do it consistently. The current limitation is low-level manipulation: - As you can see, I'm aligning the objects so they are easy to grasp using the same technique from the training data. I couldn't get Gemini Flash to consistently output an accurate grasping angle, and Gemini 1.5 Pro was too expensive and slow for real-time deployment. - Getting a symmetrical gripper should also help a lot. Adding rubber to the tips would probably also help prevent objects from slipping. Collecting & curating the data was the most time consuming & labor intensive part. Next, to improve low-level manipulation and make the system more real-time, I'm shifting to focus more on sims & synthetic data. This aligns better with my core competence. I'm open to tips and suggestions.

Learning from Human Demonstrations: Show the Robot How to Act! The pipeline is very similar to older experiments using Gemini & pi0 with LeRobot. Pi-zero runs locally, while Gemini Flash generates the affordances and the high-level task. (More details are in the thread.) The new component is learning from demonstrations via Gemini 2.5 Pro. I capture a video while demoing & take one of the last frames. Gemini 2.5 Pro then extracts the instructions & passes them to Gemini Flash to process the scene. The fun part is that there's no fancy insight that came from me; other than the days spent figuring out the right prompts. It's the bitter lesson hitting you in the face -> Enhanced Gemini capabilities make this possible. For example, Gemini Flash cannot do Russian doll stacking, but Gemini 2.5 Pro can do it consistently. The current limitation is low-level manipulation: - As you can see, I'm aligning the objects so they are easy to grasp using the same technique from the training data. I couldn't get Gemini Flash to consistently output an accurate grasping angle, and Gemini 1.5 Pro was too expensive and slow for real-time deployment. - Getting a symmetrical gripper should also help a lot. Adding rubber to the tips would probably also help prevent objects from slipping. Collecting & curating the data was the most time consuming & labor intensive part. Next, to improve low-level manipulation and make the system more real-time, I'm shifting to focus more on sims & synthetic data. This aligns better with my core competence. I'm open to tips and suggestions.

Shreyas Gite

22,555 Aufrufe • vor 1 Jahr

Announcing a significant upgrade to Agentic Document Extraction! LandingAI's new DPT (Document Pre-trained Transformer) accurately extracts even from complex docs. For example, from large, complex tables, which is important for many finance and healthcare applications. And a new SDK makes using it require only 3 simple lines of code. Please see the video for technical details. I hope this unlocks a lot of value from the "dark data" currently stuck in PDF files, and that you'll build something cool with this!

Announcing a significant upgrade to Agentic Document Extraction! LandingAI's new DPT (Document Pre-trained Transformer) accurately extracts even from complex docs. For example, from large, complex tables, which is important for many finance and healthcare applications. And a new SDK makes using it require only 3 simple lines of code. Please see the video for technical details. I hope this unlocks a lot of value from the "dark data" currently stuck in PDF files, and that you'll build something cool with this!

Andrew Ng

299,778 Aufrufe • vor 1 Jahr

2025 has been the hardest year of life I’ve had to deal with yet. The reason i began Moshpxt was to put Xelly in a position to win and losing him almost made me lose my vision and purpose for everything but God always has a plan, from now on everything turned up 2000% #LLX #XMG

2025 has been the hardest year of life I’ve had to deal with yet. The reason i began Moshpxt was to put Xelly in a position to win and losing him almost made me lose my vision and purpose for everything but God always has a plan, from now on everything turned up 2000% #LLX #XMG

Moshpxt

35,344 Aufrufe • vor 9 Monaten

The way you use Google Maps will never be the same. Introducing Ask Maps, a new way for you to ask anything about anywhere, with help from the latest Gemini models. Rolling out now on Android and iOS in the US and India.

The way you use Google Maps will never be the same. Introducing Ask Maps, a new way for you to ask anything about anywhere, with help from the latest Gemini models. Rolling out now on Android and iOS in the US and India.

Google Maps

543,052 Aufrufe • vor 6 Monaten

The best way to bring the composition from your head into an image → Ideogram V4 + drawing bounding boxes in Comfy. The control here is quite unique. The model uses structured JSON so drawing bounding boxes to get the exact placement works very well. The model only needs 12 steps (turbo), so iterating with different seeds + very impressive text rendering capability leads me to say this is a state of the art open source image model right now. Using the 'Ideogram 4 Prompt Builder' node by Kijai.

The best way to bring the composition from your head into an image → Ideogram V4 + drawing bounding boxes in Comfy. The control here is quite unique. The model uses structured JSON so drawing bounding boxes to get the exact placement works very well. The model only needs 12 steps (turbo), so iterating with different seeds + very impressive text rendering capability leads me to say this is a state of the art open source image model right now. Using the 'Ideogram 4 Prompt Builder' node by Kijai.

rob - comfyui

25,841 Aufrufe • vor 3 Monaten