Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Engineering teams require focus now more than ever. We’ve changed the way we solve for paper cuts in the product while maintaining our speed of shipping: "The second [a bug] comes through Slack it triggers an agent that figures out the right team to send it to. That team’s...

15,009 görüntüleme • 2 ay önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

The latest RAG trend for the current agent harnesses (Codex, Cowork) is to do two passes of document processing to solve a knowledge work task over a data room of documents: 1️⃣ A fast and light pass, oftentimes using a free/OSS doc parsing tool. This can be cheaply run across 10-100-1k’s of files, and enables the agent to then do retrieval (e.g. grep, semantic) to find relevant subsets of context. 2️⃣ A “just-in-time” VLM-based pass. Once the agent finds the relevant pages of context, it will screenshot the documents can call its own VLM (or write code) to dissect the pages. The issue with only using VLM-based OCR tools over massive ad-hoc customer file dumps is that it’s slow and expensive. Doing JIT VLM OCR allows the agent to filter through the data cheaply, but still preserve accuracy for the context that’s needed for the task. The agent harnesses do two-pass document processing by default using off the shelf-tools: pdf2text as the first pass, and using itself (Opus 5) as the second pass. See the below video where Cowork runs over a bunch of PDFs to answer a question about a benchmark graph in the Kimi k3 paper. The main issues here with the “out of the box” doc processing these agents offer are: * Opus 5 is not the best VLM for OCR. It is also way too expensive at scale and lacks grounding * The OSS tools like pypdf, pdf2text, may not be versatile enough as the first pass. * The agent will write a lot of throwaway code to rewrite things an OCR tool would’ve provided out of the box, like chart processing, bounding boxes, confidence scores, leading to increased cost and speed. We have all the tools within LlamaIndex 🦙 to help any agent do two-pass document processing with higher accuracy and lower cost. 1️⃣ We have liteparse for the first pass - a free/OSS parser written in Rust that’s faster/more accurate than other OSS parsers, and supports 50+ document types 2️⃣ We have LlamaParse for the second pass - an agentic document engine that uses VLMs+harnesses to achieve SOTA in accuracy and cost across various doc parsing and extraction tasks. It can be called from any agent harness as an MCP or skill. It takes in page numbers as input, so that the agent can choose to run LlamaParse over a subset of the doc instead of the full doc as a “zoom-in” pass. Come check it out! LiteParse: LlamaParse: All the relevant docs, including MCP, are here:

Jerry Liu

23,119 görüntüleme • 1 ay önce

Elon Musk believes that YES, prominent Democrats like Maxine Waters, Adam Schiff and Chuck Schumer have received USAID money funneled through NGOs “There is a massive amount of corruption — So they'll send the money overseas to one NGO, then it'll go through a bunch of them, and then I'm highly confident that a bunch of that money then comes back to the United States and lands in the pockets of the people you just mentioned.” “So what happens is there's money that, obviously it's your taxpayer money, that is then sent to various government organizations who then send it to, to NGOs, which, which an NGO is a non-governmental organization. But obviously if it's a government-funded non-governmental organization, it's just an organization, it's just a government. And effectively there's a giant fraud loophole, which is that the government can send money to an NGO that is then no longer governed by the law laws of the United States. So they'll, they'll send the money overseas to one NGO, then it'll go through a bunch of a bunch of them. And then I'm highly confident that a bunch of that money then comes back to the United States and lands in the pockets of the people you just mentioned. But it is a circuitous route. It's not like it doesn't go directly, but let's just say that there's a lot of strangely wealthy members of Congress where I'm trying to connect the dots of how did they become rich? Well earning, how'd they get $20 million if they're earning $200,000 a year? It sounds that's how, how do I just, nobody can explain that. So it’s something we're gonna try to figure it out and certainly stop it from happening. The whole NGO scam is just crazy — It’s blown my mind really”

Wall Street Apes

344,580 görüntüleme • 1 yıl önce