Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

btw literally everybody is reporting that Agentic RAG is beating “trad RAG” by leaps and bounds its probably the #1 most cited result in RAG after “have you tried BM25” from Merrill Lutsky on the Raza Habib pod

30,551 görüntüleme • 1 yıl önce •via X (Twitter)

11 Yorum

Rahul Dave profil fotoğrafı
Rahul Dave1 yıl önce

@corbtt @MerrillLutsky @RazRazcle Add one more reporter. Financial documents.

swyx 🔜 @aiDotEngineer (Jun 3-5) profil fotoğrafı
swyx 🔜 @aiDotEngineer (Jun 3-5)1 yıl önce

@corbtt @MerrillLutsky @RazRazcle wdym

Rainmaker profil fotoğrafı
Rainmaker2 yıl önce

Here I share an XGBoost model that delivers a 25% CAGR with minimal drawdown on Visa stock. In this free Substack post I share code and commentary for a powerful Machine Learning strategy that delivers powerful returns.

Janaka Abeywardhana profil fotoğrafı
Janaka Abeywardhana1 yıl önce

@MerrillLutsky @RazRazcle Hold that orig tweet implies agentic RAG does use semantic search???

Jo Kristian Bergum profil fotoğrafı
Jo Kristian Bergum1 yıl önce

@MerrillLutsky @RazRazcle I had a meeting this week with founders of an AI support bot that said the same thing

Sherwood 💬 profil fotoğrafı
Sherwood 💬1 yıl önce

@MerrillLutsky @RazRazcle A wild @MerrillLutsky appears

Ak profil fotoğrafı
Ak1 yıl önce

@MerrillLutsky @RazRazcle Building a hosted version of this at !

sorta_sota profil fotoğrafı
sorta_sota1 yıl önce

@MerrillLutsky @RazRazcle how can I get snipd to export like that

Raza Habib profil fotoğrafı
Raza Habib1 yıl önce

@MerrillLutsky The first team I saw do this was actually @bloopdotai almost 2 years ago now

swyx 🔜 @aiDotEngineer (Jun 3-5) profil fotoğrafı
swyx 🔜 @aiDotEngineer (Jun 3-5)1 yıl önce

@MerrillLutsky @bloopdotai i wonder if theres a canonical paper bc mine is the jerry liu talk

Christian Nonis profil fotoğrafı
Christian Nonis1 yıl önce

@MerrillLutsky @RazRazcle I am team graph rag

Benzer Videolar

Announcing a new Coursera course: Retrieval Augmented Generation (RAG) You'll learn to build high performance, production-ready RAG systems in this hands-on, in-depth course created by and taught by Zain, experienced AI and ML engineer, researcher, and educator. RAG is a critical component today of many LLM-based applications in customer support, internal company Q&A systems, even many of the leading chatbots that use web search to answer your questions. This course teaches you in-depth how to make RAG work well. LLMs can produce generic or outdated responses, especially when asked specialized questions not covered in its training data. RAG is the most widely used technique for addressing this. It brings in data from new data sources, such as internal documents or recent news, to give the LLM the relevant context to private, recent, or specialized information. This lets it generate more grounded and accurate responses. In this course, you’ll learn to design and implement every part of a RAG system, from retrievers to vector databases to generation to evals. You’ll learn about the fundamental principles behind RAG and how to optimize it at both the component and whole-system levels. As AI evolves, RAG is evolving too. New models can handle longer context windows, reason more effectively, and can be parts of complex agentic workflows. One exciting growth area is Agentic RAG, in which an AI agent at runtime (rather than it being hardcoded at development time) autonomously decides what data to retrieve, and when/how to go deeper. Even with this evolution, access to high-quality data at runtime is essential, which is why RAG is a key part of so many applications. You'll learn via hands-on experiences to: - Build a RAG system with retrieval and prompt augmentation - Compare retrieval methods like BM25, semantic search, and Reciprocal Rank Fusion - Chunk, index, and retrieve documents using a Weaviate vector database and a news dataset - Develop a chatbot, using open-source LLMs hosted by Together AI, for a fictional store that answers product and FAQ questions - Use evals to drive improving reliability, and incorporate multi-modal data RAG is an important foundational technique. Become good at it through this course! Please sign up here:

Andrew Ng

124,458 görüntüleme • 1 yıl önce

There’s been two papers released in the past couple months, one by Google and one by NVIDIA, that argue that ordering the documents retrieved by RAG systems can enhance performance. However, they both give two different strategies on HOW these documents should be ordered 🤔 Both papers agree on two main points: 1️⃣ There’s a fundamental issue in RAG - as more documents are retrieved, more irrelevant context (e.g., hard negatives) are introduced, which leads to confusion for the LLM and eventually degrades the quality of the generated output. This is called an inverted-U performance curve. 2️⃣ Ordering the retrieved documents is a key lever for optimizing RAG performance. Google Cloud researchers proposed ordering results based on relevance scores: The authors in this paper argue for relevance-based reordering, or ordering the retrieved chunks based on their similarity scores, so the most relevant documents are at the beginning and the end of the inputs to counter the “lost in the middle” effect. NVIDIA researchers proposed ordering results based on the original sequence of document chunks: The authors of this paper argue for Order-Preserving Reordering, or Order-Preserve RAG (OP-RAG), to maintain the logically coherent content flow of the document. So they preserved the original order of retrieved document chunks in the source text, instead of ranking them by relevance scores. So which one is right? It probably depends on the specific use case and dataset - relevance-based reordering could perform better in tasks where you need fast access to the most critical information (e.g., fact retrieval, QA systems), while order-preserving RAG might be better where you need to understand the sequential structure of information (e.g., narrative or legal documents). There are still so many uncertainties in AI - we don’t actually know what we’re doing, and it takes awhile to figure out the best strategies for most things! Excited to see more research about this.

Victoria Slocum

15,333 görüntüleme • 1 yıl önce

Traditional data pipelines don't work for RAG applications. There are 3 issues with them: ​ 1. Traditional data engineering solutions are optimized to handle structured data. RAG applications rely primarily on unstructured data. ​ 2. The connector ecosystem to load data from unstructured data sources is very immature. ​ 3. Traditional solutions do not offer any way to transform unstructured data into an optimized vector search index. ​ The goal of a RAG Pipeline is to solve these problems. ​ The number one objective is to create a reliable vector search index using factual knowledge and relevant context. This sounds easy, but it's one of the biggest challenges we face when building RAG applications. ​ At a high level, there are four different stages in the architecture of a RAG pipeline: ​ 1. Ingestion: Here is where the pipeline loads the information from the data source. ​ 2. Extraction: Where the pipeline processes the input data and decides how to retrieve the text contained inside them. ​ 3. Transform: Where the pipeline chunks the data and generates document embeddings. ​ 4. Load: Where the pipeline creates a search index in a vector database and loads the document embeddings. ​ There are different rabbit holes at each one of these stages. Here are three of them: ​ 1. Ingesting data once is simple. The hard part is refreshing the vector database whenever the original data source changes. ​ 2. Extracting the content of a plain text document is simple. The hard part is to extract content from complex documents containing tables, images, or cross-references. ​ 3. A simple continual chunking strategy with an overlap is simple. The hard part is to find the optimal strategy for your specific knowledge base and the way you are planning to query it. ​ In the attached video, I'll show you how you can build an enterprise-grade RAG Pipeline that solves every one of the above problems. ​ I'll use Vectorize. They partnered with me on this post. You can use them to build RAG pipelines optimized for accurate context retrieval. ​ ​ If you have a few documents lying around, set up a free account and give it a try.

Santiago

40,441 görüntüleme • 1 yıl önce