Загрузка видео...

Не удалось загрузить видео

На главную

Introducing RAG CLI 🧑‍💻🔎 - a dead-simple command-line tool that allows you to RAG literally any file on your local machine. Index any files including glob patterns, such as `$ llamaindex-cli rag --files "./docs/**/*.rst”` To search simply do `$ llamaindex-cli rag --question "What is LlamaIndex?”` Built with our IngestionPipeline...

67,888 просмотров • 2 лет назад •via X (Twitter)

Комментарии: 9

Фото профиля Fabrizio Milo
Fabrizio Milo2 лет назад

just a word of caution: this can be expensive if you don't know how big are your files in terms of tokens. It does sends data to @OpenAI with the blog's default configuration.

Фото профиля ahmed
ahmed2 лет назад

Which embedding model it is using?

Фото профиля LlamaIndex 🦙
LlamaIndex 🦙2 лет назад

@ahmed_abdullahx ada-002, but you can customize it to use any model!

Фото профиля ppg
ppg2 лет назад

@ollama From the name "llamaindex" it would seem your default model would be at least llama or open weights based but instead the default is openAI based. Any reason for that? Do the open models do very poorly?

Фото профиля Matrix Dai
Matrix Dai2 лет назад

@TheAICoder This is easiest way to index and "ask" local files.

Фото профиля AiBee Agency
AiBee Agency2 лет назад

🛠️ The RAG CLI tool looks like a game-changer for developers! Easy indexing means quicker access and better productivity. Could you share more on how it handles large file systems? #DevTools #CommandLineMagic

Фото профиля Peter Calvanelli
Peter Calvanelli2 лет назад

🤯

Фото профиля Bryce Amacker
Bryce Amacker2 лет назад

@memdotai mem it

Фото профиля Mem
Mem2 лет назад

@llama_index Saved! Here's the compiled thread:

Похожие видео

Announcing a new Coursera course: Retrieval Augmented Generation (RAG) You'll learn to build high performance, production-ready RAG systems in this hands-on, in-depth course created by and taught by , experienced AI and ML engineer, researcher, and educator. RAG is a critical component today of many LLM-based applications in customer support, internal company Q&A systems, even many of the leading chatbots that use web search to answer your questions. This course teaches you in-depth how to make RAG work well. LLMs can produce generic or outdated responses, especially when asked specialized questions not covered in its training data. RAG is the most widely used technique for addressing this. It brings in data from new data sources, such as internal documents or recent news, to give the LLM the relevant context to private, recent, or specialized information. This lets it generate more grounded and accurate responses. In this course, you’ll learn to design and implement every part of a RAG system, from retrievers to vector databases to generation to evals. You’ll learn about the fundamental principles behind RAG and how to optimize it at both the component and whole-system levels. As AI evolves, RAG is evolving too. New models can handle longer context windows, reason more effectively, and can be parts of complex agentic workflows. One exciting growth area is Agentic RAG, in which an AI agent at runtime (rather than it being hardcoded at development time) autonomously decides what data to retrieve, and when/how to go deeper. Even with this evolution, access to high-quality data at runtime is essential, which is why RAG is a key part of so many applications. You'll learn via hands-on experiences to: - Build a RAG system with retrieval and prompt augmentation - Compare retrieval methods like BM25, semantic search, and Reciprocal Rank Fusion - Chunk, index, and retrieve documents using a Weaviate vector database and a news dataset - Develop a chatbot, using open-source LLMs hosted by Together AI, for a fictional store that answers product and FAQ questions - Use evals to drive improving reliability, and incorporate multi-modal data RAG is an important foundational technique. Become good at it through this course! Please sign up here:

Andrew Ng

124,656 просмотров • 1 год назад

Traditional data pipelines don't work for RAG applications. There are 3 issues with them: ​ 1. Traditional data engineering solutions are optimized to handle structured data. RAG applications rely primarily on unstructured data. ​ 2. The connector ecosystem to load data from unstructured data sources is very immature. ​ 3. Traditional solutions do not offer any way to transform unstructured data into an optimized vector search index. ​ The goal of a RAG Pipeline is to solve these problems. ​ The number one objective is to create a reliable vector search index using factual knowledge and relevant context. This sounds easy, but it's one of the biggest challenges we face when building RAG applications. ​ At a high level, there are four different stages in the architecture of a RAG pipeline: ​ 1. Ingestion: Here is where the pipeline loads the information from the data source. ​ 2. Extraction: Where the pipeline processes the input data and decides how to retrieve the text contained inside them. ​ 3. Transform: Where the pipeline chunks the data and generates document embeddings. ​ 4. Load: Where the pipeline creates a search index in a vector database and loads the document embeddings. ​ There are different rabbit holes at each one of these stages. Here are three of them: ​ 1. Ingesting data once is simple. The hard part is refreshing the vector database whenever the original data source changes. ​ 2. Extracting the content of a plain text document is simple. The hard part is to extract content from complex documents containing tables, images, or cross-references. ​ 3. A simple continual chunking strategy with an overlap is simple. The hard part is to find the optimal strategy for your specific knowledge base and the way you are planning to query it. ​ In the attached video, I'll show you how you can build an enterprise-grade RAG Pipeline that solves every one of the above problems. ​ I'll use Vectorize. They partnered with me on this post. You can use them to build RAG pipelines optimized for accurate context retrieval. ​ ​ If you have a few documents lying around, set up a free account and give it a try.

Santiago

40,627 просмотров • 1 год назад