Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Andrew Ng + Google showed the foundation behind modern "RAG", "Graph RAG" and semantic retrieval: • 12:00 - turning text into embeddings that capture meaning • 24:00 - visualizing semantic relationships between vectors • 35:00 - using embeddings for classification, clustering and outlier detection • 50:00 - controlling LLM...

0xMorlex's profile picture

Morlex

3,215 subscribers

34,790 görüntüleme • 1 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

15 Yorum

Hussain Hashim | Building SundayBack profil fotoğrafı
Hussain Hashim | Building SundayBack1 ay önce

@0xMorlex watched it last night. the part on embeddings for clustering? blew my mind. so many use cases I hadn't considered yet!

Chase profil fotoğrafı
Chase1 ay önce

really useful because it separates representation from retrieval from generation instead of treating rag as one monolithic feature

Morlex profil fotoğrafı
Morlex1 ay önce

yeah bro

國泰世華 profil fotoğrafı
國泰世華1 ay önce

Good

MiklaS profil fotoğrafı
MiklaS1 ay önce

solid resource, graph RAG saved me on a research bot where plain vector search kept losing entity relationships across long docs. still cap chunk size aggressively though, oversized nodes torched my retrieval precision fast.

YuML AI profil fotoğrafı
YuML AI1 ay önce

@grok when was this lecture?

AI Mastery Guide profil fotoğrafı
AI Mastery Guide1 ay önce

One level lower makes all the difference

Saman Ahmed profil fotoğrafı
Saman Ahmed1 ay önce

This is the layer everyone skips.

Alex Smith profil fotoğrafı
Alex Smith1 ay önce

yeah similarity search alone misses this. we moved retrieval over to HydraDB since it's graph based and answers got noticeably more precise once entities were actually linked instead of just scored.

ALEXYZ profil fotoğrafı
ALEXYZ1 ay önce

embeddings make semantic search click

Osamik 🤖 profil fotoğrafı
Osamik 🤖1 ay önce

The chunk retriever example nails why naive RAG fails — keyword matching disguised as semantic search. Curious if the roadmap covers re-ranking after retrieval, that's usually where the real quality gap shows up.

cvxv666 profil fotoğrafı
cvxv6661 ay önce

the most logical path for the evolution of AI

Morlex profil fotoğrafı
Morlex1 ay önce

yep, andrej broke it all down cleanly like always

中國信託 profil fotoğrafı
中國信託1 ay önce

Good

Dipanshu Kushwaha profil fotoğrafı
Dipanshu Kushwaha1 ay önce

This is a great breakdown. It really clarifies how these concepts work together.

Benzer Videolar

Google just showed how AI engineers are moving from simple "RAG" to "graphs", memory and multimodal agents • 15:32 - setting up the production agent stack • 28:00 - turning disconnected data into a knowledge graph • 41:00 - Graph RAG with semantic + hybrid search • 58:00 - extracting graph context from images, text and video • 1:09:00 - orchestrating specialized agents with ADK • 1:20:00 - giving agents persistent memory across sessions 94-minute Google Cloud workshop, and it’s one of the clearest hands-on examples of the shift from -> RAG → Graph RAG → Memory → Multimodal Agent Graphs. The workshop uses Spanner Graph, Gemini, ADK and Memory Bank to build that stack. Watch it today, then read the full “From RAG to Context Graphs” roadmap below.
1:30:26

Google just showed how AI engineers are moving from simple "RAG" to "graphs", memory and multimodal agents • 15:32 - setting up the production agent stack • 28:00 - turning disconnected data into a knowledge graph • 41:00 - Graph RAG with semantic + hybrid search • 58:00 - extracting graph context from images, text and video • 1:09:00 - orchestrating specialized agents with ADK • 1:20:00 - giving agents persistent memory across sessions 94-minute Google Cloud workshop, and it’s one of the clearest hands-on examples of the shift from -> RAG → Graph RAG → Memory → Multimodal Agent Graphs. The workshop uses Spanner Graph, Gemini, ADK and Memory Bank to build that stack. Watch it today, then read the full “From RAG to Context Graphs” roadmap below.

Morlex

74,134 görüntüleme • 1 ay önce

Google Engineers just showed how their AI engineers are moving from simple "RAG" to "graphs" RAG → Graph RAG → Memory → Multimodal Agent Graphs. 0% → 15:32 - setting up the production agent stack 30% → 41:00 - Graph RAG with semantic 65% → 58:00 - extracting graph context 100% → 1:09:00 - orchestrating specialized agents 90-minute Google Cloud workshop, and it’s one of the clearest hands-on examples of the shift from. Watch it today, then read the full “From RAG to Context Graphs” roadmap below.
1:30:26

Google Engineers just showed how their AI engineers are moving from simple "RAG" to "graphs" RAG → Graph RAG → Memory → Multimodal Agent Graphs. 0% → 15:32 - setting up the production agent stack 30% → 41:00 - Graph RAG with semantic 65% → 58:00 - extracting graph context 100% → 1:09:00 - orchestrating specialized agents 90-minute Google Cloud workshop, and it’s one of the clearest hands-on examples of the shift from. Watch it today, then read the full “From RAG to Context Graphs” roadmap below.

Morty

53,555 görüntüleme • 1 ay önce

IBM just turned five of its best graph lectures into a 50-minute course on building AI systems around connected knowledge: • 00:00 - How knowledge graphs represent entities and relationships • 05:36 - Why vector-based RAG misses connections between facts • 09:53 - GraphRAG, precision retrieval and context engineering • 20:43 - How graph neural networks learn from connected data • 37:30 - Building GraphRAG with knowledge graphs and Cypher The progression is simple: Text chunks → entities → relationships → graph retrieval → graph intelligence Vector search finds information that looks similar. Graphs recover the structure behind that information. This 50-minute course will teach you more about modern graph engineering than most paid AI programs. Watch it today, then read how to become a knowledge graph engineer in the article below.
48:59

IBM just turned five of its best graph lectures into a 50-minute course on building AI systems around connected knowledge: • 00:00 - How knowledge graphs represent entities and relationships • 05:36 - Why vector-based RAG misses connections between facts • 09:53 - GraphRAG, precision retrieval and context engineering • 20:43 - How graph neural networks learn from connected data • 37:30 - Building GraphRAG with knowledge graphs and Cypher The progression is simple: Text chunks → entities → relationships → graph retrieval → graph intelligence Vector search finds information that looks similar. Graphs recover the structure behind that information. This 50-minute course will teach you more about modern graph engineering than most paid AI programs. Watch it today, then read how to become a knowledge graph engineer in the article below.

Morlex

12,053 görüntüleme • 2 ay önce

Ex-Google engineer just compressed the shift from AI agents to "graphs" and "loops" into one 2h47m lecture: • 00:00 - understanding the different layers of AI memory • 30:00 - moving from simple LLM calls to AI agents • 50:00 - why agent systems are becoming a graph engineering problem • 1:12:00 - connecting context, tools and agent state • 1:24:00 - building a minimal agent harness from scratch • 1:46:00 - breaking down the architecture behind Hermes Agent • 2:08:00 - turning agent concepts into working systems 167-minute deep dive, and one of the clearest ways to understand how AI engineering is moving beyond prompts The progression: Prompt → Context → Memory → Agent → Loop → Graph → Agent Harness Watch it today, then read the full roadmap below
2:47:42

Ex-Google engineer just compressed the shift from AI agents to "graphs" and "loops" into one 2h47m lecture: • 00:00 - understanding the different layers of AI memory • 30:00 - moving from simple LLM calls to AI agents • 50:00 - why agent systems are becoming a graph engineering problem • 1:12:00 - connecting context, tools and agent state • 1:24:00 - building a minimal agent harness from scratch • 1:46:00 - breaking down the architecture behind Hermes Agent • 2:08:00 - turning agent concepts into working systems 167-minute deep dive, and one of the clearest ways to understand how AI engineering is moving beyond prompts The progression: Prompt → Context → Memory → Agent → Loop → Graph → Agent Harness Watch it today, then read the full roadmap below

Morlex

51,952 görüntüleme • 1 ay önce

We're unlocking next-level AI capabilities with the launch of our Retrieval Augmentation Generation (RAG) architecture! 🌟 By integrating a sophisticated information retrieval system, RAG empowers our Large Language Model (LLM), Qwen, with an extra layer of context, allowing it to access industry-specific insights or a company's proprietary data on demand. At the heart of RAG's knowledgebase lies the Vector Engine – a powerhouse of semantic recall ensuring all data is meticulously preserved and readily accessible. Plus, with Alibaba Cloud's suite of vector database solutions, we're at the forefront of augmented data retrieval, offering unprecedented precision and speed. Get ready to transform your data strategy with RAG! #AlibabaCloud #AI #Innovation #DataStrategy #VectorEngine #RAG #AIandBigDataSummit2024 #AIForward
0:22

We're unlocking next-level AI capabilities with the launch of our Retrieval Augmentation Generation (RAG) architecture! 🌟 By integrating a sophisticated information retrieval system, RAG empowers our Large Language Model (LLM), Qwen, with an extra layer of context, allowing it to access industry-specific insights or a company's proprietary data on demand. At the heart of RAG's knowledgebase lies the Vector Engine – a powerhouse of semantic recall ensuring all data is meticulously preserved and readily accessible. Plus, with Alibaba Cloud's suite of vector database solutions, we're at the forefront of augmented data retrieval, offering unprecedented precision and speed. Get ready to transform your data strategy with RAG! #AlibabaCloud #AI #Innovation #DataStrategy #VectorEngine #RAG #AIandBigDataSummit2024 #AIForward

Alibaba Cloud

9,636,416 görüntüleme • 2 yıl önce

Andrew Ng just released a 1-hour course on what comes after RAG. How to turn raw documents into agent memory: 00:00 - Why larger context windows are not enough 02:18 - Extract entities, relationships, and sources 14:31 - Coordinate specialized agents inside one graph 30:43 - Build it with Google ADK and Neo4j 47:25 - Turn knowledge graphs into persistent memory Most people are still learning RAG. Andrew Ng is already teaching the layer that comes after it. Documents → Entities → Relationships → Agents → Knowledge Graph More context is the old workflow. Persistent graphs are the new memory layer. This 1-hour watch is worth more than most paid GraphRAG courses. Bookmark and watch it today Then read the full graph engineering roadmap below
1:00:53

Andrew Ng just released a 1-hour course on what comes after RAG. How to turn raw documents into agent memory: 00:00 - Why larger context windows are not enough 02:18 - Extract entities, relationships, and sources 14:31 - Coordinate specialized agents inside one graph 30:43 - Build it with Google ADK and Neo4j 47:25 - Turn knowledge graphs into persistent memory Most people are still learning RAG. Andrew Ng is already teaching the layer that comes after it. Documents → Entities → Relationships → Agents → Knowledge Graph More context is the old workflow. Persistent graphs are the new memory layer. This 1-hour watch is worth more than most paid GraphRAG courses. Bookmark and watch it today Then read the full graph engineering roadmap below

Lunar

42,118 görüntüleme • 2 ay önce

Our new short course, Knowledge Graphs for RAG, is now available! Knowledge graphs are a data structure that is great at capturing complex relationships between data of multiple types. By enabling more sophisticated retrieval of text than similarity search alone, knowledge graphs can improve the context you pass to the LLM and the performance of your RAG applications. In this course, taught by Andreas Kollegger of Neo4j, you’ll - Explore how knowledge graphs work by building a graph of public financial documents from scratch - Learn to write queries that retrieve text and data from the graph and use it to enhance the context you pass to an LLM chatbot - Combine a knowledge graph with a question-answer chain to build better RAG-powered chat systems Sign up here!
3:46

Our new short course, Knowledge Graphs for RAG, is now available! Knowledge graphs are a data structure that is great at capturing complex relationships between data of multiple types. By enabling more sophisticated retrieval of text than similarity search alone, knowledge graphs can improve the context you pass to the LLM and the performance of your RAG applications. In this course, taught by Andreas Kollegger of Neo4j, you’ll - Explore how knowledge graphs work by building a graph of public financial documents from scratch - Learn to write queries that retrieve text and data from the graph and use it to enhance the context you pass to an LLM chatbot - Combine a knowledge graph with a question-answer chain to build better RAG-powered chat systems Sign up here!

Andrew Ng

244,435 görüntüleme • 2 yıl önce

New short course on advanced retrieval for RAG (retrieval augmented generation)! RAG fetches relevant documents to give context to an LLM. In Advanced Retrieval for AI with Chroma, taught by Chroma founder anton 🇺🇸, you’ll learn: (i) Query expansion using an LLM to rewrite and improve a query, by either generating either additional relevant queries or a hypothetical answer to the query. (ii) Reranking using a cross-encoder - a model trained to measure similarity between two inputs presented simultaneously. Reranking reorders retrieved documents based on the cross-encoder similarity measure. (iii) Constructing and training an Embedding Adaptor, which is a model that adapts the embedding values to be more relevant to your use case. Each of these techniques can help you build much better RAG systems. Please sign up for the course here:
2:36

New short course on advanced retrieval for RAG (retrieval augmented generation)! RAG fetches relevant documents to give context to an LLM. In Advanced Retrieval for AI with Chroma, taught by Chroma founder anton 🇺🇸, you’ll learn: (i) Query expansion using an LLM to rewrite and improve a query, by either generating either additional relevant queries or a hypothetical answer to the query. (ii) Reranking using a cross-encoder - a model trained to measure similarity between two inputs presented simultaneously. Reranking reorders retrieved documents based on the cross-encoder similarity measure. (iii) Constructing and training an Embedding Adaptor, which is a model that adapts the embedding values to be more relevant to your use case. Each of these techniques can help you build much better RAG systems. Please sign up for the course here:

Andrew Ng

191,219 görüntüleme • 2 yıl önce

New short course on Building Applications with Vector Databases, taught by Pinecone’s Tim Tully! At the heart of a vector database is the ability to store a collection of vectors and then query against that, meaning input a new vector and find similar ones. This is useful for many AI applications. In this course, you'll learn how to use vector databases to build: (i) Semantic Search: Create a text search tool that goes beyond keyword matching, and instead focuses on the meaning of content. (ii) RAG (retrieval augmented generation): Enhance your LLM output by incorporating context from sources the model wasn't trained on. (iii) Recommender System: Combine semantic search and RAG to recommend topics, and demonstrate it with a news article recommender. (iv) Hybrid Search: Build an application that finds items using both images and descriptive text -- by combining both sparse and dense vector representations of the data -- using an eCommerce dataset as an example. (v) Image Similarity: Use image vector embeddings to create an app to compare facial features, using a database of public figures to determine the likeness between them. (vi) Anomaly Detection: Build an anomaly detection app that identifies unusual patterns in network communication logs. I hope you’ll enjoy learning how to build all these types of applications! Please sign up here:
2:19

New short course on Building Applications with Vector Databases, taught by Pinecone’s Tim Tully! At the heart of a vector database is the ability to store a collection of vectors and then query against that, meaning input a new vector and find similar ones. This is useful for many AI applications. In this course, you'll learn how to use vector databases to build: (i) Semantic Search: Create a text search tool that goes beyond keyword matching, and instead focuses on the meaning of content. (ii) RAG (retrieval augmented generation): Enhance your LLM output by incorporating context from sources the model wasn't trained on. (iii) Recommender System: Combine semantic search and RAG to recommend topics, and demonstrate it with a news article recommender. (iv) Hybrid Search: Build an application that finds items using both images and descriptive text -- by combining both sparse and dense vector representations of the data -- using an eCommerce dataset as an example. (v) Image Similarity: Use image vector embeddings to create an app to compare facial features, using a database of public figures to determine the likeness between them. (vi) Anomaly Detection: Build an anomaly detection app that identifies unusual patterns in network communication logs. I hope you’ll enjoy learning how to build all these types of applications! Please sign up here:

Andrew Ng

137,169 görüntüleme • 2 yıl önce

Traditional (SQL) databases rely primarily on keyword-based searches to retrieve information. These searches match the exact words or phrases in your query to the text stored in the database. While effective for many applications, this method has limitations when it comes to understanding context or finding relevant information that doesn’t include the exact keywords. Hybrid search combines the strengths of traditional keyword-based BM25 search with the advanced capabilities of semantic search. To effectively implement a hybrid search, a vector database is essential. Vector databases go beyond just words; they understand the meaning behind the data. They transform data such as text, images, or audio into numerical representations called vectors. These vector embeddings enable the database to find similar items, even if they don't share exact keywords. When you integrate hybrid search with Retrieval-Augmented Generation (RAG) systems, you can achieve higher accuracy in retrieved context and better output in generated responses. Learn more about RAG systems in this video with Victoria Slocum:
0:44

Traditional (SQL) databases rely primarily on keyword-based searches to retrieve information. These searches match the exact words or phrases in your query to the text stored in the database. While effective for many applications, this method has limitations when it comes to understanding context or finding relevant information that doesn’t include the exact keywords. Hybrid search combines the strengths of traditional keyword-based BM25 search with the advanced capabilities of semantic search. To effectively implement a hybrid search, a vector database is essential. Vector databases go beyond just words; they understand the meaning behind the data. They transform data such as text, images, or audio into numerical representations called vectors. These vector embeddings enable the database to find similar items, even if they don't share exact keywords. When you integrate hybrid search with Retrieval-Augmented Generation (RAG) systems, you can achieve higher accuracy in retrieved context and better output in generated responses. Learn more about RAG systems in this video with Victoria Slocum:

Femke Plantinga

144,343 görüntüleme • 2 yıl önce

Announcing a new Coursera course: Retrieval Augmented Generation (RAG) You'll learn to build high performance, production-ready RAG systems in this hands-on, in-depth course created by and taught by , experienced AI and ML engineer, researcher, and educator. RAG is a critical component today of many LLM-based applications in customer support, internal company Q&A systems, even many of the leading chatbots that use web search to answer your questions. This course teaches you in-depth how to make RAG work well. LLMs can produce generic or outdated responses, especially when asked specialized questions not covered in its training data. RAG is the most widely used technique for addressing this. It brings in data from new data sources, such as internal documents or recent news, to give the LLM the relevant context to private, recent, or specialized information. This lets it generate more grounded and accurate responses. In this course, you’ll learn to design and implement every part of a RAG system, from retrievers to vector databases to generation to evals. You’ll learn about the fundamental principles behind RAG and how to optimize it at both the component and whole-system levels. As AI evolves, RAG is evolving too. New models can handle longer context windows, reason more effectively, and can be parts of complex agentic workflows. One exciting growth area is Agentic RAG, in which an AI agent at runtime (rather than it being hardcoded at development time) autonomously decides what data to retrieve, and when/how to go deeper. Even with this evolution, access to high-quality data at runtime is essential, which is why RAG is a key part of so many applications. You'll learn via hands-on experiences to: - Build a RAG system with retrieval and prompt augmentation - Compare retrieval methods like BM25, semantic search, and Reciprocal Rank Fusion - Chunk, index, and retrieve documents using a Weaviate vector database and a news dataset - Develop a chatbot, using open-source LLMs hosted by Together AI, for a fictional store that answers product and FAQ questions - Use evals to drive improving reliability, and incorporate multi-modal data RAG is an important foundational technique. Become good at it through this course! Please sign up here:
1:39

Announcing a new Coursera course: Retrieval Augmented Generation (RAG) You'll learn to build high performance, production-ready RAG systems in this hands-on, in-depth course created by and taught by , experienced AI and ML engineer, researcher, and educator. RAG is a critical component today of many LLM-based applications in customer support, internal company Q&A systems, even many of the leading chatbots that use web search to answer your questions. This course teaches you in-depth how to make RAG work well. LLMs can produce generic or outdated responses, especially when asked specialized questions not covered in its training data. RAG is the most widely used technique for addressing this. It brings in data from new data sources, such as internal documents or recent news, to give the LLM the relevant context to private, recent, or specialized information. This lets it generate more grounded and accurate responses. In this course, you’ll learn to design and implement every part of a RAG system, from retrievers to vector databases to generation to evals. You’ll learn about the fundamental principles behind RAG and how to optimize it at both the component and whole-system levels. As AI evolves, RAG is evolving too. New models can handle longer context windows, reason more effectively, and can be parts of complex agentic workflows. One exciting growth area is Agentic RAG, in which an AI agent at runtime (rather than it being hardcoded at development time) autonomously decides what data to retrieve, and when/how to go deeper. Even with this evolution, access to high-quality data at runtime is essential, which is why RAG is a key part of so many applications. You'll learn via hands-on experiences to: - Build a RAG system with retrieval and prompt augmentation - Compare retrieval methods like BM25, semantic search, and Reciprocal Rank Fusion - Chunk, index, and retrieve documents using a Weaviate vector database and a news dataset - Develop a chatbot, using open-source LLMs hosted by Together AI, for a fictional store that answers product and FAQ questions - Use evals to drive improving reliability, and incorporate multi-modal data RAG is an important foundational technique. Become good at it through this course! Please sign up here:

Andrew Ng

124,656 görüntüleme • 1 yıl önce

Verba is an open source Retrieval Augmented Generation (RAG) application that performs RAG on your own data. To showcase its capabilities, we've customized it as an Airbnb chatbot using Airbnb’s customer documentation. How it works: • Ask any questions, related to your booking, policies, or anything related to your Airbnb experience. • Get relevant, human-like responses: Verba provides natural and informative answers. • Access original sources: One of the standout features of RAG is its ability to directly indicate the sources it used to generate each response. Under the hood, Verba uses a RAG pipeline to deliver these exceptional results. Your query is transformed into a numerical representation (vector) and be used to search through our vector database for the most similar context using Hybrid Search. The most relevant context is then combined with your original question and fed into a powerful large language model (LLM). The LLM will then use all of that information to generate a conversational response. Et voilà! 💫 Try Verba: Verba on GitHub: Learn more in our video:
0:43

Verba is an open source Retrieval Augmented Generation (RAG) application that performs RAG on your own data. To showcase its capabilities, we've customized it as an Airbnb chatbot using Airbnb’s customer documentation. How it works: • Ask any questions, related to your booking, policies, or anything related to your Airbnb experience. • Get relevant, human-like responses: Verba provides natural and informative answers. • Access original sources: One of the standout features of RAG is its ability to directly indicate the sources it used to generate each response. Under the hood, Verba uses a RAG pipeline to deliver these exceptional results. Your query is transformed into a numerical representation (vector) and be used to search through our vector database for the most similar context using Hybrid Search. The most relevant context is then combined with your original question and fed into a powerful large language model (LLM). The LLM will then use all of that information to generate a conversational response. Et voilà! 💫 Try Verba: Verba on GitHub: Learn more in our video:

Femke Plantinga

120,565 görüntüleme • 2 yıl önce

New short course: Building Multimodal Search and RAG", by Weaviate AI Database's Sebastia(N_) Witalec ✊🏽✊🏾✊🏿. Contrastive learning is used to train models to map vectors into an embedding space by pulling similar concepts closer together and pushing dissimilar concepts away from each other. This technique is also used to train multimodal embedding models that capture semantic similarity across different modalities like text, images, and audio. These multimodal embeddings can be used to build multimodal search and RAG systems. In this course, you'll learn how contrastive learning works, and how to add multimodality to RAG – so your models can draw on diverse, relevant context to answer questions. For example, a query about a financial report might synthesize information from text snippets, graphs, tables, and slides. You will also learn how visual instruction tuning lets you integrate image understanding into language models, and build a multi-vector recommender system using Weaviate’s open-source vector database. Please sign up here:
3:25

New short course: Building Multimodal Search and RAG", by Weaviate AI Database's Sebastia(N_) Witalec ✊🏽✊🏾✊🏿. Contrastive learning is used to train models to map vectors into an embedding space by pulling similar concepts closer together and pushing dissimilar concepts away from each other. This technique is also used to train multimodal embedding models that capture semantic similarity across different modalities like text, images, and audio. These multimodal embeddings can be used to build multimodal search and RAG systems. In this course, you'll learn how contrastive learning works, and how to add multimodality to RAG – so your models can draw on diverse, relevant context to answer questions. For example, a query about a financial report might synthesize information from text snippets, graphs, tables, and slides. You will also learn how visual instruction tuning lets you integrate image understanding into language models, and build a multi-vector recommender system using Weaviate’s open-source vector database. Please sign up here:

Andrew Ng

104,451 görüntüleme • 2 yıl önce

New short course on sophisticated RAG (Retrieval Augmented Generation) techniques is out! Taught by Jerry Liu and Anupam Datta of LlamaIndex 🦙 and TruEra , this teaches advanced techniques that help your LLM generate good answers. Topics include: - Sentence-window retrieval, which retrieves not just the most relevant sentence, but a window of sentences around it for higher quality context. - Auto-merging retrieval, which organizes your document into a hierarchical tree structure, where each parent node's text is split among its child nodes. Based on the relevance of the child nodes to a user query, this lets you better decide whether the entire parent node should be provided as context to the LLM. - Evaluation methodology for separately evaluating the quality of the key steps of RAG (context relevance, answer relevance, groundedness) so that you can perform error analysis, identify which part of your pipeline needs work, and tune components systematically. Please check out the course!
1:43

New short course on sophisticated RAG (Retrieval Augmented Generation) techniques is out! Taught by Jerry Liu and Anupam Datta of LlamaIndex 🦙 and TruEra , this teaches advanced techniques that help your LLM generate good answers. Topics include: - Sentence-window retrieval, which retrieves not just the most relevant sentence, but a window of sentences around it for higher quality context. - Auto-merging retrieval, which organizes your document into a hierarchical tree structure, where each parent node's text is split among its child nodes. Based on the relevance of the child nodes to a user query, this lets you better decide whether the entire parent node should be provided as context to the LLM. - Evaluation methodology for separately evaluating the quality of the key steps of RAG (context relevance, answer relevance, groundedness) so that you can perform error analysis, identify which part of your pipeline needs work, and tune components systematically. Please check out the course!

Andrew Ng

655,873 görüntüleme • 2 yıl önce

Google Senior Engineer Annie Wang just dropped a free hands-on course on Graph RAG agents, from scratch: Setup → Graph Schema → Embeddings → Hybrid Search (RRF) → ADK Agent → Deploy 0% → 0:00 – a Graph RAG agent with ADK 25% → 13:01 – Build the graph schema and visualize your data 77% → 39:16 – Hybrid search + RRF 84% → 43:05 – Wiring up the ADK agent: runner, session service, memory service 100% → 51:06 – Final demo and deploying the agent with FastAPI This is one of the few guides that walks through real code and architecture, from an empty project to a working agent. Watch it, then build it yourself
51:06

Google Senior Engineer Annie Wang just dropped a free hands-on course on Graph RAG agents, from scratch: Setup → Graph Schema → Embeddings → Hybrid Search (RRF) → ADK Agent → Deploy 0% → 0:00 – a Graph RAG agent with ADK 25% → 13:01 – Build the graph schema and visualize your data 77% → 39:16 – Hybrid search + RRF 84% → 43:05 – Wiring up the ADK agent: runner, session service, memory service 100% → 51:06 – Final demo and deploying the agent with FastAPI This is one of the few guides that walks through real code and architecture, from an empty project to a working agent. Watch it, then build it yourself

Morty

19,059 görüntüleme • 26 gün önce

Google Engineers just showed how their AI engineers are building Context Graphs from 0% to 100%: 10% → 4:01 - how to build a Context Graph 30% → 15:00 - Graph Engineering explanation 55% → 30:00 - Agentic search Engineering 80% → 35:48 - Graph Engineering practice 100% → 47:06 - self-improving agents in graphs 54-minute Google workshop, and it’s one of the clearest hands-on examples of the shift from. Watch it today, then read the full Context Graphs Playbook below.
55:07

Google Engineers just showed how their AI engineers are building Context Graphs from 0% to 100%: 10% → 4:01 - how to build a Context Graph 30% → 15:00 - Graph Engineering explanation 55% → 30:00 - Agentic search Engineering 80% → 35:48 - Graph Engineering practice 100% → 47:06 - self-improving agents in graphs 54-minute Google workshop, and it’s one of the clearest hands-on examples of the shift from. Watch it today, then read the full Context Graphs Playbook below.

Morty

10,451 görüntüleme • 1 ay önce

Tokenization -- turning text into a sequence of integers -- is a key part of generative AI, and most API providers charge per million tokens. How does tokenization work? Learn the details of tokenization and RAG optimization in Retrieval Optimization: From Tokenization to Vector Quantization, created in collaboration with Qdrant and taught by its Developer Relations Lead, Kacper Łukawski. This course focuses on Retrieval augmented generation (RAG), which has two steps: First, a retriever finds relevant information; then, the generator uses what’s retrieved as context to produce a response. You’ll learn to optimize the first step (the retriever) by understanding how tokenization works and how it impacts the relevance of your search. In addition, you will also learn to measure and improve retrieval quality, speed, and memory. In detail, you’ll: - Learn about the internal workings of the embedding models and how your text turns into vectors. - Understand how several tokenizers, such as Byte-Pair Encoding, WordPiece, Unigram, and SentencePiece work. - Explore common challenges with tokenizers, such as unknown tokens, domain-specific identifiers, and numerical values, that can negatively affect your vector search. - Understand how to measure the quality of your search across relevance, ranking, and score-related metrics. - Understand how the main parameters in "HNSW", a graph-based algorithm, affect the relevance and speed of vector search, and how to tune its parameters. - Experiment with the three major quantization methods – product, scalar, and binary – and learn how they impact memory requirements, search quality, and speed. By the end of this course, you’ll have a solid understanding of how tokenization functions and how to optimize vector search in your RAG systems. Please sign up here!
4:10

Tokenization -- turning text into a sequence of integers -- is a key part of generative AI, and most API providers charge per million tokens. How does tokenization work? Learn the details of tokenization and RAG optimization in Retrieval Optimization: From Tokenization to Vector Quantization, created in collaboration with Qdrant and taught by its Developer Relations Lead, Kacper Łukawski. This course focuses on Retrieval augmented generation (RAG), which has two steps: First, a retriever finds relevant information; then, the generator uses what’s retrieved as context to produce a response. You’ll learn to optimize the first step (the retriever) by understanding how tokenization works and how it impacts the relevance of your search. In addition, you will also learn to measure and improve retrieval quality, speed, and memory. In detail, you’ll: - Learn about the internal workings of the embedding models and how your text turns into vectors. - Understand how several tokenizers, such as Byte-Pair Encoding, WordPiece, Unigram, and SentencePiece work. - Explore common challenges with tokenizers, such as unknown tokens, domain-specific identifiers, and numerical values, that can negatively affect your vector search. - Understand how to measure the quality of your search across relevance, ranking, and score-related metrics. - Understand how the main parameters in "HNSW", a graph-based algorithm, affect the relevance and speed of vector search, and how to tune its parameters. - Experiment with the three major quantization methods – product, scalar, and binary – and learn how they impact memory requirements, search quality, and speed. By the end of this course, you’ll have a solid understanding of how tokenization functions and how to optimize vector search in your RAG systems. Please sign up here!

Andrew Ng

146,313 görüntüleme • 2 yıl önce

Ex-Google engineer just released a free 3-hour course on building and monetizing AI agents. How to go from one agent to a full system that finds leads and makes money: 00:00 - Design an AI agent system 07:38 - Add human handoffs 19:27 - Understand RAG and vector databases 52:38 - Deploy agents to Google Cloud 1:25:57 - Turn agents into a paid WhatsApp business 1:33:00 - Convert conversations into leads 2:24:01 - Learn loops vs graphs 2:33:08 - Build a multi-tool agent graph Most people are still building AI demos. This course shows the full stack: Agents → RAG → Deployment → Leads → Revenue Building agents is the old workflow. Monetizing agent systems is the new one. This 3-hour watch covers more than most $500 paid courses. Save it before everyone starts selling the same thing.
2:43:44

Ex-Google engineer just released a free 3-hour course on building and monetizing AI agents. How to go from one agent to a full system that finds leads and makes money: 00:00 - Design an AI agent system 07:38 - Add human handoffs 19:27 - Understand RAG and vector databases 52:38 - Deploy agents to Google Cloud 1:25:57 - Turn agents into a paid WhatsApp business 1:33:00 - Convert conversations into leads 2:24:01 - Learn loops vs graphs 2:33:08 - Build a multi-tool agent graph Most people are still building AI demos. This course shows the full stack: Agents → RAG → Deployment → Leads → Revenue Building agents is the old workflow. Monetizing agent systems is the new one. This 3-hour watch covers more than most $500 paid courses. Save it before everyone starts selling the same thing.

Lunar

353,365 görüntüleme • 2 ay önce

This is, by far, one of the best uses of modern AI. If you don't use embeddings when querying your database, you are definitely leaving a lot on the table. In this video, I'll show you how to run semantic searches using OpenAI and PostgreSQL. It's all thanks to Pgai, an open-source PostgreSQL extension: Here's what will happen: 1. We'll create a simple table with news articles 2. We'll generate embeddings for those articles 3. We'll run queries on top of those embeddings For this video, I generated the embeddings using a simple query, but pgai Vectorizer would do the same automatically as new information makes it into the database. This is awesome! If you have a PostgreSQL database with data you are searching over, you should start experimenting with semantic searches immediately. For most use cases, a combination of full-text search + semantic search is the best approach. If you don't have a PostgreSQL database around, you can try free for 30 days using Timescale: Thanks to the TimescaleDB (by Tiger Data) team for partnering with me on this post!
19:19

This is, by far, one of the best uses of modern AI. If you don't use embeddings when querying your database, you are definitely leaving a lot on the table. In this video, I'll show you how to run semantic searches using OpenAI and PostgreSQL. It's all thanks to Pgai, an open-source PostgreSQL extension: Here's what will happen: 1. We'll create a simple table with news articles 2. We'll generate embeddings for those articles 3. We'll run queries on top of those embeddings For this video, I generated the embeddings using a simple query, but pgai Vectorizer would do the same automatically as new information makes it into the database. This is awesome! If you have a PostgreSQL database with data you are searching over, you should start experimenting with semantic searches immediately. For most use cases, a combination of full-text search + semantic search is the best approach. If you don't have a PostgreSQL database around, you can try free for 30 days using Timescale: Thanks to the TimescaleDB (by Tiger Data) team for partnering with me on this post!

Santiago

110,133 görüntüleme • 1 yıl önce

How do professional RAG applications chunk their text? Let’s cover some Advanced Chunking Techniques. In our latest video, we cover simple chunking methods like splitting documents into sentences or sections. But these methods often miss out on ensuring each chunk has independent meaning. Semantic chunking solved exactly this! By measuring the semantic similarity between sentences using vector embeddings, we can combine similar sentences into meaningful chunks. With LLM-based chunking, large language models help break down text effectively, although it can be slow and costly. And what about the newest Late Chunking? Which keeps context intact across chunks—more on that soon. 👀 In this video, we cover these advanced techniques in detail. Watch it to learn more. A big shoutout to Daniel Williams for helping create this video! 💚
1:18

How do professional RAG applications chunk their text? Let’s cover some Advanced Chunking Techniques. In our latest video, we cover simple chunking methods like splitting documents into sentences or sections. But these methods often miss out on ensuring each chunk has independent meaning. Semantic chunking solved exactly this! By measuring the semantic similarity between sentences using vector embeddings, we can combine similar sentences into meaningful chunks. With LLM-based chunking, large language models help break down text effectively, although it can be slow and costly. And what about the newest Late Chunking? Which keeps context intact across chunks—more on that soon. 👀 In this video, we cover these advanced techniques in detail. Watch it to learn more. A big shoutout to Daniel Williams for helping create this video! 💚

Femke Plantinga

29,675 görüntüleme • 1 yıl önce