Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Web scraping is a critical skill, and yet nobody talks about it. How do you think companies are training their Large Language Models? Where do you think the data comes from? But web scraping goes beyond all of that. Imagine giving an AI agent access to any public online... data in real time! I like to call this "web-scrapping on demand", and I'm pretty sure it's going to unlock unlimited power for AI applications. I recorded a quick video to show you how you can do this using Apify. I've talked about them before, and they are collaborating with me on this post. They have one of the best open-source web scraping and browser automation libraries out there: But it gets much better than this! You can use MCP to connect your AI Agents and applications to the Apify platform and use any specialized actor on demand to scrape and process online data. In the video, I used Cursor to scrape LinkedIn posts with the words "Machine Learning" in real time. Worked like a charm with no code needed! Here is a link to the platform: Think about this: You can now feed your AI applications with any public data on demand! We aren't ready for what's coming.show more

Santiago

452,377 subscribers

101,473 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & Teknoloji Eğitim

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Tune Studio is an end-to-end platform for developing applications using Large Language Models. So far, I haven't seen any other platform like this one. You can do everything here: 1. You can curate your data. 2. Use the playground to play with different models and try your ideas. 3. Fine-tune an open-source model on your data. 4. Deploy the model when you are done. This is awesome for anyone building generative AI applications. You can use Tune Studio to work with any of the open-source models out there. They were one of the few companies to host Llama 2 and Llama 3 before anyone else. Here is a link to check it out: One of their main selling points is that Tune Studio scales! You don't have to worry about serving your model to lots of users. They also have built-in user management, authentication, on-prem support, user context management, and pretty much everything you need to build generative AI applications. Thanks to the Tune team for collaborating with me on this post. We are living through the best years of development tools for AI developers. The field is unstoppable.

Tune Studio is an end-to-end platform for developing applications using Large Language Models. So far, I haven't seen any other platform like this one. You can do everything here: 1. You can curate your data. 2. Use the playground to play with different models and try your ideas. 3. Fine-tune an open-source model on your data. 4. Deploy the model when you are done. This is awesome for anyone building generative AI applications. You can use Tune Studio to work with any of the open-source models out there. They were one of the few companies to host Llama 2 and Llama 3 before anyone else. Here is a link to check it out: One of their main selling points is that Tune Studio scales! You don't have to worry about serving your model to lots of users. They also have built-in user management, authentication, on-prem support, user context management, and pretty much everything you need to build generative AI applications. Thanks to the Tune team for collaborating with me on this post. We are living through the best years of development tools for AI developers. The field is unstoppable.

Santiago

39,101 görüntüleme • 2 yıl önce

99% of AI applications are cool-looking demos. Impressive, but don't get fooled by the hype. It takes a lot to build enterprise-grade products that deliver real value. I have at least three weekly conversations with companies that want to use a Large Language Model with their data. The demand is huge! Here is one idea about what you can do to help. The use cases that most of these companies want to solve are similar: They have an extensive knowledge base and want to build a simple application that uses that information to answer questions. In other words, they need help building Retrieval Augmented Generation (RAG) applications they can use in many different scenarios: 1. To train new employees 2. To help their support team 3. To search old meetings and documents 4. To help with their research However, building these systems is not straightforward. Yes, there's a lot of information online, but there aren't enough people who know how to create solutions that work. Here is the idea: Today, you can build an enterprise-grade RAG application without writing code. A couple of MIT PhDs with 10+ years of experience building AI applications created . It's a no-code platform for building applications using Large Language Models. They are partnering with me on this post. You can use Stack AI to create, test, and deploy an end-to-end production-ready AI system. It's SOC-2, HIPAA, and GDPR compliant and offers SSO, role management, access control, and on-premise deployments. Of course, you can use the platform with any LLM on the market now. It's the whole nine yards for building AI applications. Check them out here: 2023 was about models. 2024 is about the tools using these models to build production-ready applications. That's where I'd start.

99% of AI applications are cool-looking demos. Impressive, but don't get fooled by the hype. It takes a lot to build enterprise-grade products that deliver real value. I have at least three weekly conversations with companies that want to use a Large Language Model with their data. The demand is huge! Here is one idea about what you can do to help. The use cases that most of these companies want to solve are similar: They have an extensive knowledge base and want to build a simple application that uses that information to answer questions. In other words, they need help building Retrieval Augmented Generation (RAG) applications they can use in many different scenarios: 1. To train new employees 2. To help their support team 3. To search old meetings and documents 4. To help with their research However, building these systems is not straightforward. Yes, there's a lot of information online, but there aren't enough people who know how to create solutions that work. Here is the idea: Today, you can build an enterprise-grade RAG application without writing code. A couple of MIT PhDs with 10+ years of experience building AI applications created . It's a no-code platform for building applications using Large Language Models. They are partnering with me on this post. You can use Stack AI to create, test, and deploy an end-to-end production-ready AI system. It's SOC-2, HIPAA, and GDPR compliant and offers SSO, role management, access control, and on-premise deployments. Of course, you can use the platform with any LLM on the market now. It's the whole nine yards for building AI applications. Check them out here: 2023 was about models. 2024 is about the tools using these models to build production-ready applications. That's where I'd start.

Santiago

197,702 görüntüleme • 2 yıl önce

Forget about HTML, JavaScript, and CSS. You can build AI and data applications using Python alone! Python is the best programming language out there. You can now use it across the stack. Take a look at Taipy, an open-source Python library to build end-to-end production applications. Star their repository: I recorded a quick video showing how to build a simple chat interface to talk to OpenAI GPT-3.5 using Taipy alone. Something important to keep in mind: Taipy's goal is not to replace web developers but to provide an alternative to those who need to build applications without web experience. If you are a data scientist or someone dealing with data, Taipy will simplify your life considerably. Thanks to the team behind Taipy for collaborating with me on this post. Here is a link to the full demo. Download this code and run it. It takes 30 seconds:

Forget about HTML, JavaScript, and CSS. You can build AI and data applications using Python alone! Python is the best programming language out there. You can now use it across the stack. Take a look at Taipy, an open-source Python library to build end-to-end production applications. Star their repository: I recorded a quick video showing how to build a simple chat interface to talk to OpenAI GPT-3.5 using Taipy alone. Something important to keep in mind: Taipy's goal is not to replace web developers but to provide an alternative to those who need to build applications without web experience. If you are a data scientist or someone dealing with data, Taipy will simplify your life considerably. Thanks to the team behind Taipy for collaborating with me on this post. Here is a link to the full demo. Download this code and run it. It takes 30 seconds:

Santiago

233,897 görüntüleme • 2 yıl önce

Building with AI gets easier every day. Here is an open-source library that makes integrating AI into an application extremely easy: Star the repository! This library alone can make React the best front-end framework out there! There are a bunch of cool things I like about CopilotKit. Here are 3 of them: 1. It allows you to take any -powered agent and bring it into your application. (This is a brand-new feature!) 2. You can build an AI-powered chatbot in your application. The chatbot will have access to your context and can act on the application. 3. You can build a RAG workflow to process and answer questions from a real-time knowledge base. I recorded a video to show you how simple it is to make some of this happen. A few lines of code, and you are in business. Here is a link to the sample application: CopilotKit is open-source. You can self-host it. You can use it with any LLM. Thanks to the team for showing me their tool and collaborating with me on this post!

Santiago

108,835 görüntüleme • 2 yıl önce

This is how you can get programmatic access to any website. You need two things: 1. The URL of the website 2. A prompt specifying what you want to do on the site Mino is a neat platform that uses browser automation and AI-powered navigation to understand your prompt, open the website, and extract the information you want. This opens the doors to unlimited potential automations you could build using data from everyday websites that don't give you an API. Mino uses AI to go way further than you could get by using a regular web scraping tool: • It can handle dynamic JavaScript content • It can handle login walls • It can navigate through interactive booking flows • It adapts to different interfaces and layout changes • It can fill out forms automatically • It supports stealth browser mode In my experience, running Mino on relatively straightforward sites takes about 30-60 seconds to complete. The more times you run it, the faster it gets. I recorded a quick video to show you the platform. You can check their site here: Thanks to the team for the support, onboarding me on their platform, and the collaboration on this post.

This is how you can get programmatic access to any website. You need two things: 1. The URL of the website 2. A prompt specifying what you want to do on the site Mino is a neat platform that uses browser automation and AI-powered navigation to understand your prompt, open the website, and extract the information you want. This opens the doors to unlimited potential automations you could build using data from everyday websites that don't give you an API. Mino uses AI to go way further than you could get by using a regular web scraping tool: • It can handle dynamic JavaScript content • It can handle login walls • It can navigate through interactive booking flows • It adapts to different interfaces and layout changes • It can fill out forms automatically • It supports stealth browser mode In my experience, running Mino on relatively straightforward sites takes about 30-60 seconds to complete. The more times you run it, the faster it gets. I recorded a quick video to show you the platform. You can check their site here: Thanks to the team for the support, onboarding me on their platform, and the collaboration on this post.

Santiago

31,742 görüntüleme • 7 ay önce

Today we're launching Amplitude MCP MCP was made for data analytics. Ask a vague question and have an AI model iteratively query Amplitude to find you insights. Amplitude MCP exposes all of Amplitude's functionality so an agent can interact with it directly. It allows you to use Amplitude without having to know anything about Amplitude's user interface or your data taxonomy. It uses the intelligence of off the shelf AI agents, including Claude, Gemini, and Cursor, to query Amplitude data you already have to find answers. It leverages all of your existing Amplitude data and how it's used to navigate through large complex behavioral datasets. You can have conversations about your product data directly inside any AI model with MCP. It can create Amplitude dashboards and notebooks with what it finds and even make recommendations. This is the best MCP use case I've ever seen. Watching an AI agent think, reason, query Amplitude, and then repeat that process iteratively is magical. See it in action:

Today we're launching Amplitude MCP MCP was made for data analytics. Ask a vague question and have an AI model iteratively query Amplitude to find you insights. Amplitude MCP exposes all of Amplitude's functionality so an agent can interact with it directly. It allows you to use Amplitude without having to know anything about Amplitude's user interface or your data taxonomy. It uses the intelligence of off the shelf AI agents, including Claude, Gemini, and Cursor, to query Amplitude data you already have to find answers. It leverages all of your existing Amplitude data and how it's used to navigate through large complex behavioral datasets. You can have conversations about your product data directly inside any AI model with MCP. It can create Amplitude dashboards and notebooks with what it finds and even make recommendations. This is the best MCP use case I've ever seen. Watching an AI agent think, reason, query Amplitude, and then repeat that process iteratively is magical. See it in action:

Spenser Skates

32,332 görüntüleme • 9 ay önce

This makes the future way closer than you think. Director AI automates any tasks you can do in a browser. It interacts with web pages just like a person would. If you could use a browser to complete a task, you can have this AI do it for you. And it's free! Watch the video:

This makes the future way closer than you think. Director AI automates any tasks you can do in a browser. It interacts with web pages just like a person would. If you could use a browser to complete a task, you can have this AI do it for you. And it's free! Watch the video:

Santiago

36,273 görüntüleme • 1 yıl önce

Your AI agents become far more powerful when they can scrape the web but most people don't know how to set it up properly... well, in this 23 min video, i teach you everything you need to know about web scraping

Your AI agents become far more powerful when they can scrape the web but most people don't know how to set it up properly... well, in this 23 min video, i teach you everything you need to know about web scraping

David Ondrej

80,841 görüntüleme • 6 ay önce

Knowledge graphs for representing information are unbeatable. After this, you will never build a RAG system without knowledge graphs. It will take you five lines of code to build a knowledge graph with your data. I recorded a video to show you how you can do this. I used Cognee, an open-source library that outperforms any basic vector search approach in terms of retrieval relevance. They are collaborating with me on this post. Cognee is: • Easy to use • Reduces hallucinations • Open-source Here is a link to the repository: They also offer a comprehensive platform and UI with Python notebooks you can utilize to manage your data. Here is the link:

Knowledge graphs for representing information are unbeatable. After this, you will never build a RAG system without knowledge graphs. It will take you five lines of code to build a knowledge graph with your data. I recorded a video to show you how you can do this. I used Cognee, an open-source library that outperforms any basic vector search approach in terms of retrieval relevance. They are collaborating with me on this post. Cognee is: • Easy to use • Reduces hallucinations • Open-source Here is a link to the repository: They also offer a comprehensive platform and UI with Python notebooks you can utilize to manage your data. Here is the link:

Santiago

126,337 görüntüleme • 10 ay önce

108 workflow templates you can use to build AI applications without writing any code. You can use these templates with n8n. I recorded the attached video to show you how it works. n8n is the workhorse behind an open-source, self-hosted AI starter kit you can install on your computer. They are sponsoring this post. Here is the link to the starter kit repository: And here is the spreadsheet with the 108 templates: Whatever idea you have, search for something similar in the list of templates, and you'll save a ton of time. Lately, I've talked to many non-coders who want to start using AI more seriously to build things. n8n is perfect for that.

108 workflow templates you can use to build AI applications without writing any code. You can use these templates with n8n. I recorded the attached video to show you how it works. n8n is the workhorse behind an open-source, self-hosted AI starter kit you can install on your computer. They are sponsoring this post. Here is the link to the starter kit repository: And here is the spreadsheet with the 108 templates: Whatever idea you have, search for something similar in the list of templates, and you'll save a ton of time. Lately, I've talked to many non-coders who want to start using AI more seriously to build things. n8n is perfect for that.

Santiago

78,133 görüntüleme • 1 yıl önce

Python is the best language in the world. Today, you can build AI and data applications using Python alone! No HTML or JavaScript necessary. Take a look at Taipy, an open-source Python library to build end-to-end production applications. Star their repository: I recorded a quick video showing how to build a simple chat interface to talk to OpenAI GPT-3.5 using Taipy alone. Something important to keep in mind: Taipy's goal is not to replace web developers but to provide an alternative to those who need to build applications without web experience. If you are a data scientist or someone dealing with data, Taipy will simplify your life considerably. Thanks to the team behind Taipy for collaborating with me on this post. Here is a link to the full demo. Download this code and run it. It takes 30 seconds:

Python is the best language in the world. Today, you can build AI and data applications using Python alone! No HTML or JavaScript necessary. Take a look at Taipy, an open-source Python library to build end-to-end production applications. Star their repository: I recorded a quick video showing how to build a simple chat interface to talk to OpenAI GPT-3.5 using Taipy alone. Something important to keep in mind: Taipy's goal is not to replace web developers but to provide an alternative to those who need to build applications without web experience. If you are a data scientist or someone dealing with data, Taipy will simplify your life considerably. Thanks to the team behind Taipy for collaborating with me on this post. Here is a link to the full demo. Download this code and run it. It takes 30 seconds:

Santiago

359,020 görüntüleme • 2 yıl önce

Everyone is building RAG applications, but nobody is talking about the data these systems use. You are delusional if you think clients will have their data sitting in a folder waiting for you to process it. Data is everywhere: in Google Drive, Dropbox, S3, Gmail, Slack, you name it. And, of course, no sane developer wants to build connections to every one of these systems. This would be suicide. I'm working with Ragie, and they released Ragie Connect to solve this problem. First, their RAG system is top-notch (they have published how they do on several RAG benchmarks), and with Connect, they made it very simple to integrate client data without having to write any code. (Well, in reality, you still have to write a few lines, but it's minimal.) Instead of developing one-off integrations for Drive, Dropbox, etc, you can use Connect to integrate with all of them and let Ragie handle authentication, authorization, and automatic data synchronization. This is a huge time saver!

Everyone is building RAG applications, but nobody is talking about the data these systems use. You are delusional if you think clients will have their data sitting in a folder waiting for you to process it. Data is everywhere: in Google Drive, Dropbox, S3, Gmail, Slack, you name it. And, of course, no sane developer wants to build connections to every one of these systems. This would be suicide. I'm working with Ragie, and they released Ragie Connect to solve this problem. First, their RAG system is top-notch (they have published how they do on several RAG benchmarks), and with Connect, they made it very simple to integrate client data without having to write any code. (Well, in reality, you still have to write a few lines, but it's minimal.) Instead of developing one-off integrations for Drive, Dropbox, etc, you can use Connect to integrate with all of them and let Ragie handle authentication, authorization, and automatic data synchronization. This is a huge time saver!

Santiago

72,996 görüntüleme • 1 yıl önce

Claude Code can parse the whole Internet using Apify actors. And with MCP connectors, you can talk to servers and have your agents perform operations behind paywalls. Example (see the video here): Analyze a YouTube video and write the summary in a Notion page. Another example: Scrape the school calendar and automatically add the events to your Google Calendar. You can do all of this using Claude Code + Apify Skills. Setting this up takes a few seconds: • Open your Apify settings > API & Integrations • Connect your tool (Notion, Google Calendar, ...) • Authorize once Your actors will now have direct read and write access to those services. Here is a blog post with an explanation of how MCP connectors work in Apify: Thanks to the Apify team for partnering with me on this post.

Claude Code can parse the whole Internet using Apify actors. And with MCP connectors, you can talk to servers and have your agents perform operations behind paywalls. Example (see the video here): Analyze a YouTube video and write the summary in a Notion page. Another example: Scrape the school calendar and automatically add the events to your Google Calendar. You can do all of this using Claude Code + Apify Skills. Setting this up takes a few seconds: • Open your Apify settings > API & Integrations • Connect your tool (Notion, Google Calendar, ...) • Authorize once Your actors will now have direct read and write access to those services. Here is a blog post with an explanation of how MCP connectors work in Apify: Thanks to the Apify team for partnering with me on this post.

Santiago

19,783 görüntüleme • 1 ay önce

Zerve has been the best platform for writing data science code for a while. It's 100x better than Jupyter notebooks. Now, they have a specialized, fine-tuned AI assistant who knows all about data science code and how to use the platform. This is a killer feature. A generalist model will never be better than a specialized one. Watch the video. I promise you'll be jealous in 3 minutes. Some other features, in case you've never used Zerve: 1. It's web-based 2. You can share and work with your team on the same canvas 3. You can deploy your code with a click 4. Blocks are the center of attention. Promotes code modularity 5. You can combine multiple languages in a single canvas 6. You can run code blocks in parallel Zerve organizes your code as a DAG. Each block inherits the state of every block before it. Everything runs in a serverless architecture. By the way, you can use Zerve for FREE. Visit this link: Thanks to the team for partnering with me on this post.

Zerve has been the best platform for writing data science code for a while. It's 100x better than Jupyter notebooks. Now, they have a specialized, fine-tuned AI assistant who knows all about data science code and how to use the platform. This is a killer feature. A generalist model will never be better than a specialized one. Watch the video. I promise you'll be jealous in 3 minutes. Some other features, in case you've never used Zerve: 1. It's web-based 2. You can share and work with your team on the same canvas 3. You can deploy your code with a click 4. Blocks are the center of attention. Promotes code modularity 5. You can combine multiple languages in a single canvas 6. You can run code blocks in parallel Zerve organizes your code as a DAG. Each block inherits the state of every block before it. Everything runs in a serverless architecture. By the way, you can use Zerve for FREE. Visit this link: Thanks to the team for partnering with me on this post.

Santiago

27,942 görüntüleme • 1 yıl önce

English is the most powerful language in the world. MongoDB just added support for MCP, and literally anyone can now query data without knowing anything about databases. If you know English, you are all set. I recorded a quick video to show you how I connect to a sample Airbnb database and run different queries: • How many listings? • How many listings in the US? • What's the list of countries in these listings? It takes 10 seconds to configure Claude, Cursor, WindSurf, or any other AI assistant to connect to MongoDB's MCP Server. By the way, the server supports much more than queries: • You can explore your collections • You can fetch schema information • You can generate app code snippets • You can manage your databases • You can handle cluster/user/admin tasks Here is a link to the MCP server GitHub repository: This is huge for developers. It's even bigger for non-developers. Thanks to the MongoDB team for collaborating with me on this post.

English is the most powerful language in the world. MongoDB just added support for MCP, and literally anyone can now query data without knowing anything about databases. If you know English, you are all set. I recorded a quick video to show you how I connect to a sample Airbnb database and run different queries: • How many listings? • How many listings in the US? • What's the list of countries in these listings? It takes 10 seconds to configure Claude, Cursor, WindSurf, or any other AI assistant to connect to MongoDB's MCP Server. By the way, the server supports much more than queries: • You can explore your collections • You can fetch schema information • You can generate app code snippets • You can manage your databases • You can handle cluster/user/admin tasks Here is a link to the MCP server GitHub repository: This is huge for developers. It's even bigger for non-developers. Thanks to the MongoDB team for collaborating with me on this post.

Santiago

44,842 görüntüleme • 1 yıl önce

How is the Web changing due to AI? This visit to TinyFish yesterday goes deeply into just how. TinyFish makes a new kind of web browser. One that is started virtually. It is like a Google Chrome in the cloud. But it is very smart, can read and use any website, and your AI agents can talk to it. Here we talk about what it all means for business and the future of robots, brain computer interfaces, and AI glasses. It lets you build systems that can look at MANY websites at the same time and build new kinds of apps to do all sorts of new things.

How is the Web changing due to AI? This visit to TinyFish yesterday goes deeply into just how. TinyFish makes a new kind of web browser. One that is started virtually. It is like a Google Chrome in the cloud. But it is very smart, can read and use any website, and your AI agents can talk to it. Here we talk about what it all means for business and the future of robots, brain computer interfaces, and AI glasses. It lets you build systems that can look at MANY websites at the same time and build new kinds of apps to do all sorts of new things.

Robert Scoble

16,341 görüntüleme • 7 ay önce

Postman is going all-in on AI! Their AI Agent Builder is live (and it's pretty powerful!) Postman's API Network has 100,000+ APIs and they just released a suite of tools for building AI Agents that can automatically discover and connect to any of these APIs. Think about it for a second: You can now build an AI agent that searches the network, discovers an API, processes its documentation, connects to it, and evaluates whether everything worked at the end of the process. This is a huge deal. Every person I know uses the Postman client to work with APIs. Now, they will have access to the AI Agent Builder, a complete suite for designing, building, testing, and deploying agents. I've built a few simple agents myself, and it's tough. The ability to discover and use an API automatically is really exciting (and a huge time saver if it works as promised!) In collaboration with the Postman team, who is sponsoring this post, I recorded a video with my thoughts about the Postman AI Agent Builder.

Postman is going all-in on AI! Their AI Agent Builder is live (and it's pretty powerful!) Postman's API Network has 100,000+ APIs and they just released a suite of tools for building AI Agents that can automatically discover and connect to any of these APIs. Think about it for a second: You can now build an AI agent that searches the network, discovers an API, processes its documentation, connects to it, and evaluates whether everything worked at the end of the process. This is a huge deal. Every person I know uses the Postman client to work with APIs. Now, they will have access to the AI Agent Builder, a complete suite for designing, building, testing, and deploying agents. I've built a few simple agents myself, and it's tough. The ability to discover and use an API automatically is really exciting (and a huge time saver if it works as promised!) In collaboration with the Postman team, who is sponsoring this post, I recorded a video with my thoughts about the Postman AI Agent Builder.

Santiago

230,594 görüntüleme • 1 yıl önce

Here is how you can install an open-source, enterprise-grade RAG system on your server (with the best document understanding I've seen.) First, something obvious to anyone trying to sell RAG in the market: You are crazy if you think companies will let their data travel to a hosted model. No one wants to send their data anywhere (those who do haven't found an alternative.) Every single company would rather have an air-gapped system with no internet access. GroundX is an open-source RAG system that you can run on your servers (or any cloud provider, as long as you have access to GPUs) and works without a network. (If the military wants to do RAG, this is precisely what they will be looking for.) I installed GroundX on my AWS account and recorded a video to show you how to use it. There are two services you can use: 1. Ingest: This service uses a pretrained vision model to ingest and understand your knowledge base. 2. Search: This service combines text and vector search with a fine-tuned re-ranker model to retrieve information from your knowledge base. A quick note about the Ingest service: 99% of people think they need better "retrieval" mechanisms. I think they need better "ingestion." That's where this service comes in! Ingest "understands" your documents in a way I haven't seen before. After you try it, you'll realize why showing your LLM your raw documents is a bad idea. In the video, I use a free tool called X-Ray to test a document and understand how the Ingest service breaks it down. You can access this tool by signing up for a free GroundX cloud account and uploading your documents. You'll see a bit more about this in the video.

Here is how you can install an open-source, enterprise-grade RAG system on your server (with the best document understanding I've seen.) First, something obvious to anyone trying to sell RAG in the market: You are crazy if you think companies will let their data travel to a hosted model. No one wants to send their data anywhere (those who do haven't found an alternative.) Every single company would rather have an air-gapped system with no internet access. GroundX is an open-source RAG system that you can run on your servers (or any cloud provider, as long as you have access to GPUs) and works without a network. (If the military wants to do RAG, this is precisely what they will be looking for.) I installed GroundX on my AWS account and recorded a video to show you how to use it. There are two services you can use: 1. Ingest: This service uses a pretrained vision model to ingest and understand your knowledge base. 2. Search: This service combines text and vector search with a fine-tuned re-ranker model to retrieve information from your knowledge base. A quick note about the Ingest service: 99% of people think they need better "retrieval" mechanisms. I think they need better "ingestion." That's where this service comes in! Ingest "understands" your documents in a way I haven't seen before. After you try it, you'll realize why showing your LLM your raw documents is a bad idea. In the video, I use a free tool called X-Ray to test a document and understand how the Ingest service breaks it down. You can access this tool by signing up for a free GroundX cloud account and uploading your documents. You'll see a bit more about this in the video.

Santiago

89,664 görüntüleme • 1 yıl önce

🔥 Introducing Firecrawl /search. Firecrawl just launched an insane feature to search and crawl in one shot. You heard that right! One API call to search the web and scrape any data you need for your AI agents. I took it for a spin in n8n:

🔥 Introducing Firecrawl /search. Firecrawl just launched an insane feature to search and crawl in one shot. You heard that right! One API call to search the web and scrape any data you need for your AI agents. I took it for a spin in n8n:

elvis

42,656 görüntüleme • 1 yıl önce