Loading video...

Video Failed to Load

Go Home

Fully local RAG with Llama 3 on ollama & Streamlit Learn how to: 🦙Run Llama 3 using ollama 📄Add Website & PDFs to a knowledge base 💻Build an AI App using Streamlit 🏬Store chat history in a database PostgreSQL YT:

ashpreetbedi's profile picture

Ashpreet Bedi

20,468 subscribers

70,356 views • 2 years ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.
0:20

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.

Pietro Schirano

310,018 views • 2 years ago

Today, we're building a Streamlit app to compare Alibaba's latest Qwen 3 against DeepSeek-R1 using RAG. Here's our tool stack: - @Llama_Index workflows for orchestration. - Comet Opik for evaluation. - ollama to serve both LLMs locally. Let's begin!
0:29

Today, we're building a Streamlit app to compare Alibaba's latest Qwen 3 against DeepSeek-R1 using RAG. Here's our tool stack: - @Llama_Index workflows for orchestration. - Comet Opik for evaluation. - ollama to serve both LLMs locally. Let's begin!

Avi Chawla

15,473 views • 1 year ago

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):
0:35

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Shubham Saboo

189,778 views • 2 years ago

Drag & Drop to build local chat app with memory using Llama 3.1 without writing a single line of code (100% free and without internet).
1:07

Drag & Drop to build local chat app with memory using Llama 3.1 without writing a single line of code (100% free and without internet).

Shubham Saboo

12,444 views • 2 years ago

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)
15:16

The future of AI is open-source. And ollama is the easiest way to build AI applications with open-source LLMs. Here's how to build a free, private RAG app using open-source tools. We'll use: - Ollama for LLMs and embedding models - PostgreSQL for data storage and retrieval - pgai Vectorizer for embedding creation and sync (I use Nomic for embeddings and tinnyllama as my LLM but you can substitute them for any models on Ollama)

Avthar

34,261 views • 1 year ago

create-llama is now also the easiest way to get started with multi-agents using LlamaIndex 🦙 v0.2 adds multi-agents using LlamaIndex Workflows. Create a multi-agent chat UI like the one below in a single command line! 🖥️ $ npx create-llama 📄
0:29

create-llama is now also the easiest way to get started with multi-agents using LlamaIndex 🦙 v0.2 adds multi-agents using LlamaIndex Workflows. Create a multi-agent chat UI like the one below in a single command line! 🖥️ $ npx create-llama 📄

Marcus Schiesser

48,338 views • 2 years ago

GLM 4.6 in Claude Code to build a python app Took me around 3 mins to make this python app with a Streamlit web ui and llamacpp python bindings The app lets you run an inference via a simple chat interface plus configurable params 👇 (video 4x speed)
0:52

GLM 4.6 in Claude Code to build a python app Took me around 3 mins to make this python app with a Streamlit web ui and llamacpp python bindings The app lets you run an inference via a simple chat interface plus configurable params 👇 (video 4x speed)

Melvin Vivas

21,803 views • 9 months ago

Agentic Website Scraping using Firecrawl: How to Setup Locally? 🔥 Integrate with @LangChainAI LlamaIndex 🦙 🤖 AI Agent Integration PraisonAI 🌐 Set up locally Docker 📊 Data Processing Automation Llama 3 LLM Groq Inc 🔄 Search @yousearchengine Mendable @firecrawl_dev Subscribe: YT:
8:27

Agentic Website Scraping using Firecrawl: How to Setup Locally? 🔥 Integrate with @LangChainAI LlamaIndex 🦙 🤖 AI Agent Integration PraisonAI 🌐 Set up locally Docker 📊 Data Processing Automation Llama 3 LLM Groq Inc 🔄 Search @yousearchengine Mendable @firecrawl_dev Subscribe: YT:

Mervin Praison

20,909 views • 2 years ago

Transforming Invoice Data into JSON: Local LLM with LlamaIndex & Pydantic 🚀 Complete video: Code: I explain how to get structured JSON output with LlamaIndex and dynamic Pydantic class. This helps to implement the use case of data extraction from invoice documents. The solution runs on the local machine, thanks to Ollama. I'm using a MacBook Air M1 with 8GB RAM. LlamaIndex 🦙 Pydantic ollama #Python #LLM #RAG
1:56

Transforming Invoice Data into JSON: Local LLM with LlamaIndex & Pydantic 🚀 Complete video: Code: I explain how to get structured JSON output with LlamaIndex and dynamic Pydantic class. This helps to implement the use case of data extraction from invoice documents. The solution runs on the local machine, thanks to Ollama. I'm using a MacBook Air M1 with 8GB RAM. LlamaIndex 🦙 Pydantic ollama #Python #LLM #RAG

Andrej Baranovskij

147,949 views • 2 years ago

Ready to build a “Chat with your code” application with ollama, Weaviate, and LlamaIndex 🦙 on Lightning AI ⚡️ Studio? We’ve just published a Lightning AI Studio template that you can simply copy. You’ll be up and running with your Retrieval-Augmented Generation (RAG) pipeline in minutes. Jump right in here:
0:25

Ready to build a “Chat with your code” application with ollama, Weaviate, and LlamaIndex 🦙 on Lightning AI ⚡️ Studio? We’ve just published a Lightning AI Studio template that you can simply copy. You’ll be up and running with your Retrieval-Augmented Generation (RAG) pipeline in minutes. Jump right in here:

Weaviate AI Database

12,435 views • 2 years ago

🆕 How to run (and finetune) open source AI models with a simple API! In 5 mins, I go over how to: ◆ Generate text with DeepSeek R1 & Llama 3 ◆ Generate code with Qwen on LlamaCoder ◆ Generate images with Flux on BlinkShot ◆ Finetune a model on your own data & run it
4:44

🆕 How to run (and finetune) open source AI models with a simple API! In 5 mins, I go over how to: ◆ Generate text with DeepSeek R1 & Llama 3 ◆ Generate code with Qwen on LlamaCoder ◆ Generate images with Flux on BlinkShot ◆ Finetune a model on your own data & run it

Hassan

30,236 views • 1 year ago

A Secure AI App Store Garry Tan There is a small window today for a startup to create an AI App Store that provides computer use APIs and local LLaMA versioning with secure privacy controls, discovery, and payments. We hope you might build it.
2:06

A Secure AI App Store Garry Tan There is a small window today for a startup to create an AI App Store that provides computer use APIs and local LLaMA versioning with secure privacy controls, discovery, and payments. We hope you might build it.

Y Combinator

300,533 views • 1 year ago

🚀 Watch how I connected Chrome's AI API to ollama, enabling ANY web app built for Chrome's local Gemini to seamlessly work with open-source LLMs! A🧵on making AI in Chrome more open and flexible...
1:56

🚀 Watch how I connected Chrome's AI API to ollama, enabling ANY web app built for Chrome's local Gemini to seamlessly work with open-source LLMs! A🧵on making AI in Chrome more open and flexible...

Andrei David

94,530 views • 1 year ago

🚀 OpenLLM 0.6 is out providing fast inference speed! Check out our video comparing #OpenLLM and #Ollama handling concurrent requests on the Llama 3 8B model. Ollama is ideal for local LLM deployment, but it is not designed for high concurrency scenarios essential for deployments in the cloud, powering applications with a large number of users. OpenLLM enables you to run any open-source model as OpenAI-compatible endpoints with just a single command. It supports a broad array of models like Llama 3, Mistral, and Qwen 2, including those fine-tuned with proprietary datasets and quantized versions. Ready to speed up your AI deployments? See the OpenLLM repo #BentoML #OpenSource
0:43

🚀 OpenLLM 0.6 is out providing fast inference speed! Check out our video comparing #OpenLLM and #Ollama handling concurrent requests on the Llama 3 8B model. Ollama is ideal for local LLM deployment, but it is not designed for high concurrency scenarios essential for deployments in the cloud, powering applications with a large number of users. OpenLLM enables you to run any open-source model as OpenAI-compatible endpoints with just a single command. It supports a broad array of models like Llama 3, Mistral, and Qwen 2, including those fine-tuned with proprietary datasets and quantized versions. Ready to speed up your AI deployments? See the OpenLLM repo #BentoML #OpenSource

BentoML

18,798 views • 2 years ago

New JavaScript short course: Build a full-stack web application that uses RAG in JavaScript RAG Web Apps with LlamaIndex, taught by Laurie Voss, VP of Developer Relations at LlamaIndex 🦙 and npm co-founder. - Build a RAG application for querying your own data - Develop tools to interact with multiple data sources using an agent that intelligently selects the right tool for your queries - Create a full-stack web app that can chat with your data - Dig further into production-ready techniques, like how to persist your data so you aren’t constantly reindexing, and try the create-llama command line tool from LlamaIndex You can sign up here:
2:47

New JavaScript short course: Build a full-stack web application that uses RAG in JavaScript RAG Web Apps with LlamaIndex, taught by Laurie Voss, VP of Developer Relations at LlamaIndex 🦙 and npm co-founder. - Build a RAG application for querying your own data - Develop tools to interact with multiple data sources using an agent that intelligently selects the right tool for your queries - Create a full-stack web app that can chat with your data - Dig further into production-ready techniques, like how to persist your data so you aren’t constantly reindexing, and try the create-llama command line tool from LlamaIndex You can sign up here:

Andrew Ng

218,703 views • 2 years ago

This is, by far, one of the best uses of modern AI. If you don't use embeddings when querying your database, you are definitely leaving a lot on the table. In this video, I'll show you how to run semantic searches using OpenAI and PostgreSQL. It's all thanks to Pgai, an open-source PostgreSQL extension: Here's what will happen: 1. We'll create a simple table with news articles 2. We'll generate embeddings for those articles 3. We'll run queries on top of those embeddings For this video, I generated the embeddings using a simple query, but pgai Vectorizer would do the same automatically as new information makes it into the database. This is awesome! If you have a PostgreSQL database with data you are searching over, you should start experimenting with semantic searches immediately. For most use cases, a combination of full-text search + semantic search is the best approach. If you don't have a PostgreSQL database around, you can try free for 30 days using Timescale: Thanks to the TimescaleDB (by Tiger Data) team for partnering with me on this post!
19:19

This is, by far, one of the best uses of modern AI. If you don't use embeddings when querying your database, you are definitely leaving a lot on the table. In this video, I'll show you how to run semantic searches using OpenAI and PostgreSQL. It's all thanks to Pgai, an open-source PostgreSQL extension: Here's what will happen: 1. We'll create a simple table with news articles 2. We'll generate embeddings for those articles 3. We'll run queries on top of those embeddings For this video, I generated the embeddings using a simple query, but pgai Vectorizer would do the same automatically as new information makes it into the database. This is awesome! If you have a PostgreSQL database with data you are searching over, you should start experimenting with semantic searches immediately. For most use cases, a combination of full-text search + semantic search is the best approach. If you don't have a PostgreSQL database around, you can try free for 30 days using Timescale: Thanks to the TimescaleDB (by Tiger Data) team for partnering with me on this post!

Santiago

110,133 views • 1 year ago

Built with Meta Llama, FoondaMate is a fast-growing, always-on study aid for students. The flexibility & open ecosystem around Llama is helping the team create a greater impact for the 3 million students already using the tool in emerging markets today ➡️
1:30

Built with Meta Llama, FoondaMate is a fast-growing, always-on study aid for students. The flexibility & open ecosystem around Llama is helping the team create a greater impact for the 3 million students already using the tool in emerging markets today ➡️

AI at Meta

59,323 views • 2 years ago