Edward's banner

Edward

@aestheticedwar1 • 2,306 subscribers

Machine Learning Engineer at @weaviate_io passionate about open source, machine learning and indie games! ✨

Shorts

Our open-source RAG app, Verba, can now run Ollama models locally to embed documents into Weaviate and generate answers without your data leaving your device! I tested it with Llama3, and it works great + super quickly on my M2; In this recording, I'm doing a little Verba-ception, asking Verba what Verba is 🤤 You can also use open-source models like Mistral, Claude, or your own custom LLMs. This will make doing RAG with sensitive data possible since you won't depend on APIs anymore. Looking forward to everyone trying it out 🤗 Update's coming next week!

Our open-source RAG app, Verba, can now run Ollama models locally to embed documents into Weaviate and generate answers without your data leaving your device! I tested it with Llama3, and it works great + super quickly on my M2; In this recording, I'm doing a little Verba-ception, asking Verba what Verba is 🤤 You can also use open-source models like Mistral, Claude, or your own custom LLMs. This will make doing RAG with sensitive data possible since you won't depend on APIs anymore. Looking forward to everyone trying it out 🤗 Update's coming next week!

125,564 Aufrufe