search

phidatahq / phidata

Build AI Agents with memory, knowledge, tools and reasoning. Chat with them using a beautiful Agent UI.
https://docs.phidata.com
Mozilla Public License 2.0
14k stars 1.96k forks source link

How big can the knowledge base be ? #223

Closed aurthurm closed 2 weeks ago

aurthurm commented 5 months ago

I am imagining a case where one might need to:

  1. load 100+ books on a particular topic like medicine
  2. Convert a digital library to RAG Like Library where students search university data.

On your experience with PgVector how much knowledge base can it handle?

chiheb08 commented 5 months ago

Great question, I'm also interested to know how much storage should the knowledge base have? and what is the approximate cost and services for it (using open source LLMs).