pragunbhutani / dbt-llm-tools

RAG based LLM chatbot for dbt projects
Other
60 stars 14 forks source link

Add more storage options for persisting the model directory #12

Open pragunbhutani opened 6 months ago

pragunbhutani commented 6 months ago

Currently the model directory is stored in a local json file. To make it easier to take ragstar to production, we should add the ability to use a database as a backend - I haven't yet made my mind up whether this should be a sql or no-sql backend.

What would we like to store in this db?

  1. Project directory created by DbtProject.parse(). At first thought, a no-sql db might be the easiest transition since we're using a json file at the moment but not sure if that'll come back to bite us in the long run.
  2. Questions asked and answers offered