[FEATURE] Add in RDB (probably Postgres)

whyhow-ai / knowledge-table

Knowledge Table is an open-source package designed to simplify extracting and exploring structured data from unstructured documents.

MIT License

196 stars 25 forks source link

[FEATURE] Add in RDB (probably Postgres) #22

Open tomsmoker opened 5 days ago

tomsmoker commented 5 days ago

What

Add a DB to the project to store each knowledge table.

Why

We currently just store in memory for ease of use. Works fine, but for larger workloads or analytical usecases it would be good to have persistent backend storage.

Implementation guidance

Add DB into dockerfile (probably postgres), add an ORM (probably tortoise) and some migrations (probably alembic).