johndpjr / AgTern

19 stars 5 forks source link

Migrate database from SQLite to PostgreSQL #148

Open johndpjr opened 11 months ago

johndpjr commented 11 months ago

Context

SQLite is good for a single-file database solution; it won't scale well for our needs since we'll be having multiple webscrapers working at once and we'll need this database to be hosted on some URL somewhere. PostgreSQL is another SQL-based database solution that handles concurrency and scales better than SQLite. We were using SQLAlchemy as a database abstraction layer which allows us to write SQLAlchemy code without having to worry about the underlying implementation (e.g. SQLite, PostgreSQL, etc.).

TODO

Notes

You don't need to set up a remote PostgreSQL instance. A local one will work for now.

johndpjr commented 5 months ago

Waiting for the following things to do before merging: