matt-lebl / uvic-marketplace

5 stars 0 forks source link

SCA: Implement data sharding #209

Open Broondoon opened 4 months ago

Broondoon commented 4 months ago

Observing Backend's current database schema, implement data sharding to spread what information makes sense to shard across multiple database instances.

Presumably, some logic is needed to either determine when new databases must be spun up to be sharded to, or logic is needed to be notified/discover when new databases are spun up to then shard to.

Broondoon commented 4 months ago

From talking with Matt, this is another "probably won't do" sort of deal, at least, not for Subsprint 2. It would require Kubernetes to be set up already, as both infrastructure changes and Postgres admin config changes are needed to do this. Kubernetes already allows for a good deal of horizontal system scalability, so it'll be fine if our databases do not for this subsprint.

Moving into Subsprint 3.