search

onemoredata / bagger

Massive log storage in PostgreSQL
BSD 2-Clause "Simplified" License
9 stars 0 forks source link

Add Safety Setting #41

Closed einhverfr closed 8 months ago

einhverfr commented 8 months ago

One issue with the current structures is that they allow partitioning and indexing to be back-defined in the past. This is proper for when systems do not have data but it will fail in production.

I propose two pieces to this:

  1. The settings should also be transmitted out to the cluster management piece and then on to the data nodes
  2. Our tooling should refuse to start if the production setting is not set to 1
  3. If the setting is missing or set to 0, only then can we back-date partitioning.
  4. By default indexes should have the same logic but perhaps after 1.0 we should explore ways to backfill indexes.