onemoredata / bagger

Massive log storage in PostgreSQL
BSD 2-Clause "Simplified" License
9 stars 0 forks source link

Storage agent, part 1 #102

Closed einhverfr closed 3 months ago

einhverfr commented 7 months ago

The Storage Agent is going to be a significant piece of code. In order to minimize the reviewability problems, this PR will be broken up into smaller steps. This is step 1.

At this step, the storage_agent concept code is written and the code to allow logical replication from the KVStore (of whatever implimentation) to Postgres has been created. Review here should focus on conceptual, coding, and design issues. Tests have not been written yet because of the scope of the challenges involved.

The current plan is for the next PR to include Schaufel configuration and state management, and for logical replication and schaufel actions to be tested at that point with appropriate mocks in place.