Closed problame closed 1 month ago
This week:
This week, @problame to address his follow-up requests from https://github.com/neondatabase/neon/pull/7867#pullrequestreview-2096797786
This issue was part of
In the end, that work expanded into Q3 and we focussed solely on bottommost compaction.
Bottommost compaction is very deterministic and hence, the existing quantification work in test_gc_feedback
(https://github.com/neondatabase/neon/pull/7867) is sufficient to qualify & quantify it.
Child of 2024Q2 compaction work: https://github.com/neondatabase/neon/issues/8001
This epic tracks the efforts to quantify any compaction algorithm's outcomes.
We had a brainstorming session some time back to come up with an (incomplete) set of potentially useful metrics: https://www.notion.so/neondatabase/Productionize-Tiered-Compaction-eca9b06aa1ae4c62bdf6cf40ab002eb6?pvs=4
Meeting notes / ideas:
(logical size + wal in PITR window)
= synthetic size, can just use thatsum(all layer files in index_part.json)
=> just thatDemo test case to adapt / apply the Python helpers to:
test_gc_feedback