Closed morph-dev closed 4 months ago
I'm was waiting with merging until we observe some metrics while running this on some machines.
Here are the observations, from 35GB (trin-nyc1-11
) and 10GB (kolby-nyc1-5
) databases:
however, single pruning takes 0.5-1 sec in most of the cases on 35GB (0.1-0.3 sec on 10GB) and sometimes (rarely) even longer
Let's discuss this in today's meeting.
What was wrong?
The history storage still uses
LegacyHistoryStore
. This will migrate it toIdIndexedV1Store
.How was it fixed?
Change to the
IdIndexedV1Store
implementation.On the startup, this will perform the migration which can take few minutes (depending on the db size):
Remaining tasks for future PR-s:
LegacyHistoryStore
and related code, but leave migration codeTo-Do