storj / team-metainfo

GNU Affero General Public License v3.0
0 stars 0 forks source link

Research potential implementations for soft deletion #111

Open mniewrzal opened 2 years ago

mniewrzal commented 2 years ago

The current way how we are deleting objects and segments looks to be problematic. Before server-side copy we were only deleting objects and segments from metabase. Now we are also processing relation ancestor - copy and in case of deleting ancestor we are looking which object copy should become new ancestor. This is causing DB retries for crdb and deadlocks for postgres. We are thinking about doing soft deleted in a meaning that we will only mark elements to be deleted and separate cleanup process will do that later.

Acceptance criteria:

Fadila82 commented 2 years ago

My notes: https://storjlabs.atlassian.net/wiki/spaces/~231609733/pages/2330656777/Deletion+optimization

storjBuildBot commented 2 years ago

Change https://review.dev.storj.io/c/storj/storj/+/7641 mentions this issue.