Add gc for file storage.

v6d-io / v6d

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

https://v6d.io

Apache License 2.0

818 stars 117 forks source link

Add gc for file storage. #1862

Closed vegetableysm closed 2 months ago

vegetableysm commented 2 months ago

What do these changes do?

Add file storage gc for each client.
Add global storage to scan dir and delete outdated files.
Fix bugs in Update when delete files that do not meet requirements.

Related issue number

Fixes #1861

vegetableysm commented 2 months ago

Could you please add related unit tests?

The test case can assert:

if the file can be correctly deleted

make sure files that doesn't expire won't be deleted

check if global GC work after the process/kv-cache manager restarts.

OK, I'll add it in this pr.