codalab / codabench

Codabench is a flexible, easy-to-use and reproducible benchmarking platform. Check our paper at Patterns Cell Press https://hubs.li/Q01fwRWB0
Apache License 2.0
76 stars 28 forks source link

[Feature] Delete orphan files #1523

Closed OhMaley closed 2 months ago

OhMaley commented 4 months ago

A brief description of the purpose of the changes contained in this PR.

This adds a button in the storage view to trigger, after confirmation, the deletion of orphan files in the storage. The list of orphan files are not computed during the process since it is time expensive. Instead is uses the last storage analytics results and its storage_inconsistency log file.

Issues this PR resolves

Related to issue #713

To do once merged

Copy and paste last storage_inconsistency files from /logs folder to /var/logs/ folder. Mind the 's' at the end of 'logs'.

Checklist

Didayolo commented 2 months ago

Merging into the branch codalab/orphan-files-deletion

Didayolo commented 2 months ago

@OhMaley

EDIT: The problem was because I did not copy the logs.

This is required when deploying on prod? Only the first time?


When I refresh the "Analytics" page, I get this error message:

Capture d’écran 2024-09-02 à 19 17 24

I am not seeing related logs in the containers.