facebookresearch / hydra

Hydra is a framework for elegantly configuring complex applications
https://hydra.cc
MIT License
8.81k stars 634 forks source link

[Feature Request] Purging older output/working directories #700

Open umvarma opened 4 years ago

umvarma commented 4 years ago

🚀 Feature Request

Purging older Hydra output/working directories based on the specified purging criteria

Motivation

Each Hydra application run creates a output/working directory to store application and hydra outputs for the run. Depending upon the execution frequency, the number of folders created in this fashion may become too many. It would be a great help if Hydra can provide a way to the user to purge older output folders and provide a mechanism to identify and configure what folders need to be purged.

Pitch

Describe the solution you'd like A simple configuration option to specify the number of days and purge files older than the specified number of days after each run is I believe a great solution.

omry commented 4 years ago

Since you are able to fully customize the working directory pattern it's pretty difficult to do. Putting it down as a wishlist.