spine-tools / Spine-Toolbox

Spine Toolbox is an open source Python package to manage data, scenarios and workflows for modelling and simulation. You can have your local workflow, but work as a team through version control and SQL databases.
https://www.tools-for-energy-system-modelling.org/
GNU Lesser General Public License v3.0
72 stars 17 forks source link

Tracking and/or managing project folder or item folder sizes? #480

Open spine-o-bot opened 3 years ago

spine-o-bot commented 3 years ago

In GitLab by @Tasqu on Feb 28, 2020, 12:07

Currently, the size of Spine Toolbox project folders can get quite large (multiple gigabytes) when the project accumulates a lot of results from repeated tool runs. At the moment, it's not very well visible for the user how much disk space their project is occupying, and it would be nice to have at least some very basic tools for this in the toolbox. Some possible ideas include:

  1. Displaying the size of the contents of the project through toolbox somewhere. Maybe for individual items as well?

  2. Being able to set some limit on the size of the project and/or individual items, after which the toolbox shows some warning for the user?

  3. Providing some convenience features for e.g. filtered deletion of results? However, these start to be item specific and not necessarily worth it at this stage.

spine-o-bot commented 3 years ago

In GitLab by @Tasqu on Feb 28, 2020, 12:08

changed title from Tracking and/or managing project folder or {-tool result-} folder sizes? to Tracking and/or managing project folder or {+item+} folder sizes?

spine-o-bot commented 3 years ago

In GitLab by @jkiviluo on Feb 28, 2020, 14:29

It would also be great if one could run on 'persistent' work folders. Most of the time the result history doesn't mean anything and copying the tool would not be needed. Maybe a nice default would be to have persistent work folders until the user presses 'new work folder'. Of course sometimes it can be good to have a new work folder for every run.

spine-o-bot commented 3 years ago

In GitLab by @PekkaSavolainen on Aug 25, 2020, 16:19

assigned to @PekkaSavolainen