Ouranosinc / miranda

A modern Python utility library for climate data collection and management
Apache License 2.0
17 stars 2 forks source link

Refactor `DataBase` class and `archive`/`remote` modules #140

Open Zeitsperre opened 1 year ago

Zeitsperre commented 1 year ago

Proposal

There is a very old and unmaintained DataBase-related class (miranda.data) used for interacting with remote servers. This functionality is only useful when combined with miranda.archive and miranda.remote to perform actions such as ensuring that adequate space is available before transferring data. Unfortunately, a significant effort is needed to bring up the quality and usability of these classes/functions.

Approach

These modules and classes need to be completely refactored and documented. The idea behind this section of Miranda is to facilitate an easier approach to archiving obsolete data for long-term storage. An ideal approach to archiving (as Miranda are presently organized) would be as follows:

The current approach clearly does not make this obvious. There should be a regrouping of function and utilities. There may even potential for moving some functions to the miranda.io module.