spine-tools / Spine-Toolbox

Spine Toolbox is an open source Python package to manage data, scenarios and workflows for modelling and simulation. You can have your local workflow, but work as a team through version control and SQL databases.
https://www.tools-for-energy-system-modelling.org/
GNU Lesser General Public License v3.0
68 stars 17 forks source link

Move Data Transformer's functionality into connections #2146

Open soininen opened 1 year ago

soininen commented 1 year ago

Data transformer is quite confusing to use as it doesn't do anything in itself --- it merely modifies database URLs such that the next item to "sees" the transformations. I think moving the functionality into the connections between items would be more logical.

In broad terms, the changes would be:

jkiviluo commented 1 year ago

Not sure about this. While this would be understandable in current situation, we do have a need for a more capable data transformer that performs operations either between DBs or between importer and DB or between DB and exporter.