We want to implement a new functionality / behavior to store data in metacatalog.
Essentially, each Entry with a datasource saves its data to its own SQL table, the name of the table can be specified in Datasource.path and could default to something like f"{variable_name}_{entry_id}".
Important / TODO:
[x] can pandas.DataFrame.to_sql write to specific schemas? -> _Yes! .to_sql(schema='data')_
[ ] Datasource.data_names still working? What do we have to change?
[ ] DB revision: create new schema data
[ ] We should make these changes additive and make sure that our current approach still works (e.g. one table for all timeseries data)
We want to implement a new functionality / behavior to store data in metacatalog.
Essentially, each Entry with a datasource saves its data to its own SQL table, the name of the table can be specified in
Datasource.pathand could default to something likef"{variable_name}_{entry_id}".Important / TODO:
pandas.DataFrame.to_sqlwrite to specific schemas? -> _Yes!.to_sql(schema='data')_Datasource.data_namesstill working? What do we have to change?datatimeseriesdata)