EIDF upload - Githubissues

Battery-Intelligence-Lab / galv

An open-source platform for automated storage of battery data with advanced metadata support

https://battery-intelligence-lab.github.io/galv/

Other

33 stars 8 forks source link

EIDF upload #33

Open mjaquiery opened 1 year ago

mjaquiery commented 1 year ago

To send data to the EIDF, Galvanalyser needs to:

[x] monitor battery data directories
[x] extract file and dataset metadata
[x] allow metadata to be checked and edited by authorised users
[ ] send raw files and metadata to 3rd parties (i.e. the EIDF's CKAN ingestion service)

This will require:

[ ] Authenticating with EIDF CKAN
[ ] Implementing the EIDF CKAN ingestion API
[ ] Providing users an action button to perform uploading
[ ] Tracking upload status and reporting it to users (e.g. EIDF CKAN record uid)

See left side of restructure

martinjrobins commented 1 year ago

so a user can upload to EIDF even before the data has been imported into their galvanalyser dbase? Since you only need the raw file....

mjaquiery commented 1 year ago

Yes, theoretically. There was some discussion on whether files processed with Galvanalyser should also upload processed data to the EIDF. Currently, provided the metadata are processed and the dataset created, the metadata can be completed by the user and the metadata + raw files would be sent to EIDF.

Still working on how to get the raw files to EIDF given they never reach Galvanalyser (perhaps an instruction to the Harvester to send the file with appropriate metadata?).