[FEAT] Backend / Data access API

[charlottegiseleweil]

API in dev by miguel.peon@epfl.ch - should get access by the end of July

Sample data attached in the meantime~ Data_sites_A.zip C1_water_level.csv B_Temp_080424_190624.xlsx

Can EML provide Data Dictionary (units etc) ?

[charlottegiseleweil]

Hi @RizlanBL ! Any updates on the backend data access from Miguel? Kindly

[charlottegiseleweil]

Dear @RizlanBL and @AnderssonDan-epfl,

We met yesterday with Xavier and Miguel about the data access. They clarified that they cannot take care of the full back-end for us, for security reasons, and the DB is not ready yet anyway.

Here's the proposed plan :

Data sharing 

(1) Short term solution : Miguel will provide (in a shared folder) regularly dumps of CSVs, so you have sample data in the website - from the past week or so.

(2) Long term solution (2a) Option A - Access directly the DB. However, Xavier (from EcoCloud team) doesn't want to expose the DB online for security reasons, so that would require the users to login on the website with login-protected accounts. That means it's not Open Access Data...

(2b) (suggested) - Option B - Access a replica of the DB.

• Yannick needs to create the VM on our side, so the responsibility of the DB in case it gets corrupted in on our end.
• Then Xavier, when he finds the time (but most likely by mid-Sept) will upload the replica of the DB, which will then have realtime data, that we'll display directly.
• At what frequency do you want to display "realtime" data ? For your sensors it's a tradeoffs between battery lifetime vs data frequency. They said @AnderssonDan-epfl had suggested twice a day (7am, 1pm). (We also noted the point of manymany decimals that is overloading memory and could be optimized)

Data formats

Fyi, There are still aspects to be clarified on their end for data structure / variables definitions etc to ensure we have the same format - but if all sensors outputs in the same formats as the sample file you gave us last month it should be smooth !

Kindly,