search

ILIAD-ocean-twin / data_access_api

Apache License 2.0
1 stars 0 forks source link

Water quality sensor data through OGC APIs #8

Open pzaborowski opened 1 year ago

pzaborowski commented 1 year ago

Data from the Influx Database will be exposed by the OGC APIs. Current phase is the examples how it can be done with STA and Features API.

pzaborowski commented 1 year ago

Data description is provided online https://oceanlab.azure.sintef.no/d/YinybPjnk/list-of-all-data Questions to SINTEF:

  1. can we have a sample of the data?
  2. which values vary in the buckets. taking the salinity: ---- castawayctd_salinity_portable: time approved data_level edge_device platform salinity sensor serial unit 2022-08-23T11:57:25Z none raw none none 17.308714 castawayctd CC1821002 psu

is the unit changing? is sensor/serial/platform/edge-device anyhow related to location? do we know the location of that?

  1. what can be in approved, data_level?
pzaborowski commented 1 year ago

Data mapping is defined initially to the SOSA https://docs.google.com/spreadsheets/d/12MadX52_fYrDkMfSZWSlQcJ6LxSjRANCR7YsGP6smBc/edit#gid=1811777466 SINTEF is going to provide:

PSNC is going to propose exposed sample data on the STA. OGC is going to propose exposed sample data on the OGC Features.

pzaborowski commented 1 year ago

some links shared today: https://argo.ucsd.edu/data/ https://docs.ogc.org/is/18-088/18-088.html#_built_in_query_functions example STA with JellyFish data - https://iliad-ocean-twin.github.io/JF-API/#/Observations/get_Observations ODIS catalogue SINTEF is working with on the metadata https://catalogue.odis.org/search/type=1 One of the CDT Temperature measument definitions https://vocab.nerc.ac.uk/collection/P01/current/TEMPST02/ Temperature as the Essential Variable - https://gcos.wmo.int/en/essential-climate-variables/subsurface-temperature

pzaborowski commented 11 months ago

folowing suggestion about efficiency, I'm looking now in the geoparquet. apparently used xarray provides nice serialisation as long as the properties in the feature are simple types (parquet is tabular form with metadata header so it is natural). will turn back to feature definition with this constrain and test within pygeoapi.

Remind it would be good to have sample data. if we'd like to test influx provider - would it be possible to have access to the endpoint with some python lib?

avillar commented 11 months ago

There's a python client for influx...