2021Q4 Metric storage - Githubissues

nih-cfde / cfde-deriva

Collaboration point for miscellaneous CFDE-deriva scripts

Other

2 stars 3 forks source link

2021Q4 Metric storage #310

Closed karlcz closed 2 years ago

karlcz commented 2 years ago

[x] Add tables to registry to track per-submission FAIR metrics
[x] Python API to help upload new measurements from pipeline
[x] Registry UX tweaks to allow browsing of new tables

karlcz commented 2 years ago

This is sketched out in a draft PR https://github.com/nih-cfde/cfde-deriva/pull/309 which assumes we will introduce a CURI-like metric concept "vocabulary" id space to coordinate the measurement code, persistence layer, and UI layers.

a datapackage_metric vocabulary table (named this way in case we introduce some other granularity of metric concept later)
a datapackage_measurement data table which links a submission, metric concept, and actual measurement value(s)

karlcz commented 2 years ago

The latest revision of this (with the new "hide" boolean) is deployed in app-dev's registry. It should be possible to check out the "metrics" branch of cfde-deriva and test with the new cfde_deriva.metrics API module.

Once we successfully get some measurements recorded for at least one submission, I will revisit to make the measurements visible in the registry's deriva UX...

karlcz commented 2 years ago

Some measurements have been loaded for this submission https://app-dev.nih-cfde.org/chaise/record/#registry/CFDE:datapackage/RID=J7NT