search

geco-bern / FluxDataKit

LEMONTREE flux data kit
https://geco-bern.github.io/FluxDataKit
2 stars 11 forks source link

Propagate QC flags to DD #45

Closed stineb closed 1 year ago

stineb commented 1 year ago

For the DD data, specify QC information as fraction (0-1) of good (not gap-filled) HH data that went into the respective, aggregated DD data.

Keep all HH data (do not apply any filtering) and provide HH data quality in the respective QC variable. At HH, the QC variable is a code (integer, 0 = good, 1 = ...).

This is to avoid that DD data is aggregated from HH data that has gaps. Gaps are non-random (tend to be more frequent at night). Therefore daily means calculated from cleaned, gappy, HH data will be biased.

khufkens commented 1 year ago

https://github.com/computationales/FluxDataKit/commit/fe1153c7f73851f4dbeeb1f258d19a7d7ed46689

khufkens commented 1 year ago

Fixed as per https://github.com/computationales/FluxDataKit/pull/47 and some commits before