nwfsc-fram / warehouse

FRAM Data Warehouse - Public
Other
5 stars 1 forks source link

Add backlogged age data from fram_central (postgres prod) to the data warehouse #72

Open BHHorness-NOAA opened 4 years ago

BHHorness-NOAA commented 4 years ago

As age_facility qualifiers were being added into the data warehouse individual_fact table (#71), several age data sets were found to be absent. These will need to be added after the ageing facility data have been added. So, the missing age data belong to the following groups:

Ages read in 2016 and 2017; this should be checked to confirm which age data lots are truly absent POP ages read in 2014; master specimen analysis lots 375 and 376. POP ages read in 2015; master specimen analysis lot 406

It was also noted that the 2014 Pacific Hake ages read in 2018 (master specimen analysis lot 423, 424) were selected to support maturity analysis. The age structures were collected randomly in the field, but the subset selected for ageing was non-random. So, these ages were not transferred to the data warehouse. It is likely that they will be wanted by users. If those ages are added, then it is unclear what the Standard_Survey_whid should be. The age structures were randomly collected in the field (Standard_Survey_whid = 1), but the age reads were not randomly conducted (Standard_Survey_whid = 28). The standard_survey_whid has been set based on field collections, so this variant would be a departure. Since they should not be included in assessments, the standard_survey_whid should be set to 28 if the nonrandomly read ages are added to the warehouse.

SaOgaz-NOAA commented 3 years ago

Hi @BHHorness-NOAA, same question here, any updates?