search

afsc-gap-products / Data-Processes-WG

0 stars 0 forks source link

Standardized Data Finalization Procedure #9

Open AlexandraDowlin-NOAA opened 5 months ago

AlexandraDowlin-NOAA commented 5 months ago

Code that is used to check the data that is processed from our survey. Hopefully across all regions. Code that is current is a band aid to a band aid. With improvement, this band aid could be the solution.

SarahFriedman-NOAA commented 5 months ago

Existing code here: https://github.com/SarahFriedman-NOAA/data_finalization; needs updated and more sophisticated statistical procedures.

Would also like to incorporate geographic outlier tests. Code here: https://github.com/SarahFriedman-NOAA/survey_species_outliers

Ned-Laman-NOAA commented 3 months ago

There is a GIDES procedure for finalizing data. This procedure is being reviewed and updated by OFIS contractor (Mahesh) and is currently tied to the APEX application which OFIS may also move away from to a platform of their choice. Sarah has some statistical routines outside of GIDES that should be implemented annually to check data, but these are currently external to GIDES. Ideal situation would be to integrate Sarah's checks with the updated GIDES platform and checks being developed by OFIS.