NRLMMD-GEOIPS / geoips

Main Geolocated Information Processing System code base with basic functionality enabled.
https://nrlmmd-geoips.github.io/geoips/
Other
14 stars 11 forks source link

Problems with outputs from failed comparison #470

Open jsolbrig opened 6 months ago

jsolbrig commented 6 months ago

Requested Update

Description

When running the abi.static.Infrared.netcdf_geoips.sh test script, if the compare file doesn't exist, I see to problems with the resulting output.

First, there are two copy scripts reported. The INFO level one can just be removed from the logging output.

03_005745 output_checkers.py:335  WARNING: MISSINGCOMPARE no /home/jsolbrig/geoips/github/outdirs/preprocessed/algorithms/Infrared_latitude_longitude/abi/goes-16/denver/20200918/20200918.195020.goes-16.Infrared_latitude_longitude.denver.nc in comparepath
03_005745 output_checkers.py:339  INTERACTIVE: MISSINGCOMPARE Commands to copy 1 missing files to comparison path.
03_005745 output_checkers.py:343     INFO:   source /home/jsolbrig/geoips/github/geoips/tests/outputs/abi.static.Infrared.netcdf_geoips/diff_test_output_dir_jsolbrig/cptest_MISSINGCOMPARE.txt
03_005745 output_checkers.py:344  INTERACTIVE:   source /home/jsolbrig/geoips/github/geoips/tests/outputs/abi.static.Infrared.netcdf_geoips/diff_test_output_dir_jsolbrig/cp_MISSINGCOMPARE.txt
03_005745 output_checkers.py:368     INFO: MISSINGCOMPS 1

Second, for some reason I'm also getting a MISSINGPRODUCT warning. This goes away once the compare file has been put in place. It shouldn't disappear in that circumstance. This warning is probably incorrect.

03_005745 output_checkers.py:231  WARNING: MISSINGPRODUCT no /home/jsolbrig/geoips/github/outdirs/preprocessed/algorithms/Infrared_latitude_longitude/abi/goes-16/denver/20200918/20200918.195020.goes-16.Infrared_latitude_longitude.denver.nc in output path from current run
03_005745 output_checkers.py:242  INTERACTIVE: MISSINGPRODUCTS Commands to remove 1 incorrect files from test output path.
03_005745 output_checkers.py:247     INFO:   source /home/jsolbrig/geoips/github/geoips/tests/outputs/abi.static.Infrared.netcdf_geoips/diff_test_output_dir_jsolbrig/cptest_MISSINGPRODUCTS.txt
03_005745 output_checkers.py:251  INTERACTIVE:   source /home/jsolbrig/geoips/github/geoips/tests/outputs/abi.static.Infrared.netcdf_geoips/diff_test_output_dir_jsolbrig/rm_MISSINGPRODUCTS.txt
03_005745 output_checkers.py:288     INFO: MISSINGPRODUCTS 1
03_005745 output_checkers.py:884     INFO: retval: 0b10001
03_005745 output_checkers.py:886     INFO: Nonzero return value indicates error, 6 bit binary code: WXY where:
03_005745 output_checkers.py:889     INFO:     Y (0-1): BADCOMP: number of bad comparisons found betweencomparepath and current run output path
03_005745 output_checkers.py:895     INFO:     X (2-3): MISSINGCOMP: Number of products missing in compare path but existing in current output path
03_005745 output_checkers.py:901     INFO:     W (4-5): MISSINGPROD: Number of products existing in comparepath, but missing in current output path

Background and Motivation

Alternative Solutions

Environment

Code to demonstrate issue

Checklist for Completion