Closed uturuncoglu closed 3 weeks ago
Let me test this on Derecho. I'll update you about it.
Hercules, need to check the permissions for the baseline files.
@DusanJovic-NOAA I double check and I think that permissions are fine. Can you try to read the files in /work2/noaa/nems/tufuk/RT/NEMSfv3gfs/develop-20240126/coastal_irene_atm2roms_intel
or /work2/noaa/nems/tufuk/RT/NEMSfv3gfs/develop-20240417/coastal_irene_atm2roms_intel
and let me know. If you could not which level you could see.
Might be also related following closed issue - https://github.com/ufs-community/ufs-weather-model/issues/2015
I see the differences in the compiler_flags global attribute:
$ nccmp -g /work2/noaa/stmp/tufuk/stmp/tufuk/FV3_RT/rt_2770508/coastal_irene_atm2roms_intel/irene_avg.nc /work2/noaa/nems/tufuk/RT/NEMSfv3gfs/develop-20240126/coastal_irene_atm2roms_intel/irene_avg.nc
DIFFER : LENGTHS OF GLOBAL ATTRIBUTE : compiler_flags : 223 <> 193 : VALUES : -g -traceback -fpp -fno-alias -auto -safe-cray-ptr -ftz -assume byterecl -sox -align array64byte -qno-opt-dynamic-align -diag-disable 5462 -diag-disable 7712 -real-size 64 -fp-model precise -ip -O3 -traceback -check uninit <> -g -traceback -fpp -fno-alias -auto -safe-cray-ptr -ftz -assume byterecl -nowarn -sox -align array64byte -qno-opt-dynamic-align -real-size 64 -fp-model precise -ip -O3 -traceback -check uninit
If I'm looking at correct output files.
@DusanJovic-NOAA Thanks for checking. That is really helpful. I am not sure why I am not seeing this in the nccmp output. If this is the case, since these are ROMS global attributes and related with the compile flags, the baseline needs to be created again even if the data itself are fine. I think there is also way to check just data not the attributes but I am not sure that is the way that we need to go. Let me check the create baseline and check again on Hercules. Thanks again for your help.
You are not seeing the differences because of -q
(quiet) flag. Without -q the stdout will be huge in case the files are actually different so we rely on the error code to determine if the files are actually different.
@DusanJovic-NOAA Thanks. It is good to know. I added export CMP_DATAONLY=true
to the test file and run again and it is passing now. I think I could close this issue. Thanks again for your help.
Description
I am trying to compare a set of netcdf files for the regression test defined in ufs-coastal. This is CDEPS data atmosphere coupled ROMS configuration and produces three netcdf files. The output of the regression test is something like following on Hercules,
It indicates that the test is failed in the step of baseline configuration. Actually, if I run the
nccmp -d -S -q -f -g -B --Attribute=checksum --warn=format /work2/noaa/nems/tufuk/RT/NEMSfv3gfs/develop-20240417/coastal_irene_atm2roms_intel/irene_his.nc /work2/noaa/stmp/tufuk/stmp/tufuk/FV3_RT/rt_2701396/coastal_irene_atm2roms_intel/irene_his.nc > log 2>&1 && d=$? || d=$?; echo $d
command manually. The log file is empty but$d
has value of1
and the regression testing thinks that the test is failed. I also compared the files with NCAR'scprnc
tool and it seems that the files are identical.So, I am not sure why but
rt_utils.sh
thinks that the files are not identical. Any suggestion? Is this a bug? Since the script is used by multiple tests and seems robust but I am not sure. There could be still issue with the RT baseline check step.I also test this on Frontera and got similar results (https://github.com/oceanmodeling/roms/issues/3) but of course that is not a officially supported Teir 1 platform and also with little bit old version of model (maybe not using nccmp).
To Reproduce:
This can be reproduced on Hercules using ufs-coastal.
./rt.sh -l rt_coastal.conf -a nems -e
since there is a bug in rt.sh (https://github.com/ufs-community/ufs-weather-model/issues/2244) there is n o way to run single test likecoastal_irene_atm2roms
butrt_coastal.conf
can be edited to keep onlycoastal_irene_atm2roms
.Additional context
None
Output
None