noaa-ocs-modeling / CoupledModelDriver

coupled model configuration generation
https://CoupledModelDriver.readthedocs.io
Creative Commons Zero v1.0 Universal
4 stars 3 forks source link

`forrtl: severe (64): input conversion error, unit 22` when running ADCIRC-only BestTrack run #96

Closed ghost closed 3 years ago

ghost commented 3 years ago

when running an unperturbed BestTrack run at /scratch2/COASTAL/coastal/save/shared/working/zach/adcirc/run_20210505_hsofs_120m_subsetflo_besttrack, the hotstart fails with the following error:

ADCIRC_HOTSTART.err.log
...
...
...
padcirc            0000000000463B30  hotstart_                1453  hstart.F
padcirc            00000000004B9790  adcirc_mod_mp_adc         278  adcirc.F
padcirc            000000000061A8D2  MAIN__                     18  driver.F
padcirc            000000000040BE9E  Unknown               Unknown  Unknown
libc-2.17.so       00002ABC38804555  __libc_start_main     Unknown  Unknown
padcirc            000000000040BDA9  Unknown               Unknown  Unknown
forrtl: severe (64): input conversion error, unit 22, file /scratch2/COASTAL/coastal/save/shared/working/zach/adcirc/run_20210505_hsofs_120m_subsetflo_besttrack/runs/unperturbed/./fort.22
Image              PC                Routine            Line        Source
padcirc            00000000006BBC1E  Unknown               Unknown  Unknown
padcirc            00000000006F5882  Unknown               Unknown  Unknown
padcirc            0000000000516152  wind_mp_nws20get_        6314  wind.F
padcirc            000000000052882E  wind_mp_hotstartm        2568  wind.F
padcirc            0000000000463B30  hotstart_                1453  hstart.F
padcirc            00000000004B9790  adcirc_mod_mp_adc         278  adcirc.F
padcirc            000000000061A8D2  MAIN__                     18  driver.F
padcirc            000000000040BE9E  Unknown               Unknown  Unknown
libc-2.17.so       00002B63FEBB4555  __libc_start_main     Unknown  Unknown
padcirc            000000000040BDA9  Unknown               Unknown  Unknown
srun: error: h20c28: tasks 520-559: Exited with exit code 64
srun: launch/slurm: _step_signal: Terminating StepId=18581227.0
srun: error: h20c41: tasks 560-599: Exited with exit code 64
srun: error: h9c37: tasks 80-119: Exited with exit code 64
srun: error: h9c39: tasks 160-199: Exited with exit code 64
srun: error: h14c44: tasks 440-479: Exited with exit code 64
srun: error: h14c42: tasks 360-399: Exited with exit code 64
srun: error: h11c52: tasks 280-319: Exited with exit code 64
srun: error: h8c05: tasks 0-39: Exited with exit code 64
srun: error: h9c30: tasks 40-79: Exited with exit code 64
srun: error: h11c18: tasks 240-279: Exited with exit code 64
srun: error: h11c17: tasks 200-239: Exited with exit code 64
srun: error: h14c43: tasks 400-439: Exited with exit code 64
srun: error: h20c02: tasks 480-519: Exited with exit code 64
srun: error: h9c38: tasks 120-159: Exited with exit code 64
srun: error: h14c11: tasks 320-359: Exited with exit code 64
ghost commented 3 years ago

@saeed-moghimi-noaa @WPringle @ps2epsi @JaimeCalzadaNOAA

ghost commented 3 years ago

I am currently running the same configuration with NEMS + ADCIRC to see if the same error persists there

ghost commented 3 years ago

BestTrack configuration

configure_besttrack.json
{
  "storm_id": "sandy2012",
  "start_date": null,
  "end_date": null,
  "fort22_filename": null,
  "nws": 20,
  "attributes": {
    "NWS": null,
    "BLADj": null,
    "_storm_id": null,
    "geofactor": null,
    "start_date": null,
    "end_date": null
  }
}
fort.22
AL, 18,2012102206,   , BEST,   0, 135N,  782W,  25, 1003, LO,   0,    ,    0,    0,    0,    0, 1008,  225,  75,     ,    ,    ,    ,    ,224,   6,   INVEST   ,   1
AL, 18,2012102212,   , BEST,   6, 131N,  786W,  30, 1002, TD,   0,    ,    0,    0,    0,    0, 1007,  250,  75,     ,    ,    ,    ,    ,194,   4,  EIGHTEEN  ,   2
AL, 18,2012102218,   , BEST,  12, 127N,  787W,  35, 1000, TS,  34, NEQ,   50,   60,    0,    0, 1007,  250,  60,     ,    ,    ,    ,    ,109,   3,  EIGHTEEN  ,   3
AL, 18,2012102300,   , BEST,  18, 126N,  784W,  40,  998, TS,  34, NEQ,   50,   60,    0,    0, 1007,  250,  40,     ,    ,    ,    ,    , 44,   4,   SANDY    ,   4
AL, 18,2012102306,   , BEST,  24, 129N,  781W,  40,  998, TS,  34, NEQ,   70,   80,    0,    0, 1005,  240,  60,     ,    ,    ,    ,    , 21,   5,   SANDY    ,   5
AL, 18,2012102312,   , BEST,  30, 134N,  779W,  40,  995, TS,  34, NEQ,  100,  100,    0,    0, 1005,  240,  60,     ,    ,    ,    ,    , 26,   7,   SANDY    ,   6
AL, 18,2012102318,   , BEST,  36, 140N,  776W,  45,  993, TS,  34, NEQ,  100,  120,    0,    0, 1005,  240,  60,     ,    ,    ,    ,    , 23,   8,   SANDY    ,   7
AL, 18,2012102400,   , BEST,  42, 147N,  773W,  55,  990, TS,  34, NEQ,  100,  150,   40,   40, 1007,  300,  60,     ,    ,    ,    ,    , 12,   9,   SANDY    ,   8
AL, 18,2012102400,   , BEST,  42, 147N,  773W,  55,  990, TS,  50, NEQ,    0,   70,    0,    0, 1007,  300,  60,     ,    ,    ,    ,    , 12,   9,   SANDY    ,   8
AL, 18,2012102406,   , BEST,  48, 156N,  771W,  60,  987, TS,  34, NEQ,  100,  150,   50,   50, 1007,  300,  45,     ,    ,    ,    ,    , 11,  10,   SANDY    ,   9
AL, 18,2012102406,   , BEST,  48, 156N,  771W,  60,  987, TS,  50, NEQ,   50,   70,   20,   20, 1007,  300,  45,     ,    ,    ,    ,    , 11,  10,   SANDY    ,   9
AL, 18,2012102412,   , BEST,  54, 166N,  769W,  65,  981, HU,  34, NEQ,  120,  160,   70,   70, 1006,  285,  40,     ,    ,    ,    ,    , 10,  11,   SANDY    ,  10
AL, 18,2012102412,   , BEST,  54, 166N,  769W,  65,  981, HU,  50, NEQ,   50,   60,   40,   30, 1006,  285,  40,     ,    ,    ,    ,    , 10,  11,   SANDY    ,  10
AL, 18,2012102412,   , BEST,  54, 166N,  769W,  65,  981, HU,  64, NEQ,   20,   20,    0,    0, 1006,  285,  40,     ,    ,    ,    ,    , 10,  11,   SANDY    ,  10
AL, 18,2012102418,   , BEST,  60, 176N,  767W,  75,  972, HU,  34, NEQ,  150,  180,   70,   70, 1005,  290,  25,     ,    ,    ,    ,    , 25,  13,   SANDY    ,  11
AL, 18,2012102418,   , BEST,  60, 176N,  767W,  75,  972, HU,  50, NEQ,   50,   60,   40,   40, 1005,  290,  25,     ,    ,    ,    ,    , 25,  13,   SANDY    ,  11
AL, 18,2012102418,   , BEST,  60, 176N,  767W,  75,  972, HU,  64, NEQ,   25,   30,   20,   25, 1005,  290,  25,     ,    ,    ,    ,    , 25,  13,   SANDY    ,  11
AL, 18,2012102419,   , BEST,  61, 179N,  766W,  75,  971, HU,  34, NEQ,  150,  180,   70,   70, 1005,  290,  25,     ,    ,    ,    ,    , 11,  12,            ,  12
AL, 18,2012102419,   , BEST,  61, 179N,  766W,  75,  971, HU,  50, NEQ,   50,   60,   40,   40, 1005,  290,  25,     ,    ,    ,    ,    , 11,  12,            ,  12
AL, 18,2012102419,   , BEST,  61, 179N,  766W,  75,  971, HU,  64, NEQ,   25,   30,   20,   25, 1005,  290,  25,     ,    ,    ,    ,    , 11,  12,            ,  12
AL, 18,2012102500,   , BEST,  66, 189N,  764W,  85,  964, HU,  34, NEQ,  180,  240,   70,   70, 1005,  300,  15,     ,    ,    ,    ,    , 19,  13,   SANDY    ,  13
AL, 18,2012102500,   , BEST,  66, 189N,  764W,  85,  964, HU,  50, NEQ,   50,   60,   40,   40, 1005,  300,  15,     ,    ,    ,    ,    , 19,  13,   SANDY    ,  13
AL, 18,2012102500,   , BEST,  66, 189N,  764W,  85,  964, HU,  64, NEQ,   30,   30,   25,   25, 1005,  300,  15,     ,    ,    ,    ,    , 19,  13,   SANDY    ,  13
AL, 18,2012102505,   , BEST,  71, 200N,  760W, 100,  954, HU,  34, NEQ,  240,  240,   70,  120, 1005,  300,  15,     ,    ,    ,    ,    ,  0,  10,            ,  14
AL, 18,2012102505,   , BEST,  71, 200N,  760W, 100,  954, HU,  50, NEQ,   50,   60,   40,   40, 1005,  300,  15,     ,    ,    ,    ,    ,  0,  10,            ,  14
AL, 18,2012102505,   , BEST,  71, 200N,  760W, 100,  954, HU,  64, NEQ,   30,   30,   25,   25, 1005,  300,  15,     ,    ,    ,    ,    ,  0,  10,            ,  14
AL, 18,2012102506,   , BEST,  72, 201N,  760W, 100,  954, HU,  34, NEQ,  240,  240,   70,  120, 1005,  300,  10,     ,    ,    ,    ,    , 19,  17,   SANDY    ,  15
AL, 18,2012102506,   , BEST,  72, 201N,  760W, 100,  954, HU,  50, NEQ,   50,   60,   40,   40, 1005,  300,  10,     ,    ,    ,    ,    , 19,  17,   SANDY    ,  15
AL, 18,2012102506,   , BEST,  72, 201N,  760W, 100,  954, HU,  64, NEQ,   25,   20,   20,   20, 1005,  300,  10,     ,    ,    ,    ,    , 19,  17,   SANDY    ,  15
AL, 18,2012102509,   , BEST,  75, 209N,  757W,  95,  960, HU,  34, NEQ,  240,  240,   70,  180, 1005,  300,  10,     ,    ,    ,    ,    , 13,  16,            ,  16
AL, 18,2012102509,   , BEST,  75, 209N,  757W,  95,  960, HU,  50, NEQ,   50,   60,   40,   40, 1005,  300,  10,     ,    ,    ,    ,    , 13,  16,            ,  16
AL, 18,2012102509,   , BEST,  75, 209N,  757W,  95,  960, HU,  64, NEQ,   25,   20,   20,   20, 1005,  300,  10,     ,    ,    ,    ,    , 13,  16,            ,  16
AL, 18,2012102512,   , BEST,  78, 217N,  755W,  95,  966, HU,  34, NEQ,  240,  240,   70,  240, 1005,  320,  20,     ,    ,    ,    ,    ,  7,  16,   SANDY    ,  17
AL, 18,2012102512,   , BEST,  78, 217N,  755W,  95,  966, HU,  50, NEQ,   60,   60,   40,   50, 1005,  320,  20,     ,    ,    ,    ,    ,  7,  16,   SANDY    ,  17
AL, 18,2012102512,   , BEST,  78, 217N,  755W,  95,  966, HU,  64, NEQ,   30,   30,   20,   20, 1005,  320,  20,     ,    ,    ,    ,    ,  7,  16,   SANDY    ,  17
AL, 18,2012102518,   , BEST,  84, 233N,  752W,  90,  963, HU,  34, NEQ,  270,  270,  120,  270, 1005,  350,  20,     ,    ,    ,    ,    ,340,  16,   SANDY    ,  18
AL, 18,2012102518,   , BEST,  84, 233N,  752W,  90,  963, HU,  50, NEQ,   60,   60,   40,   50, 1005,  350,  20,     ,    ,    ,    ,    ,340,  16,   SANDY    ,  18
AL, 18,2012102518,   , BEST,  84, 233N,  752W,  90,  963, HU,  64, NEQ,   30,   30,   20,   20, 1005,  350,  20,     ,    ,    ,    ,    ,340,  16,   SANDY    ,  18
AL, 18,2012102600,   , BEST,  90, 248N,  759W,  75,  965, HU,  34, NEQ,  300,  300,  160,  270, 1007,  375,  20,     ,    ,    ,    ,    ,333,  10,   SANDY    ,  19
AL, 18,2012102600,   , BEST,  90, 248N,  759W,  75,  965, HU,  50, NEQ,   70,   60,   40,   60, 1007,  375,  20,     ,    ,    ,    ,    ,333,  10,   SANDY    ,  19
AL, 18,2012102600,   , BEST,  90, 248N,  759W,  75,  965, HU,  64, NEQ,   30,   30,   20,   30, 1007,  375,  20,     ,    ,    ,    ,    ,333,  10,   SANDY    ,  19
AL, 18,2012102606,   , BEST,  96, 257N,  764W,  70,  968, HU,  34, NEQ,  300,  300,  160,  240, 1006,  380,  30,     ,    ,    ,    ,    ,327,   8,   SANDY    ,  20
AL, 18,2012102606,   , BEST,  96, 257N,  764W,  70,  968, HU,  50, NEQ,   90,   70,   50,   70, 1006,  380,  30,     ,    ,    ,    ,    ,327,   8,   SANDY    ,  20
AL, 18,2012102606,   , BEST,  96, 257N,  764W,  70,  968, HU,  64, NEQ,   30,   20,    0,   60, 1006,  380,  30,     ,    ,    ,    ,    ,327,   8,   SANDY    ,  20
AL, 18,2012102612,   , BEST, 102, 264N,  769W,  65,  970, HU,  34, NEQ,  360,  240,  170,  240, 1008,  420,  70,     ,    ,    ,    ,    ,336,   7,   SANDY    ,  21
AL, 18,2012102612,   , BEST, 102, 264N,  769W,  65,  970, HU,  50, NEQ,   90,   80,   90,  120, 1008,  420,  70,     ,    ,    ,    ,    ,336,   7,   SANDY    ,  21
AL, 18,2012102612,   , BEST, 102, 264N,  769W,  65,  970, HU,  64, NEQ,    0,    0,    0,   90, 1008,  420,  70,     ,    ,    ,    ,    ,336,   7,   SANDY    ,  21
ghost commented 3 years ago

ADCIRC configuration

configure_adcirc.json
{
  "adcirc_executable_path": "/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/padcirc",
  "adcprep_executable_path": "/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/adcprep",
  "modeled_start_time": "2012-10-22 06:00:00",
  "modeled_end_time": "2012-10-26 11:00:00",
  "modeled_timestep": 7.0,
  "fort_13_path": "/scratch2/COASTAL/coastal/save/shared/models/meshes/hsofs/120m/Subsetted_Florence2018_Test/fort.13",
  "fort_14_path": "/scratch2/COASTAL/coastal/save/shared/models/meshes/hsofs/120m/Subsetted_Florence2018_Test/fort.14",
  "tidal_spinup_duration": 1058400.0,
  "tidal_spinup_timestep": 7.0,
  "source_filename": "/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/modulefiles/envmodules_intel.hera",
  "use_original_mesh": false,
  "output_surface": true,
  "surface_output_interval": 3600.0,
  "output_stations": false,
  "stations_file_path": null,
  "stations_output_interval": 360.0,
  "output_spinup": true,
  "output_elevations": true,
  "output_velocities": true,
  "output_concentrations": false,
  "output_meteorological_factors": false,
  "processors": 600,
  "nems_parameters": {},
  "attributes": {
    ...
    "gwce_solution_scheme": "semi-implicit",
    ...
    "smagorinsky": true,
    ...
  }
}
ghost commented 3 years ago

comparison between spinup fort.15 and hotstart fort.15

diff spinup/fort.15 runs/unperturbed/fort.15
1c1
< created on 2021-05-05 15:47                                     ! RUNDES                              - 32 CHARACTER ALPHANUMERIC RUN DESCRIPTION
---
> created on 2021-05-05 15:48                                     ! RUNDES                              - 32 CHARACTER ALPHANUMERIC RUN DESCRIPTION
6c6
< 0                                                               ! IHOT                                - HOT START PARAMETER
---
> 567                                                             ! IHOT                                - HOT START PARAMETER
21,22c21,22
< 0                                                               ! NWS                                 - WIND STRESS AND BAROMETRIC PRESSURE OPTION PARAMETER
< 1                                                               ! NRAMP                               - RAMP FUNCTION OPTION
---
> 20                                                              ! NWS                                 - WIND STRESS AND BAROMETRIC PRESSURE OPTION PARAMETER
> 8                                                               ! NRAMP                               - RAMP FUNCTION OPTION
28,29c28,30
< 12.25                                                           ! RNDAY                               - TOTAL LENGTH OF SIMULATION (IN DAYS)
< 12.25                                                           ! DRAMP                               - DURATION OF RAMP FUNCTION (IN DAYS)
---
> 2012 10 22 06 18 0.9 1                                          ! WTIMINC                             - meteorological data time increment
> 16.4583                                                         ! RNDAY                               - TOTAL LENGTH OF SIMULATION (IN DAYS)
> 12.250 0.000 0.000 0.000 12.250 12.250 1.000 0.000 12.250       ! DRAMP                               - DURATION OF RAMP FUNCTION (IN DAYS)
4934,4935c4935,4939
< -5 0.000000 12.250000 514                                       ! NOUTGE TOUTSGE TOUTFGE NSPOOLGE     - GLOBAL ELEVATION OUTPUT INFO (UNIT 63)
< -5 0.000000 0.000000 514                                        ! NOUTGV TOUTSGV TOUTFGV NSPOOLGV     - GLOBAL VELOCITY OUTPUT INFO (UNIT 64)
---
> 0 0 0 0                                                         ! NOUTM TOUTSM TOUTFM NSPOOLM         - METEOROLOGICAL STATION OUTPUT INFO (UNITS 71/72)
> 0                                                               ! NSTAM                               - TOTAL NUMBER OF METEOROLOGICAL RECORDING STATIONS
> -5 0.000000 16.458333 514                                       ! NOUTGE TOUTSGE TOUTFGE NSPOOLGE     - GLOBAL ELEVATION OUTPUT INFO (UNIT 63)
> -5 0.000000 16.458333 514                                       ! NOUTGV TOUTSGV TOUTFGV NSPOOLGV     - GLOBAL VELOCITY OUTPUT INFO (UNIT 64)
> 0 0.000000 0.000000 0                                           ! NOUTGM TOUTSGM TOUTFGM NSPOOLGM     - GLOBAL METEOROLOGICAL OUTPUT INFO
4939c4943
< 5 151200                                                        ! NHSTAR NHSINC                       - HOT START FILE GENERATION PARAMETERS
---
> 0 0                                                             ! NHSTAR NHSINC                       - HOT START FILE GENERATION PARAMETERS
ghost commented 3 years ago

comparison between hotstart fort.15 and working BestTrack fort.15

diff /scratch2/COASTAL/coastal/save/shared/saeed/best_track_runs_from_orion/Florence2018/fort.15.hotstart runs/unperturbed/fort.15
1,38c1,37
< created on 2021-04-09 14:38                                     ! RUNDES
< OceanMesh2D                                                     ! RUNID
< 1                                                               ! NFOVER
< 1                                                               ! NABOUT
< 100                                                             ! NSCREEN
< 567                                                             ! IHOT
< 2                                                               ! ICS
< 511112                                                          ! IM
< 1                                                               ! NOLIBF
< 2                                                               ! NOLIFA
< 1                                                               ! NOLICA
< 1                                                               ! NOLICAT
< 6                                                               ! NWP
< primitive_weighting_in_continuity_equation                     
< quadratic_friction_coefficient_at_sea_floor                    
< internal_tide_friction                                         
< subgrid_barrier                                                
< surface_directional_effective_roughness_length                 
< sea_surface_height_above_geoid                                 
< 1                                                               ! NCOR
< 1                                                               ! NTIP
< 20                                                              ! NWS
< 8                                                               ! NRAMP
< 9.81                                                            ! gravitational acceleration
< -3                                                              ! TAU0
< 2.000000                                                        ! DTDP
< 0                                                               ! STATIM
< 0                                                               ! REFTIM
< 2018 09 10 00 06 0.9 1                                          ! WTIMINC - meteorological data time increment
< 13.5                                                            ! RNDAY
< 5.000 0.000 0.000 0.000 5.000 5.000 1.000 0.000 5.000           ! DRAMP
< 0 1 0                                                           ! A00 B00 C00
< 0.01 0 0 0.01                                                   ! H0 ? ? VELMIN
< -80.8143 30.3328                                                ! SLAM0 SFEA0
< 0.0025                                                          ! FFACTOR
< -0.2                                                            ! smagorinsky coefficient
< 0                                                               ! CORI
< 8                                                               ! NTIF
---
> created on 2021-05-05 15:48                                     ! RUNDES                              - 32 CHARACTER ALPHANUMERIC RUN DESCRIPTION
> NOMAD mesh v1e MSL                                              ! RUNID                               - 24 CHARACTER ALPANUMERIC RUN IDENTIFICATION
> 1                                                               ! NFOVER                              - NONFATAL ERROR OVERRIDE OPTION
> 1                                                               ! NABOUT                              - ABREVIATED OUTPUT OPTION PARAMETER
> 100                                                             ! NSCREEN                             - UNIT 6 OUTPUT OPTION PARAMETER
> 567                                                             ! IHOT                                - HOT START PARAMETER
> 2                                                               ! ICS                                 - COORDINATE SYSTEM SELECTION PARAMETER
> 511113                                                          ! IM                                  - MODEL SELECTION PARAMETER
> 1                                                               ! NOLIBF                              - BOTTOM FRICTION TERM SELECTION PARAM; before NWP==1, '2' was used
> 2                                                               ! NOLIFA                              - FINITE AMPLITUDE TERM SELECTION PARAMETER
> 1                                                               ! NOLICA                              - SPATIAL DERIVATIVE CONVECTIVE SELECTION PARAMETER
> 1                                                               ! NOLICAT                             - TIME DERIVATIVE CONVECTIVE TERM SELECTION PARAMETER
> 5                                                               ! NWP                                 - VARIABLE BOTTOM FRICTION AND LATERAL VISCOSITY OPTION PARAMETER; default 0
> mannings_n_at_sea_floor
> primitive_weighting_in_continuity_equation
> surface_canopy_coefficient
> surface_directional_effective_roughness_length
> surface_submergence_state
> 1                                                               ! NCOR                                - VARIABLE CORIOLIS IN SPACE OPTION PARAMETER
> 1                                                               ! NTIP                                - TIDAL POTENTIAL OPTION PARAMETER
> 20                                                              ! NWS                                 - WIND STRESS AND BAROMETRIC PRESSURE OPTION PARAMETER
> 8                                                               ! NRAMP                               - RAMP FUNCTION OPTION
> 9.81                                                            ! G                                   - ACCELERATION DUE TO GRAVITY - DETERMINES UNITS
> -3                                                              ! TAU0                                - WEIGHTING FACTOR IN GWCE; original, 0.005
> 7.000000                                                        ! DTDP                                - TIME STEP (IN SECONDS)
> 0                                                               ! STATIM                              - STARTING TIME (IN DAYS)
> 0                                                               ! REFTIM                              - REFERENCE TIME (IN DAYS)
> 2012 10 22 06 18 0.9 1                                          ! WTIMINC                             - meteorological data time increment
> 16.4583                                                         ! RNDAY                               - TOTAL LENGTH OF SIMULATION (IN DAYS)
> 12.250 0.000 0.000 0.000 12.250 12.250 1.000 0.000 12.250       ! DRAMP                               - DURATION OF RAMP FUNCTION (IN DAYS)
> 0.5 0.5 0                                                       ! A00 B00 C00                         - TIME WEIGHTING FACTORS FOR THE GWCE EQUATION
> 0.01 0 0 0.01                                                   ! H0 NODEDRYMIN NODEWETRMP VELMIN    
> -77.0775 32.4507                                                ! SLAM0 SFEA0                         - CENTER OF CPP PROJECTION (NOT USED IF ICS=1, NTIP=0, NCOR=0)
> 0.0025                                                          ! FFACTOR                            
> -0.2                                                            ! smagorinsky coefficient             - LATERAL EDDY VISCOSITY COEFFICIENT; IGNORED IF NWP =1
> 0                                                               ! CORI                                - CORIOLIS PARAMETER - IGNORED IF NCOR = 1
> 8                                                               ! NTIF                                - NUMBER OF TIDAL POTENTIAL CONSTITUENTS BEING FORCED starting 2008082300
...
...
...
< 110                                                             ! ANGINN
< -5 5 13.5 180                                                   ! NOUTE TOUTSE TOUTFE NSPOOLE
< 397                                                             ! NSTAE
< -64.7033 32.3734                                                ! 2695540
< -66.9826 44.9045                                                ! 8410140
< -67.1085 44.8711                                                ! 8410714
< -67.125 44.9199                                                 ! 8410715
< -67.1407 45.1301                                                ! 8410834
...
< -67.1692 18.214                                                 ! 9759394
< -67.1685 18.4557                                                ! 9759412
< -67.1903 18.1638                                                ! 9759421
< -67.9936 18.107                                                 ! 9759938
< -61.8446 17.5546                                                ! 9761115
< 0 0 0 0                                                         ! NOUTV TOUTSV TOUTFV NSPOOLV
< 0                                                               ! NSTAV
< 0 0 0 0                                                         ! NOUTM TOUTSM TOUTFM NSPOOLM
< 0                                                               ! NSTAM
< -5 5.000000 13.500000 1800                                      ! NOUTGE TOUTSGE TOUTFGE NSPOOLGE
< 0 0.000000 0.000000 0                                           ! NOUTGV TOUTSGV TOUTFGV NSPOOLGV
< 0 0.000000 0.000000 0                                           ! NOUTGM TOUTSGM TOUTFGM NSPOOLGM
< 0                                                               ! NFREQ
< 0 0 0 0                                                         ! THAS THAF NHAINC FMV
< 0 0 0 0                                                         ! NHASE NHASV NHAGE NHAGV
< 0 0                                                             ! NHSTAR NHSINC
< 1 0 1E-08 25                                                    ! ITITER ISLDIA CONVCR ITMAX
<                                                                 ! NCPROJ
<                                                                 ! NCINST
<                                                                 ! NCSOUR
<                                                                 ! NCHIST
<                                                                 ! NCREF
<                                                                 ! NCCOM
<                                                                 ! NCHOST
<                                                                 ! NCONV
<                                                                 ! NCCONT
< 2018-09-05 00:00                                                ! Forcing start date / NCDATE
---
> 3.60371262e-03 1.97085192e+02
> 110                                                             ! ANGINN                              - INNER ANGLE THRESHOLD
> 0 0 0 0                                                         ! NOUTE TOUTSE TOUTFE NSPOOLE         - ELEV STATION OUTPUT INFO (UNIT 61)
> 0                                                               ! NSTAE                               - TOTAL NUMBER OF ELEVATION RECORDING STATIONS
> 0 0 0 0                                                         ! NOUTV TOUTSV TOUTFV NSPOOLV         - VELOCITY STATION OUTPUT INFO (UNIT 62)
> 0                                                               ! NSTAV                               - TOTAL NUMBER OF VELOCITY RECORDING STATIONS
> 0 0 0 0                                                         ! NOUTM TOUTSM TOUTFM NSPOOLM         - METEOROLOGICAL STATION OUTPUT INFO (UNITS 71/72)
> 0                                                               ! NSTAM                               - TOTAL NUMBER OF METEOROLOGICAL RECORDING STATIONS
> -5 0.000000 16.458333 514                                       ! NOUTGE TOUTSGE TOUTFGE NSPOOLGE     - GLOBAL ELEVATION OUTPUT INFO (UNIT 63)
> -5 0.000000 16.458333 514                                       ! NOUTGV TOUTSGV TOUTFGV NSPOOLGV     - GLOBAL VELOCITY OUTPUT INFO (UNIT 64)
> 0 0.000000 0.000000 0                                           ! NOUTGM TOUTSGM TOUTFGM NSPOOLGM     - GLOBAL METEOROLOGICAL OUTPUT INFO
> 0                                                               ! NFREQ                              
> 0 0 0 0                                                         ! THAS THAF NHAINC FMV                - HARMONIC ANALYSIS PARAMETERS
> 0 0 0 0                                                         ! NHASE NHASV NHAGE NHAGV             - CONTROL HARMONIC ANALYSIS AND OUTPUT TO UNITS 51,52,53,54
> 0 0                                                             ! NHSTAR NHSINC                       - HOT START FILE GENERATION PARAMETERS
> 1 0 1E-08 25                                                    ! ITITER ISLDIA CONVCR ITMAX          - ALGEBRAIC SOLUTION PARAMETERS
>                                                                 ! NCPROJ                              - PROJECT TITLE
>                                                                 ! NCINST                              - PROJECT INSTITUTION
>                                                                 ! NCSOUR                              - PROJECT SOURCE
>                                                                 ! NCHIST                              - PROJECT HISTORY
>                                                                 ! NCREF                               - PROJECT REFERENCES
>                                                                 ! NCCOM                               - PROJECT COMMENTS
>                                                                 ! NCHOST                              - PROJECT HOST
>                                                                 ! NCONV                               - CONVENTIONS
>                                                                 ! NCCONT                              - CONTACT INFORMATION
> 2012-10-10 00:00                                                ! NCDATE                              - forcing start date
WPringle commented 3 years ago

@zacharyburnettNOAA can you show me the PE0000/fort.16 error message too? I suspect it is the error in fort.22 without running aswip on it.

WPringle commented 3 years ago

Did you run aswip on the fort.22? ./aswip -n 20 -m 4 -z 2

WPringle commented 3 years ago

Left is original fort.22 and right is after running aswip that is needed for NWS=20 option (NWS=8 will work with original fort.22)

Screen Shot 2021-05-05 at 1 49 08 PM
ghost commented 3 years ago

@zacharyburnettNOAA can you show me the PE0000/fort.16 error message too?

sure thing, here

runs/unperturbed/fort.16
INFO: openFileForRead: Searching for file to open on unit 15...
INFO: openFileForRead: The file 'fort.15' was found. The file will be opened.
INFO: openFileForRead: The file 'fort.15' was opened successfully.
INFO: readFort015prep: The subdomainModeling capability is not active.
ECHO: readFort015prep:  subdomainOn= F
INFO: read15: The timeBathyControl namelist was not found.
INFO: read15: The metControl namelist was not found.
INFO: read15: The waveCoupling namelist was not found.
INFO: read15: The owiWindNetcdf namelist was not found.
INFO: read15: The wetDryControl namelist was not found.
INFO: read15: The inundationOutput namelist was not found.
INFO: read15: End-of-file when searching for dynamicWaterLevelCorrectionControl namelist.
INFO: read15: The Smag_Control namelist was not found.
INFO: read15: The WarnElev namelist was not found.
INFO: read15: The AliDispersion namelist was not found.
INFO: read15: The density control namelist was not found.
INFO: initNodalDataFile: Initialized "fort.63.nc" file.
INFO: initNodalDataFile: Initialized "fort.64.nc" file.
INFO: initNodalDataFile: Initialized "maxele.63.nc" file.
INFO: initNodalDataFile: Initialized "maxvel.63.nc" file.
INFO: initWindModule: Subdomain fort.22 files will not be created.
runs/unperturbed/PE0000/fort.16

runs/unperturbed/PE0000/fort.16

WPringle commented 3 years ago

Hmm I don't see anything in the PE0000 one, maybe it is in another one, grep search PE*/fort.16 for "error" or something like that.

But any case, I think it is likely the problem related to not running aswip on fort.22 and using that instead of the original one.

ghost commented 3 years ago
/scratch2/COASTAL/coastal/save/shared/repositories/adcirc-cg/work/aswip

running aswip (on the fort.22 downloaded by adcircpy) raises the following error

forrtl: severe (64): input conversion error, unit 22, file /scratch2/COASTAL/coastal/save/shared/working/zach/adcirc/run_20210506_hsofs_120m_subsetflo_besttrack/runs/unperturbed/fort.22
Image              PC                Routine            Line        Source
aswip              00000000004EC34E  Unknown               Unknown  Unknown
aswip              000000000051AFF2  Unknown               Unknown  Unknown
aswip              0000000000495F40  asymmetricvortexp         180  aswip.F
aswip              00000000004920FE  MAIN__                   2878  aswip.F
aswip              000000000040309E  Unknown               Unknown  Unknown
libc-2.17.so       00007F2E40AD9555  __libc_start_main     Unknown  Unknown
aswip              0000000000402FA9  Unknown               Unknown  Unknown
WPringle commented 3 years ago

Run this command?: ./aswip -n 20 -m 4 -z 2

WPringle commented 3 years ago

Try again after removing the lines near bottom of file with "EX" in them. (Maybe it doesn't work for the hurricane when it is an EXtratropical cyclone)

ghost commented 3 years ago

Try again after removing the lines near bottom of file with "EX" in them. (Maybe it doesn't work for the hurricane when it is an EXtratropical cyclone)

I can't find ex in the file anywhere:

grep ex -iF fort.22

Run this command?: ./aswip -n 20 -m 4 -z 2

This resulted in the same error, unfortunately. I will build aswip again from scratch, to see if that fixes it. Thanks.

WPringle commented 3 years ago

can you also try deleting the first line? (that has LO in it). I don't seem to have that in my Sandy fort.22

ghost commented 3 years ago

I removed the line with LO but it has the same error:

(coupledmodeldriver)  Zachary.Burnett@hfe05  /scratch2/COASTAL/coastal/save/shared/working/zach/adcirc/run_20210507_hsofs_120m_subsetflo_besttrack/spinup
 ➜ /scratch2/COASTAL/coastal/save/shared/repositories/adcirc-cg/work/aswip
forrtl: severe (64): input conversion error, unit 22, file /scratch2/COASTAL/coastal/save/shared/working/zach/adcirc/run_20210507_hsofs_120m_subsetflo_besttrack/spinup/fort.22
Image              PC                Routine            Line        Source
aswip              00000000004EC34E  Unknown               Unknown  Unknown
aswip              000000000051AFF2  Unknown               Unknown  Unknown
aswip              0000000000495F40  asymmetricvortexp         180  aswip.F
aswip              00000000004920FE  MAIN__                   2878  aswip.F
aswip              000000000040309E  Unknown               Unknown  Unknown
libc-2.17.so       00007FF1AE521555  __libc_start_main     Unknown  Unknown
aswip              0000000000402FA9  Unknown               Unknown  Unknown
ghost commented 3 years ago

aswip does work on the original.22 for Florence2018

(coupledmodeldriver)  Zachary.Burnett@hfe05  /scratch2/COASTAL/coastal/save/shared/models/forcings/besttrack/aswip_test
 ➜ /scratch2/COASTAL/coastal/save/shared/repositories/adcirc-cg/work/aswip
 Finished processing ient =            3 iquadrot =            1
 Finished processing ient =            2 iquadrot =            1
 Finished processing ient =            1 iquadrot =            1
 Finished processing ient =            6 iquadrot =            1
 Finished processing ient =            5 iquadrot =            1
 Finished processing ient =            4 iquadrot =            1
 Finished processing ient =            9 iquadrot =            1
 Finished processing ient =            8 iquadrot =            1
 Finished processing ient =            7 iquadrot =            1
 Finished processing ient =           12 iquadrot =            1
 Finished processing ient =           11 iquadrot =            1
 Finished processing ient =           10 iquadrot =            1
 Finished processing ient =           15 iquadrot =            1
 Finished processing ient =           14 iquadrot =            1
 Finished processing ient =           13 iquadrot =            1
 Finished processing ient =           18 iquadrot =            1
 Finished processing ient =           17 iquadrot =            1
 Finished processing ient =           16 iquadrot =            1
 Finished processing ient =           21 iquadrot =            1
 Finished processing ient =           20 iquadrot =            1
 Finished processing ient =           19 iquadrot =            1
 Finished processing ient =           24 iquadrot =            1
 Finished processing ient =           23 iquadrot =            1
 Finished processing ient =           22 iquadrot =            1
 Finished processing ient =           27 iquadrot =            1
 Finished processing ient =           26 iquadrot =            1
 Finished processing ient =           25 iquadrot =            1
 Finished processing ient =           30 iquadrot =            1
 Finished processing ient =           29 iquadrot =            1
 Finished processing ient =           28 iquadrot =            1
 Finished processing ient =           33 iquadrot =            1
 Finished processing ient =           32 iquadrot =            1
 Finished processing ient =           31 iquadrot =            1
 Finished processing ient =           36 iquadrot =            1
 Finished processing ient =           35 iquadrot =            1
 Finished processing ient =           34 iquadrot =            1
 Finished processing ient =           39 iquadrot =            1
 Finished processing ient =           38 iquadrot =            1
 Finished processing ient =           37 iquadrot =            1
 Finished processing ient =           42 iquadrot =            1
 Finished processing ient =           41 iquadrot =            1
 Finished processing ient =           40 iquadrot =            1
 Finished processing ient =           45 iquadrot =            1
 Finished processing ient =           44 iquadrot =            1
 Finished processing ient =           43 iquadrot =            1
 Finished processing ient =           48 iquadrot =            2
 Finished processing ient =           47 iquadrot =            1
 Finished processing ient =           46 iquadrot =            1
 Finished processing ient =           50 iquadrot =            1
 Finished processing ient =           49 iquadrot =            1
 Finished processing ient =           52 iquadrot =            2
 Finished processing ient =           51 iquadrot =            1
 Finished processing ient =           54 iquadrot =            3
 Finished processing ient =           53 iquadrot =            1
 Finished processing ient =           56 iquadrot =            2
 Finished processing ient =           55 iquadrot =            1
 Finished processing ient =           57 iquadrot =            1
 Finished processing ient =           58 iquadrot =            4
 Finished processing ient =           59 iquadrot =            2
 Finished processing ient =           60 iquadrot =            2
 Finished processing ient =           61 iquadrot =            2
 Finished processing ient =           62 iquadrot =            2

I will investigate the differences between these two fort.22

ghost commented 3 years ago

I've found the problem; it is the space after the storm number.

< AL, 06,2018091106,   , BEST,   0, 260N,  632W, 115,  950, HU,  34, NEQ,  130,  130,   90,  140, 1010,  200,  15,     ,    ,    ,    ,    ,290,  14,  FLORENCE  ,   1
---
> AL, 06, 2018091106,   , BEST,   0, 260N,  632W, 115,  950, HU,  34, NEQ,  130,  130,   90,  140, 1010,  200,  15,     ,    ,    ,    ,    ,290,  14,  FLORENCE  ,   1,

when I add the space back in, aswip works again.

WPringle commented 3 years ago

Weird, was that in one of the modified fort.22s? Wonder why that got changed

ghost commented 3 years ago

I fixed the problem in https://github.com/JaimeCalzadaNOAA/adcircpy/commit/c2879e04e74d28cd5d7acc0be83101871876384e, it looks like I introduced the bug in the fort.22 generation code