DOI-USGS / COAWST

COAWST modeling system git repository
Other
105 stars 50 forks source link

Error running a WRF+ROMS+SWAN experiment #106

Closed r0squete closed 1 year ago

r0squete commented 2 years ago

Hi! I am trying to run a WRF+ROMS+SWAN experiment. I already ran a WRF+ROMS experiment, the problem appears now when I include SWAN model. I just receive this error information:

Coupled Input File name = /home/lvproveyer/Programs/Test/Projects/Test/coupling_test.in

Program received signal SIGSEGV: Segmentation fault - invalid memory reference.

Backtrace for this error:

Program received signal SIGSEGV: Segmentation fault - invalid memory reference.

Backtrace for this error:

Program received signal SIGSEGV: Segmentation fault - invalid memory reference.

Backtrace for this error:

0 0x7f4c8f319d21 in ???

1 0x7f4c8f318ef5 in ???

2 0x7f4c8efb208f in ???

at /build/glibc-SzIz7B/glibc-2.31/signal/../sysdeps/unix/sysv/linux/x86_64/sigaction.c:0

3 0x558d5e5c97d0 in ???

4 0x558d5e5bf22b in ???

5 0x558d5e5be302 in ???

6 0x7f4c8ef93082 in __libc_start_main

at ../csu/libc-start.c:308

7 0x558d5e5be35d in ???

8 0xffffffffffffffff in ???

0 0x7ff267e24d21 in ???

1 0x7ff267e23ef5 in ???

2 0x7ff267abd08f in ???

at /build/glibc-SzIz7B/glibc-2.31/signal/../sysdeps/unix/sysv/linux/x86_64/sigaction.c:0

3 0x55e7219147d0 in ???

4 0x55e72190a22b in ???

5 0x55e721909302 in ???

6 0x7ff267a9e082 in __libc_start_main

at ../csu/libc-start.c:308

7 0x55e72190935d in ???

8 0xffffffffffffffff in ???

0 0x7f51614b9d21 in ???

1 0x7f51614b8ef5 in ???

2 0x7f516115208f in ???

at /build/glibc-SzIz7B/glibc-2.31/signal/../sysdeps/unix/sysv/linux/x86_64/sigaction.c:0

3 0x5640bbe677d0 in ???

4 0x5640bbe5d22b in ???

5 0x5640bbe5c302 in ???

6 0x7f5161133082 in __libc_start_main

at ../csu/libc-start.c:308

7 0x5640bbe5c35d in ???

8 0xffffffffffffffff in ???

=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = PID 254510 RUNNING AT pop-os = EXIT CODE: 139 = CLEANING UP REMAINING PROCESSES = YOU CAN IGNORE THE BELOW CLEANUP MESSAGES

YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11) This typically refers to a problem with your application. Please see the FAQ page for debugging suggestions

What can be causing this issue?

jcwarner-usgs commented 2 years ago

not much information there. if you added SWAN, are there any Err* files? do the PRINT files provide any info?

r0squete commented 2 years ago

Thanks for replaying me! Sorry, it doesn't create any error or print file...

jcwarner-usgs commented 2 years ago

can you run the coupled roms+wrf+swan Sandy case that we distribute? if so, compare your .h to that. maybe you are missing something with the scrip file. -j

r0squete commented 2 years ago

I was able to run the Sandy case. I compared both .h files and they are exactly the same. Where else could my error be? Should I run the model in debug mode? How can I do this?

jcwarner-usgs commented 2 years ago

you could try to edit coawst.bash, set DEUBG=on recompile and it will give you a coawstG then run that. sometimes that helps. did you create scrip weights for all 3 coupled models?

r0squete commented 2 years ago

Yes, I created scrip weights for the 3 models. I edited coawst.bash like you said but then I can't compile coawst. I am getting this error:

makefile:244: INCLUDING FILE ./Build/make_macros.mk WHICH CONTAINS APPLICATION-DEPENDENT MAKE DEFINITIONS mod_strings.f90:165:132:

165 | (len=160) :: my_fflags = "-frepack-arrays -g -fbounds-check -I/home/lvproveyer/Programs/tesis/Lib/mct-install/include -I/usr/include -I/home/lvproveyer/Programs/Test//WRF/main -I/home/lvproveyer/Programs/Test//WRF/external/esmf_time_f90 -I/home/lvproveyer/Programs/Test//WRF/frame -I/home/lvproveyer/Programs/Test//WRF/share -ffree-form -ffree-form" | 1

Error: Line truncated at (1) [-Werror=line-truncation] mod_strings.f90:165:44:

165 | character (len=160) :: my_fflags = "-frepack-arrays -g -fbounds-check -I/home/lvproveyer/Programs/tesis/Lib/mct-install/include -I/usr/include -I/home/lvproveyer/Programs/Test//WRF/main -I/home/lvproveyer/Programs/Test//WRF/external/esmf_time_f90 -I/home/lvproveyer/Programs/Test//WRF/frame -I/home/lvproveyer/Programs/Test//WRF/share -ffree-form -ffree-form" | 1 Error: Unterminated character constant beginning at (1) f951: some warnings being treated as errors make: *** [ROMS/Modules/Module.mk:15: Build/mod_strings.o] Error 1

jcwarner-usgs commented 2 years ago

ok i think you have an older version of code. there has been a fix for this. lets try this: edit ROMS/Modules/mod_strings.F and look for character (len=160) :: my_fflags = MY_FFLAGS and change it to character (len=512) :: my_fflags = MY_FFLAGS

r0squete commented 2 years ago

I changed it, but I think that it doesn't work:

makefile:244: INCLUDING FILE ./Build/make_macros.mk WHICH CONTAINS APPLICATION-DEPENDENT MAKE DEFINITIONS mod_strings.f90:165:132:

165 | s-check -I/home/lvproveyer/Programs/tesis/Lib/mct-install/include -I/usr/include -I/home/lvproveyer/Programs/Test//WRF/main -I/home/lvproveyer/Programs/Test//WRF/external/esmf_time_f90 -I/home/lvproveyer/Programs/Test//WRF/frame -I/home/lvproveyer/Programs/Test//WRF/share -ffree-form -ffree-form" | 1

Error: Line truncated at (1) [-Werror=line-truncation] mod_strings.f90:165:44:

165 | character (len=512) :: my_fflags = "-frepack-arrays -g -fbounds-check -I/home/lvproveyer/Programs/tesis/Lib/mct-install/include -I/usr/include -I/home/lvproveyer/Programs/Test//WRF/main -I/home/lvproveyer/Programs/Test//WRF/external/esmf_time_f90 -I/home/lvproveyer/Programs/Test//WRF/frame -I/home/lvproveyer/Programs/Test//WRF/share -ffree-form -ffree-form" | 1 Error: Unterminated character constant beginning at (1) f951: some warnings being treated as errors make: *** [ROMS/Modules/Module.mk:15: Build/mod_strings.o] Error 1

I am using COAWST version 3.2...

jcwarner-usgs commented 2 years ago

can you upgrade to the latest version? you will have to use newer versions of the makefile, coawst.bash, ocean.in, but i think the other stuff should be ok.

-j

r0squete commented 2 years ago

I upgraded to the 3.7 version and implemented all the necessary changes. When I run the experiment now I get this error:

Coupled Input File name = /home/lvproveyer/Programs/test2/Projects/test2/coupling_test2.in At line 135 of file read_coawst_par.f90 Fortran runtime error: Index '1' of dimension 1 of array 'wname' above upper bound of 0

Error termination. Backtrace: At line 135 of file read_coawst_par.f90 Fortran runtime error: Index '1' of dimension 1 of array 'wname' above upper bound of 0

Error termination. Backtrace: At line 135 of file read_coawst_par.f90 Fortran runtime error: Index '1' of dimension 1 of array 'wname' above upper bound of 0

Error termination. Backtrace:

0 0x7f448bb10d21 in ???

1 0x7f448bb11869 in ???

2 0x7f448bb11ee6 in ???

3 0x55c93ecb4212 in read_coawstpar

at /home/lvproveyer/Programs/test2/Build/read_coawst_par.f90:135

4 0x55c93ec55995 in mct_driver

at /home/lvproveyer/Programs/test2/Build/master.f90:71

5 0x55c93ec7604d in main

at /home/lvproveyer/Programs/test2/Build/master.f90:23

0 0x7f9148d4fd21 in ???

1 0x7f9148d50869 in ???

2 0x7f9148d50ee6 in ???

3 0x5631f27b3212 in read_coawstpar

at /home/lvproveyer/Programs/test2/Build/read_coawst_par.f90:135

0 0x7f7f03772d21 in ???

1 0x7f7f03773869 in ???

2 0x7f7f03773ee6 in ???

4 0x5631f2754995 in mct_driver

at /home/lvproveyer/Programs/test2/Build/master.f90:71

5 0x5631f277504d in main

at /home/lvproveyer/Programs/test2/Build/master.f90:23

3 0x5643c40c7212 in read_coawstpar

at /home/lvproveyer/Programs/test2/Build/read_coawst_par.f90:135

4 0x5643c4068995 in mct_driver

at /home/lvproveyer/Programs/test2/Build/master.f90:71

5 0x5643c408904d in main

at /home/lvproveyer/Programs/test2/Build/master.f90:23

Any idea???

jcwarner-usgs commented 2 years ago

well Wname is dimensioned (Num swan grids) so how many swan grids do you have? do you have #SWAN _MODEL activated? in your SWAN input file, you need to list NUM_SGRIDS = ___

r0squete commented 2 years ago

Well, I think I am making some progress now, but I still have some issues:

Coupled Input File name = /home/lvproveyer/Programs/test2/Projects/test2/coupling_test2.in Coupled Input File name = /home/lvproveyer/Programs/test2/Projects/test2/coupling_test2.in

Model Coupling:

   Ocean Model MPI nodes: 000 - 000

   Waves Model MPI nodes: 001 - 001

   Atmos Model MPI nodes: 002 - 002

   WAVgrid 01 dt= ***** -to- OCNgrid 01 dt=  15.0, CplInt:  1800.0 Steps: 001

   OCNgrid 01 dt=  15.0 -to- WAVgrid 01 dt= *****, CplInt:  1800.0 Steps: 120

   ATMgrid 01 dt= 150.0 -to- OCNgrid 01 dt=  15.0, CplInt:  1800.0 Steps: 012

   OCNgrid 01 dt=  15.0 -to- ATMgrid 01 dt= 150.0, CplInt:  1800.0 Steps: 120

   ATMgrid 02 dt=  50.0 -to- OCNgrid 01 dt=  15.0, CplInt:  1800.0 Steps: 036

   OCNgrid 01 dt=  15.0 -to- ATMgrid 02 dt=  50.0, CplInt:  1800.0 Steps: 120

   ATMgrid 01 dt= 150.0 -to- WAVgrid 01 dt= *****, CplInt:  1800.0 Steps: 012

   WAVgrid 01 dt= ***** -to- ATMgrid 01 dt= 150.0, CplInt:  1800.0 Steps: 001

   ATMgrid 02 dt=  50.0 -to- WAVgrid 01 dt= *****, CplInt:  1800.0 Steps: 036

   WAVgrid 01 dt= ***** -to- ATMgrid 02 dt=  50.0, CplInt:  1800.0 Steps: 001

Model Input Parameters: ROMS/TOMS version 3.9
Monday - October 17, 2022 - 9:02:59 PM

module_io_quilt_old.F 2931 F

SWAN grid 1 is preparing computation

Quilting with 1 groups of 0 I/O tasks. Quilting with 1 groups of 0 I/O tasks. Ntasks in X 1 , ntasks in Y 1 Ntasks in X 1 , ntasks in Y 1 Domain # 1: dx = 27000.000 m Domain # 1: dx = 27000.000 m Domain # 2: dx = 9000.000 m Domain # 2: dx = 9000.000 m WRF V4.2.2 MODEL WRF V4.2.2 MODEL



Parent domain Parent domain ids,ide,jds,jde 1 145 1 82 ids,ide,jds,jde 1 145 1 82 ims,ime,jms,jme -4 150 -4 87 ims,ime,jms,jme -4 150 -4 87 ips,ipe,jps,jpe 1 145 1 82 ips,ipe,jps,jpe 1 145 1 82



DYNAMICS OPTION: Eulerian Mass Coordinate DYNAMICS OPTION: Eulerian Mass Coordinate

Hurricane Matthew

Operating system : Linux CPU/hardware : x86_64 Compiler system : gfortran Compiler command : /home/lvproveyer/Libs_COAWST/Library/bin/mpif90 Compiler flags : -frepack-arrays -g -fbounds-check -fconvert=big-endian -frecord-marker=4 -fbacktrace -fcheck=all -fsanitize=address -fsanitize=undefined -finit-real=nan -ffpe-trap=invalid,zero,overflow -g -fbounds-check -fbacktrace -finit-real=nan -ffpe-trap=invalid,zero,overflow -I/usr/include -I/home/lvproveyer/Programs/tesis/Lib/mct-install/include -I/home/lvproveyer/Programs/test2//WRF/main -I/home/lvproveyer/Programs/test2//WRF/external/esmf_time_f90 -I/home/lvproveyer/Programs/test2//WRF/frame -I/home/lvproveyer/Prog OCN Communicator : -2080374780, PET size = 1

Input Script :

SVN Root URL : SVN Revision :

Local Root : /home/lvproveyer/Programs/test2 Header Dir : /home/lvproveyer/Programs/test2/Projects/test2 Header file : test2.h Analytical Dir : /home/lvproveyer/Programs/test2/Projects/test2

Resolution, Grid 01: 214x101x12, Parallel Nodes: 1, Tiling: 1x1

Physical Parameters, Grid: 01

  17280  ntimes            Number of timesteps for 3-D equations.
 15.000  dt                Timestep size (s) for 3-D equations.
     10  ndtfast           Number of timesteps for 2-D equations between
                             each 3D timestep.
      1  ERstr             Starting ensemble/perturbation run number.
      1  ERend             Ending ensemble/perturbation run number.
      0  nrrec             Number of restart records to read from disk.
      T  LcycleRST         Switch to recycle time-records in restart file.
     60  nRST              Number of timesteps between the writing of data
                             into restart fields.
      1  ninfo             Number of timesteps between print of information
                             to standard output.
      T  ldefout           Switch to create a new output NetCDF file(s).
     60  nHIS              Number of timesteps between the writing fields
                             into history file.

** nQCK Number of timesteps between the writing fields into quicksave file. 1 ntsAVG Starting timestep for the accumulation of output time-averaged data. 432 nAVG Number of timesteps between the writing of time-averaged data into averages file. 2.0000E-01 nl_tnu2(01) NLM Horizontal, harmonic mixing coefficient (m2/s) for tracer 01: temp 2.0000E-01 nl_tnu2(02) NLM Horizontal, harmonic mixing coefficient (m2/s) for tracer 02: salt 1.0000E-01 nl_visc2 NLM Horizontal, harmonic mixing coefficient (m2/s) for momentum. F LuvSponge Turning OFF sponge on horizontal momentum. F LtracerSponge(01) Turning OFF sponge on tracer 01: temp F LtracerSponge(02) Turning OFF sponge on tracer 02: salt 1.0000E-06 Akt_bak(01) Background vertical mixing coefficient (m2/s) for tracer 01: temp 1.0000E-06 Akt_bak(02) Background vertical mixing coefficient (m2/s) for tracer 02: salt 1.0000E-03 Akt_limit(01) Vertical diffusion upper threshold (m2/s) for tracer 01: temp 1.0000E-03 Akt_limit(02) Vertical diffusion upper threshold (m2/s) for tracer 02: salt 1.0000E-05 Akv_bak Background vertical mixing coefficient (m2/s) for momentum. 1.0000E-03 Akv_limit Vertical viscosity upper threshold (m2/s) for momentum. 5.0000E-06 Akk_bak Background vertical mixing coefficient (m2/s) for turbulent energy. 5.0000E-06 Akp_bak Background vertical mixing coefficient (m2/s) for turbulent generic statistical field. 3.000 gls_p GLS stability exponent. 1.500 gls_m GLS turbulent kinetic energy exponent. -1.000 gls_n GLS turbulent length scale exponent. 7.6000E-06 gls_Kmin GLS minimum value of turbulent kinetic energy. 1.0000E-12 gls_Pmin GLS minimum value of dissipation. 5.4770E-01 gls_cmu0 GLS stability coefficient. 1.4400E+00 gls_c1 GLS shear production coefficient. 1.9200E+00 gls_c2 GLS dissipation coefficient. -4.0000E-01 gls_c3m GLS stable buoyancy production coefficient. 1.0000E+00 gls_c3p GLS unstable buoyancy production coefficient. 1.0000E+00 gls_sigk GLS constant Schmidt number for TKE. 1.3000E+00 gls_sigp GLS constant Schmidt number for PSI. 1400.000 charnok_alpha Charnok factor for Zos calculation. 0.500 zos_hsig_alpha Factor for Zos calculation using Hsig(Awave). 0.250 sz_alpha Factor for Wave dissipation surface tke flux . 100.000 crgban_cw Factor for Craig/Banner surface tke flux. 0.000 wec_alpha WEC factor for roller/breaking energy distribution. 3.0000E-04 rdrg Linear bottom drag coefficient (m/s). 2.5000E-02 rdrg2 Quadratic bottom drag coefficient. 2.0000E-02 Zob Bottom roughness (m). 2.0000E-02 Zos Surface roughness (m). 1 lmd_Jwt Jerlov water type. 2 Vtransform S-coordinate transformation equation. 4 Vstretching S-coordinate stretching function. 6.0000E+00 theta_s S-coordinate surface control parameter. 4.0000E-01 theta_b S-coordinate bottom control parameter. 50.000 Tcline S-coordinate surface/bottom layer width (m) used in vertical coordinate stretching. 1025.000 rho0 Mean density (kg/m3) for Boussinesq approximation. 57665.000 dstart Time-stamp assigned to model initialization (days). 57665.000 tide_start Reference time origin for tidal forcing (days). 18581117.00 time_ref Reference time for units attribute (yyyymmdd.dd) 1.0000E+00 Tnudg(01) Nudging/relaxation time scale (days) for tracer 01: temp 1.0000E+00 Tnudg(02) Nudging/relaxation time scale (days) for tracer 02: salt 0.0000E+00 Znudg Nudging/relaxation time scale (days) for free-surface. 0.0000E+00 M2nudg Nudging/relaxation time scale (days) for 2D momentum. 1.0000E+00 M3nudg Nudging/relaxation time scale (days) for 3D momentum. 0.0000E+00 obcfac Factor between passive and active open boundary conditions. F VolCons(1) NLM western edge boundary volume conservation. F VolCons(2) NLM southern edge boundary volume conservation. F VolCons(3) NLM eastern edge boundary volume conservation. F VolCons(4) NLM northern edge boundary volume conservation. 10.000 T0 Background potential temperature (C) constant. 30.000 S0 Background salinity (PSU) constant. 1.000 gamma2 Slipperiness variable: free-slip (1.0) or no-slip (-1.0). F LuvSrc Turning OFF momentum point Sources/Sinks. F LwSrc Turning OFF volume influx point Sources/Sinks. F LtracerSrc(01) Turning OFF point Sources/Sinks on tracer 01: temp F LtracerSrc(02) Turning OFF point Sources/Sinks on tracer 02: salt F LsshCLM Turning OFF processing of SSH climatology. F Lm2CLM Turning OFF processing of 2D momentum climatology. F Lm3CLM Turning OFF processing of 3D momentum climatology. T LtracerCLM(01) Turning ON processing of climatology tracer 01: temp T LtracerCLM(02) Turning ON processing of climatology tracer 02: salt F LnudgeM2CLM Turning OFF nudging of 2D momentum climatology. F LnudgeM3CLM Turning OFF nudging of 3D momentum climatology. T LnudgeTCLM(01) Turning ON nudging of climatology tracer 01: temp T LnudgeTCLM(02) Turning ON nudging of climatology tracer 02: salt

      T  Hout(idFsur)      Write out free-surface.
      T  Hout(idUbar)      Write out 2D U-momentum component.
      T  Hout(idVbar)      Write out 2D V-momentum component.
      T  Hout(idUvel)      Write out 3D U-momentum component.
      T  Hout(idVvel)      Write out 3D V-momentum component.
      T  Hout(idWvel)      Write out W-momentum component.
      T  Hout(idOvel)      Write out omega vertical velocity.
      T  Hout(idTvar)      Write out tracer 01: temp
      T  Hout(idTvar)      Write out tracer 02: salt
      T  Hout(idUsms)      Write out surface U-momentum stress.
      T  Hout(idVsms)      Write out surface V-momentum stress.
      T  Hout(idUbms)      Write out bottom U-momentum stress.
      T  Hout(idVbms)      Write out bottom V-momentum stress.
      T  Hout(idU2Sd)      Write out 2D u-momentum stokes velocity.
      T  Hout(idV2Sd)      Write out 2D v-momentum stokes velocity.
      T  Hout(idU3Sd)      Write out 3D u-momentum stokes velocity.
      T  Hout(idV3Sd)      Write out 3D v-momentum stokes velocity.
      T  Hout(idW3Sd)      Write out 3D omega-momentum stokes velocity.
      T  Hout(idW3St)      Write out 3D w-momentum stokes velocity.
      T  Hout(idWztw)      Write out WEC quasi-static sea level adjustment.
      T  Hout(idWqsp)      Write out WEC quasi-static pressure.
      T  Hout(idWbeh)      Write out WEC Bernoulli head.
      T  Hout(idWamp)      Write out wave height.
      T  Hout(idWlen)      Write out wavelength.
      T  Hout(idWlep)      Write out peak wavelength.
      T  Hout(idWdir)      Write out mean wave direction.
      T  Hout(idWdip)      Write out peak wave direction.
      T  Hout(idWptp)      Write out wave surface period.
      T  Hout(idWpbt)      Write out wave bottom period.
      T  Hout(idWorb)      Write out wave bottom orbital velocity.
      T  Hout(idUwav)      Wave-avg surface u-velocity.
      T  Hout(idVwav)      Wave-avg surface v-velocity.
      T  Hout(idPair)      Write out surface air pressure.
      T  Hout(idTsur)      Write out surface net heat flux.
      T  Hout(idTsur)      Write out surface net salt flux.
      T  Hout(idSrad)      Write out shortwave radiation flux.
      T  Hout(idLrad)      Write out longwave radiation flux.
      T  Hout(idLhea)      Write out latent heat flux.
      T  Hout(idShea)      Write out sensible heat flux.
      T  Hout(idEmPf)      Write out E-P flux.
      T  Hout(idevap)      Write out evaporation rate.
      T  Hout(idrain)      Write out rain rate.
      T  Hout(idVvis)      Write out vertical viscosity: AKv.
      T  Hout(idMtke)      Write out turbulent kinetic energy.
      T  Hout(idMtls)      Write out turbulent generic length-scale.

      T  Aout(idSdif)      Write out averaged vertical diffusion: AKt(isalt).

Output/Input Files:

           Output Restart File:  test2_ocean_rst.nc
           Output History File:  test2_ocean_his.nc
          Output Averages File:  test2_ocean_avg.nc
      Physical parameters File:  
               Input Grid File:  Projects/test2/Matthew_roms_grid.nc
  Input Nonlinear Initial File:  Projects/test2/coawst_ini.nc
            Tidal Forcing File:  Projects/test2/tide_forc_Matthew.nc
     Input Climatology File 01:  Projects/test2/merged_coawst_clm.nc
Input Lateral Boundary File 01:  Projects/test2/merged_coawst_bdy.nc

ROMS I/O variables Metadata File: ROMS/External/varinfo.dat

Tile partition information for Grid 01: 214x101x12 tiling: 1x1

 tile     Istr     Iend     Jstr     Jend     Npts

    0        1      214        1      101   259368

Tile minimum and maximum fractional coordinates for Grid 01: (interior points only)

 tile     Xmin     Xmax     Ymin     Ymax     grid

    0     0.50   214.50     0.50   101.50  RHO-points

    0     1.00   214.00     0.50   101.50    U-points

    0     0.50   214.50     1.00   101.00    V-points

Maximum halo size in XI and ETA directions:

           HaloSizeI(1) =     450
           HaloSizeJ(1) =     222
            TileSide(1) =     219
            TileSize(1) =   22995

Tracer Advection Scheme: NLM

Variable Grid Horizontal Vertical


temp 1 Upstream3 Centered4

salt 1 Upstream3 Centered4

Akima4 Fourth-order Akima advection Centered2 Second-order centered differences advection Centered4 Fourth-order centered differences advection HSIMT Third High-order Spatial Inteporlation at Middle Time Advection with TVD limiter MPDATA Multidimensional Positive Definite Advection Algorithm, recursive method Splines Conservative Parabolic Splines Reconstruction Advection (only vertical; not recommended) Split_U3 Split third-order Upstream Advection Upstream3 Third-order Upstream-biased Advection (only horizontal)

Lateral Boundary Conditions: NLM

Variable Grid West Edge South Edge East Edge North Edge


zeta 1 Closed Chapman Imp Chapman Imp Chapman Imp

ubar 1 Closed Flather Flather Flather

vbar 1 Closed Flather Flather Flather

u 1 Closed Nested Nested Nested

v 1 Closed Nested Nested Nested

temp 1 Gradient Nested Nested Gradient

salt 1 Gradient Nested Nested Gradient

tke 1 Closed Gradient Gradient Gradient

ubar_stokes 1 Closed Gradient Gradient Gradient

vbar_stokes 1 Closed Gradient Gradient Gradient

u_stokes 1 Closed Gradient Gradient Gradient

v_stokes 1 Closed Gradient Gradient Gradient

Activated C-preprocessing Options:

TEST2 Hurricane Matthew ANA_BSFLUX Analytical kinematic bottom salinity flux ANA_BTFLUX Analytical kinematic bottom temperature flux ANA_FSOBC Analytical free-surface boundary conditions ANA_M2OBC Analytical 2D momentum boundary conditions ANA_NUDGCOEF Analytical spatially varying nudging time-scales ANA_SRFLUX Analytical kinematic shortwave radiation flux ASSUMED_SHAPE Using assumed-shape arrays ATM_PRESS Impose atmospheric pressure onto sea surface ATM2OCN_FLUXES Surface fluxes from ATM Model. AVERAGES Writing out time-averaged nonlinear model fields !BOUNDARY_ALLGATHER Using mpi_allreduce in mp_boundary routine !COLLECT_ALL... Using mpi_isend/mpi_recv in mp_collect routine CHARNOK Charnok surface roughness from wind stress CRAIG_BANNER Craig and Banner wave breaking surface flux COARE_TAYLOR_YELLAND Taylor and Yelland (2001) relation for ZoW in bulk fluxes CURVGRID Orthogonal curvilinear grid DJ_GRADPS Parabolic Splines density Jacobian (Shchepetkin, 2002) DOUBLE_PRECISION Double precision arithmetic numerical kernel. FRC_COUPLING Atmospheric forcing fields are from ESM coupling GLS_MIXING Generic Length-Scale turbulence closure KANTHA_CLAYSON Kantha and Clayson stability function formulation LIMIT_VDIFF Impose an upper limit on vertical diffusion coefficient LIMIT_VVISC Impose an upper limit on vertical viscosity coefficient MASKING Land/Sea masking MCT_LIB Using Model Coupling Toolkit library MIX_GEO_TS Mixing of tracers along geopotential surfaces MIX_S_UV Mixing of momentum along constant S-surfaces MPI MPI distributed-memory configuration WEC_VF Vortex Force wave current interaction WDISS_WAVEMOD Wave energy dissipation acquired from coupled wave model NONLINEAR Nonlinear Model NONLIN_EOS Nonlinear Equation of State for seawater N2S2_HORAVG Horizontal smoothing of buoyancy and shear POWER_LAW Power-law shape time-averaging barotropic filter PROFILE Time profiling activated K_GSCHEME Third-order upstream advection of TKE fields RAMP_TIDES Ramping tidal forcing for one day REDUCE_ALLREDUCE Using mpi_allreduce in mp_reduce routine RI_SPLINES Parabolic Spline Reconstruction for Richardson Number !RST_SINGLE Double precision fields in restart NetCDF file SALINITY Using salinity SOLAR_SOURCE Solar Radiation Source Term SOLVE3D Solving 3D Primitive Equations SPLINES_VDIFF Parabolic Spline Reconstruction for Vertical Diffusion SPLINES_VVISC Parabolic Spline Reconstruction for Vertical Viscosity SSH_TIDES Add tidal elevation to SSH climatology SWAN_COUPLING SWAN model coupling TS_DIF2 Harmonic mixing of tracers UV_ADV Advection of momentum UV_COR Coriolis term UV_U3HADVECTION Third-order upstream horizontal advection of 3D momentum UV_C4VADVECTION Fourth-order centered vertical advection of momentum UV_KIRBY Compute uwave and vwave Kirby avg velocities. UV_LOGDRAG Logarithmic bottom stress UV_TIDES Add tidal currents to 2D momentum climatologies UV_VIS2 Harmonic mixing of momentum VAR_RHO_2D Variable density barotropic mode WAVES_OCEAN Two-way wave-ocean models coupling. WRF_COUPLING WRF model coupling.

Process Information:

Node # 0 (pid= 161857) is active. alloc_space_field: domain 1 , 311709404 bytes allocated alloc_space_field: domain 1 , 311709404 bytes allocated med_initialdata_input: calling input_input med_initialdata_input: calling input_input Input data is acceptable to use: wrfinput_d01 Input data is acceptable to use: wrfinput_d01 CURRENT DATE = 2016-10-04_00:00:00 CURRENT DATE = 2016-10-04_00:00:00 SIMULATION START DATE = 2016-10-04_00:00:00 SIMULATION START DATE = 2016-10-04_00:00:00 Timing for processing wrfinput file (stream 0) for domain 1: 0.35330 elapsed seconds Timing for processing wrfinput file (stream 0) for domain 1: 0.35330 elapsed seconds Max map factor in domain 1 = 1.05. Scale the dt in the model accordingly. Max map factor in domain 1 = 1.05. Scale the dt in the model accordingly. D01: Time step = 150.000000 (s) D01: Grid Distance = 27.0000000 (km) D01: Time step = 150.000000 (s) D01: Grid Distance = 27.0000000 (km) D01: Grid Distance Ratio dt/dx = 5.55555534 (s/km) D01: Grid Distance Ratio dt/dx = 5.55555534 (s/km) D01: Ratio Including Maximum Map Factor = 5.83250475 (s/km) D01: Ratio Including Maximum Map Factor = 5.83250475 (s/km) D01: NML defined reasonable_time_step_ratio = 6.00000000 D01: NML defined reasonable_time_step_ratio = 6.00000000 INPUT LandUse = "USGS" INPUT LandUse = "USGS" LANDUSE TYPE = "USGS" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 16 SNOW CATEGORY = 24 LANDUSE TYPE = "USGS" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 16 SNOW CATEGORY = 24 INITIALIZE THREE Noah LSM RELATED TABLES INITIALIZE THREE Noah LSM RELATED TABLES LANDUSE TYPE = USGS FOUND 27 CATEGORIES LANDUSE TYPE = USGS FOUND 27 CATEGORIES INPUT SOIL TEXTURE CLASSIFICATION = STAS INPUT SOIL TEXTURE CLASSIFICATION = STAS SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES At line 602 of file waves_coupler.f90 Fortran runtime error: Index '1' of dimension 1 of array 'globalsegmap_g' above upper bound of 0

Error termination. Backtrace:

0 0x7fc095904d21 in ???

1 0x7fc095905869 in ???

2 0x7fc095905ee6 in ???

3 0x5560fad159b4 in __waves_coupler_mod_MOD_initialize_wav_routers

at /home/lvproveyer/Programs/test2/Build/waves_coupler.f90:602

4 0x5560facd0d7b in __waves_control_mod_MOD_swan_driver_init

at /home/lvproveyer/Programs/test2/Build/waves_control.f90:84

5 0x5560f71a3716 in mct_driver

at /home/lvproveyer/Programs/test2/Build/master.f90:360

6 0x5560f71a4081 in main

at /home/lvproveyer/Programs/test2/Build/master.f90:23

================================================================= ==161858==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 100000 byte(s) in 1 object(s) allocated from:

0 0x7fc096108808 in __interceptor_malloc ../../../../src/libsanitizer/asan/asan_malloc_linux.cc:144

#1 0x5560fb07e7fc in __swpoint_mod_MOD_allocate_swan_arrays /home/lvproveyer/Programs/test2/Build/swpoint.f90:136
#2 0x5560faf1a2fd in swan_initialize_ /home/lvproveyer/Programs/test2/Build/swanmain.f90:261
#3 0x5560facd0c9b in __waves_control_mod_MOD_swan_driver_init /home/lvproveyer/Programs/test2/Build/waves_control.f90:77
#4 0x5560f71a3716 in mct_driver /home/lvproveyer/Programs/test2/Build/master.f90:360
#5 0x5560f71a4081 in main /home/lvproveyer/Programs/test2/Build/master.f90:23
#6 0x7fc094bc7082 in __libc_start_main ../csu/libc-start.c:308

Direct leak of 280 byte(s) in 1 object(s) allocated from:

0 0x7fc096108808 in __interceptor_malloc ../../../../src/libsanitizer/asan/asan_malloc_linux.cc:144

#1 0x5560fb7f0a6f in swboun_ /home/lvproveyer/Programs/test2/Build/swanpre2.f90:3520
#2 0x5560fb2c1a03 in swread_ /home/lvproveyer/Programs/test2/Build/swanpre1.f90:1851
#3 0x5560faf2b235 in swan_initialize_ /home/lvproveyer/Programs/test2/Build/swanmain.f90:332
#4 0x5560facd0c9b in __waves_control_mod_MOD_swan_driver_init /home/lvproveyer/Programs/test2/Build/waves_control.f90:77
#5 0x5560f71a3716 in mct_driver /home/lvproveyer/Programs/test2/Build/master.f90:360
#6 0x5560f71a4081 in main /home/lvproveyer/Programs/test2/Build/master.f90:23
#7 0x7fc094bc7082 in __libc_start_main ../csu/libc-start.c:308

Direct leak of 16 byte(s) in 1 object(s) allocated from:

0 0x7fc096108808 in __interceptor_malloc ../../../../src/libsanitizer/asan/asan_malloc_linux.cc:144

#1 0x5560fb7d9e06 in swboun_ /home/lvproveyer/Programs/test2/Build/swanpre2.f90:2947
#2 0x5560fb2c1a03 in swread_ /home/lvproveyer/Programs/test2/Build/swanpre1.f90:1851
#3 0x5560faf2b235 in swan_initialize_ /home/lvproveyer/Programs/test2/Build/swanmain.f90:332
#4 0x5560facd0c9b in __waves_control_mod_MOD_swan_driver_init /home/lvproveyer/Programs/test2/Build/waves_control.f90:77
#5 0x5560f71a3716 in mct_driver /home/lvproveyer/Programs/test2/Build/master.f90:360
#6 0x5560f71a4081 in main /home/lvproveyer/Programs/test2/Build/master.f90:23
#7 0x7fc094bc7082 in __libc_start_main ../csu/libc-start.c:308

Indirect leak of 352 byte(s) in 22 object(s) allocated from:

0 0x7fc096108808 in __interceptor_malloc ../../../../src/libsanitizer/asan/asan_malloc_linux.cc:144

#1 0x5560fb7d9e06 in swboun_ /home/lvproveyer/Programs/test2/Build/swanpre2.f90:2947
#2 0x5560fb2c1a03 in swread_ /home/lvproveyer/Programs/test2/Build/swanpre1.f90:1851
#3 0x5560faf2b235 in swan_initialize_ /home/lvproveyer/Programs/test2/Build/swanmain.f90:332
#4 0x5560facd0c9b in __waves_control_mod_MOD_swan_driver_init /home/lvproveyer/Programs/test2/Build/waves_control.f90:77
#5 0x5560f71a3716 in mct_driver /home/lvproveyer/Programs/test2/Build/master.f90:360
#6 0x5560f71a4081 in main /home/lvproveyer/Programs/test2/Build/master.f90:23
#7 0x7fc094bc7082 in __libc_start_main ../csu/libc-start.c:308

SUMMARY: AddressSanitizer: 100648 byte(s) leaked in 25 allocation(s).

jcwarner-usgs commented 2 years ago

is your swan dt = 1800s? that might be too large, suggest more like 300 or 600 ? but that is not the problem. can you send me your swan.in file?

r0squete commented 2 years ago

swan_matthew.in.txt

r0squete commented 2 years ago

There is my swan input. I will try with other swan dt.

jcwarner-usgs commented 2 years ago

ok try a few things.

comment out the Quad: & QUAD

what is the QC after coords spherical ?

are you running swan in cartesian? the others are in nautical.

r0squete commented 2 years ago

QC represent the projection method in case of spherical coordinates, in this case is quasi-cartesian. I commented the QUAD and tried with nautical convention but it didn't work. I am getting the same error message

jcwarner-usgs commented 2 years ago

are you getting any PRINT or Err files? maybe you should compile with SWAN_MODEL only that and see if it works.

r0squete commented 2 years ago

Hello! First of all thanks for answering all my questions. When I tried to run compiling only SWAN model I get this error:

Fatal error in PMPI_Comm_rank: Invalid communicator, error stack: PMPI_Comm_rank(111): MPI_Comm_rank(comm=0x0, rank=0x7ffff5dd0468) failed PMPI_Comm_rank(68).: Invalid communicator

It seems to be related with conflicts due to several versions of MPI library coexisting in the computer. Nevertheless I was able to run the SWAN experiment using the SWAN model version 41.31 independent of COAWST, and on the other hand remember that I I was able to run the Sandy experiment. About the print or err files, they are created but don't have any information, the files are blank.

jcwarner-usgs commented 1 year ago

when you run SWAN alone as compiled with coawst, what is your run command? mpirun -np X ./coawstM swan.in ??

what is the full std out? does it just say that mpi issue?

r0squete commented 1 year ago

Hi! There is my command run and yes, that is all my std out

mpirun -np 1 ./coawstM /home/lvproveyer/Programs/tswan/Projects/tswan/tswan.in

Fatal error in PMPI_Comm_rank: Invalid communicator, error stack: PMPI_Comm_rank(111): MPI_Comm_rank(comm=0x0, rank=0x7ffd50f1d100) failed PMPI_Comm_rank(68).: Invalid communicator

jcwarner-usgs commented 1 year ago

looks odd. how did you compile coawstM ? can u send coawst.bash

r0squete commented 1 year ago

I tried with this two versions. The result was the same.

coawst.bash1.txt coawst.bash2.txt

jcwarner-usgs commented 1 year ago

when it built, what compiler flags did it use? i see you commented out the Compilers/ dir option. what are the FFLAGS? so when you say ./coawst.bash what happens next?

r0squete commented 1 year ago

temp1.txt This is the std out for the compilation process

jcwarner-usgs commented 1 year ago

i guess just make sure mpirun is the same verion/compiler as mpif90.

try this, type which mpif90 which mpirun and make sure they are pointing to similar mpi versions

r0squete commented 1 year ago

I think they are pointing to the same mpi version, I don't know what it's happening...

$ which mpirun /home/lvproveyer/Libs_COAWST/Library/bin/mpirun

$ which mpif90 /home/lvproveyer/Libs_COAWST/Library/bin/mpif90

jcwarner-usgs commented 1 year ago

try mpif90 -version (or something like that) mpirun -version

r0squete commented 1 year ago

When I type mpirun -version I get: HYDRA build details: Version: 3.3.1 Release Date: Wed Jun 5 14:57:33 CDT 2019 CC: gcc -I/home/lvproveyer/Libs_COAWST/Library/include -L/home/lvproveyer/Libs_COAWST/Library/lib -lnetcdf -lhdf5_hl -lhdf5 -lz CXX: g++ -I/home/lvproveyer/Libs_COAWST/Library/include -L/home/lvproveyer/Libs_COAWST/Library/lib -lnetcdf -lhdf5_hl -lhdf5 -lz F77: gfortran -L/home/lvproveyer/Libs_COAWST/Library/lib -lnetcdf -lhdf5_hl -lhdf5 -lz F90: gfortran -L/home/lvproveyer/Libs_COAWST/Library/lib -lnetcdf -lhdf5_hl -lhdf5 -lz Configure options: '--disable-option-checking' '--prefix=/home/lvproveyer/Libs_COAWST/Library' 'LDFLAGS=-L/home/lvproveyer/Libs_COAWST/Library/lib' 'LIBS=-lnetcdf -lhdf5_hl -lhdf5 -lz' 'CPPFLAGS=-I/home/lvproveyer/Libs_COAWST/Library/include -I/home/lvproveyer/Libs_COAWST/Downloads/mpich-3.3.1/src/mpl/include -I/home/lvproveyer/Libs_COAWST/Downloads/mpich-3.3.1/src/mpl/include -I/home/lvproveyer/Libs_COAWST/Downloads/mpich-3.3.1/src/openpa/src -I/home/lvproveyer/Libs_COAWST/Downloads/mpich-3.3.1/src/openpa/src -D_REENTRANT -I/home/lvproveyer/Libs_COAWST/Downloads/mpich-3.3.1/src/mpi/romio/include' '--cache-file=/dev/null' '--srcdir=.' 'CC=gcc' 'CFLAGS= -O2' 'MPLLIBNAME=mpl' Process Manager: pmi Launchers available: ssh rsh fork slurm ll lsf sge manual persist Topology libraries available: hwloc Resource management kernels available: user slurm ll lsf sge pbs cobalt Checkpointing libraries available:
Demux engines available: poll select ................................................................................................................................................. And I looked in /home/lvproveyer/Libs_COAWST/Library/bin/mpif90 and I found MPICH_VERSION="3.3.1". That seems to be fine, right?

jcwarner-usgs commented 1 year ago

what do you get for mpirun -version

r0squete commented 1 year ago

I get this:

HYDRA build details: Version: 3.3.1 Release Date: Wed Jun 5 14:57:33 CDT 2019 CC: gcc -I/home/lvproveyer/Libs_COAWST/Library/include -L/home/lvproveyer/Libs_COAWST/Library/lib -lnetcdf -lhdf5_hl -lhdf5 -lz CXX: g++ -I/home/lvproveyer/Libs_COAWST/Library/include -L/home/lvproveyer/Libs_COAWST/Library/lib -lnetcdf -lhdf5_hl -lhdf5 -lz F77: gfortran -L/home/lvproveyer/Libs_COAWST/Library/lib -lnetcdf -lhdf5_hl -lhdf5 -lz F90: gfortran -L/home/lvproveyer/Libs_COAWST/Library/lib -lnetcdf -lhdf5_hl -lhdf5 -lz Configure options: '--disable-option-checking' '--prefix=/home/lvproveyer/Libs_COAWST/Library' 'LDFLAGS=-L/home/lvproveyer/Libs_COAWST/Library/lib' 'LIBS=-lnetcdf -lhdf5_hl -lhdf5 -lz' 'CPPFLAGS=-I/home/lvproveyer/Libs_COAWST/Library/include -I/home/lvproveyer/Libs_COAWST/Downloads/mpich-3.3.1/src/mpl/include -I/home/lvproveyer/Libs_COAWST/Downloads/mpich-3.3.1/src/mpl/include -I/home/lvproveyer/Libs_COAWST/Downloads/mpich-3.3.1/src/openpa/src -I/home/lvproveyer/Libs_COAWST/Downloads/mpich-3.3.1/src/openpa/src -D_REENTRANT -I/home/lvproveyer/Libs_COAWST/Downloads/mpich-3.3.1/src/mpi/romio/include' '--cache-file=/dev/null' '--srcdir=.' 'CC=gcc' 'CFLAGS= -O2' 'MPLLIBNAME=mpl' Process Manager: pmi Launchers available: ssh rsh fork slurm ll lsf sge manual persist Topology libraries available: hwloc Resource management kernels available: user slurm ll lsf sge pbs cobalt Checkpointing libraries available:
Demux engines available: poll select

jcwarner-usgs commented 1 year ago

everything online that i see is saying that there is a mix up between the versions of mpi used for compile, and the version being used for the run.
maybe be explicit /home/lvproveyer/Libs_COAWST/Library/bin/mpirun -np 1 ./coawstM /home/lvproveyer/Programs/tswan/Projects/tswan/tswan.in

r0squete commented 1 year ago

Hi again! Sorry for the delay in reply. I have made some progress. After change the debbuging flags my WRF-ROMS-SWAN experiment started to run, but now it is blowing up. Here's my stdout partially:

............................................................................................................................................................................ WAVgrid 01 dt= 180.0 -to- OCNgrid 01 dt= 15.0, CplInt: 1800.0 Steps: 010

   OCNgrid 01 dt=  15.0 -to- WAVgrid 01 dt= 180.0, CplInt:  1800.0 Steps: 120

   ATMgrid 01 dt= 150.0 -to- OCNgrid 01 dt=  15.0, CplInt:  1800.0 Steps: 012

   OCNgrid 01 dt=  15.0 -to- ATMgrid 01 dt= 150.0, CplInt:  1800.0 Steps: 120

   ATMgrid 02 dt=  50.0 -to- OCNgrid 01 dt=  15.0, CplInt:  1800.0 Steps: 036

   OCNgrid 01 dt=  15.0 -to- ATMgrid 02 dt=  50.0, CplInt:  1800.0 Steps: 120

   ATMgrid 01 dt= 150.0 -to- WAVgrid 01 dt= 180.0, CplInt:  1800.0 Steps: 012

   WAVgrid 01 dt= 180.0 -to- ATMgrid 01 dt= 150.0, CplInt:  1800.0 Steps: 010

   ATMgrid 02 dt=  50.0 -to- WAVgrid 01 dt= 180.0, CplInt:  1800.0 Steps: 036

   WAVgrid 01 dt= 180.0 -to- ATMgrid 02 dt=  50.0, CplInt:  1800.0 Steps: 010

Model Input Parameters: ROMS/TOMS version 3.9
Thursday - October 27, 2022 - 11:25:57 AM

module_io_quilt_old.F 2931 F Quilting with 1 groups of 0 I/O tasks. Quilting with 1 groups of 0 I/O tasks.

SWAN grid 1 is preparing computation

Hurricane Matthew

Operating system : Linux CPU/hardware : x86_64 Compiler system : gfortran Compiler command : /home/lvproveyer/Libs_COAWST/Library/bin/mpif90 Compiler flags : -frepack-arrays -O3 -ffast-math -O3 -ftree-vectorize -ftree-loop-linear -funroll-loops -w - OCN Communicator : -2080374780, PET size = 1

Input Script :

SVN Root URL : SVN Revision :

Local Root : /home/lvproveyer/Programs/test2 Header Dir : /home/lvproveyer/Programs/test2 Header file : test2.h Analytical Dir : /home/lvproveyer/Programs/test2

Resolution, Grid 01: 214x101x12, Parallel Nodes: 1, Tiling: 1x1

Physical Parameters, Grid: 01

  17280  ntimes            Number of timesteps for 3-D equations.
 15.000  dt                Timestep size (s) for 3-D equations.
     10  ndtfast           Number of timesteps for 2-D equations between
                             each 3D timestep.
      1  ERstr             Starting ensemble/perturbation run number.
      1  ERend             Ending ensemble/perturbation run number.
      0  nrrec             Number of restart records to read from disk.
      T  LcycleRST         Switch to recycle time-records in restart file.
     60  nRST              Number of timesteps between the writing of data
                             into restart fields.
      1  ninfo             Number of timesteps between print of information
                             to standard output.
      T  ldefout           Switch to create a new output NetCDF file(s).
     60  nHIS              Number of timesteps between the writing fields
                             into history file.

1361569328 nQCK Number of timesteps between the writing fields into quicksave file. 1361590976 ndefQCK Number of timesteps between creation of new brief snpashots files. 1 ntsAVG Starting timestep for the accumulation of output time-averaged data. 432 nAVG Number of timesteps between the writing of time-averaged data into averages file. 2.0000E-01 nl_tnu2(01) NLM Horizontal, harmonic mixing coefficient (m2/s) for tracer 01: temp 2.0000E-01 nl_tnu2(02) NLM Horizontal, harmonic mixing coefficient (m2/s) for tracer 02: salt 1.0000E-01 nl_visc2 NLM Horizontal, harmonic mixing coefficient (m2/s) for momentum. F LuvSponge Turning OFF sponge on horizontal momentum. F LtracerSponge(01) Turning OFF sponge on tracer 01: temp F LtracerSponge(02) Turning OFF sponge on tracer 02: salt 1.0000E-06 Akt_bak(01) Background vertical mixing coefficient (m2/s) for tracer 01: temp 1.0000E-06 Akt_bak(02) Background vertical mixing coefficient (m2/s) for tracer 02: salt 1.0000E-03 Akt_limit(01) Vertical diffusion upper threshold (m2/s) for tracer 01: temp 1.0000E-03 Akt_limit(02) Vertical diffusion upper threshold (m2/s) for tracer 02: salt 1.0000E-05 Akv_bak Background vertical mixing coefficient (m2/s) for momentum. 1.0000E-03 Akv_limit Vertical viscosity upper threshold (m2/s) for momentum. 5.0000E-06 Akk_bak Background vertical mixing coefficient (m2/s) for turbulent energy. 5.0000E-06 Akp_bak Background vertical mixing coefficient (m2/s) for turbulent generic statistical field. 3.000 gls_p GLS stability exponent. 1.500 gls_m GLS turbulent kinetic energy exponent. -1.000 gls_n GLS turbulent length scale exponent. 7.6000E-06 gls_Kmin GLS minimum value of turbulent kinetic energy. 1.0000E-12 gls_Pmin GLS minimum value of dissipation. 5.4770E-01 gls_cmu0 GLS stability coefficient. 1.4400E+00 gls_c1 GLS shear production coefficient. 1.9200E+00 gls_c2 GLS dissipation coefficient. -4.0000E-01 gls_c3m GLS stable buoyancy production coefficient. 1.0000E+00 gls_c3p GLS unstable buoyancy production coefficient. 1.0000E+00 gls_sigk GLS constant Schmidt number for TKE. 1.3000E+00 gls_sigp GLS constant Schmidt number for PSI. 1400.000 charnok_alpha Charnok factor for Zos calculation. 0.500 zos_hsig_alpha Factor for Zos calculation using Hsig(Awave). 0.250 sz_alpha Factor for Wave dissipation surface tke flux . 100.000 crgban_cw Factor for Craig/Banner surface tke flux. 0.000 wec_alpha WEC factor for roller/breaking energy distribution. 3.0000E-04 rdrg Linear bottom drag coefficient (m/s). 2.5000E-02 rdrg2 Quadratic bottom drag coefficient. 2.0000E-02 Zob Bottom roughness (m). 2.0000E-02 Zos Surface roughness (m). 1 lmd_Jwt Jerlov water type. 2 Vtransform S-coordinate transformation equation. 4 Vstretching S-coordinate stretching function. 6.0000E+00 theta_s S-coordinate surface control parameter. 4.0000E-01 theta_b S-coordinate bottom control parameter. 50.000 Tcline S-coordinate surface/bottom layer width (m) used in vertical coordinate stretching. 1025.000 rho0 Mean density (kg/m3) for Boussinesq approximation. 57665.000 dstart Time-stamp assigned to model initialization (days). 57665.000 tide_start Reference time origin for tidal forcing (days). 18581117.00 time_ref Reference time for units attribute (yyyymmdd.dd) 1.0000E+00 Tnudg(01) Nudging/relaxation time scale (days) for tracer 01: temp 1.0000E+00 Tnudg(02) Nudging/relaxation time scale (days) for tracer 02: salt 0.0000E+00 Znudg Nudging/relaxation time scale (days) for free-surface. 0.0000E+00 M2nudg Nudging/relaxation time scale (days) for 2D momentum. 1.0000E+00 M3nudg Nudging/relaxation time scale (days) for 3D momentum. 0.0000E+00 obcfac Factor between passive and active open boundary conditions. F VolCons(1) NLM western edge boundary volume conservation. F VolCons(2) NLM southern edge boundary volume conservation. F VolCons(3) NLM eastern edge boundary volume conservation. F VolCons(4) NLM northern edge boundary volume conservation. 10.000 T0 Background potential temperature (C) constant. 30.000 S0 Background salinity (PSU) constant. 1.000 gamma2 Slipperiness variable: free-slip (1.0) or no-slip (-1.0). F LuvSrc Turning OFF momentum point Sources/Sinks. F LwSrc Turning OFF volume influx point Sources/Sinks. F LtracerSrc(01) Turning OFF point Sources/Sinks on tracer 01: temp F LtracerSrc(02) Turning OFF point Sources/Sinks on tracer 02: salt F LsshCLM Turning OFF processing of SSH climatology. F Lm2CLM Turning OFF processing of 2D momentum climatology. F Lm3CLM Turning OFF processing of 3D momentum climatology. T LtracerCLM(01) Turning ON processing of climatology tracer 01: temp T LtracerCLM(02) Turning ON processing of climatology tracer 02: salt F LnudgeM2CLM Turning OFF nudging of 2D momentum climatology. F LnudgeM3CLM Turning OFF nudging of 3D momentum climatology. T LnudgeTCLM(01) Turning ON nudging of climatology tracer 01: temp T LnudgeTCLM(02) Turning ON nudging of climatology tracer 02: salt

      T  Hout(idFsur)      Write out free-surface.
      T  Hout(idUbar)      Write out 2D U-momentum component.
      T  Hout(idVbar)      Write out 2D V-momentum component.
      T  Hout(idUvel)      Write out 3D U-momentum component.
      T  Hout(idVvel)      Write out 3D V-momentum component.
      T  Hout(idWvel)      Write out W-momentum component.
      T  Hout(idOvel)      Write out omega vertical velocity.
      T  Hout(idTvar)      Write out tracer 01: temp
      T  Hout(idTvar)      Write out tracer 02: salt
      T  Hout(idUsms)      Write out surface U-momentum stress.
      T  Hout(idVsms)      Write out surface V-momentum stress.
      T  Hout(idUbms)      Write out bottom U-momentum stress.
      T  Hout(idVbms)      Write out bottom V-momentum stress.
      T  Hout(idU2Sd)      Write out 2D u-momentum stokes velocity.
      T  Hout(idV2Sd)      Write out 2D v-momentum stokes velocity.
      T  Hout(idU3Sd)      Write out 3D u-momentum stokes velocity.
      T  Hout(idV3Sd)      Write out 3D v-momentum stokes velocity.
      T  Hout(idW3Sd)      Write out 3D omega-momentum stokes velocity.
      T  Hout(idW3St)      Write out 3D w-momentum stokes velocity.
      T  Hout(idWztw)      Write out WEC quasi-static sea level adjustment.
      T  Hout(idWqsp)      Write out WEC quasi-static pressure.
      T  Hout(idWbeh)      Write out WEC Bernoulli head.
      T  Hout(idWamp)      Write out wave height.
      T  Hout(idWlen)      Write out wavelength.
      T  Hout(idWlep)      Write out peak wavelength.
      T  Hout(idWdir)      Write out mean wave direction.
      T  Hout(idWdip)      Write out peak wave direction.
      T  Hout(idWptp)      Write out wave surface period.
      T  Hout(idWpbt)      Write out wave bottom period.
      T  Hout(idWorb)      Write out wave bottom orbital velocity.
      T  Hout(idUwav)      Wave-avg surface u-velocity.
      T  Hout(idVwav)      Wave-avg surface v-velocity.
      T  Hout(idPair)      Write out surface air pressure.
      T  Hout(idTsur)      Write out surface net heat flux.
      T  Hout(idTsur)      Write out surface net salt flux.
      T  Hout(idSrad)      Write out shortwave radiation flux.
      T  Hout(idLrad)      Write out longwave radiation flux.
      T  Hout(idLhea)      Write out latent heat flux.
      T  Hout(idShea)      Write out sensible heat flux.
      T  Hout(idEmPf)      Write out E-P flux.
      T  Hout(idevap)      Write out evaporation rate.
      T  Hout(idrain)      Write out rain rate.
      T  Hout(idVvis)      Write out vertical viscosity: AKv.
      T  Hout(idMtke)      Write out turbulent kinetic energy.
      T  Hout(idMtls)      Write out turbulent generic length-scale.

      T  Qout(idFsur)      Write out free-surface.
      T  Qout(idUbar)      Write out 2D U-momentum component.
      T  Qout(idVbar)      Write out 2D V-momentum component.
      T  Qout(idu2dE)      Write out 2D U-eastward  at RHO-points.
      T  Qout(idv2dN)      Write out 2D V-northward at RHO-points.
      T  Qout(idUsur)      Write out surface U-momentum component.
      T  Qout(idVsur)      Write out surface V-momentum component.
      T  Qout(idsurT)      Write out surface tracer 01: temp_sur
      T  Qout(idsurT)      Write out surface tracer 02: salt_sur

      T  Aout(idSdif)      Write out averaged vertical diffusion: AKt(isalt).

Output/Input Files:

           Output Restart File:  test2_ocean_rst.nc
           Output History File:  test2_ocean_his.nc
          Output Averages File:  test2_ocean_avg.nc
      Physical parameters File:  
               Input Grid File:  Matthew_roms_grid.nc
  Input Nonlinear Initial File:  coawst_ini.nc
            Tidal Forcing File:  tide_forc_Matthew.nc
     Input Climatology File 01:  merged_coawst_clm.nc
Input Lateral Boundary File 01:  merged_coawst_bdy.nc

ROMS I/O variables Metadata File: ROMS/External/varinfo.dat

Tile partition information for Grid 01: 214x101x12 tiling: 1x1

 tile     Istr     Iend     Jstr     Jend     Npts

    0        1      214        1      101   259368

Tile minimum and maximum fractional coordinates for Grid 01: (interior points only)

 tile     Xmin     Xmax     Ymin     Ymax     grid

    0     0.50   214.50     0.50   101.50  RHO-points

    0     1.00   214.00     0.50   101.50    U-points

    0     0.50   214.50     1.00   101.00    V-points

Maximum halo size in XI and ETA directions:

           HaloSizeI(1) =     450
           HaloSizeJ(1) =     222
            TileSide(1) =     219
            TileSize(1) =   22995

Tracer Advection Scheme: NLM

Variable Grid Horizontal Vertical


temp 1 Upstream3 Centered4

salt 1 Upstream3 Centered4

Akima4 Fourth-order Akima advection Centered2 Second-order centered differences advection Centered4 Fourth-order centered differences advection HSIMT Third High-order Spatial Inteporlation at Middle Time Advection with TVD limiter MPDATA Multidimensional Positive Definite Advection Algorithm, recursive method Splines Conservative Parabolic Splines Reconstruction Advection (only vertical; not recommended) Split_U3 Split third-order Upstream Advection Upstream3 Third-order Upstream-biased Advection (only horizontal)

Lateral Boundary Conditions: NLM

Variable Grid West Edge South Edge East Edge North Edge


zeta 1 Closed Chapman Imp Chapman Imp Chapman Imp

ubar 1 Closed Flather Flather Flather

vbar 1 Closed Flather Flather Flather

u 1 Closed Nested Nested Nested

v 1 Closed Nested Nested Nested

temp 1 Gradient Nested Nested Gradient

salt 1 Gradient Nested Nested Gradient

tke 1 Closed Gradient Gradient Gradient

ubar_stokes 1 Closed Gradient Gradient Gradient

vbar_stokes 1 Closed Gradient Gradient Gradient

u_stokes 1 Closed Gradient Gradient Gradient

v_stokes 1 Closed Gradient Gradient Gradient

Activated C-preprocessing Options:

TEST2 Hurricane Matthew ANA_BSFLUX Analytical kinematic bottom salinity flux ANA_BTFLUX Analytical kinematic bottom temperature flux ANA_FSOBC Analytical free-surface boundary conditions ANA_M2OBC Analytical 2D momentum boundary conditions ANA_NUDGCOEF Analytical spatially varying nudging time-scales ANA_SRFLUX Analytical kinematic shortwave radiation flux ASSUMED_SHAPE Using assumed-shape arrays ATM_PRESS Impose atmospheric pressure onto sea surface ATM2OCN_FLUXES Surface fluxes from ATM Model. AVERAGES Writing out time-averaged nonlinear model fields !BOUNDARY_ALLGATHER Using mpi_allreduce in mp_boundary routine !COLLECT_ALL... Using mpi_isend/mpi_recv in mp_collect routine CHARNOK Charnok surface roughness from wind stress CRAIG_BANNER Craig and Banner wave breaking surface flux COARE_TAYLOR_YELLAND Taylor and Yelland (2001) relation for ZoW in bulk fluxes CURVGRID Orthogonal curvilinear grid DJ_GRADPS Parabolic Splines density Jacobian (Shchepetkin, 2002) DOUBLE_PRECISION Double precision arithmetic numerical kernel. FRC_COUPLING Atmospheric forcing fields are from ESM coupling GLS_MIXING Generic Length-Scale turbulence closure KANTHA_CLAYSON Kantha and Clayson stability function formulation LIMIT_VDIFF Impose an upper limit on vertical diffusion coefficient LIMIT_VVISC Impose an upper limit on vertical viscosity coefficient MASKING Land/Sea masking MCT_LIB Using Model Coupling Toolkit library MIX_GEO_TS Mixing of tracers along geopotential surfaces MIX_S_UV Mixing of momentum along constant S-surfaces MPI MPI distributed-memory configuration WEC_VF Vortex Force wave current interaction WDISS_WAVEMOD Wave energy dissipation acquired from coupled wave model NONLINEAR Nonlinear Model NONLIN_EOS Nonlinear Equation of State for seawater N2S2_HORAVG Horizontal smoothing of buoyancy and shear POWER_LAW Power-law shape time-averaging barotropic filter PROFILE Time profiling activated K_GSCHEME Third-order upstream advection of TKE fields RAMP_TIDES Ramping tidal forcing for one day REDUCE_ALLREDUCE Using mpi_allreduce in mp_reduce routine RI_SPLINES Parabolic Spline Reconstruction for Richardson Number !RST_SINGLE Double precision fields in restart NetCDF file SALINITY Using salinity SOLAR_SOURCE Solar Radiation Source Term SOLVE3D Solving 3D Primitive Equations SPLINES_VDIFF Parabolic Spline Reconstruction for Vertical Diffusion SPLINES_VVISC Parabolic Spline Reconstruction for Vertical Viscosity SSH_TIDES Add tidal elevation to SSH climatology SWAN_COUPLING SWAN model coupling TS_DIF2 Harmonic mixing of tracers UV_ADV Advection of momentum UV_COR Coriolis term UV_U3HADVECTION Third-order upstream horizontal advection of 3D momentum UV_C4VADVECTION Fourth-order centered vertical advection of momentum UV_KIRBY Compute uwave and vwave Kirby avg velocities. UV_LOGDRAG Logarithmic bottom stress UV_TIDES Add tidal currents to 2D momentum climatologies UV_VIS2 Harmonic mixing of momentum VAR_RHO_2D Variable density barotropic mode WAVES_OCEAN Two-way wave-ocean models coupling. WRF_COUPLING WRF model coupling.

Process Information:

Node # 0 (pid= 22769) is active. Ntasks in X 1 , ntasks in Y 1 Ntasks in X 1 , ntasks in Y 1 Domain # 1: dx = 27000.000 m Domain # 1: dx = 27000.000 m Domain # 2: dx = 9000.000 m Domain # 2: dx = 9000.000 m WRF V4.2.2 MODEL WRF V4.2.2 MODEL



Parent domain Parent domain ids,ide,jds,jde 1 145 1 82 ids,ide,jds,jde 1 145 1 82 ims,ime,jms,jme -4 150 -4 87 ims,ime,jms,jme -4 150 -4 87 ips,ipe,jps,jpe 1 145 1 82 ips,ipe,jps,jpe 1 145 1 82



DYNAMICS OPTION: Eulerian Mass Coordinate DYNAMICS OPTION: Eulerian Mass Coordinate alloc_space_field: domain 1 , 311709404 bytes allocated alloc_space_field: domain 1 , 311709404 bytes allocated med_initialdata_input: calling input_input med_initialdata_input: calling input_input Input data is acceptable to use: wrfinput_d01 Input data is acceptable to use: wrfinput_d01 CURRENT DATE = 2016-10-04_00:00:00 SIMULATION START DATE = 2016-10-04_00:00:00 CURRENT DATE = 2016-10-04_00:00:00 SIMULATION START DATE = 2016-10-04_00:00:00 Timing for processing wrfinput file (stream 0) for domain 1: 0.21124 elapsed seconds Timing for processing wrfinput file (stream 0) for domain 1: 0.21124 elapsed seconds Max map factor in domain 1 = 1.05. Scale the dt in the model accordingly. D01: Time step = 150.000000 (s) Max map factor in domain 1 = 1.05. Scale the dt in the model accordingly. D01: Time step = 150.000000 (s) D01: Grid Distance = 27.0000000 (km) D01: Grid Distance Ratio dt/dx = 5.55555534 (s/km) D01: Ratio Including Maximum Map Factor = 5.83250475 (s/km) D01: Grid Distance = 27.0000000 (km) D01: Grid Distance Ratio dt/dx = 5.55555534 (s/km) D01: Ratio Including Maximum Map Factor = 5.83250475 (s/km) D01: NML defined reasonable_time_step_ratio = 6.00000000 D01: NML defined reasonable_time_step_ratio = 6.00000000 INPUT LandUse = "USGS" INPUT LandUse = "USGS" LANDUSE TYPE = "USGS" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 16 SNOW CATEGORY = 24 LANDUSE TYPE = "USGS" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 16 SNOW CATEGORY = 24 INITIALIZE THREE Noah LSM RELATED TABLES INITIALIZE THREE Noah LSM RELATED TABLES LANDUSE TYPE = USGS FOUND 27 CATEGORIES LANDUSE TYPE = USGS FOUND 27 CATEGORIES INPUT SOIL TEXTURE CLASSIFICATION = STAS INPUT SOIL TEXTURE CLASSIFICATION = STAS SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES



Nesting domain Nesting domain ids,ide,jds,jde 1 262 1 130 ids,ide,jds,jde 1 262 1 130 ims,ime,jms,jme -4 267 -4 135 ims,ime,jms,jme -4 267 -4 135 ips,ipe,jps,jpe 1 262 1 130 ips,ipe,jps,jpe 1 262 1 130 INTERMEDIATE domain INTERMEDIATE domain ids,ide,jds,jde 28 120 14 62 ids,ide,jds,jde 28 120 14 62 ims,ime,jms,jme 23 125 9 67 ims,ime,jms,jme 23 125 9 67 ips,ipe,jps,jpe 26 122 12 64 ips,ipe,jps,jpe 26 122 12 64



d01 2016-10-04_00:00:00 alloc_space_field: domain 2 , 35732760 bytes allocated d01 2016-10-04_00:00:00 alloc_space_field: domain 2 , 35732760 bytes allocated d01 2016-10-04_00:00:00 alloc_space_field: domain 2 , 821470724 bytes allocated d01 2016-10-04_00:00:00 alloc_space_field: domain 2 , 821470724 bytes allocated d01 2016-10-04_00:00:00 Initializing nest domain # 2 from an input file. d01 2016-10-04_00:00:00 Initializing nest domain # 2 from an input file. d01 2016-10-04_00:00:00 med_initialdata_input: calling input_input d01 2016-10-04_00:00:00 med_initialdata_input: calling input_input d01 2016-10-04_00:00:00 Input data is acceptable to use: wrfinput_d02 d01 2016-10-04_00:00:00 Input data is acceptable to use: wrfinput_d02 Timing for processing wrfinput file (stream 0) for domain 2: 0.47102 elapsed seconds Timing for processing wrfinput file (stream 0) for domain 2: 0.47102 elapsed seconds INPUT LandUse = "USGS" INPUT LandUse = "USGS" LANDUSE TYPE = "USGS" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 16 SNOW CATEGORY = 24 LANDUSE TYPE = "USGS" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 16 SNOW CATEGORY = 24 INITIALIZE THREE Noah LSM RELATED TABLES INITIALIZE THREE Noah LSM RELATED TABLES LANDUSE TYPE = USGS FOUND 27 CATEGORIES LANDUSE TYPE = USGS FOUND 27 CATEGORIES INPUT SOIL TEXTURE CLASSIFICATION = STAS INPUT SOIL TEXTURE CLASSIFICATION = STAS SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES INPUT LandUse = "USGS" INPUT LandUse = "USGS" LANDUSE TYPE = "USGS" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 16 SNOW CATEGORY = 24 LANDUSE TYPE = "USGS" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 16 SNOW CATEGORY = 24 INITIALIZE THREE Noah LSM RELATED TABLES INITIALIZE THREE Noah LSM RELATED TABLES LANDUSE TYPE = USGS FOUND 27 CATEGORIES LANDUSE TYPE = USGS FOUND 27 CATEGORIES INPUT SOIL TEXTURE CLASSIFICATION = STAS INPUT SOIL TEXTURE CLASSIFICATION = STAS SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES Max map factor in domain 1 = 1.05. Scale the dt in the model accordingly. Max map factor in domain 1 = 1.05. Scale the dt in the model accordingly. D01: Time step = 150.000000 (s) D01: Time step = 150.000000 (s) D01: Grid Distance = 27.0000000 (km) D01: Grid Distance = 27.0000000 (km) D01: Grid Distance Ratio dt/dx = 5.55555534 (s/km) D01: Grid Distance Ratio dt/dx = 5.55555534 (s/km) D01: Ratio Including Maximum Map Factor = 5.83250475 (s/km) D01: Ratio Including Maximum Map Factor = 5.83250475 (s/km) D01: NML defined reasonable_time_step_ratio = 6.00000000 D01: NML defined reasonable_time_step_ratio = 6.00000000 INPUT LandUse = "USGS" INPUT LandUse = "USGS" LANDUSE TYPE = "USGS" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 16 SNOW CATEGORY = 24 LANDUSE TYPE = "USGS" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 16 SNOW CATEGORY = 24 INITIALIZE THREE Noah LSM RELATED TABLES INITIALIZE THREE Noah LSM RELATED TABLES LANDUSE TYPE = USGS FOUND 27 CATEGORIES LANDUSE TYPE = USGS FOUND 27 CATEGORIES INPUT SOIL TEXTURE CLASSIFICATION = STAS INPUT SOIL TEXTURE CLASSIFICATION = STAS SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES MCT::m_MCTWorld::initm_MCTERROR: MCTWorld has already been initialized...Continuing Timing for Writing wrfout_d01_2016-10-04_00:00:00 for domain 1: 0.56758 elapsed seconds Timing for Writing wrfout_d01_2016-10-04_00:00:00 for domain 1: 0.56758 elapsed seconds d01 2016-10-04_00:00:00 Input data is acceptable to use: wrflowinp_d01 d01 2016-10-04_00:00:00 Input data is acceptable to use: wrflowinp_d01 d01 2016-10-04_00:00:00 Input data processed for aux input 4 for domain 1 d01 2016-10-04_00:00:00 Input data processed for aux input 4 for domain 1 d01 2016-10-04_00:00:00 Input data is acceptable to use: wrfbdy_d01 d01 2016-10-04_00:00:00 Input data is acceptable to use: wrfbdy_d01 Timing for processing lateral boundary for domain 1: 0.06124 elapsed seconds Timing for processing lateral boundary for domain 1: 0.06124 elapsed seconds Tile Strategy is not specified. Assuming 1D-Y Tile Strategy is not specified. Assuming 1D-Y WRF TILE 1 IS 1 IE 145 JS 1 JE 82 WRF TILE 1 IS 1 IE 145 JS 1 JE 82 WRF NUMBER OF TILES = 1 WRF NUMBER OF TILES = 1 Timing for Writing wrfout_d02_2016-10-04_00:00:00 for domain 2: 1.38362 elapsed seconds Timing for Writing wrfout_d02_2016-10-04_00:00:00 for domain 2: 1.38362 elapsed seconds d02 2016-10-04_00:00:00 Input data is acceptable to use: wrflowinp_d02 d02 2016-10-04_00:00:00 Input data is acceptable to use: wrflowinp_d02 d02 2016-10-04_00:00:00 Input data processed for aux input 4 for domain 2 d02 2016-10-04_00:00:00 Input data processed for aux input 4 for domain 2 Tile Strategy is not specified. Assuming 1D-Y Tile Strategy is not specified. Assuming 1D-Y WRF TILE 1 IS 1 IE 262 JS 1 JE 130 WRF TILE 1 IS 1 IE 262 JS 1 JE 130 WRF NUMBER OF TILES = 1 WRF NUMBER OF TILES = 1

INITIAL: Configuring and initializing forward nonlinear model ...


GET_GRID    - bathymetry at RHO-points: h
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  5.00000000E+00 Max =  7.12634517E+03)
GET_GRID    - Coriolis parameter at RHO-points: f
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  4.56652069E-05 Max =  6.50856109E-05)
GET_GRID    - reciprocal XI-grid spacing: pm
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  1.07650081E-04 Max =  1.17624428E-04)
GET_GRID    - reciprocal ETA-grid spacing: pn
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  1.11300023E-04 Max =  1.11361828E-04)
GET_GRID    - XI-derivative of inverse metric factor pn: dndx
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -2.25023823E+00 Max =  2.47994578E+00)
GET_GRID    - ETA-derivative of inverse metric factor pm: dmde
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -6.14204334E+00 Max =  1.34452103E+02)
GET_GRID    - x-location of RHO-points: x-rho
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -9.31961873E+05 Max =  9.85990850E+05)
GET_GRID    - y-location of RHO-points: y_rho
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -3.49536370E+06 Max = -2.56226326E+06)
GET_GRID    - x-location of PSI-points: x_psi
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -9.27575766E+05 Max =  9.81469375E+05)
GET_GRID    - y-location of PSI-points: y-psi
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -3.49092163E+06 Max = -2.56697784E+06)
GET_GRID    - x-location of U-points: x_u
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -9.27575771E+05 Max =  9.81469386E+05)
GET_GRID    - y-location of U-points: y_u
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -3.49536369E+06 Max = -2.56240597E+06)
GET_GRID    - x-location of V-points: x_v
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -9.31961840E+05 Max =  9.85990816E+05)
GET_GRID    - y-location of V-points: y_v
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -3.49092164E+06 Max = -2.56683719E+06)
GET_GRID    - latitude of RHO-points lat_rho
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  1.82472687E+01 Max =  2.65053215E+01)
GET_GRID    - longitude of RHO-points: lon_rho
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -8.83004761E+01 Max = -6.93665161E+01)
GET_GRID    - latitude of PSI-points lat_psi
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  1.82877097E+01 Max =  2.64648801E+01)
GET_GRID    - longitude of PSI-points: lon_psi
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -8.82557541E+01 Max = -6.94119736E+01)
GET_GRID    - latitude of U-points: lat_u
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  1.82473042E+01 Max =  2.65052858E+01)
GET_GRID    - longitude of U-points: lon_u
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -8.82564436E+01 Max = -6.94105486E+01)
GET_GRID    - latitude of V-points: lat_v
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  1.82876741E+01 Max =  2.64649157E+01)
GET_GRID    - longitude of V-points: lon_v
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -8.82991290E+01 Max = -6.93679412E+01)
GET_GRID    - mask on RHO-points: mask_rho
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  0.00000000E+00 Max =  1.00000000E+00)
GET_GRID    - mask on U-points: mask_u
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  0.00000000E+00 Max =  1.00000000E+00)
GET_GRID    - mask on V-points: mask_v
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  0.00000000E+00 Max =  1.00000000E+00)
GET_GRID    - mask on PSI-points: mask_psi
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min =  0.00000000E+00 Max =  1.00000000E+00)
GET_GRID    - angle between XI-axis and EAST: angler
               (Grid = 01, File: Matthew_roms_grid.nc)
               (Min = -9.28550455E-04 Max = -8.54268018E-04)

Vertical S-coordinate System, Grid 01:

level S-coord Cs-curve Z at hmin at hc half way at hmax

12   0.0000000   0.0000000        0.000       0.000       0.000       0.000
11  -0.0833333  -0.0007714       -0.379      -2.103      -6.822      -9.596
10  -0.1666667  -0.0032811       -0.759      -4.249     -19.756     -31.494
 9  -0.2500000  -0.0081641       -1.140      -6.454     -41.035     -70.188
 8  -0.3333333  -0.0166512       -1.523      -8.750     -74.988    -134.386
 7  -0.4166667  -0.0308659       -1.908     -11.188    -129.081    -239.116
 6  -0.5000000  -0.0543205       -2.297     -13.858    -215.665    -409.235
 5  -0.5833333  -0.0926898       -2.694     -16.901    -354.694    -684.901
 4  -0.6666667  -0.1549326       -3.101     -20.540    -577.672   -1129.512
 3  -0.7500000  -0.2547244       -3.525     -25.118    -932.685   -1839.845
 2  -0.8333333  -0.4117752       -3.975     -31.128   -1489.042   -2955.383
 1  -0.9166667  -0.6515741       -4.463     -39.206   -2336.371   -4656.504
 0  -1.0000000  -1.0000000       -5.000     -50.000   -3565.673   -7126.345

Time Splitting Weights for Grid 01: ndtfast = 10 nfast = 15

Primary            Secondary            Accumulated to Current Step

1 0.0014850648765542 0.1000000000000000 0.0014850648765542 0.1000000000000000 2 0.0059386031399402 0.0998514935123446 0.0074236680164944 0.1998514935123446 3 0.0133457074936657 0.0992576331983505 0.0207693755101601 0.2991091267106951 4 0.0236484051180389 0.0979230624489840 0.0444177806281990 0.3970321891596791 5 0.0366959666818608 0.0955582219371801 0.0811137473100598 0.4925904110968592 6 0.0521753389587947 0.0918886252689940 0.1332890862688545 0.5844790363658532 7 0.0695217010484137 0.0866710913731145 0.2028107873172681 0.6711501277389678 8 0.0878091442019233 0.0797189212682732 0.2906199315191914 0.7508690490072409 9 0.1056214752525633 0.0709380068480809 0.3962414067717547 0.8218070558553218 10 0.1209031436506851 0.0603758593228245 0.5171445504224399 0.8821829151781463 11 0.1307902921035067 0.0482855449577560 0.6479348425259466 0.9304684601359023 12 0.1314219308195445 0.0352065157474053 0.7793567733454911 0.9656749758833076 13 0.1177312353577226 0.0220643226654509 0.8970880087032138 0.9877392985487585 14 0.0832169680811588 0.0102911991296786 0.9803049767843727 0.9980304976784371 15 0.0196950232156274 0.0019695023215627 1.0000000000000000 0.9999999999999999

ndtfast, nfast = 10 15 nfast/ndtfast = 1.50000

Centers of gravity and integrals (values must be 1, 1, approx 1/2, 1, 1):

1.000000000000 1.083803072626 0.541901536313 1.000000000000 1.000000000000

Power filter parameters, Fgamma, gamma = 0.28400 0.00000

Metrics information for Grid 01:

Minimum X-grid spacing, DXmin = 8.50163538E+00 km Water points = 8.50163538E+00 km Maximum X-grid spacing, DXmax = 9.28935672E+00 km Water points = 9.28935672E+00 km Minimum Y-grid spacing, DYmin = 8.97973766E+00 km Water points = 8.97973766E+00 km Maximum Y-grid spacing, DYmax = 8.98472412E+00 km Water points = 8.98472412E+00 km Minimum Z-grid spacing, DZmin = 3.79138507E-01 m Water points = 3.79138507E-01 m Maximum Z-grid spacing, DZmax = 2.46984125E+03 m Water points = 2.46984125E+03 m

Minimum barotropic Courant Number = 1.63609178E-03 Maximum barotropic Courant Number = 6.25002771E-02 Maximum Coriolis Courant Number = 9.76284164E-04

NLM: GET_STATE - Reading state initial conditions, 2016-10-04 00:00:00.00 (Grid 01, t = 57665.0000, File: coawst_ini.nc, Rec=0001, Index=1)

After 600 iterations in ROMS model I get this error:

DIAG speed trouble 766.50973780472236
Found Error: 01 Line: 341 Source: ROMS/Nonlinear/main3d.F Found Error: 01 Line: 331 Source: ROMS/Drivers/nl_ocean.h, ROMS_run

Blowing-up: Saving latest model state into RESTART file REASON: MaxSpeed = 7.7E+02

  WRT_RST     - wrote re-start    fields (Index=1,1) in record = 3

Elapsed wall CPU time for each process (seconds):

Node # 0 CPU: 1042.553 Total: 1042.553

Nonlinear model elapsed CPU time profile, Grid: 01

Allocation and array initialization .............. 0.115 ( 0.0111 %) Ocean state initialization ....................... 0.492 ( 0.0472 %) Reading of input data ............................ 0.113 ( 0.0108 %) Processing of input data ......................... 1.469 ( 0.1409 %) Processing of output time averaged data .......... 0.542 ( 0.0520 %) Computation of vertical boundary conditions ...... 0.527 ( 0.0506 %) Computation of global information integrals ...... 3.157 ( 0.3028 %) Writing of output data ........................... 3.154 ( 0.3025 %) Model 2D kernel .................................. 100.919 ( 9.6800 %) Tidal forcing .................................... 1.186 ( 0.1138 %) 2D/3D coupling, vertical metrics ................. 3.413 ( 0.3274 %) Omega vertical velocity .......................... 2.421 ( 0.2322 %) Equation of state for seawater ................... 6.620 ( 0.6350 %) Atmosphere-Ocean bulk flux parameterization ...... 0.286 ( 0.0274 %) GLS vertical mixing parameterization ............. 143.701 (13.7836 %) 3D equations right-side terms .................... 104.951 (10.0668 %) 3D equations predictor step ...................... 23.727 ( 2.2758 %) Pressure gradient ................................ 9.517 ( 0.9129 %) Harmonic mixing of tracers, geopotentials ........ 15.855 ( 1.5208 %) Harmonic stress tensor, S-surfaces ............... 6.845 ( 0.6566 %) Corrector time-step for 3D momentum .............. 12.685 ( 1.2167 %) Corrector time-step for tracers .................. 15.723 ( 1.5081 %) Unused 07 ........................................ 552.995 (53.0424 %) Total: 1010.414 96.9173 %

Unique kernel(s) regions profiled ................ 1010.414 96.9173 % Residual, non-profiled code ...................... 32.138 3.0827 %

All percentages are with respect to total time = 1042.553

MPI communications profile, Grid: 01

Message Passage: 2D halo exchanges ............... 0.365 ( 0.0350 %) Message Passage: 3D halo exchanges ............... 0.060 ( 0.0057 %) Message Passage: 4D halo exchanges ............... 0.010 ( 0.0010 %) Message Passage: data broadcast .................. 0.005 ( 0.0005 %) Message Passage: data reduction .................. 0.011 ( 0.0010 %) Message Passage: data gathering .................. 0.554 ( 0.0531 %) Message Passage: data scattering.................. 0.025 ( 0.0024 %) Message Passage: boundary data gathering ......... 0.019 ( 0.0018 %) Message Passage: point data gathering ............ 0.000 ( 0.0000 %) Message Passage: synchronization barrier ......... 0.000 ( 0.0000 %) Total: 1.049 0.1007 %

Dynamic and Automatic memory (MB) usage for Grid 01: 214x101x12 tiling: 1x1

 tile          Dynamic        Automatic            USAGE      MPI-Buffers

    0           169.05            17.23           186.28             2.39

TOTAL           169.05            17.23           186.28             2.39

<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

ROMS/TOMS - Output NetCDF summary for Grid 01: number of time records written in HISTORY file = 10 number of time records written in RESTART file = 10 number of time records written in AVERAGE file = 1

Analytical header files used:

 ROMS/Functionals/ana_btflux.h
 ROMS/Functionals/ana_fsobc.h
 ROMS/Functionals/ana_m2obc.h
 ROMS/Functionals/ana_nudgcoef.h
 ROMS/Functionals/ana_srflux.h

MAIN: Abnormal termination: BLOWUP. REASON: MaxSpeed = 7.7E+02

....................................................................................................................................................................................

I tried with different time steps but this doesn't seem to be the problem. Can you give some advice? Thanks for helping me during the process.

jcwarner-usgs commented 1 year ago

i see SWANtoROMS Min/Max HSIGN (m): 0.000000E+00 5.092543E+00 so roms is getting a Hsig of 5m somewhere right away. it might be giving some troubles.

after 600 iterations in ROMS model I get this error: so maybe save the his file more frequently so you can see what is happening.

r0squete commented 1 year ago

Hi! Thanks for your advice. I have done several experiments changing some parameters and even the SWAN domain. My problems due to max speed are always in two specific points. When you look at the bathymetry this points have the particularity of been places where the bathymetry changes abruptly. Does it tell you anything???

jcwarner-usgs commented 1 year ago

well if the bathy is very irregular, it might cause problems in the ocean model. can you smooth out that section a bit? it would be edit 'h' in the grid file. you can load that into matlab and smooth that area.

r0squete commented 1 year ago

Thanks for your attention!!!! Smoothing the bathymetry was the solution to my blowing-up.

r0squete commented 1 year ago

125