NCAR / wrf_hydro_docker

Docker containers for the WRF-Hydro modeling system
https://hub.docker.com/u/wrfhydro
22 stars 24 forks source link

NULL geo_em.d01.nc file #54

Closed mollymca closed 6 years ago

mollymca commented 6 years ago

From https://hub.docker.com/r/wrfhydro/wps/ Ran the commands as listed with the example namelist and produced a geo_em.d01.nc file with 0 values for the variables. did the following:

  1. docker pull wrfhydro/wps

    1. create mount dicrectory in my local drive and put the namelist file there.
    2. docker run -v ~/dockerMount/:/home/docker/mount \

           wrfhydro/wps \
      
           --namelist_path /home/docker/mount/namelist.wps \
      
           --output_dir /home/docker/mount \
      
           --plot_only False

Custom namelist.wps file contents is listed below:

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! ! Specify the number of domains !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

max_dom = 1,

/

&geogrid

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! ! Define the extend in west-east (e_we) and south-north (e_sn) directions ! Note: will create a domain of size (e_we-1) x (e_sn-1) !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

e_we = 110, e_sn = 93,

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! ! Define the center point of your domain !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

ref_lat = 43.01595 ref_lon = -91.84459

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! ! Define the domain grid spacing (in meters) !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

dx = 1000, dy = 1000,

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! ! Define the map projection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

map_proj = 'lambert', truelat1 = 30.0, truelat2 = 60.0, stand_lon = -97.00,

/

Also, tried running with different coordinates in the namelist.wps and that file resulted in null values. Also, tried adding lines in the namelist.wps file to specify the path to data geog_data_res = 'nlcd2011_30m+gtopo_30s+default', geog_data_path = '/home/docker/WRF_WPS/utilities/geog_conus' and resulted in null values.

Expected result would be a geo_em.d01.nc file which has values for the variables.

tjmills commented 6 years ago

This could be due to a malformed namelist file. I ran the same namelist through and got a domain image and .nc file with values. Try again with this namelist.wps

NOTE the image is updating as we speak with a few minor edits, but should not affect this issue. If you'd like to run on the exact image please wait ~ 1hour for the push to finish (slow wifi)

&geogrid

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
! Define the extend in west-east (e_we) and south-north (e_sn) directions
! Note: will create a domain of size (e_we-1) x (e_sn-1)
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

e_we = 110,
e_sn = 93,

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
! Define the center point of your domain
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

ref_lat = 43.01595
ref_lon = -91.84459

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
! Define the domain grid spacing (in meters)
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

dx = 1000,
dy = 1000,

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
! Define the map projection
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

map_proj = 'lambert',
truelat1 = 30.0,
truelat2 = 60.0,
stand_lon = -97.00,

/
mollymca commented 6 years ago

I will have the user try it. I still can not get it to work on my system. :(

tjmills commented 6 years ago

It should be system independent for this since nothing really happens on the host file system.

With the above namelist saved as a text file called namelist.wps

Try this with the correct path for your system

docker pull wrfhydro/wps docker run -v /home/wpstest/:/home/docker/mount wrfhydro/wps --plot_only False

mollymca commented 6 years ago

I used the following commands docker pull wrfhydro/wps docker run -v /dockerMount/:/home/docker/mount wrfhydro/wps --plot_only False I got this error: FileNotFoundError: [Errno 2] No such file or directory: '/home/docker/mount/namelist.wps'

I'm already in my home directory, Am I specifying the path correctly?

On Thu, Jun 14, 2018 at 1:55 PM, T. Joe Mills notifications@github.com wrote:

It should be system independent for this since nothing really happens on the host file system.

With the above namelist saved as a text file called namelist.wps..

Try this with the correct path for your system

docker pull wrfhydro/wps docker run -v /home/wpstest/:/home/docker/mount wrfhydro/wps --plot_only False

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/NCAR/wrf_hydro_docker/issues/54#issuecomment-397418705, or mute the thread https://github.com/notifications/unsubscribe-auth/AaCnmRqh8jD_iQMsQLZEa0zyF3ibnrfnks5t8r-cgaJpZM4UofQ6 .

-- Molly J. McAllister Associate Scientist III National Center for Atmospheric Research mollymca@ucar.edu office: (303) 497-8253 <%28303%29%20497-8404>

<%28831%29%20261-5149>

mollymca commented 6 years ago

The user ran the file namelist.wps file that you specified above. I also sent him a copy. It did not work. :(

barlage commented 6 years ago

@mollymca is HGT_M the only field that is empty? LU_INDEX is OK? do you have access to geogrid.log?

@jmills-NCAR do you think this is a problem with GEOGRID.TBL.ARW.wrf_hydro_training?

tjmills commented 6 years ago

@mollymca You need to specify the full path to the folder on your local system and make sure that namelist.wps is in there, that error is saying that it can't find your namelist.wps

@barlage, give it a go, I have tried on two different systems without issue, including my personal windows machine so I am fairly confident it is an issue with the user setup

mollymca commented 6 years ago

I did multiple times, even checked that the file was there and exists. I'll try it again today.

tjmills commented 6 years ago

Yeah give it a go with the pull path to the folder, so I'm not positive but I dont think this /dockerMount/ is full path on a windows system. I believe it should be something like C:/.../.../dockerMount/

If you can navigate to your dockerMount directory and print the path and directory contents and paste here that would help troubleshoot.

mollymca commented 6 years ago

Yeah, it's weird, I do a mkdir /dockerMount under C:/Users/mollymca and then it puts it under C: (I didn't specify /home/) I did make sure that the directory and file existed. Then ran the following docker pull wrfhydro/wps PS C:\Users\mollymca> docker run -v C:/dockerMount/:/home/docker/mount wrfhydro/wps --plot_only False Which you recommended yesterday. and got a different message this time C:\Program Files\Docker\Docker\Resources\bin\docker.exe: Error response from daemon: Drive has not been shared. See 'C:\Program Files\Docker\Docker\Resources\bin\docker.exe run --help'.

mollymca commented 6 years ago

I think it might be a problem of where the directory is being created. my C drive might have restrictions on it since this is a work computer. It is strange that when I run the command in the directory that I want it to create in C:/Users/mollymca... it automatically puts it in a different directory C:/. Yesterday it created it in C:/Users/mollymca.

I think my comp has gremlins.

tjmills commented 6 years ago

So that is the issue then. So 1) You need to make sure that the drive is shared with docker, you can find help online for this, 2) Typically when you preface a directory with a / it will put it in root on a unix system, which appears to be the base C drive on your windows system.

Once you get the drive shared and the proper path I am betting it will work.

mollymca commented 6 years ago

Yep, a firewall is preventing file sharing. It has something to do with the HyperV etc. I don't have admin privileges so will have to work with SNAT which won't be until next week I'm guessing. Booo.

We might want to have Mike or someone else test this WPS geogrid file creation utility until then. Also, we should update the instructions on the Dockerhub page if needed.

Did you make updates since yesterday? I had the user try it again and he was not successful in creating a geogrid file with values.

barlage commented 6 years ago

@jmills-ncar can I update the geog_conus tar file?

tjmills commented 6 years ago

This issuehas been resolved.

The tar file was also updated that addressed an unrelated issue that was uncovered through this issue