NCAR / container-dtc-nwp

End-to-end NWP systems in containers.
https://dtcenter.org/community-code/numerical-weather-prediction-nwp-containers
28 stars 13 forks source link

Fix port issue to use METviewer GUI with Singularity on AWS #93

Closed fossell closed 1 year ago

fossell commented 1 year ago

Currently running METviewer with Singularity on AWS only support generating batch plots on the command line; the GUI does not launch or function. Initial impression is some sort of port mapping issues.

TatianaBurek commented 1 year ago

In order to make image and other output files visible in the web UI the value of parameter 'url.output' should be changed to /metviewer_output. I made this change in Dockerfile and Dockerfile_for_Singularity files

TatianaBurek commented 1 year ago

To test, I rebuild the docker image and created singularity container from it. I was able to load the data and create and view the images using GUI

michelleharrold commented 1 year ago

@TatianaBurek - I tried to rebuild the docker image with this command: docker build -t nwp-container-metviewer_singularity -f Dockerfile_for_Singularity .

But it failed with this error:

  Downloading https://files.pythonhosted.org/packages/10/6f/9aa15b1f9001593d51a0e417a8ad2127ef384d08129a0720b3599133c1ed/xarray-0.16.2-py3-none-any.whl (736kB)
Collecting lazy-loader==0.1rc2 (from pandas_flavor>=0.1.2->pingouin==0.3.8)
  Could not find a version that satisfies the requirement lazy-loader==0.1rc2 (from pandas_flavor>=0.1.2->pingouin==0.3.8) (from versions: )
No matching distribution found for lazy-loader==0.1rc2 (from pandas_flavor>=0.1.2->pingouin==0.3.8)
The command '/bin/sh -c pip-3 install kiwisolver==1.0.1  && pip-3 install pillow==7.2.0  && pip-3 install bootstrapped==0.0.2  && pip-3 install plotly==4.9.0  && pip-3 install kaleido==0.2.1  && pip-3 install pandas==1.0.1  && pip-3 install numpy==1.17.0  && pip-3 install scipy==1.5.1  && pip-3 install pingouin==0.3.8  && pip-3 install PyYAML==5.3.1  && pip-3 install psutil==5.7.2  && pip-3 install requests==2.24.0  && pip-3 install matplotlib==3.3.0  && pip-3 install lxml==4.5.2  && pip-3 install pymysql==0.9.3' returned a non-zero code: 1

I am sure I am doing something silly...any ideas?

TatianaBurek commented 1 year ago

The Python libraries that are needed for METcalcpy/METviewer 4.0.2 have dependency issues that were resolved in the next version. Need to upgrade METviewer to v4.1, METcalcpy/METplotpy to 1.10 and add METdatadb

michelleharrold commented 1 year ago

I tested building the new Dockerfile_for_Singularity -- success! Moving onto testing the loading and pulling up the GUI.

TatianaBurek commented 1 year ago

I committed the fix for mv_batch.sh. The container is ready for testing