ECMWFCode4Earth / ml_drought

Machine learning to better predict and understand drought. Moving github.com/ml-clim
https://ml-clim.github.io/drought-prediction/
90 stars 18 forks source link

pytest failing to run. crashing with `..%` #31

Open tommylees112 opened 5 years ago

tommylees112 commented 5 years ago
(crop) ➜  ml_drought git:(exporters/seas5) pytest
================================================================ test session starts =================================================================
platform darwin -- Python 3.7.0, pytest-4.5.0, py-1.8.0, pluggy-0.11.0
rootdir: /Users/tommylees/github/ml_drought, inifile: pytest.ini
plugins: flake8-1.0.4
collected 83 items

run.py s                                                                                                                                       [  1%]
src/__init__.py s                                                                                                                              [  2%]
src/run.py s                                                                                                                                   [  3%]
src/utils.py .                                                                                                                                 [  4%]
src/exporters/__init__.py .                                                                                                                    [  6%]
src/exporters/all_valid_s5.py .                                                                                                                [  7%]
src/exporters/base.py .                                                                                                                        [  8%]
src/exporters/cds.py .                                                                                                                         [  9%]
src/exporters/chirps.py s                                                                                                                      [ 10%]
src/exporters/planetOS.py s                                                                                                                    [ 12%]
src/exporters/s5.py .                                                                                                                          [ 13%]
src/exporters/vhi.py s                                                                                                                         [ 14%]
src/preprocess/__init__.py s                                                                                                                   [ 15%]
src/preprocess/base.py s                                                                                                                       [ 16%]
src/preprocess/chirps.py .                                                                                                                     [ 18%]
src/preprocess/utils.py s                                                                                                                      [ 19%]
src/preprocess/vhi.py s                                                                                                                        [ 20%]
tests/__init__.py s                                                                                                                            [ 21%]
tests/test_run.py s....                                                                                                                        [ 27%]
tests/exporters/__init__.py s                                                                                                                  [ 28%]
tests/exporters/test_base.py s.                                                                                                                [ 31%]
tests/exporters/test_cds.py .........                                                                                                          [ 42%]
tests/exporters/test_chirps.py s....                                                                                                           [ 48%]
tests/exporters/test_planetOS.py s...                                                                                                          [ 53%]
tests/exporters/test_s5.py ...FFFFFFFFF                                                                                                        [ 67%]
tests/exporters/test_vhi.py s.....                                                                                                             [ 74%]
tests/preprocess/__init__.py s                                                                                                                 [ 75%]
tests/preprocess/test_base.py ..%                                                                                                                     (crop) ➜  ml_drought git:(exporters/seas5)

But it works on other instances (gcloud) ? huh?!

tommylees112 commented 5 years ago

https://stackoverflow.com/questions/34835462/py-test-terminates-without-completing-with-a-terminal

tommylees112 commented 5 years ago

The error has to do with MPI (called in XEMSF)

Fatal error in MPI_Init_thread: Other MPI error, error stack:
MPIR_Init_thread(474)..............:
MPID_Init(190).....................: channel initialization failed
MPIDI_CH3_Init(89).................:
MPID_nem_init(320).................:
MPID_nem_tcp_init(173).............:
MPID_nem_tcp_get_business_card(420):
MPID_nem_tcp_init(379).............: gethostbyname failed, Tommys-MacBook-Air.local (errno 1)
[unset]: write_line error; fd=-1 buf=:cmd=abort exitcode=3191311
:
system msg for write_line failure : Bad file descriptor

https://github.com/conda-forge/fenics-feedstock/issues/44 https://github.com/conda-forge/fenics-feedstock/issues/44#issuecomment-338164343 https://stackoverflow.com/questions/23112515/mpich2-gethostbyname-failed