PCMDI / cmor

Climate Model Output Rewriter
BSD 3-Clause "New" or "Revised" License
51 stars 33 forks source link

CMOR nightly install on conda is not getting the latest version #558

Closed mauzey1 closed 3 years ago

mauzey1 commented 4 years ago

I have been getting an issue lately where trying to install the nightly build of CMOR is installing an older version instead. This has been causing issues with CircleCI tests for cmip6-cmor-tables since they install the latest nightly build for testing the tables.

For OSX, there is a nightly Python 3.7 build from November 1, 2019. However, when I try to install from nightly it gives me a build from May 2019. Below is the output when I try to install the latest nightly.

conda create -d -n cmor_nightly -c pcmdi/label/nightly -c conda-forge cmor python=3.7
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /Users/mauzey1/anaconda3/envs/cmor_nightly

  added / updated specs:
    - cmor
    - python=3.7

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    cdms2-3.1.4                |   py37hec45fce_3         534 KB  conda-forge
    cffi-1.13.2                |   py37h33e799b_0         213 KB  conda-forge
    cmor-3.4.0.2019.05.01.09.32.ge066e2b.numpy|   py37h6f46a84_0         958 KB  pcmdi/label/nightly
    cryptography-2.7           |   py37hafa8578_0         576 KB  conda-forge
    decorator-4.4.1            |             py_0          11 KB  conda-forge
    esmpy-7.1.0                |   py37h5ca1d4c_3         160 KB  conda-forge
    future-0.18.2              |           py37_0         708 KB  conda-forge
    lazy-object-proxy-1.4.3    |   py37h0b31af3_0          26 KB  conda-forge
    libopenblas-0.3.6          |       hd44dcd8_6         8.4 MB  conda-forge
    libtiff-4.1.0              |       h3527a1b_0         570 KB  conda-forge
    openblas-0.3.6             |       hd44dcd8_6         9.2 MB  conda-forge
    pyrsistent-0.15.5          |   py37h0b31af3_0          87 KB  conda-forge
    setuptools-41.6.0          |           py37_1         650 KB  conda-forge
    six-1.13.0                 |           py37_0          22 KB  conda-forge
    ------------------------------------------------------------
                                           Total:        22.0 MB

The following NEW packages will be INSTALLED:

  asn1crypto         conda-forge/osx-64::asn1crypto-1.2.0-py37_0
  attrs              conda-forge/noarch::attrs-19.3.0-py_0
  bzip2              conda-forge/osx-64::bzip2-1.0.8-h01d97ff_1
  ca-certificates    conda-forge/osx-64::ca-certificates-2019.9.11-hecc5488_0
  cdat_info          conda-forge/noarch::cdat_info-8.2-py_3
  cdms2              conda-forge/osx-64::cdms2-3.1.4-py37hec45fce_3
  cdtime             conda-forge/osx-64::cdtime-3.1.2-py37h2cdb68b_4
  certifi            conda-forge/osx-64::certifi-2019.9.11-py37_0
  cffi               conda-forge/osx-64::cffi-1.13.2-py37h33e799b_0
  chardet            conda-forge/osx-64::chardet-3.0.4-py37_1003
  cmor               pcmdi/label/nightly/osx-64::cmor-3.4.0.2019.05.01.09.32.ge066e2b.numpy-py37h6f46a84_0
  cryptography       conda-forge/osx-64::cryptography-2.7-py37hafa8578_0
  curl               conda-forge/osx-64::curl-7.65.3-h22ea746_0
  decorator          conda-forge/noarch::decorator-4.4.1-py_0
  distarray          conda-forge/noarch::distarray-2.12.2-py_1
  esmf               conda-forge/osx-64::esmf-7.1.0-h2adf3d1_1005
  esmpy              conda-forge/osx-64::esmpy-7.1.0-py37h5ca1d4c_3
  expat              conda-forge/osx-64::expat-2.2.5-h4a8c4bd_1004
  future             conda-forge/osx-64::future-0.18.2-py37_0
  g2clib             conda-forge/osx-64::g2clib-1.6.0-h4e57d6e_9
  hdf4               conda-forge/osx-64::hdf4-4.2.13-hf3c6af0_1002
  hdf5               conda-forge/osx-64::hdf5-1.10.4-nompi_h0cbb7df_1106
  idna               conda-forge/osx-64::idna-2.8-py37_1000
  importlib_metadata conda-forge/osx-64::importlib_metadata-0.23-py37_0
  ipython_genutils   conda-forge/noarch::ipython_genutils-0.2.0-py_1
  jasper             conda-forge/osx-64::jasper-1.900.1-h636a363_1006
  jpeg               conda-forge/osx-64::jpeg-9c-h1de35cc_1001
  json-c             conda-forge/osx-64::json-c-0.13.1-h1de35cc_1001
  jsonschema         conda-forge/osx-64::jsonschema-3.1.1-py37_0
  jupyter_core       conda-forge/noarch::jupyter_core-4.5.0-py_0
  krb5               conda-forge/osx-64::krb5-1.16.3-hcfa6398_1001
  lazy-object-proxy  conda-forge/osx-64::lazy-object-proxy-1.4.3-py37h0b31af3_0
  libblas            conda-forge/osx-64::libblas-3.8.0-11_openblas
  libcblas           conda-forge/osx-64::libcblas-3.8.0-11_openblas
  libcdms            conda-forge/osx-64::libcdms-3.1.2-hba43199_1000
  libcf              conda-forge/osx-64::libcf-1.0.3-py37h5820161_0
  libcurl            conda-forge/osx-64::libcurl-7.65.3-h16faf7d_0
  libcxx             conda-forge/osx-64::libcxx-9.0.0-h89e68fa_1
  libdrs             conda-forge/osx-64::libdrs-3.1.2-h4160185_5
  libdrs_f           conda-forge/osx-64::libdrs_f-3.1.2-h3edcf31_4
  libedit            conda-forge/osx-64::libedit-3.1.20170329-hcfe32e1_1001
  libffi             conda-forge/osx-64::libffi-3.2.1-h6de7cb9_1006
  libgfortran        conda-forge/osx-64::libgfortran-3.0.1-0
  liblapack          conda-forge/osx-64::liblapack-3.8.0-11_openblas
  libnetcdf          conda-forge/osx-64::libnetcdf-4.6.2-h6b88ef6_1001
  libopenblas        conda-forge/osx-64::libopenblas-0.3.6-hd44dcd8_6
  libpng             conda-forge/osx-64::libpng-1.6.37-h2573ce8_0
  libssh2            conda-forge/osx-64::libssh2-1.8.2-hcdc9a53_2
  libtiff            conda-forge/osx-64::libtiff-4.1.0-h3527a1b_0
  libuuid            conda-forge/osx-64::libuuid-2.32.1-h1de35cc_1000
  lz4-c              conda-forge/osx-64::lz4-c-1.8.3-h6de7cb9_1001
  more-itertools     conda-forge/noarch::more-itertools-7.2.0-py_0
  mpi                conda-forge/osx-64::mpi-1.0-mpich
  mpich              conda-forge/osx-64::mpich-3.2.1-ha90c164_1014
  nbformat           conda-forge/noarch::nbformat-4.4.0-py_1
  ncurses            conda-forge/osx-64::ncurses-6.1-h0a44026_1002
  netcdf-fortran     conda-forge/osx-64::netcdf-fortran-4.4.5-h5ce9b53_1000
  numpy              conda-forge/osx-64::numpy-1.17.3-py37hde6bac1_0
  openblas           conda-forge/osx-64::openblas-0.3.6-hd44dcd8_6
  openssl            conda-forge/osx-64::openssl-1.1.1c-h01d97ff_0
  pip                conda-forge/osx-64::pip-19.3.1-py37_0
  pycparser          conda-forge/osx-64::pycparser-2.19-py37_1
  pyopenssl          conda-forge/osx-64::pyopenssl-19.0.0-py37_0
  pyrsistent         conda-forge/osx-64::pyrsistent-0.15.5-py37h0b31af3_0
  pysocks            conda-forge/osx-64::pysocks-1.7.1-py37_0
  python             conda-forge/osx-64::python-3.7.3-h93065d6_1
  readline           conda-forge/osx-64::readline-8.0-hcfe32e1_0
  requests           conda-forge/osx-64::requests-2.22.0-py37_1
  setuptools         conda-forge/osx-64::setuptools-41.6.0-py37_1
  six                conda-forge/osx-64::six-1.13.0-py37_0
  sqlite             conda-forge/osx-64::sqlite-3.30.1-h93121df_0
  tk                 conda-forge/osx-64::tk-8.6.9-h2573ce8_1003
  traitlets          conda-forge/osx-64::traitlets-4.3.3-py37_0
  udunits2           conda-forge/osx-64::udunits2-2.2.27.6-h776b7f1_1001
  urllib3            conda-forge/osx-64::urllib3-1.25.6-py37_0
  wheel              conda-forge/osx-64::wheel-0.33.6-py37_0
  xz                 conda-forge/osx-64::xz-5.2.4-h1de35cc_1001
  zipp               conda-forge/noarch::zipp-0.6.0-py_0
  zlib               conda-forge/osx-64::zlib-1.2.11-h0b31af3_1006
  zstd               conda-forge/osx-64::zstd-1.4.3-he7fca8b_0

DryRunExit: Dry run. Exiting

It does install the right version if you specify it in the command.

conda create -n cmor_nightly -c pcmdi/label/nightly -c conda-forge cmor=3.5.0.2019.11.01.10.35.g6767105.numpy python=3.7
Collecting package metadata (current_repodata.json): done
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /Users/mauzey1/anaconda3/envs/cmor_nightly

  added / updated specs:
    - cmor=3.5.0.2019.11.01.10.35.g6767105.numpy
    - python=3.7

The following NEW packages will be INSTALLED:

  bzip2              conda-forge/osx-64::bzip2-1.0.8-h01d97ff_1
  ca-certificates    conda-forge/osx-64::ca-certificates-2019.9.11-hecc5488_0
  certifi            conda-forge/osx-64::certifi-2019.9.11-py37_0
  cftime             conda-forge/osx-64::cftime-1.0.4.2-py37h3b54f70_0
  cmor               pcmdi/label/nightly/osx-64::cmor-3.5.0.2019.11.01.10.35.g6767105.numpy-py37h6f46a84_0
  curl               conda-forge/osx-64::curl-7.65.3-h22ea746_0
  expat              conda-forge/osx-64::expat-2.2.5-h4a8c4bd_1004
  hdf4               conda-forge/osx-64::hdf4-4.2.13-hf3c6af0_1002
  hdf5               conda-forge/osx-64::hdf5-1.10.4-nompi_h0cbb7df_1106
  jpeg               conda-forge/osx-64::jpeg-9c-h1de35cc_1001
  json-c             conda-forge/osx-64::json-c-0.13.1-h1de35cc_1001
  krb5               conda-forge/osx-64::krb5-1.16.3-hcfa6398_1001
  libblas            conda-forge/osx-64::libblas-3.8.0-14_openblas
  libcblas           conda-forge/osx-64::libcblas-3.8.0-14_openblas
  libcurl            conda-forge/osx-64::libcurl-7.65.3-h16faf7d_0
  libcxx             conda-forge/osx-64::libcxx-9.0.0-h89e68fa_1
  libedit            conda-forge/osx-64::libedit-3.1.20170329-hcfe32e1_1001
  libffi             conda-forge/osx-64::libffi-3.2.1-h6de7cb9_1006
  libgfortran        conda-forge/osx-64::libgfortran-3.0.1-0
  liblapack          conda-forge/osx-64::liblapack-3.8.0-14_openblas
  libnetcdf          conda-forge/osx-64::libnetcdf-4.6.2-h6b88ef6_1001
  libopenblas        conda-forge/osx-64::libopenblas-0.3.7-hd44dcd8_1
  libssh2            conda-forge/osx-64::libssh2-1.8.2-hcdc9a53_2
  libuuid            conda-forge/osx-64::libuuid-2.32.1-h1de35cc_1000
  ncurses            conda-forge/osx-64::ncurses-6.1-h0a44026_1002
  netcdf4            conda-forge/osx-64::netcdf4-1.5.1.2-py37h58b02fa_0
  numpy              conda-forge/osx-64::numpy-1.17.3-py37hde6bac1_0
  openssl            conda-forge/osx-64::openssl-1.1.1c-h01d97ff_0
  pip                conda-forge/osx-64::pip-19.3.1-py37_0
  python             conda-forge/osx-64::python-3.7.3-h93065d6_1
  readline           conda-forge/osx-64::readline-8.0-hcfe32e1_0
  setuptools         conda-forge/osx-64::setuptools-41.6.0-py37_1
  six                conda-forge/osx-64::six-1.13.0-py37_0
  sqlite             conda-forge/osx-64::sqlite-3.30.1-h93121df_0
  tk                 conda-forge/osx-64::tk-8.6.9-h2573ce8_1003
  udunits2           conda-forge/osx-64::udunits2-2.2.27.6-h776b7f1_1001
  wheel              conda-forge/osx-64::wheel-0.33.6-py37_0
  xz                 conda-forge/osx-64::xz-5.2.4-h1de35cc_1001
  zlib               conda-forge/osx-64::zlib-1.2.11-h0b31af3_1006

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
#     $ conda activate cmor_nightly
#
# To deactivate an active environment, use
#
#     $ conda deactivate

@sterlingbaldwin @muryanto1 Do you know what might be going wrong?

durack1 commented 4 years ago

@mauzey1 this looks like a channel dependency issue. When @doutriaux1 is done with the day job he might have a couple of minutes to provide some guidance, he's hit these issues again and again and again

taylor13 commented 4 years ago

@mauzey1 If you can correctly build using the "right version" by specifying it in the command line, can you rely on that method now until the problem can be truly corrected?