desihub / desiconda

Tools to install DESI dependencies from scratch.
BSD 3-Clause "New" or "Revised" License
1 stars 7 forks source link

new imaging desiconda for DR8; fix ceres issue #27

Closed moustakas closed 4 years ago

moustakas commented 5 years ago

@tskisner @dstndstn @mlandriau

Looking ahead to the DR8 production run, it would be useful to have a new version of the imaging desiconda packages with the tractor/ceres dependencies properly compiled. I've been poking around at the DR7 log files and found many errors along what I've pasted below. Thanks.

module use /global/common/software/desi/$NERSC_HOST/desiconda/20180512-1.2.5-img/modulefiles
module load desiconda
from tractor import ceres
---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/aux/lib/python3.6/site-packages/tractor/ceres.py in swig_import_helper()
     13         try:
---> 14             return importlib.import_module(mname)
     15         except ImportError:

/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/conda/lib/python3.6/importlib/__init__.py in import_module(name, package)
    125             level += 1
--> 126     return _bootstrap._gcd_import(name[level:], package, level)
    127 

/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/conda/lib/python3.6/importlib/_bootstrap.py in _gcd_import(name, package, level)

/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/conda/lib/python3.6/importlib/_bootstrap.py in _find_and_load(name, import_)

/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/conda/lib/python3.6/importlib/_bootstrap.py in _find_and_load_unlocked(name, import_)

/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/conda/lib/python3.6/importlib/_bootstrap.py in _load_unlocked(spec)

/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/conda/lib/python3.6/importlib/_bootstrap.py in module_from_spec(spec)

/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/conda/lib/python3.6/importlib/_bootstrap_external.py in create_module(self, spec)

/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/conda/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

ImportError: /global/common/software/desi/edison/desiconda/20180512-1.2.5-img/aux/lib/python3.6/site-packages/tractor/_ceres.cpython-36m-x86_64-linux-gnu.so: undefined symbol: _ZN5ceres7ProblemD1Ev

During handling of the above exception, another exception occurred:

ModuleNotFoundError                       Traceback (most recent call last)
<ipython-input-2-6a5831c53850> in <module>()
----> 1 from tractor import ceres

/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/aux/lib/python3.6/site-packages/tractor/ceres.py in <module>()
     15         except ImportError:
     16             return importlib.import_module('_ceres')
---> 17     _ceres = swig_import_helper()
     18     del swig_import_helper
     19 elif _swig_python_version_info >= (2, 6, 0):

/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/aux/lib/python3.6/site-packages/tractor/ceres.py in swig_import_helper()
     14             return importlib.import_module(mname)
     15         except ImportError:
---> 16             return importlib.import_module('_ceres')
     17     _ceres = swig_import_helper()
     18     del swig_import_helper

/global/common/software/desi/edison/desiconda/20180512-1.2.5-img/conda/lib/python3.6/importlib/__init__.py in import_module(name, package)
    124                 break
    125             level += 1
--> 126     return _bootstrap._gcd_import(name[level:], package, level)
    127 
    128 

ModuleNotFoundError: No module named '_ceres'
dstndstn commented 5 years ago

I believe this only happens on the version we have on Edison

weaverba137 commented 4 years ago

Considering that DR8 has been public for a while, can this be closed?

moustakas commented 4 years ago

I don't think this issue was ever addressed, but it's moot since (a) edison is no more; and (b) we use a Docker container for production. Closing.