installing PySM3 at NERSC

[NicolettaK]

I'm having problems at installing pysm3 at nersc. I'm using the pip install pysm3 command with the --prefix option and getting the following error:

` ERROR: Command errored out with exit status 1: command: /usr/common/software/tensorflow/gpu-tensorflow/1.15.0-py37/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-aftj8io3/pysm3/setup.py'"'"'; file='"'"'/tmp/pip-install-aftj8io3/pysm3/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-install-aftj8io3/pysm3/pip-egg-info cwd: /tmp/pip-install-aftj8io3/pysm3/ Complete output (5 lines): Traceback (most recent call last): File "", line 1, in File "/tmp/pip-install-aftj8io3/pysm3/setup.py", line 51, in from astropy_helpers.setup_helpers import ( ModuleNotFoundError: No module named 'astropy_helpers.setup_helpers'

ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.`

[zonca]

Have you tried the conda package?

[NicolettaK]

No, I usually prefer to use pip at NERSC, but I can try with conda if you recommend so.

[zonca]

Do you want to also install mapsims?

On Wed, Mar 4, 2020, 07:37 Nicoletta Krachmalnicoff < notifications@github.com> wrote:

No, I usually prefer to use pip at NERSC, but I can try with conda if you recommend so.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/healpy/pysm/issues/40?email_source=notifications&email_token=AAC5Q4RPDN6ICU3YCYP6IODRFZYUPA5CNFSM4LBJFPE2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOENYQA5I#issuecomment-594608245, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAC5Q4S2JGGR2XHYHOHD77LRFZYUPANCNFSM4LBJFPEQ .

[NicolettaK]

No I just need PySM3

[zonca]

Okay I think it is useful if I create more detailed instructions just for NERSC

On Wed, Mar 4, 2020, 07:47 Nicoletta Krachmalnicoff < notifications@github.com> wrote:

No I just need PySM3

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/healpy/pysm/issues/40?email_source=notifications&email_token=AAC5Q4VCL5ESAH6XVSE3KETRFZZXZA5CNFSM4LBJFPE2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOENYR3JA#issuecomment-594615716, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAC5Q4XIPXPXMSOJ6C32RI3RFZZXZANCNFSM4LBJFPEQ .

[NicolettaK]

great! thanks!

[zonca]

give me a few days, I want to find a way to properly handle once and for all the case of running on the login node (where I cannot import mpi4py).

[zonca]

@NicolettaK for now do:

module load python/3.7-anaconda-2019.10
conda create -c conda-forge -n pysm pysm3 python=3.7 ipython
conda activate pysm
module unload python

I found the last step needed otherwise it always loads the base environment.

Then quick test:

python -c "import pysm;sky=pysm.Sky(nside=64, preset_strings=['d1']);print(sky.get_emission(12*pysm.units.GHz)[:5])"
[[ 0.05146998  0.05273027  0.06248602 ...  0.04509924  0.06567437
   0.0677657 ]
 [ 0.00080898 -0.00050239  0.00052695 ...  0.00210943 -0.00166372
   0.00063091]
 [-0.00293329  0.00108048 -0.00223178 ... -0.00236847  0.00317197
   0.00120832]] uK_RJ

[NicolettaK]

It worked. Thanks!

[dpole]

I've got the same problem when installing pysm3 in a clean conda environment on my laptop. pip install pysm3 fails with Nico's error message.

Installing the pysm3 through conda works, but I'd like to add pysm3 as a dependency to another package that I is currently pip-installable.

[zonca]

Have you tried installing astropy_helpers?

On Sun, Mar 8, 2020, 04:39 Davide Poletti notifications@github.com wrote:

I've got the same problem when installing pysm3 in a clean conda environment on my laptop. pip install pysm3 fails with Nico's error message.

Installing the pysm3 through conda works, but I'd like to add pysm3 as a dependency to another package that I is currently pip-installable.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/healpy/pysm/issues/40?email_source=notifications&email_token=AAC5Q4XSJHY2LJYRDVLUUCDRGN7WXA5CNFSM4LBJFPE2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEOETU3A#issuecomment-596195948, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAC5Q4U4MKHQDPF3QJI2MC3RGN7WXANCNFSM4LBJFPEQ .

[dpole]

Thanks. Yes, if I installed the modules by hand it worked. However, I found that the problem was that pip was picking the system install instead of the one on the conda environment. Probably I initialized the environment with conda create -n myenv instead of conda create -n myenv python=3.7. In the latter case everything works. I hope this saves others' time...