"Illegal Instruction" when using 20190311-1.2.7-img software stack on edison

[moustakas]

On edison I can't run the imaging pipeline. Here's a MWE--

cd /global/project/projectdirs/cosmo/work/legacysurvey/dr8b/runbrick-decam
export LEGACY_SURVEY_DIR=/global/project/projectdirs/cosmo/work/legacysurvey/dr8b/runbrick-decam
export LEGACYPIPE_DIR=$LEGACY_SURVEY_DIR/code/legacypipe
source $LEGACYPIPE_DIR/bin/legacypipe-env
export PYTHONPATH=$LEGACYPIPE_DIR/py:$PYTHONPATH
python $LEGACYPIPE_DIR/py/legacypipe/runbrick.py --brick 2449p065 --outdir test

For me, the output is

runbrick.py starting at 2019-03-13T05:13:49.529269
legacypipe git version: dr8-test10-158-gb89a292e
Command-line args: ['/global/project/projectdirs/cosmo/work/legacysurvey/dr8b/runbrick-decam/code/legacypipe/py/legacypipe/runbrick.py', '--brick', '2449p065', '--outdir', 'test']
Slurm cluster/job/array: none / none / none

Starting process 31253 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 416 MB, VmSize: 416 MB, VmRSS: 70 MB, VmData: 113 MB, maxrss: 0.071904 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage mask_junk
Runstage tims
Running stage tims
Running stage tims at 2019-03-13T05:13:51.175777
Illegal instruction

[moustakas]

I can bypass this issue using a locally compiled version of tractor and astrometry.net, but it's not ideal as, e.g., I am unable to successfully compile ceres.

[tskisner]

Formally the cori and edison environments are / could be different. They may not have the same compiler versions and Cray userspace. If the cori-built tools work on edison it would be a happy coincidence. It looks like this is not the case.

[moustakas]

OK, thanks. And I guess it's not worth the effort to get the software stack working on edison given its imminent retirement, right? If yes, feel free to close this issue.

[sbailey]

No more edison, closing ticket.