RickKessler / SNANA

Supernova Analysis package
38 stars 23 forks source link

SNN classifiers failing on Pippin analysis run #1449

Open paulshah opened 6 hours ago

paulshah commented 6 hours ago

Run : Adapted PIPPIN analysis.yml to process simulated DES data.

Pippin Output dir : /scratch/midway2/rkessler/PIPPIN_OUTPUT/PS_ANALYSIS_DUST

Error : FAILED: SuperNNovaClassifier SNNTESTV19_z_data task (1 jobs, deps ['DATADESSIM']) Other classifiers SNIRF, SCONE etc run OK.

Example output log error file : /scratch/midway2/rkessler/PIPPIN_OUTPUT/PS_ANALYSIS_DUST/3_CLAS/SNNTESTV19_z_data_1_DATADESSIM_SNNTRAINV19_z_TRAINDES_V19

May be connected to recent updates, as same run had previously worked. Extract from logfile : /project2/rkessler/PRODUCTS/miniconda/envs/snn_gpu/lib/python3.6/site-packages/sklearn/externals/joblib/externals/cloudpickle/cloudpickle.py:47: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp ^[[32m[Loading FITRES file] ^[[0m ^[[33m[Warning: No FITRES file to load] ^[[0m ^[[33m[All lcs used for salt and photometry samples] ^[[0m ^[[32m[Computing saltfit splits for 2-way classification] ^[[0m

RickKessler commented 3 hours ago

There is indeed a recent sim update that broke scone, and may have broke SNN as well. I updated the sim to write full filter strings (e.g., 'DES-g') instead of the single-char representation (e.g., 'g'); this update is needed for SALT3training code. I fixed scone to store only the last character of the string, and SNN may need a similar fix.

See https://github.com/RickKessler/SNANA/issues/1446