dessn / Pippin

Pipeline for photometric SN analysis
MIT License
9 stars 10 forks source link

Error : Module `numpy' has no attribute float #146

Closed am610 closed 11 months ago

am610 commented 1 year ago

I am getting an error while running Pippin job. Stage 4 Aggregator :

[  NOTICE |           manager.py:464]       Merger MERGE_FIT_LOWZ_DATA_DC2LOWZ_SIMDATA task (wall time 0:00:00, 1 jobs, deps ['FIT_LOWZ_DATA_DC2LOWZ_SIMDATA', 'AGG_DC2LOWZ_SIMDATA'])
[  NOTICE |           manager.py:464]       Merger MERGE_FIT_DC2LOWZ_BIASCOR_DC2LOWZ_BIASCOR task (wall time 0:00:00, 1 jobs, deps ['FIT_DC2LOWZ_BIASCOR_DC2LOWZ_BIASCOR', 'AGG_DC2LOWZ_BIASCOR'])
[    INFO |           manager.py:467]   Failed Tasks:
[   ERROR |           manager.py:469]       Aggregator AGG_LSST_SIMDATA task (1 jobs, deps ['SCONE_PREDICT', 'SCONE_PREDICT', 'SCONE_PREDICT', 'SCONE_PREDICT', 'SCONE_PREDICT'])
[    INFO |           manager.py:472]   Blocked Tasks:
[ WARNING |           manager.py:474]       Merger MERGE_FIT_DATA_PHOTOZ_LSST_SIMDATA task (1 jobs, deps ['FIT_DATA_PHOTOZ_LSST_SIMDATA', 'AGG_LSST_SIMDATA'])
[ WARNING |           manager.py:474]       BiasCor BBC_SIMDATA_PHOTOZ task (1 jobs, deps ['SCONE_PREDICT', 'MERGE_FIT_BIASCOR_PHOTOZ_LSST_BIASCOR_Ia', 'MERGE_FIT_DC2LOWZ_BIASCOR_DC2LOWZ_BIASCOR', 'MERGE_FIT_BIASCOR_PHOTOZ_LSST_BIASCOR_CC', 'MERGE_FIT_DATA_PHOTOZ_LSST_SIMDATA'] + 1 more deps)
[ WARNING |           manager.py:474]       CreateCov LSST_COV task (1 jobs, deps ['BBC_SIMDATA_PHOTOZ', 'BBC_SIMDATA_SPECZ'])
[ WARNING |           manager.py:474]       WFit WFIT_WFIT_w0wa_CMB_BINNED task (1 jobs, deps ['LSST_COV'])
[ WARNING |           manager.py:474]       Merger MERGE_FIT_DATA_SPECZ_LSST_SIMDATA task (1 jobs, deps ['FIT_DATA_SPECZ_LSST_SIMDATA', 'AGG_LSST_SIMDATA'])
[ WARNING |           manager.py:474]       BiasCor BBC_SIMDATA_SPECZ task (1 jobs, deps ['SCONE_PREDICT', 'MERGE_FIT_BIASCOR_SPECZ_LSST_BIASCOR_Ia', 'MERGE_FIT_DC2LOWZ_BIASCOR_DC2LOWZ_BIASCOR', 'MERGE_FIT_BIASCOR_PHOTOZ_LSST_BIASCOR_CC', 'MERGE_FIT_DATA_SPECZ_LSST_SIMDATA'] + 1 more deps)
[ WARNING |           manager.py:474]       WFit WFIT_WFIT_wOM_BINNED task (1 jobs, deps ['LSST_COV'])
[    INFO |           manager.py:478]   
[ WARNING |           manager.py:482]   4 warnings
[ WARNING |           manager.py:484]       When constructing Biascor BBC_SIMDATA_PHOTOZ, merge input FIT_DC2LOWZ_BIASCOR_DC2LOWZ_BIASCOR does not have classifier SCONE_PREDICT. If this is a spec confirmed sample, or an EXTERNAL task, all good, else check this.
[ WARNING |           manager.py:484]       When constructing Biascor BBC_SIMDATA_PHOTOZ, merge input FIT_LOWZ_DATA_DC2LOWZ_SIMDATA does not have classifier SCONE_PREDICT. If this is a spec confirmed sample, or an EXTERNAL task, all good, else check this.
[ WARNING |           manager.py:484]       When constructing Biascor BBC_SIMDATA_SPECZ, merge input FIT_DC2LOWZ_BIASCOR_DC2LOWZ_BIASCOR does not have classifier SCONE_PREDICT. If this is a spec confirmed sample, or an EXTERNAL task, all good, else check this.
[ WARNING |           manager.py:484]       When constructing Biascor BBC_SIMDATA_SPECZ, merge input FIT_LOWZ_DATA_DC2LOWZ_SIMDATA does not have classifier SCONE_PREDICT. If this is a spec confirmed sample, or an EXTERNAL task, all good, else check this.
[   ERROR |           manager.py:489]   3 errors
[   ERROR |           manager.py:492]       module 'numpy' has no attribute 'float'.
`np.float` was a deprecated alias for the builtin `float`. To avoid this error in existing code, use `float` by itself. Doing this will not modify any behavior and is safe. If you specifically wanted the numpy scalar type, use `np.float64` here.
The aliases was originally deprecated in NumPy 1.20; for more details and guidance see the original release note at:
    https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
[   ERROR |           manager.py:492]       FAILED TO LAUNCH: Aggregator AGG_LSST_SIMDATA task (1 jobs, deps ['SCONE_PREDICT', 'SCONE_PREDICT', 'SCONE_PREDICT', 'SCONE_PREDICT', 'SCONE_PREDICT'])
[   ERROR |           manager.py:492]       FAILED: Aggregator AGG_LSST_SIMDATA task (1 jobs, deps ['SCONE_PREDICT', 'SCONE_PREDICT', 'SCONE_PREDICT', 'SCONE_PREDICT', 'SCONE_PREDICT'])

All previous stages are green

Screenshot 2023-08-31 at 10 18 37

the path is $PIPPIN_OUTPUT/LSST_COMBINED_CC_V2

OmegaLambda1998 commented 1 year ago

I can't see LSST_COMBINED_CC_V2 in $PIPPIN_OUTPUT, what server is this on?

OmegaLambda1998 commented 1 year ago

Regardless, I've pushed an update to change np.float -> float which should fix the deprecation warning. Once I know what server you're on I'll pull the changes

am610 commented 1 year ago

I can't see LSST_COMBINED_CC_V2 in $PIPPIN_OUTPUT, what server is this on?

Perlmutter

OmegaLambda1998 commented 1 year ago

I don't currently have access to perlmutter, it's on my todo list

Might need to get @RickKessler to pull for the moment

OmegaLambda1998 commented 11 months ago

@am610 has this been resolved? I'm still struggling with my perlmutter authentication, so can't check!

am610 commented 11 months ago

Yeah its fixed, thanks.