LSSTDESC / rail_pipelines

Collection of RAIL-based data analysis pipelines
MIT License
0 stars 0 forks source link

Issue/36/error model #37

Closed eacharles closed 2 months ago

eacharles commented 2 months ago

Problem & Solution Description (including issue #)

Code Quality

codecov[bot] commented 2 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 97.30%. Comparing base (2334e43) to head (75bcbec).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #37 +/- ## ========================================== + Coverage 97.26% 97.30% +0.04% ========================================== Files 9 9 Lines 438 446 +8 ========================================== + Hits 426 434 +8 Misses 12 12 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

sidneymau commented 2 months ago

Note that fzboost seems to fail in the goldenspike notebook:

Executing inform_fzboost
Command is:
OMP_NUM_THREADS=1   python3 -m ceci rail.estimation.algos.flexzboost.FlexZBoostInformer   --input=./output_table_conv_train.hdf5   --name=inform_fzboost   --config=tmp_goldenspike_config.yml   --model=./model_inform_fzboost.pkl 
Output writing to ./inform_fzboost.out

Job inform_fzboost has failed with status 1

*************************************************
Error running pipeline stage inform_fzboost.

Standard output and error streams in ./inform_fzboost.out
*************************************************
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/home/smau/.conda/envs/pzflow/lib/python3.12/site-packages/ceci/__main__.py", line 5, in <module>
    PipelineStage.main()
  File "/home/smau/.conda/envs/pzflow/lib/python3.12/site-packages/ceci/stage.py", line 513, in main
    stage.execute(args)
  File "/home/smau/.conda/envs/pzflow/lib/python3.12/site-packages/ceci/stage.py", line 665, in execute
    stage.run()
  File "/home/smau/Documents/software/rail_flexzboost/src/rail/estimation/algos/flexzboost.py", line 140, in run
    training_data[errname][detmask] = 1.0
    ~~~~~~~~~~~~~^^^^^^^^^
KeyError: 'mag_err_u_lsst'
Executing stage: FlexZBoostInformer @ 2024-08-02 15:59:18.645511
Inserting handle into data store.  input: ./output_table_conv_train.hdf5, inform_fzboost
Stage failed: FlexZBoostInformer @ 2024-08-02 15:59:19.018895 after 0.01 minutes