search

CHIMEFRB / workflow

🌊 Working in flowstate.
0 stars 0 forks source link

Parameters not passing on the second iteration of run when the work fails the first time #97

Closed astronamanj closed 2 months ago

astronamanj commented 4 months ago 

▰▰▰▰▰▱▱23 Jul 2024 18:54:55 UTC INFO     669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.attempt got work: ✅                                
▰▰▰▰▰▰▰23 Jul 2024 18:54:55 UTC INFO     669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.process click cli detected for func                 
                                  frb_calibration.cli.generate_calibration
▰▱▱▱▱▱▱23 **Jul 2024 18:54:55 UTC INFO     669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.process click cli options: {'--source-name': '3C_295',
                                  '--date-string': '2018-11-27', '--beam-number': '1134', '--data-directory':
                                  '/data/chime/intensity/processed/steady_source_npzs/', '--output-directory':
                                  '/data/user-data/jainn2/cal_flux_fluence/generated_calibrations/cal_sources/', '--generate-plots': True,
                                  '--base-url': 'http://frb-vsop.chime:8001/'}**
23 Jul 2024 18:54:55 UTC INFO     669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.execute executing:
                                  generate-calibration.main(args=['--source-name=3C_295', '--date-string=2018-11-27', '--beam-number=1134',
                                  '--data-directory=/data/chime/intensity/processed/steady_source_npzs/',
                                  '--output-directory=/data/user-data/jainn2/cal_flux_fluence/generated_calibrations/cal_sources/',
                                  '--generate-plots=True', '--base-url=http://frb-vsop.chime:8001/'], standalone_mode=False)
▰▱▱▱▱▱▱23 Jul 2024 18:54:55 UTC INFO     669ffa234465e19b554b6859 root ====================================================                       
23 Jul 2024 18:54:55 UTC INFO     669ffa234465e19b554b6859 root           FRB Calibration Product Pipeline
▰▰▱▱▱▱▱23 Jul 2024 18:54:55 UTC INFO     669ffa234465e19b554b6859 root ====================================================                       
23 Jul 2024 18:54:55 UTC INFO     669ffa234465e19b554b6859 root Sleeping...
...
23 Jul 2024 18:55:18 UTC INFO     669ffa234465e19b554b6859 chime_frb_api.core.core Reauthorize Result: Passed
▰▰▰▰▰▰▰23 Jul 2024 18:55:19 UTC ERROR    669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.execute index -1 is out of bounds for axis 0 with size 0
23 Jul 2024 18:55:19 UTC INFO     669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.execute execution time: 24.37s
▰▱▱▱▱▱▱23 Jul 2024 18:55:19 UTC WARNING  669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.archive Archive method copy not allowed for products by
                                  workspace.
23 Jul 2024 18:55:19 UTC WARNING  669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.archive Archive method copy not allowed for plots by
                                  workspace.
▰▱▱▱▱▱▱23 Jul 2024 18:55:19 UTC INFO     669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.attempt work completed: ✅                          
▰▰▱▱▱▱▱23 Jul 2024 18:55:50 UTC INFO     669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.attempt got work: ✅                                
▰▰▰▱▱▱▱23 Jul 2024 18:55:50 UTC INFO     669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.process click cli detected for func                 
                                  frb_calibration.cli.generate_calibration
▰▰▰▰▱▱▱23 Jul 2024 18:55:50 UTC INFO     669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.process click cli options: {'--data-directory':     
                                  '/data/chime/intensity/processed/steady_source_npzs/', '--output-directory':
                                  '/data/jainn2/flux-fluence-calibration/generated_calibrations/', '--generate-plots': True, '--base-url':
                                  'http://frb-vsop.chime:8001/'}
23 Jul 2024 18:55:50 UTC INFO     669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.execute executing:
                                  generate-calibration.main(args=['--data-directory=/data/chime/intensity/processed/steady_source_npzs/',
                                  '--output-directory=/data/jainn2/flux-fluence-calibration/generated_calibrations/', '--generate-plots=True',
                                  '--base-url=http://frb-vsop.chime:8001/'], standalone_mode=False)
▰▰▰▰▰▰▱23 Jul 2024 18:55:50 UTC ERROR    669ffa234465e19b554b6859 chimefrb.workflow.lifecycle.execute Missing parameter: source_name
chrisfandrade16 commented 2 months ago

This should be fixed with the latest commit and mentioned issue, according to my tests. Re-open this if you still encounter the issue with the latest version.