caracal-pipeline / caracal

Containerized Automated Radio Astronomy Calibration (CARACal) pipeline
GNU General Public License v2.0
28 stars 6 forks source link

Aimfast and cataloging updates #1448

Closed Athanaseus closed 1 year ago

Athanaseus commented 1 year ago
aimfast:
  enable: true
  plot: true
  convergence_criteria: ''
  online_catalog:
     enable: true
     catalog_type: nvss

If aimfast is enabled, the following json file will be generated containing stats for each selfcal iteration.

$ cat fidelity_results.json
$ {"cube.residual.fits": {"SKEW": 0.124, "KURT": 3.825, "STDDev": 5.5e-05,
                          "MEAN": 4.747e-07, "MAD": 5e-05, "RMS": 5.5e-05},
       "cube.image.fits": {"DR": 35.39, "deepest_negative": 10.48,
                           "local_rms": 30.09, "global_rms": 35.39}}

If aimfast:plot:true the following plots are generated for each iteration. FluxOffset.html 186132644-89cb22f3-461e-46dd-bea8-581fa7679a17 PositionOffset.html 186132653-c2c67f6e-92ab-4f97-aedd-b9d536cce2a0 SourceResidualNoiseRatio.html & RandomResidualNoiseRatio.html Screenshot 2022-10-26 145521

If aimfast:online_compare:true It will generate OnlineFluxOffset.html & OnlinePositionOffset.html In case no matches are found online (i.e. nvss/sumss) a friendly warning is logged.

# aimfast.aimfast - 2022-10-26 12:02:51,091 INFO - Using sky width of 5.0d
# aimfast.aimfast - 2022-10-26 12:02:51,091 INFO - Extracting phase centre coordinates form /stimela_mount/output//continuum/image_1/mypipelinerun_circinus_p3_1-pybdsm.lsm.html
# aimfast.aimfast - 2022-10-26 12:02:51,152 INFO - Quering the nvss catalog with width of 5.0d at ['14:13:20.03', '-65:22:0.59']
# aimfast.aimfast - 2022-10-26 12:02:52,093 WARNING - No object found around (ICRS) position ['14:13:20.03', '-65:22:0.59']

Original MFS image compared to generated breizorro image.

MFS MFS-breiz
mypipelinerun_circinus_p3_3-MFS-image fits-image-2022-10-26-14-18-38 mypipelinerun_circinus_p3_3-MFS-breiz-image fits-image-2022-10-26-14-18-44
Athanaseus commented 1 year ago

retest this please