Closed ddobie closed 9 months ago
Running the latest dev results in field correction seemingly being skipped at the below part of core
https://github.com/askap-vast/vast-post-processing/blob/ec7868cfc694d01e20d8085f86bdb704dc6c26e4/vast_post_processing/core.py#L785-L792
see example log for one field here:
2023-10-04 04:28:02.651 | DEBUG | vast_post_processing.corrections:shift_and_scale_image:247 - Correcting /mnt/data/VAST/vast-data/TILES/STOKESI_IMAGES/epoch_42/image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.fits... 2023-10-04 04:28:33.897 | WARNING | vast_post_processing.corrections:correct_field:658 - Overwriting existing image: /mnt/data/VAST/vast-data/TILES/STOKESI_IMAGES_CORRECTED/epoch_42/image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.corrected.fits. 2023-10-04 04:28:34.621 | SUCCESS | vast_post_processing.corrections:correct_field:662 - Writing corrected image to: /mnt/data/VAST/vast-data/TILES/STOKESI_IMAGES_CORRECTED/epoch_42/image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.corrected.fits. 2023-10-04 04:28:34.652 | DEBUG | vast_post_processing.corrections:shift_and_scale_image:247 - Correcting /mnt/data/VAST/vast-data/TILES/STOKESI_RMSMAPS/epoch_42/noiseMap.image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.fits... 2023-10-04 04:29:06.890 | WARNING | vast_post_processing.corrections:correct_field:658 - Overwriting existing image: /mnt/data/VAST/vast-data/TILES/STOKESI_RMSMAPS_CORRECTED/epoch_42/noiseMap.image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.corrected.fits. 2023-10-04 04:29:07.595 | SUCCESS | vast_post_processing.corrections:correct_field:662 - Writing corrected image to: /mnt/data/VAST/vast-data/TILES/STOKESI_RMSMAPS_CORRECTED/epoch_42/noiseMap.image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.corrected.fits. 2023-10-04 04:29:07.623 | DEBUG | vast_post_processing.corrections:shift_and_scale_image:247 - Correcting /mnt/data/VAST/vast-data/TILES/STOKESI_RMSMAPS/epoch_42/meanMap.image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.fits... 2023-10-04 04:29:37.826 | WARNING | vast_post_processing.corrections:correct_field:658 - Overwriting existing image: /mnt/data/VAST/vast-data/TILES/STOKESI_RMSMAPS_CORRECTED/epoch_42/meanMap.image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.corrected.fits. 2023-10-04 04:29:38.538 | SUCCESS | vast_post_processing.corrections:correct_field:662 - Writing corrected image to: /mnt/data/VAST/vast-data/TILES/STOKESI_RMSMAPS_CORRECTED/epoch_42/meanMap.image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.corrected.fits. 2023-10-04 04:29:38.565 | DEBUG | vast_post_processing.corrections:shift_and_scale_catalog:345 - Correcting /mnt/data/VAST/vast-data/TILES/STOKESI_SELAVY/epoch_42/selavy-image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.components.xml ... 2023-10-04 04:29:39.475 | WARNING | vast_post_processing.corrections:correct_field:688 - Overwriting existing catalogue: /mnt/data/VAST/vast-data/TILES/STOKESI_SELAVY_CORRECTED/epoch_42/selavy-image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.components.corrected.xml. 2023-10-04 04:29:41.305 | SUCCESS | vast_post_processing.corrections:correct_field:695 - Writing corrected catalogue: /mnt/data/VAST/vast-data/TILES/STOKESI_SELAVY_CORRECTED/epoch_42/selavy-image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.components.corrected.xml. 2023-10-04 04:29:41.305 | DEBUG | vast_post_processing.corrections:shift_and_scale_catalog:345 - Correcting /mnt/data/VAST/vast-data/TILES/STOKESI_SELAVY/epoch_42/selavy-image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.islands.xml ... 2023-10-04 04:29:42.279 | WARNING | vast_post_processing.corrections:correct_field:688 - Overwriting existing catalogue: /mnt/data/VAST/vast-data/TILES/STOKESI_SELAVY_CORRECTED/epoch_42/selavy-image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.islands.corrected.xml. 2023-10-04 04:29:43.945 | SUCCESS | vast_post_processing.corrections:correct_field:695 - Writing corrected catalogue: /mnt/data/VAST/vast-data/TILES/STOKESI_SELAVY_CORRECTED/epoch_42/selavy-image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.islands.corrected.xml. 2023-10-04 04:29:43.945 | INFO | vast_post_processing.corrections:correct_field:698 - Successfully corrected the images and catalogs for /mnt/data/VAST/vast-data/TILES/STOKESI_IMAGES/epoch_42/image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.fits 2023-10-04T04:29:43 WARNING Field correction was skipped for /mnt/data/VAST/vast-data/TILES/STOKESI_IMAGES/epoch_42/image.i.VAST_0840-37.SB51900.cont.taylor.0.restored.conv.fits. Skipping remaining steps [root]
Running the latest dev results in field correction seemingly being skipped at the below part of core
https://github.com/askap-vast/vast-post-processing/blob/ec7868cfc694d01e20d8085f86bdb704dc6c26e4/vast_post_processing/core.py#L785-L792
see example log for one field here: