search

ACES-CMZ / reduction_ACES

Reduction scripts and tools for ACES
https://worldwidetelescope.org/webclient/?wtml=https://data.rc.ufl.edu/pub/adamginsburg/ACES/mosaics/mosaics.wtml
15 stars 12 forks source link

Execution Block ID uid://A001/X15a0/X130 Sgr_A_st_y_03_TM1 #40

Open keflavich opened 2 years ago

keflavich commented 2 years ago

Sgr_A_st_y_03_TM1 uid://A001/X15a0/X130

Summary 18th May [Ash] - All cubes look okay, but need rechecking after full clean. Continuum could be a little more cleaned.

Product Links:

Reprocessed Product Links:

ashleythomasbarnes commented 2 years ago

Strange... the cube for SPW 33 is missing in both the weblog here and in the globus products directory

ashleythomasbarnes commented 2 years ago

find_cont task (33.) is also only showing the OLD - so looks like this has been re-run - possibly issues before? Also in the make images mfs (34.) the majority of the SPW33 is flagged as line -- aggregate bandwidth=0.141 GHz (but I'm not sure how this would cause a problem, as the brick field has even less continuum identified in this window).

keflavich commented 2 years ago

For future reference, associated TP and 7m

xinglunju commented 2 years ago

@keflavich The two images you posted are from a different region... this one: #14

xinglunju commented 2 years ago

Continuum imaging

Line imaging

keflavich commented 2 years ago

Following @ashleythomasbarnes' comment: there are no tclean parameters at all for spw33. Why was it skipped? This same issue seems to affect field m.

keflavich commented 2 years ago

The size mitigator did this:

2022-02-24 00:54:38 INFO    hif_checkproductsize::pipeline.hif.heuristics.checkproductsize::casa    Cube size for Field Sgr_A_star SPW 25 nchan 1920 nbin 1 imsize 1250 x 1600 is 15.4 GB
2022-02-24 00:54:38 INFO    hif_checkproductsize::pipeline.hif.heuristics.checkproductsize::casa    Cube size for Field Sgr_A_star SPW 27 nchan 1920 nbin 1 imsize 1250 x 1600 is 15.4 GB
2022-02-24 00:54:38 INFO    hif_checkproductsize::pipeline.hif.heuristics.checkproductsize::casa    Cube size for Field Sgr_A_star SPW 29 nchan 1920 nbin 1 imsize 1250 x 1600 is 15.4 GB
2022-02-24 00:54:38 INFO    hif_checkproductsize::pipeline.hif.heuristics.checkproductsize::casa    Cube size for Field Sgr_A_star SPW 31 nchan 1920 nbin 1 imsize 1250 x 1600 is 15.4 GB
2022-02-24 00:54:38 INFO    hif_checkproductsize::pipeline.hif.heuristics.checkproductsize::casa    Cube size for Field Sgr_A_star SPW 33 nchan 3840 nbin 1 imsize 1250 x 1600 is 30.7 GB
2022-02-24 00:54:38 INFO    hif_checkproductsize::pipeline.hif.heuristics.checkproductsize::casa    Cube size for Field Sgr_A_star SPW 35 nchan 3840 nbin 1 imsize 1250 x 1600 is 30.7 GB
2022-02-24 00:54:38 INFO    hif_checkproductsize::pipeline.hif.heuristics.checkproductsize::casa    Default imaging leads to a maximum cube size of 30.72 GB and a product size of 245.85599999999997 GB
2022-02-24 00:54:38 INFO    hif_checkproductsize::pipeline.hif.heuristics.checkproductsize::casa    Allowed maximum cube size: 40.0 GB. Allowed cube size limit: 60.0 GB. Allowed maximum product size: 500.0 GB.
2022-02-24 00:54:38 INFO    hif_checkproductsize::pipeline.hif.heuristics.checkproductsize::casa    Size mitigation: Setting (cube) spw to 25,27,29,31,35

which makes little sense, since spw33 is totally fine - it's not over the size limits. 🤷‍♂️

keflavich commented 2 years ago

the pipeline reimaging failed with a now-extremely-commonplace error: https://data.rc.ufl.edu/secure/adamginsburg/ACES/weblogs-reimaging/pipeline-20220323T131423-X15a0_X130_y_03_TM1/html/t2-4m.html?sidebar=sidebar_stage12&ms=all&subpage=t2-4m_details.html

I'm in conversations with the CASA developers about how to deal with this issue.

ashleythomasbarnes commented 2 years ago

TO DO

[minor] - I would all okay for now, but needs to be re-checked after reclean at full spectral resolution

1) Continuum could be cleaned a little more -- residual below I would suggest making the mask a little less strict uid___A001_X15a0_X130 s36_0 Sgr_A_star_sci spw25_27_29_31_33_35 cont I iter1 residual tt0 sky

2) Line cubes need to be checked, residual scaling looks odd This could be done post-rerunning of the cleaning

@keflavich --- new product links available?

d-l-walker commented 2 years ago

@ashleythomasbarnes don't suppose you've since looked at any of the reprocessed images? I'm going to start downloading some soon to take a look, but it might be useful to have another set of eyes on this, particularly for the issues you pointed out. The residuals aren't available here, but should be available as CASA image files in the relevant globus directory.

d-l-walker commented 1 year ago

This one looks good now, marking it as done. @ashleythomasbarnes I checked some of the residuals, and they look fine to me. Not sure what was going on with the images in the original weblog, maybe just a weird scaling/rendering issue?

ksi85 commented 8 months ago

QA - Line contamination in continuum images from high/low frequencies

Summary: looks ok to me

Files checked:

New: spw25_27 and spw33_35 Old: spw25_27_29_31_33_35 and oldhigh_spw33_35 Results: New continuum images look good

Attached image:

Top-left: spw25_27_29_31_33_35 Top-right: spw25_27 Bottom-left: oldhigh_spw33_35 Bottom-right: spw33_35

Continuum

ksi85 commented 8 months ago

QA - Line contamination in continuum images from high/low frequencies version 2 (Apr2024)

Summary: looks ok to me

Files checked:

New: spw25_27 and spw33_35 Old: spw25_27_29_31_33_35 and oldhigh_spw33_35 Results: New continuum images look good

Attached image:

Top-left: spw25_27_29_31_33_35 Top-right: spw25_27 Bottom-left: oldhigh_spw33_35 Bottom-right: spw33_35

Continuum_new