ACES-CMZ / reduction_ACES

Reduction scripts and tools for ACES
https://worldwidetelescope.org/webclient/?wtml=https://data.rc.ufl.edu/pub/adamginsburg/ACES/mosaics/mosaics.wtml
15 stars 12 forks source link

Total Power + 7M combination #261

Open pyhsiehATalma opened 1 year ago

pyhsiehATalma commented 1 year ago

This issue is created to combine 7 m and TP data. CS(2-1) line. 12m: spw 22 7m: spw 24

Please find the data in Globus, the path is,

/upload/ACA-TP-CS2-1/

feather_cube_fits: feather cube per field m0_fits: integrated intensity feather map per field m8_fits: peak intensity feather map per field mosaic_fits: mosaic feather cube

pyhsiehATalma commented 1 year ago

Test of stitching TP cube (spw21, HCO+)

I started from stitching ae and ag. The weighted average works well. Some channels show seamlines. ,

2eb-compare

Left: ag Middle: ae Right: ag+ae

The seamline is less likely from the edge effect, but from inconsistent structure (low s/n perhaps?) in the overlapping area of two maps. The inconsistent structures could be due to errors of baseline subtraction made by the pipeline.

It looks like the discrepancy came from the spectral baseline subtraction made by the pipeline. The maps without trimming edges are shown below. Line profiles within the pink box in the map are shown.
In this particular case, the spw bandwidth was very narrow compared with the line width and (perhaps) the pipeline wrongly fitted nonlinear baselines to the line wings. The weighted averaged map is reasonably show averaged intensity of these two data.

spectra-twoEB spectra-twoEB-spectra

Possible solution

pyhsiehATalma commented 1 year ago

Test of stitching 7 m cube (spw20, HCO+)

pyhsiehATalma commented 1 year ago

In a feather cube, it seems that ripples do not affect rms. feather cube CASA <12>: imstat('uid___A001_X15a0_X102.s38_0.Sgr_A_star_sci.spw24.cube.I.iter1.image.pbcor.feather',axes=[0,1])['rms'][50:100].mean() Out[12]: 0.029305854075964345

ACA only CASA <13>: imstat('uid___A001_X15a0_X102.s38_0.Sgr_A_star_sci.spw24.cube.I.iter1.image.pbcor',axes=[0,1])['rms'][50:100].mean() ....10....20....30....40....50....60....70....80....90....100% Out[13]: 0.02922085079619772

Screenshot 2023-06-21 at 9 49 56 AM
pyhsiehATalma commented 1 year ago

Before re-imaging ( see WP1 agenda-minute on Apri 26 2023) m8-may After re-imaging m8-june png

m0-june

38 fields are available for CS(2-1) ACA+TP combination 0 X1590_X30ac X1590_X30ae 1 X15a0_Xae X15a0_Xb0 2 X15a0_Xb4 X15a0_Xb6 3 X15b4_X39 X15a0_Xbc 4 X15a0_Xc0 X15a0_Xc2 5 X15a0_Xc6 X15a0_Xc8 6 X15a0_Xcc X15a0_Xce 7 X15b4_Xc5 X15a0_Xd4 8 X15a0_Xde X15a0_Xe0 9 X15a0_Xe4 X15a0_Xe6 10 X15b4_X43 X15b4_X45 11 X15a0_Xf0 X15a0_Xf2 12 X15a0_Xf6 X15a0_Xf8 13 X15a0_Xfc X15a0_Xfe 14 X15a0_X102 X15a0_X104 15 X15a0_X10e X15a0_X110 16 X15a0_X114 X15a0_X116 17 X15a0_X11a X15a0_X11c 18 X15a0_X120 X15a0_X122 19 X15a0_X126 X15a0_X128 20 X15a0_X12c X15a0_X12e 21 X15a9_X12d3 X15a0_X13a 22 X15a0_X13e X15a0_X140 23 X15a0_X144 X15a0_X146 24 X15a0_X14a X15a0_X14c 25 X15a0_X150 X15a0_X152 26 X15a0_X156 X15a0_X158 27 X15a0_X15c X15a0_X15e 28 X15a0_X162 X15a0_X164 29 X15a0_X168 X15a0_X16a 30 X15a0_X16e X15a0_X170 31 X15b4_X47 X15b4_X49 32 X15a9_X12d5 X15b4_X4d 33 X15a0_X180 X15a0_X182 34 X15a0_X186 X15a0_X188 35 X15a0_X18c X15a0_X18e 36 X15a0_X192 X15a0_X194 37 X15a0_X19e X15a0_X1a0

Update status of the rest 7 fields

Proposal ID Obs ID 7m MOUS ID issue issue TP MOUS ID issue issue
cmz02 b X15b4_X37 tclean stopped? no spw 24 cube under /working, maybe a manual re-imaging is needed. #162 X15a0_Xaa No issue #252
cmz10 j X15a0_Xd8 Fine,but has continuum subtraction issue of spw 24. #181 X15b4_X3f obs. completed #324
cmz18 r X15a0_X108 No issue #240 X15a0_X10a QA3 #246
cmz25 y X15a0_X132 No issue #4 X15a0_X134 Re-observe #27
cmz42 ap X15a0_X198 No issue #158 X3577_X6c5 obs. completed #325
cmz44 ar X15b4_X4f tclean stopped? no spw 24 cube under /working, maybe a manual re-imaging is needed. #159 X15a0_X1a6 obs. completed #317
cmz45 as X15a0_X1aa No issue #165 X15a0_X1ac obs. completed #322

Other issues:

  1. continuum emission is not subtracted well in some regions - need to check, e.g., Sgr B2, Sgr A star
  2. need to make a table of rms of each field continuum-residual
snlongmore commented 1 year ago

Nice work! This already looks great!

pyhsiehATalma commented 1 year ago

feather will likely to crash for two cases.

  1. 7m (or 12m) cube is not restored with a common beam in tclean (i.e, common=True is not used). This could be fixed by running imsmooth with "kernel = common".
  2. product image (member.uid___A001_X15a0.....pbcor) has the same axes order as single dish data, there is no need to do imtrans with single dish cube.
pyhsiehATalma commented 1 year ago

43 fields (beam=20") were made for mosaic. NRO 45m CS(2-1) map (beam=17", 2016, ApJ, 831, 72) is shown for comparison. Missing fields: y and r (no single dish data) cs21-sp-mom0 fits-CS21-feather-Mosaic-43field gal image imsub moment integrated-CS21-feather-Mosaic-43field gal image imsub moment maximum-image-2023-07-04-12-59-42

pyhsiehATalma commented 1 year ago
Proposal ID | Obs ID | alternative name | velocity offset | 7m MOUS ID | Divergence (cube) | Using Product? | issue | TP MOUS ID | issue -- | -- | -- | -- | -- | -- | -- | -- | -- | -- cmz01 | a | - | 40 | X1590_X30ac | no |   | #214 | X1590_X30ae | #215 cmz02 | b | Sgr B2 | 40 | X15b4_X37 | no (manual imaging) |   | #162 | X15a0_Xaa | #252 cmz03 | c | - | 0 | X15a0_Xae | yes | yes | #14 | X15a0_Xb0 | #175 cmz04 | d | - | 30 | X15a0_Xb4 | yes, ch=597-602, 613 | yes | #228 | X15a0_Xb6 | #227 cmz05 | e | - | -30 | X15b4_X39 | no |   | #168 | X15a0_Xbc | #285 cmz06 | f | - | 0 | X15a0_Xc0 | no, but continuum issue |   | #254 | X15a0_Xc2 | #315 cmz07 | g | - | 30 | X15a0_Xc6 | no |   | #161 | X15a0_Xc8 | #197 cmz08 | h | - | 0 | X15a0_Xcc | no |   | #151 | X15a0_Xce | #177 cmz09 | i | - | 30 | X15b4_Xc5 | no, but continuum issue |   | #191 | X15a0_Xd4 | #187 cmz10 | j | - | 30 | X15a0_Xd8 | no, but continuum issue |   | #181 | X15b4_X3f | #324 cmz11 | k | - | 30 | X15a0_Xde | no |   | #182 | X15a0_Xe0 | #193 cmz12 | l | - | 0 | X15a0_Xe4 | no |   | #153 | X15a0_Xe6 | #224 cmz13 | m | - | 30 | X15b4_X43 | no, but continuum issue |   | #110 | X15b4_X45 | #170 cmz14 | n | - | 30 | X15a0_Xf0 | no |   | #225 | X15a0_Xf2 | #226 cmz15 | o | - | 0 | X15a0_Xf6 | no |   | #257 | X15a0_Xf8 | #278 cmz16 | p | - | 0 | X15a0_Xfc | no |   | #148 | X15a0_Xfe | #183 cmz17 | q | - | 0 | X15a0_X102 | no |   | #171 | X15a0_X104 | #284 cmz18 | r | - | 30 | X15a0_X108 | no |   | #240 | X15a0_X10a | #246 cmz19 | s | - | 0 | X15a0_X10e | no |   | #243 | X15a0_X110 | #262 cmz20 | t | - | 0 | X15a0_X114 | yes, ch=701-703 | reclean cube | #8 | X15a0_X116 | #172 cmz21 | u | - | 30 | X15a0_X11a | no |   | #216 | X15a0_X11c | #217 cmz22 | v | - | 30 | X15a0_X120 | no |   | #218 | X15a0_X122 | #219 cmz23 | w | - | 30 | X15a0_X126 | no |   | #144 | X15a0_X128 | #173 cmz24 | x | - | 0 | X15a0_X12c | no |   | #135 | X15a0_X12e | #164 cmz25 | y | - | 0 | X15a0_X132 | no |   | #4 | X15a0_X134 | #27 cmz26 | z | - | 40 | X15a9_X12d3 | no |   | #115 | X15a0_X13a | #236 cmz27 | aa | - | 0 | X15a0_X13e | no |   | #237 | X15a0_X140 | #229 cmz28 | ab | - | 0 | X15a0_X144 | no |   | #141 | X15a0_X146 | #167 cmz29 | ac | - | 0 | X15a0_X14a | no |   | #220 | X15a0_X14c | #221 cmz30 | ad | - | 0 | X15a0_X150 | no |   | #5 | X15a0_X152 | #25 cmz31 | ae | - | 0 | X15a0_X156 | ch=652,653,655 | yes | #186 | X15a0_X158 | #180 cmz32 | af | - | 0 | X15a0_X15c | no |   | #244 | X15a0_X15e | #271 cmz33 | ag | - | 0 | X15a0_X162 | yes, ch=675 | also divergence | #174 | X15a0_X164 | #190 cmz34 | ah | - | 30 | X15a0_X168 | yes, ch=596, 615, 617 | yes | #230 | X15a0_X16a | #233 cmz35 | ai | - | 0 | X15a0_X16e | no |   | #143 | X15a0_X170 | #169 cmz36 | aj | - | -30 | X15b4_X47 | no |   | #119 | X15b4_X49 | #239 cmz37 | ak | - | 30 | X15a9_X12d5 | no |   | #116 | X15b4_X4d | #121 cmz38 | al | - | 0 | X15a0_X180 | no |   | #139 | X15a0_X182 | #166 cmz39 | am | - | 30 | X15a0_X186 | no |   | #265 | X15a0_X188 | #245 cmz40 | an | - | 30 | X15a0_X18c | no |   | #222 | X15a0_X18e | #184 cmz41 | ao | Brick | 0 | X15a0_X192 | yes, ch=627-629 | also divergence | #6 | X15a0_X194 | #29 cmz42 | ap | - | 0 | X15a0_X198 | no |   | #158 | X3577_X6c5 | #325 cmz43 | aq | Sgr A* | 0 | X15a0_X19e | no |   | #33 | X15a0_X1a0 | #223 cmz44 | ar | - | 40 | X15b4_X4f | no (manual imaging) |   | #159 | X15a0_X1a6 | #317 cmz45 | as | - | 0 | X15a0_X1aa | yes, ch=616 | yes | #165 | X15a0_X1ac | #322 **Field t was re-imaging with older version of pipeline, and the divergence occurs with latest version (not sure).**
pyhsiehATalma commented 1 year ago

RMS was measured and averaged with the first 6 channels. Fields have high rms are very likely to be affected by continuum emission (also see table above).

casa> rmslist.append(imstat(imageListACA[i][0]+'.feather',axes=[0,1])['rms'][:6].mean()) #jy/beam

Proposal ID | Obs ID | name | 7m MOUS ID | rms (mJy/b) | bmaj (") | bmin | bpa | issue | TP MOUS ID | issue -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- cmz01 | a | - | X1590_X30ac | 39.77562965 | 17.12126594 | 10.93929941 | 1.505732397 | #214 | X1590_X30ae | #215 cmz02 | b | Sgr B2 | X15b4_X37 | 90.0965609 | 17.84799957 | 10.74058056 | -78.22389221 | #162 | X15a0_Xaa | #252 cmz03 | c | - | X15a0_Xae | 40.73894367 | 17.10279358 | 10.12249347 | -74.04307389 | #14 | X15a0_Xb0 | #175 cmz04 | d | - | X15a0_Xb4 | 33.17006222 | 16.75963561 | 9.907639215 | 85.36107529 | #228 | X15a0_Xb6 | #227 cmz05 | e | - | X15b4_X39 | 38.06563367 | 16.5936729 | 11.2399217 | 1.371856192 | #168 | X15a0_Xbc | #285 cmz06 | f | - | X15a0_Xc0 | 38.33462951 | 19.46780488 | 9.076200579 | -1.517873493 | #254 | X15a0_Xc2 | #315 cmz07 | g | - | X15a0_Xc6 | 37.20820664 | 15.94895017 | 10.66000503 | -1.331747025 | #161 | X15a0_Xc8 | #197 cmz08 | h | - | X15a0_Xcc | 42.07322483 | 15.64770984 | 9.123481412 | -1.498403995 | #151 | X15a0_Xce | #177 cmz09 | i | - | X15b4_Xc5 | 77.58358932 | 16.72479793 | 11.09737381 | 1.357879438 | #191 | X15a0_Xd4 | #187 cmz10 | j | - | X15a0_Xd8 | 75.85999945 | 16.6163234 | 11.33297783 | 1.361823969 | #181 | X15b4_X3f | #324 cmz11 | k | - | X15a0_Xde | 39.23075645 | 14.85704655 | 11.20373782 | 1.200988199 | #182 | X15a0_Xe0 | #193 cmz12 | l | - | X15a0_Xe4 | 42.52966822 | 17.03870905 | 9.955202931 | -1.366953261 | #153 | X15a0_Xe6 | #224 cmz13 | m | - | X15b4_X43 | 80.860266 | 17.00656718 | 10.65003655 | -1.521902472 | #110 | X15b4_X45 | #170 cmz14 | n | - | X15a0_Xf0 | 31.43817518 | 15.55200808 | 9.0892327 | 1.39963265 | #225 | X15a0_Xf2 | #226 cmz15 | o | - | X15a0_Xf6 | 41.822197 | 18.99809996 | 8.814871533 | -1.553909248 | #257 | X15a0_Xf8 | #278 cmz16 | p | - | X15a0_Xfc | 38.58774123 | 15.75078097 | 9.484382885 | -1.432294438 | #148 | X15a0_Xfe | #183 cmz17 | q | - | X15a0_X102 | 34.83818946 | 15.75018132 | 10.16475923 | -1.548503406 | #171 | X15a0_X104 | #284 cmz18 | r | - | X15a0_X108 | 0 | 0 | 0 | 0 | #240 | X15a0_X10a | #246 cmz19 | s | - | X15a0_X10e | 32.98004308 | 16.27942686 | 9.23423306 | 1.464166758 | #243 | X15a0_X110 | #262 cmz20 | t | - | X15a0_X114 | 40.84405729 | 16.14957661 | 10.93331021 | -1.310047572 | #8 | X15a0_X116 | #172 cmz21 | u | - | X15a0_X11a | 41.11590974 | 15.69616623 | 9.136532663 | 1.469305354 | #216 | X15a0_X11c | #217 cmz22 | v | - | X15a0_X120 | 46.46228925 | 16.22580435 | 10.66255342 | 1.471255684 | #218 | X15a0_X122 | #219 cmz23 | w | - | X15a0_X126 | 37.42438856 | 16.16333824 | 9.622633656 | -1.367579717 | #144 | X15a0_X128 | #173 cmz24 | x | - | X15a0_X12c | 38.36672789 | 16.4643603 | 9.747313122 | -1.377050116 | #135 | X15a0_X12e | #164 cmz25 | y | - | X15a0_X132 | 0 | 0 | 0 | 0 | #4 | X15a0_X134 | #27 cmz26 | z | - | X15a9_X12d3 | 39.21475418 | 17.21989362 | 9.811748289 | -1.5675297 | #115 | X15a0_X13a | #236 cmz27 | aa | - | X15a0_X13e | 37.4080343 | 17.75785763 | 10.13186391 | -1.566234238 | #237 | X15a0_X140 | #229 cmz28 | ab | - | X15a0_X144 | 49.93155925 | 15.75685725 | 8.981113947 | -1.394084793 | #141 | X15a0_X146 | #167 cmz29 | ac | - | X15a0_X14a | 41.17780752 | 17.22640165 | 9.325214223 | 1.551485431 | #220 | X15a0_X14c | #221 cmz30 | ad | - | X15a0_X150 | 54.43253141 | 16.5245654 | 12.34191906 | -1.394711418 | #5 | X15a0_X152 | #25 cmz31 | ae | - | X15a0_X156 | 38.96870574 | 14.84141666 | 10.94654774 | 70.61198856 | #186 | X15a0_X158 | #180 cmz32 | af | - | X15a0_X15c | 36.5408115 | 16.90173062 | 9.36552324 | 1.51507669 | #244 | X15a0_X15e | #271 cmz33 | ag | - | X15a0_X162 | 42.06585665 | 15.47536977 | 11.86177846 | 1.149434818 | #174 | X15a0_X164 | #190 cmz34 | ah | - | X15a0_X168 | 37.28876805 | 17.36775539 | 9.923778685 | 87.00923927 | #230 | X15a0_X16a | #233 cmz35 | ai | - | X15a0_X16e | 36.58415997 | 15.90430749 | 9.625052422 | -1.394871655 | #143 | X15a0_X170 | #169 cmz36 | aj | - | X15b4_X47 | 40.12442163 | 17.07915324 | 9.906566468 | 1.542178189 | #119 | X15b4_X49 | #239 cmz37 | ak | - | X15a9_X12d5 | 47.97824491 | 17.93880719 | 9.716342375 | -1.479637694 | #116 | X15b4_X4d | #121 cmz38 | al | - | X15a0_X180 | 48.49972206 | 16.49058095 | 10.01813475 | -1.35925682 | #139 | X15a0_X182 | #166 cmz39 | am | - | X15a0_X186 | 39.0726224 | 18.62780549 | 9.575923558 | 1.551050883 | #265 | X15a0_X188 | #245 cmz40 | an | - | X15a0_X18c | 33.92615667 | 16.38291166 | 9.7743048 | 1.47356267 | #222 | X15a0_X18e | #184 cmz41 | ao | Brick | X15a0_X192 | 45.38271544 | 16.05112961 | 12.70767713 | -1.09117109 | #6 | X15a0_X194 | #29 cmz42 | ap | - | X15a0_X198 | 40.37669938 | 16.50825446 | 9.730579478 | 1.485810123 | #158 | X3577_X6c5 | #325 cmz43 | aq | Sgr A* | X15a0_X19e | 35.66502969 | 16.58921044 | 9.73437417 | -1.509049237 | #33 | X15a0_X1a0 | #223 cmz44 | ar | - | X15b4_X4f | 35.53938323 | 15.97349045 | 10.10367018 | -1.545864144 | #159 | X15a0_X1a6 | #317 cmz45 | as | - | X15a0_X1aa | 37.82851373 | 15.9603118 | 11.10114114 | 80.15482172 | #165 | X15a0_X1ac | #322
pyhsiehATalma commented 12 months ago

mosaic