Closed Athanaseus closed 8 months ago
Simple Flag Statistics Run: And for more: summary_options: [scan,corr,ant,freq]
summary_options: [scan,corr,ant,freq]
rfinder-summary-stats-0: info: report initial flagging statistics from rfinder cab: rfinder params: ms: =recipe.ms output_dir: "{recipe.dir-out-base}/" label: test ncpu: =recipe.ncpu
### running /opt/slurm/bin/srun -J rfinder-summary-stats-0.mgpls-reductions.loop-pointings --time 1-12 --mem 100GB --cpus-per-task 4 /software/common/singularity/3.11.3/bin/singularity exec --containall --pwd /scratch3/users/athanaseus --bind /scratch3/users/athanaseus:/scratch3/users/athanaseus:rw /scratch3/users/athanaseus/images/quay.io-stimela2-rfinder:cc0.0.2.simg rfinder --input msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms --input_dir ./ --output_dir mgpls-output-000/ --label test --field 0 --polarization q --ncpu 16 --summary_options ant corr --plot_summary .0# 2024-02-13 12:30:42,029; ------ Reading default parameter file in your directory ------ .0# .0# 2024-02-13 12:30:42,068; ------ Updating arguments given from terminal ------ .0# .0# 2024-02-13 12:30:42,478; ------ STARTING RFI analysis ------ .0# .0# 2024-02-13 12:30:42,478; ... Field, Antenna & Bandwidth Info ... .0# .0# 2024-02-13 12:30:42,626; Field with name T16R02C02 (Field ID = 0) .0# 2024-02-13 12:30:42,716; Total number of antennas: 61 .0# 2024-02-13 12:30:42,716; Antenna names: ['m000' 'm001' 'm002' 'm003' 'm004' 'm005' 'm006' 'm007' 'm009' 'm010' .0# 'm011' 'm012' 'm013' 'm014' 'm015' 'm016' 'm017' 'm018' 'm019' 'm020' .0# 'm021' 'm022' 'm023' 'm024' 'm025' 'm026' 'm027' 'm028' 'm029' 'm030' .0# 'm031' 'm032' 'm033' 'm034' 'm035' 'm036' 'm037' 'm038' 'm039' 'm040' .0# 'm041' 'm042' 'm043' 'm044' 'm045' 'm047' 'm048' 'm049' 'm050' 'm051' .0# 'm052' 'm053' 'm054' 'm055' 'm056' 'm057' 'm058' 'm059' 'm060' 'm061' .0# 'm062'] .0# 2024-02-13 12:30:42,852; Channel Width \\\[kHz]: 208.984375 .0# 2024-02-13 12:30:42,852; Start [GHz]: 0.856 .0# 2024-02-13 12:30:42,852; End [GHz]: 1.711791015625 .0# .0# 2024-02-13 12:30:42,852; ... Observing time Info ... .0# .0# 2024-02-13 12:30:42,964; Start date: 18Dec01:11:50:44 .0# 2024-02-13 12:30:42,965; End date : 18Dec01:11:53:23 .0# .0# .0# 2024-02-13 12:30:43,186; ... Altitude/Azimuth info ... .0# .0# 2024-02-13 12:31:09,694; ... Altitude = [43.31332145] deg .0# 2024-02-13 12:31:09,695; ... Azimuth = [212.69529205] deg .0# .0# 2024-02-13 12:31:09,695; ... Alt/Az done ... .0# .0# 2024-02-13 12:31:12,604; ... Predicting natural r.m.s. ... .0# .0# 2024-02-13 12:31:12,604; Assumptions on meerkat telescope .0# 2024-02-13 12:31:12,604; Dish diameter = 13.5 m .0# 2024-02-13 12:31:12,605; ... and SEFD = 578.710952 Jy .0# 2024-02-13 12:31:12,605; ... and Tsys = 30.0 K .0# .0# 2024-02-13 12:31:12,605; Properties of observation .0# 2024-02-13 12:31:12,605; Total number of baselines = 1830.0 .0# 2024-02-13 12:31:12,605; Total number of channels = 4096 .0# 2024-02-13 12:31:12,605; Observing time on source = 0.04887 h (2 polarisations) .0# .0# 2024-02-13 12:31:12,605; Stokes I natural r.m.s. = 1.116e+00 mJy/b .0# 2024-02-13 12:31:12,606; ... Natural r.m.s. predicted ... .0# .0# 2024-02-13 12:31:12,620; ... info from MS file loaded .0# .0# .0# 2024-02-13 12:31:12,632; ------ MSfile Loaded ----- .0# .0# 2024-02-13 12:31:12,633; ... Flag Summary Info ... .0# Successful readonly open of default-locked table ./msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms/FIELD: 9 columns, 1 rows .0# Successful readonly open of default-locked table ./msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms/ANTENNA: 8 columns, 61 rows .0# Successful readonly open of default-locked table ./msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms/SPECTRAL_WINDOW: 14 columns, 1 rows .0# Successful readonly open of default-locked table ./msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms: 28 columns, 20801 rows .0# Successful readonly open of default-locked table ./msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms: 28 columns, 20801 rows .0# Successful readonly open of default-locked table ./msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms/POLARIZATION: 4 columns, 1 rows .0# Successful readonly open of default-locked table ./msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms: 28 columns, 20801 rows .0# 2024-02-13 12:31:14,926; .0# 2024-02-13 12:31:14,927; Flagged percentages per ant: .0# 2024-02-13 12:31:14,927; .0# 2024-02-13 12:31:14,927; 0% 20% 40% 60% 80% 100% .0# 2024-02-13 12:31:14,927; | | | | | | .0# 2024-02-13 12:31:14,928; m000 40.8% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m001 41.1% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m003 40.9% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m002 41.2% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m004 40.7% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m006 40.8% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m005 40.9% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m013 40.2% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m011 41.3% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m007 40.4% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m009 40.7% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m010 40.0% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m012 41.2% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m016 40.1% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m015 40.6% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m014 40.2% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m017 40.0% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m018 41.0% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m019 40.8% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m020 41.1% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,928; m023 100.0% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m022 39.4% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m026 40.1% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m021 39.8% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m025 39.2% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m024 39.3% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m029 40.4% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m031 39.3% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m028 40.8% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m030 39.9% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m032 38.9% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m027 40.6% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m033 35.1% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m035 39.6% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m034 39.5% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m037 39.2% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m042 39.3% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m036 39.4% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m049 31.9% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m038 39.4% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m038 39.4% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m039 39.2% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m040 39.2% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m048 33.1% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m047 38.1% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m045 35.0% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m041 100.0% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m043 38.4% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,929; m044 37.2% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m050 31.9% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m051 36.1% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m052 35.5% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m053 36.0% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m059 100.0% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m058 27.2% ∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m062 100.0% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m054 37.9% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m061 100.0% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m057 29.3% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m055 34.8% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m056 33.3% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; m060 100.0% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:14,930; .0# 2024-02-13 12:31:14,932; ------ Plotting ant summary plots ------ .0# .0# 2024-02-13 12:31:15,635; ------ Saving: mgpls-output-000/rfi_q__test/plots/ant-summary.png ------ .0# .0# 2024-02-13 12:31:15,635; ------ Summary plot done ------ .0# .0# 2024-02-13 12:31:15,635; ... Flag Summary Info ... .0# .0# Successful readonly open of default-locked table ./msdir/T16R02C02-corr-scan3-chan512-t16-XXYY.ms: 28 columns, 20801 rows .0# 2024-02-13 12:31:19,280; .0# 2024-02-13 12:31:19,281; Flagged percentages per corr: .0# 2024-02-13 12:31:19,281; .0# 2024-02-13 12:31:19,281; 0% 20% 40% 60% 80% 100% .0# 2024-02-13 12:31:19,282; | | | | | | .0# 2024-02-13 12:31:19,284; XX 44.9% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:19,284; YY 44.9% ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ .0# 2024-02-13 12:31:19,284; .0# 2024-02-13 12:31:19,303; ------ Plotting corr summary plots ------ .0# .0# 2024-02-13 12:31:20,105; ------ Saving: mgpls-output-000/rfi_q__test/plots/corr-summary.png ------ .0# .0# 2024-02-13 12:31:20,105; ------ Summary plot done ------ .0# .0# 2024-02-13 12:31:20,105; ------ Total % Flagged: 44.94 ------ .0# 2024-02-13 12:31:20,613; ---- Html summary report done ---- .0# .0# 2024-02-13 12:31:20,614; ------ cleaning up ------ .0# .0# 2024-02-13 12:31:20,796; ------ End of RFInder ------ .0# .0# .0# 2024-02-13 12:31:20,796; +------+ .0# Done .0# +------+ 2024-02-13 12:31:21 STIMELA.loop-pointings.mgpls-reductions.rfinder-summary-stats-0 INFO: rfinder returns exit code 0 after 0:00:42
Simple Flag Statistics Run: And for more:
summary_options: [scan,corr,ant,freq]