shadems crashes when an antenna is fully flagged (marked faulty) and you are making one plot.

[bennahugo]

@SharmilaGoedhart reports that this only works when iterating.

Backlog to be posted

[SharmilaGoedhart]

(venv-shadems) sharmila@com06:/scratch2/sharmila/nb-artefacts$ cd sci-obs/ (venv-shadems) sharmila@com06:/scratch2/sharmila/nb-artefacts/sci-obs$ shadems --xaxis CHAN --yaxis DATA:amp bpcal.ms 2022-10-05 12:37:16 - shadems - INFO - using colourmap colorcet.bkr 2022-10-05 12:37:16 - shadems - INFO - using colourmap cmasher.pride 2022-10-05 12:37:16 - shadems - INFO - using colourmap colorcet.glasbey_dark 2022-10-05 12:37:16 - shadems - INFO - /scratch2/sharmila/venv-shadems/bin/shadems --xaxis CHAN --yaxis DATA:amp bpcal.ms 2022-10-05 12:37:16 - shadems - INFO - ------------------------------------------------------ 2022-10-05 12:37:16 - shadems - INFO - : MS bpcal.ms contains 135420 rows 2022-10-05 12:37:16 - shadems - INFO - : (1, 32768) spectral windows and channels 2022-10-05 12:37:16 - shadems - INFO - : 1 fields: J1939-6342 2022-10-05 12:37:16 - shadems - INFO - : 1 scans: 1 2022-10-05 12:37:16 - shadems - INFO - : 60/60 antennas: 0:m000 1:m001 2:m002 3:m003 4:m004 5:m005 6:m006 7:m007 8:m008 9:m009 10:m010 11:m011 12:m012 13:m013 14:m014 15:m015 16:m016 17:m017 18:m018 19:m019 20:m020 21:m021 22:m022 23:m023 24:m024 25:m025 26:m026 27:m030 28:m031 29:m032 30:m033 31:m034 32:m035 33:m036 34:m037 35:m038 36:m039 37:m040 38:m041 39:m042 40:m043 41:m044 42:m045 43:m046 44:m047 45:m048 46:m049 47:m050 48:m051 49:m052 50:m053 51:m054 52:m055 53:m057 54:m058 55:m059 56:m060 57:m061 58:m062 59:m063 2022-10-05 12:37:16 - shadems - INFO - : 1830/1830 baselines present 2022-10-05 12:37:16 - shadems - INFO - : corrs/Stokes XX YY I Q 2022-10-05 12:37:16 - shadems - INFO - ------------------------------------------------------ 2022-10-05 12:37:16 - shadems - INFO - : Data selected for plotting: 2022-10-05 12:37:16 - shadems - INFO - Antenna(s) : all 2022-10-05 12:37:16 - shadems - INFO - Baseline(s) : all except autocorrelations 2022-10-05 12:37:16 - shadems - INFO - Field(s) : all 2022-10-05 12:37:16 - shadems - INFO - SPW(s) : all 2022-10-05 12:37:16 - shadems - INFO - Scan(s) : all 2022-10-05 12:37:16 - shadems - INFO - Channels : all 2022-10-05 12:37:16 - shadems - INFO - Corr/Stokes : XX YY 2022-10-05 12:37:16 - shadems - INFO - ------------------------------------------------------ 2022-10-05 12:37:16 - shadems - INFO - loading minmax cache from bpcal-minmax-cache.json 2022-10-05 12:37:16 - shadems - INFO - axis: CHAN, range (None, None), discretization None 2022-10-05 12:37:16 - shadems - INFO - axis: amp(DATA), corr None, range (None, None), discretization None 2022-10-05 12:37:16 - shadems - INFO - : you have asked for 1 plots employing 2 unique datums 2022-10-05 12:37:16 - shadems - INFO - : Indexing MS and building dataframes (130980 rows, chunk size is 5000) 2022-10-05 12:37:16 - shadems - INFO - : complete 2022-10-05 12:37:16 - shadems - INFO - : rendering 1 dataframes with 8.58e+09 points into 1 plot types 2022-10-05 12:37:16 - shadems - INFO - : rendering plot-bpcal-DATA-XX-YY-amp-CHAN.png 2022-10-05 12:37:16 - shadems - INFO - : scanning axis min/max for DATA_amp_None /scratch2/sharmila/venv-shadems/lib/python3.8/site-packages/shade_ms/data_plots.py:254: RuntimeWarning: All-NaN slice encountered np.array([[(np.nanmin(df[axis].values).item() if bounds[axis][0] is None else bounds[axis][0]) for axis in unknowns]+ /scratch2/sharmila/venv-shadems/lib/python3.8/site-packages/shade_ms/data_plots.py:255: RuntimeWarning: All-NaN slice encountered [(np.nanmax(df[axis].values).item() if bounds[axis][1] is None else bounds[axis][1]) for axis in unknowns]]), /scratch2/sharmila/venv-shadems/lib/python3.8/site-packages/shade_ms/data_plots.py:254: RuntimeWarning: All-NaN slice encountered np.array([[(np.nanmin(df[axis].values).item() if bounds[axis][0] is None else bounds[axis][0]) for axis in unknowns]+ /scratch2/sharmila/venv-shadems/lib/python3.8/site-packages/shade_ms/data_plots.py:255: RuntimeWarning: All-NaN slice encountered [(np.nanmax(df[axis].values).item() if bounds[axis][1] is None else bounds[axis][1]) for axis in unknowns]]), 2022-10-05 12:41:51 - shadems - INFO - : wrote plot-bpcal-DATA-XX-YY-amp-CHAN.png 2022-10-05 12:41:51 - shadems - INFO - Total time : 275.65 seconds 2022-10-05 12:41:51 - shadems - INFO - Saved minmax cache to bpcal-minmax-cache.json (disable with --no-lim-save) 2022-10-05 12:41:51 - shadems - INFO - Finished 2022-10-05 12:41:51 - shadems - INFO - ------------------------------------------------------

[SharmilaGoedhart]

Apologies - it seems like it did work.. I missed seeing the output file last night. Shouldn't be working so late :-/