search

NCAR / ucomp-pipeline

Data processing pipeline for UCoMP
Other
6 stars 3 forks source link

Determine why centering for 20220612 is off #178

Closed mgalloy closed 1 year ago

mgalloy commented 1 year ago

Compared to the reprocess on 2023-08-20, the centering for 20220612 doesn't work for TCAM on many files. Finding the occulter center didn't fail at all in the reprocess on 2023-08-20.

mgalloy commented 1 year ago

Here is the new centering log

20220612.231847.ucomp.637.l1.3.fts    620.10 507.49 324.70   0.06  639.50 511.50   -NaN   0.00
20220612.232118.ucomp.637.l1.3.fts    620.42 507.59 324.91   0.07  639.50 511.50   -NaN   0.00
20220612.234719.ucomp.637.l1.3.fts    623.32 507.04 325.09   0.06  639.50 511.50   -NaN   0.00
20220612.234950.ucomp.637.l1.3.fts    623.46 507.06 325.15   0.07  639.50 511.50   -NaN   0.00
20220613.001445.ucomp.637.l1.3.fts    624.19 507.33 325.12   0.06  639.50 511.50   -NaN   0.00
20220613.001716.ucomp.637.l1.3.fts    624.29 507.44 325.18   0.07  639.50 511.50   -NaN   0.00
20220613.020759.ucomp.637.l1.3.fts    626.13 507.95 325.08   0.06  639.50 511.50   -NaN   0.00
20220613.021031.ucomp.637.l1.3.fts    626.14 508.08 325.18   0.10  639.50 511.50   -NaN   0.00
20220613.025105.ucomp.637.l1.3.fts    626.63 508.06 324.84   0.07  624.02 506.43 325.28   0.11
20220613.025337.ucomp.637.l1.3.fts    626.94 508.21 325.04   0.08  624.29 506.60 325.48   0.11
20220613.031833.ucomp.637.l1.3.fts    631.49 509.06 325.24   0.08  628.66 507.46 325.74   0.16
20220613.032104.ucomp.637.l1.3.fts    632.47 509.30 325.32   0.10  629.68 507.68 325.81   0.16
20220613.034601.ucomp.637.l1.3.fts    635.44 509.67 325.32   0.11  632.63 508.06 325.86   0.29
20220613.034832.ucomp.637.l1.3.fts    635.44 509.65 325.38   0.11  632.63 508.03 325.94   0.25
20220613.042858.ucomp.637.l1.3.fts    635.53 509.38 325.18   0.13  632.62 507.73 325.74   0.24
20220613.043129.ucomp.637.l1.3.fts    635.60 509.45 325.29   0.17  632.68 507.77 325.88   0.27
20220612.232402.ucomp.706.l1.3.fts    620.67 507.63 326.48   0.05  639.50 511.50   -NaN   0.00
20220612.232634.ucomp.706.l1.3.fts    621.10 507.62 326.51   0.06  639.50 511.50   -NaN   0.00
20220612.235234.ucomp.706.l1.3.fts    623.38 507.07 326.63   0.03  639.50 511.50   -NaN   0.00
20220612.235505.ucomp.706.l1.3.fts    623.45 507.12 326.65   0.03  639.50 511.50   -NaN   0.00
20220613.002010.ucomp.706.l1.3.fts    624.28 507.56 326.62   0.05  639.50 511.50   -NaN   0.00
20220613.002241.ucomp.706.l1.3.fts    624.43 507.59 326.64   0.04  639.50 511.50   -NaN   0.00
20220613.021315.ucomp.706.l1.3.fts    625.92 508.09 326.65   0.05  639.50 511.50   -NaN   0.00
20220613.021546.ucomp.706.l1.3.fts    625.97 508.12 326.67   0.05  639.50 511.50   -NaN   0.00
20220613.025621.ucomp.706.l1.3.fts    627.07 508.36 326.60   0.04  624.49 506.74 327.13   0.12
20220613.025852.ucomp.706.l1.3.fts    627.45 508.47 326.65   0.04  624.85 506.86 327.14   0.12
20220613.032348.ucomp.706.l1.3.fts    632.88 509.45 326.78   0.06  630.12 507.82 327.36   0.22
20220613.032619.ucomp.706.l1.3.fts    633.45 509.55 326.80   0.06  630.66 507.92 327.38   0.29
20220613.035117.ucomp.706.l1.3.fts    635.11 509.69 326.81   0.06  632.34 508.04 327.43   0.29
20220613.035348.ucomp.706.l1.3.fts    635.12 509.70 326.81   0.07  632.35 508.07 327.41   0.31
20220613.043413.ucomp.706.l1.3.fts    635.33 509.52 326.78   0.20  632.48 507.78 327.47   0.49
20220612.232918.ucomp.789.l1.3.fts    621.42 507.08 328.03   0.04  639.50 511.50   -NaN   0.00
20220612.233149.ucomp.789.l1.3.fts    621.95 507.06 328.05   0.05  639.50 511.50   -NaN   0.00
20220612.235749.ucomp.789.l1.3.fts    623.40 506.63 328.08   0.05  639.50 511.50   -NaN   0.00
20220613.000021.ucomp.789.l1.3.fts    623.45 506.61 328.15   0.04  639.50 511.50   -NaN   0.00
20220613.002527.ucomp.789.l1.3.fts    624.49 507.06 328.14   0.04  639.50 511.50   -NaN   0.00
20220613.002758.ucomp.789.l1.3.fts    624.60 507.08 328.19   0.04  639.50 511.50   -NaN   0.00
20220613.021830.ucomp.789.l1.3.fts    625.99 507.52 328.16   0.05  639.50 511.50   -NaN   0.00
20220613.022101.ucomp.789.l1.3.fts    626.05 507.56 328.14   0.07  639.50 511.50   -NaN   0.00
20220613.030136.ucomp.789.l1.3.fts    627.86 507.94 328.16   0.05  625.00 506.38 328.56   0.04
20220613.030407.ucomp.789.l1.3.fts    628.21 508.04 328.17   0.06  625.32 506.47 328.56   0.04
20220613.032904.ucomp.789.l1.3.fts    634.06 509.08 328.22   0.09  631.07 507.40 328.74   0.07
20220613.033135.ucomp.789.l1.3.fts    634.61 509.16 328.21   0.09  631.61 507.51 328.73   0.07
20220613.035632.ucomp.789.l1.3.fts    635.22 509.15 328.20   0.09  632.20 507.49 328.72   0.06
20220613.035903.ucomp.789.l1.3.fts    635.24 509.12 328.21   0.08  632.22 507.46 328.73   0.05
20220612.233433.ucomp.1074.l1.3.fts   621.42 506.64 332.80   0.02  639.50 511.50   -NaN   0.00
20220612.233704.ucomp.1074.l1.3.fts   622.04 506.57 332.82   0.02  639.50 511.50   -NaN   0.00
20220613.000305.ucomp.1074.l1.3.fts   622.40 506.16 332.84   0.02  639.50 511.50   -NaN   0.00
20220613.000536.ucomp.1074.l1.3.fts   622.54 506.15 332.87   0.02  639.50 511.50   -NaN   0.00
20220613.003042.ucomp.1074.l1.3.fts   623.48 506.72 332.84   0.01  639.50 511.50   -NaN   0.00
20220613.003314.ucomp.1074.l1.3.fts   623.57 506.76 332.84   0.01  639.50 511.50   -NaN   0.00
20220613.005834.ucomp.1074.l1.3.fts   623.29 506.79 332.31   0.02  639.50 511.50   -NaN   0.00
20220613.005907.ucomp.1074.l1.3.fts   623.28 506.80 332.35   0.02  639.50 511.50   -NaN   0.00
20220613.005941.ucomp.1074.l1.3.fts   623.29 506.86 332.47   0.02  639.50 511.50   -NaN   0.00
20220613.010014.ucomp.1074.l1.3.fts   623.30 506.87 332.43   0.02  639.50 511.50   -NaN   0.00
20220613.010047.ucomp.1074.l1.3.fts   623.31 506.89 332.53   0.02  639.50 511.50   -NaN   0.00
20220613.010121.ucomp.1074.l1.3.fts   623.33 506.96 332.65   0.02  639.50 511.50   -NaN   0.00
20220613.010154.ucomp.1074.l1.3.fts   623.34 506.94 332.62   0.02  639.50 511.50   -NaN   0.00
20220613.010227.ucomp.1074.l1.3.fts   623.38 506.98 332.69   0.01  639.50 511.50   -NaN   0.00
20220613.010301.ucomp.1074.l1.3.fts   623.36 506.99 332.55   0.02  639.50 511.50   -NaN   0.00
20220613.010334.ucomp.1074.l1.3.fts   623.40 506.99 332.71   0.02  639.50 511.50   -NaN   0.00
20220613.010407.ucomp.1074.l1.3.fts   623.43 507.02 332.80   0.01  639.50 511.50   -NaN   0.00
20220613.010440.ucomp.1074.l1.3.fts   623.43 507.03 332.67   0.02  639.50 511.50   -NaN   0.00
20220613.010514.ucomp.1074.l1.3.fts   623.44 507.00 332.61   0.02  639.50 511.50   -NaN   0.00
20220613.010547.ucomp.1074.l1.3.fts   623.49 507.03 332.81   0.01  639.50 511.50   -NaN   0.00
20220613.010620.ucomp.1074.l1.3.fts   623.53 507.04 332.84   0.02  639.50 511.50   -NaN   0.00
20220613.010654.ucomp.1074.l1.3.fts   623.52 507.04 332.74   0.02  639.50 511.50   -NaN   0.00
20220613.010727.ucomp.1074.l1.3.fts   623.55 507.05 332.81   0.02  639.50 511.50   -NaN   0.00
20220613.010800.ucomp.1074.l1.3.fts   623.57 507.04 332.77   0.02  639.50 511.50   -NaN   0.00
20220613.010833.ucomp.1074.l1.3.fts   623.56 507.06 332.83   0.02  639.50 511.50   -NaN   0.00
20220613.010907.ucomp.1074.l1.3.fts   623.56 507.03 332.74   0.02  639.50 511.50   -NaN   0.00
20220613.010940.ucomp.1074.l1.3.fts   623.61 507.03 332.84   0.02  639.50 511.50   -NaN   0.00
20220613.011013.ucomp.1074.l1.3.fts   623.62 507.05 332.85   0.02  639.50 511.50   -NaN   0.00
20220613.011047.ucomp.1074.l1.3.fts   623.61 507.04 332.85   0.02  639.50 511.50   -NaN   0.00
20220613.011120.ucomp.1074.l1.3.fts   623.63 507.02 332.81   0.02  639.50 511.50   -NaN   0.00
20220613.011153.ucomp.1074.l1.3.fts   623.65 507.05 332.87   0.02  639.50 511.50   -NaN   0.00
20220613.011227.ucomp.1074.l1.3.fts   623.68 507.02 332.83   0.02  639.50 511.50   -NaN   0.00
20220613.011300.ucomp.1074.l1.3.fts   623.67 507.01 332.78   0.02  639.50 511.50   -NaN   0.00
20220613.011333.ucomp.1074.l1.3.fts   623.68 507.02 332.82   0.02  639.50 511.50   -NaN   0.00
20220613.011406.ucomp.1074.l1.3.fts   623.70 507.04 332.88   0.02  639.50 511.50   -NaN   0.00
20220613.011440.ucomp.1074.l1.3.fts   623.70 507.02 332.78   0.02  639.50 511.50   -NaN   0.00
20220613.011513.ucomp.1074.l1.3.fts   623.72 507.00 332.74   0.02  639.50 511.50   -NaN   0.00
20220613.011546.ucomp.1074.l1.3.fts   623.73 507.01 332.81   0.02  639.50 511.50   -NaN   0.00
20220613.011620.ucomp.1074.l1.3.fts   623.74 507.04 332.92   0.02  639.50 511.50   -NaN   0.00
20220613.011653.ucomp.1074.l1.3.fts   623.73 507.00 332.84   0.02  639.50 511.50   -NaN   0.00
20220613.011726.ucomp.1074.l1.3.fts   623.76 507.06 332.92   0.02  639.50 511.50   -NaN   0.00
20220613.011759.ucomp.1074.l1.3.fts   623.76 507.03 332.86   0.01  639.50 511.50   -NaN   0.00
20220613.011833.ucomp.1074.l1.3.fts   623.78 507.00 332.80   0.02  639.50 511.50   -NaN   0.00
20220613.011906.ucomp.1074.l1.3.fts   623.79 507.01 332.85   0.02  639.50 511.50   -NaN   0.00
20220613.011939.ucomp.1074.l1.3.fts   623.78 507.01 332.84   0.01  639.50 511.50   -NaN   0.00
20220613.012013.ucomp.1074.l1.3.fts   623.80 507.00 332.83   0.02  639.50 511.50   -NaN   0.00
20220613.012046.ucomp.1074.l1.3.fts   623.80 506.99 332.85   0.02  639.50 511.50   -NaN   0.00
20220613.012119.ucomp.1074.l1.3.fts   623.83 507.03 332.87   0.02  639.50 511.50   -NaN   0.00
20220613.012153.ucomp.1074.l1.3.fts   623.83 506.99 332.83   0.01  639.50 511.50   -NaN   0.00
20220613.012226.ucomp.1074.l1.3.fts   623.85 506.98 332.87   0.02  639.50 511.50   -NaN   0.00
20220613.012259.ucomp.1074.l1.3.fts   623.83 507.00 332.81   0.02  639.50 511.50   -NaN   0.00
20220613.012332.ucomp.1074.l1.3.fts   623.85 506.99 332.83   0.02  639.50 511.50   -NaN   0.00
20220613.012406.ucomp.1074.l1.3.fts   623.85 506.97 332.79   0.02  639.50 511.50   -NaN   0.00
20220613.012439.ucomp.1074.l1.3.fts   623.88 506.97 332.86   0.02  639.50 511.50   -NaN   0.00
20220613.012512.ucomp.1074.l1.3.fts   623.88 506.98 332.77   0.02  639.50 511.50   -NaN   0.00
20220613.012546.ucomp.1074.l1.3.fts   623.86 506.97 332.87   0.02  639.50 511.50   -NaN   0.00
20220613.012619.ucomp.1074.l1.3.fts   623.88 506.95 332.72   0.02  639.50 511.50   -NaN   0.00
20220613.012652.ucomp.1074.l1.3.fts   623.88 506.99 332.87   0.02  639.50 511.50   -NaN   0.00
20220613.012725.ucomp.1074.l1.3.fts   623.90 506.96 332.84   0.02  639.50 511.50   -NaN   0.00
20220613.012759.ucomp.1074.l1.3.fts   623.90 506.96 332.82   0.02  639.50 511.50   -NaN   0.00
20220613.012832.ucomp.1074.l1.3.fts   623.92 506.95 332.76   0.02  639.50 511.50   -NaN   0.00
20220613.012905.ucomp.1074.l1.3.fts   623.91 506.98 332.80   0.02  639.50 511.50   -NaN   0.00
20220613.012939.ucomp.1074.l1.3.fts   623.91 506.94 332.72   0.02  639.50 511.50   -NaN   0.00
20220613.013012.ucomp.1074.l1.3.fts   623.93 506.97 332.83   0.02  639.50 511.50   -NaN   0.00
20220613.013045.ucomp.1074.l1.3.fts   623.95 506.95 332.82   0.02  639.50 511.50   -NaN   0.00
20220613.013118.ucomp.1074.l1.3.fts   623.92 507.00 332.89   0.02  639.50 511.50   -NaN   0.00
20220613.013152.ucomp.1074.l1.3.fts   623.94 506.95 332.78   0.02  639.50 511.50   -NaN   0.00
20220613.013225.ucomp.1074.l1.3.fts   623.98 506.97 332.87   0.01  639.50 511.50   -NaN   0.00
20220613.013258.ucomp.1074.l1.3.fts   623.99 507.01 332.90   0.02  639.50 511.50   -NaN   0.00
20220613.013332.ucomp.1074.l1.3.fts   623.98 506.94 332.82   0.02  639.50 511.50   -NaN   0.00
20220613.013405.ucomp.1074.l1.3.fts   623.99 506.99 332.92   0.02  639.50 511.50   -NaN   0.00
20220613.013438.ucomp.1074.l1.3.fts   624.00 506.93 332.75   0.02  639.50 511.50   -NaN   0.00
20220613.013512.ucomp.1074.l1.3.fts   624.02 506.95 332.79   0.02  639.50 511.50   -NaN   0.00
20220613.013545.ucomp.1074.l1.3.fts   624.01 506.97 332.84   0.02  639.50 511.50   -NaN   0.00
20220613.013618.ucomp.1074.l1.3.fts   624.03 506.96 332.84   0.02  639.50 511.50   -NaN   0.00
20220613.013651.ucomp.1074.l1.3.fts   624.04 506.97 332.82   0.02  639.50 511.50   -NaN   0.00
20220613.013725.ucomp.1074.l1.3.fts   624.04 506.97 332.84   0.01  639.50 511.50   -NaN   0.00
20220613.013758.ucomp.1074.l1.3.fts   624.06 506.95 332.83   0.02  639.50 511.50   -NaN   0.00
20220613.013831.ucomp.1074.l1.3.fts   624.06 506.96 332.86   0.02  639.50 511.50   -NaN   0.00
20220613.013905.ucomp.1074.l1.3.fts   624.06 506.97 332.82   0.02  639.50 511.50   -NaN   0.00
20220613.013938.ucomp.1074.l1.3.fts   624.05 506.95 332.89   0.02  639.50 511.50   -NaN   0.00
20220613.014011.ucomp.1074.l1.3.fts   624.07 506.97 332.88   0.02  639.50 511.50   -NaN   0.00
20220613.014044.ucomp.1074.l1.3.fts   624.08 506.95 332.83   0.02  639.50 511.50   -NaN   0.00
20220613.014118.ucomp.1074.l1.3.fts   624.10 506.97 332.80   0.02  639.50 511.50   -NaN   0.00
20220613.014151.ucomp.1074.l1.3.fts   624.09 506.96 332.84   0.02  639.50 511.50   -NaN   0.00
20220613.014224.ucomp.1074.l1.3.fts   624.09 506.93 332.76   0.02  639.50 511.50   -NaN   0.00
20220613.014258.ucomp.1074.l1.3.fts   624.10 506.92 332.72   0.02  639.50 511.50   -NaN   0.00
20220613.014331.ucomp.1074.l1.3.fts   624.10 506.98 332.85   0.02  639.50 511.50   -NaN   0.00
20220613.014404.ucomp.1074.l1.3.fts   624.13 506.93 332.78   0.02  639.50 511.50   -NaN   0.00
20220613.014438.ucomp.1074.l1.3.fts   624.14 506.93 332.78   0.02  639.50 511.50   -NaN   0.00
20220613.014511.ucomp.1074.l1.3.fts   624.15 506.94 332.81   0.02  639.50 511.50   -NaN   0.00
20220613.014544.ucomp.1074.l1.3.fts   624.16 506.93 332.76   0.02  639.50 511.50   -NaN   0.00
20220613.014617.ucomp.1074.l1.3.fts   624.16 506.95 332.84   0.02  639.50 511.50   -NaN   0.00
20220613.014651.ucomp.1074.l1.3.fts   624.17 506.92 332.82   0.02  639.50 511.50   -NaN   0.00
20220613.014724.ucomp.1074.l1.3.fts   624.17 506.94 332.85   0.02  639.50 511.50   -NaN   0.00
20220613.014757.ucomp.1074.l1.3.fts   624.17 506.93 332.81   0.02  639.50 511.50   -NaN   0.00
20220613.014831.ucomp.1074.l1.3.fts   624.19 506.95 332.85   0.02  639.50 511.50   -NaN   0.00
20220613.014904.ucomp.1074.l1.3.fts   624.19 506.92 332.78   0.02  639.50 511.50   -NaN   0.00
20220613.014937.ucomp.1074.l1.3.fts   624.19 506.94 332.77   0.02  639.50 511.50   -NaN   0.00
20220613.015010.ucomp.1074.l1.3.fts   624.18 506.96 332.87   0.01  639.50 511.50   -NaN   0.00
20220613.015044.ucomp.1074.l1.3.fts   624.21 506.95 332.81   0.02  639.50 511.50   -NaN   0.00
20220613.015117.ucomp.1074.l1.3.fts   624.23 506.94 332.79   0.02  639.50 511.50   -NaN   0.00
20220613.015150.ucomp.1074.l1.3.fts   624.22 506.96 332.79   0.02  639.50 511.50   -NaN   0.00
20220613.015224.ucomp.1074.l1.3.fts   624.23 506.92 332.76   0.02  639.50 511.50   -NaN   0.00
20220613.015257.ucomp.1074.l1.3.fts   624.23 506.95 332.82   0.02  639.50 511.50   -NaN   0.00
20220613.015330.ucomp.1074.l1.3.fts   624.24 506.92 332.72   0.02  639.50 511.50   -NaN   0.00
20220613.015403.ucomp.1074.l1.3.fts   624.25 506.97 332.81   0.02  639.50 511.50   -NaN   0.00
20220613.015437.ucomp.1074.l1.3.fts   624.26 506.97 332.83   0.02  639.50 511.50   -NaN   0.00
20220613.015510.ucomp.1074.l1.3.fts   624.28 506.95 332.81   0.02  639.50 511.50   -NaN   0.00
20220613.015543.ucomp.1074.l1.3.fts   624.28 506.97 332.84   0.01  639.50 511.50   -NaN   0.00
20220613.015617.ucomp.1074.l1.3.fts   624.28 506.98 332.83   0.02  639.50 511.50   -NaN   0.00
20220613.015650.ucomp.1074.l1.3.fts   624.28 506.91 332.72   0.02  639.50 511.50   -NaN   0.00
20220613.015723.ucomp.1074.l1.3.fts   624.29 506.92 332.80   0.02  639.50 511.50   -NaN   0.00
20220613.015757.ucomp.1074.l1.3.fts   624.31 506.94 332.80   0.02  639.50 511.50   -NaN   0.00
20220613.015830.ucomp.1074.l1.3.fts   624.30 506.92 332.67   0.02  639.50 511.50   -NaN   0.00
20220613.015903.ucomp.1074.l1.3.fts   624.33 506.95 332.84   0.01  639.50 511.50   -NaN   0.00
20220613.015936.ucomp.1074.l1.3.fts   624.33 506.92 332.73   0.02  639.50 511.50   -NaN   0.00
20220613.020010.ucomp.1074.l1.3.fts   624.34 506.93 332.80   0.02  639.50 511.50   -NaN   0.00
20220613.020043.ucomp.1074.l1.3.fts   624.35 506.94 332.77   0.02  639.50 511.50   -NaN   0.00
20220613.020116.ucomp.1074.l1.3.fts   624.36 506.93 332.81   0.01  639.50 511.50   -NaN   0.00
20220613.020150.ucomp.1074.l1.3.fts   624.36 506.93 332.82   0.02  639.50 511.50   -NaN   0.00
20220613.020223.ucomp.1074.l1.3.fts   624.37 506.93 332.81   0.02  639.50 511.50   -NaN   0.00
20220613.020256.ucomp.1074.l1.3.fts   624.37 506.94 332.75   0.02  639.50 511.50   -NaN   0.00
20220613.020329.ucomp.1074.l1.3.fts   624.40 506.95 332.86   0.02  639.50 511.50   -NaN   0.00
20220613.020403.ucomp.1074.l1.3.fts   624.39 506.94 332.84   0.01  639.50 511.50   -NaN   0.00
20220613.020436.ucomp.1074.l1.3.fts   624.40 506.93 332.78   0.02  639.50 511.50   -NaN   0.00
20220613.022346.ucomp.1074.l1.3.fts   624.97 506.93 332.77   0.02  639.50 511.50   -NaN   0.00
20220613.022617.ucomp.1074.l1.3.fts   625.00 506.92 332.75   0.02  639.50 511.50   -NaN   0.00
20220613.030651.ucomp.1074.l1.3.fts   627.56 507.39 332.73   0.02  625.08 505.79 333.26   0.01
20220613.030923.ucomp.1074.l1.3.fts   627.98 507.47 332.77   0.02  625.46 505.87 333.27   0.01
20220613.033419.ucomp.1074.l1.3.fts   634.31 508.41 332.83   0.02  631.81 506.81 333.40   0.01
20220613.033650.ucomp.1074.l1.3.fts   634.34 508.42 332.80   0.02  631.86 506.82 333.38   0.02
20220613.040147.ucomp.1074.l1.3.fts   634.46 508.27 332.72   0.02  631.93 506.68 333.33   0.02
20220613.040418.ucomp.1074.l1.3.fts   634.47 508.26 332.71   0.02  631.93 506.65 333.31   0.02
20220612.234054.ucomp.1079.l1.3.fts   620.74 506.82 332.87   0.01  639.50 511.50   -NaN   0.00
20220612.234325.ucomp.1079.l1.3.fts   621.74 506.45 332.85   0.01  639.50 511.50   -NaN   0.00
20220613.000820.ucomp.1079.l1.3.fts   623.02 506.20 332.92   0.02  639.50 511.50   -NaN   0.00
20220613.001051.ucomp.1079.l1.3.fts   623.10 506.22 332.97   0.01  639.50 511.50   -NaN   0.00
20220613.003558.ucomp.1079.l1.3.fts   624.05 506.85 332.94   0.01  639.50 511.50   -NaN   0.00
20220613.003829.ucomp.1079.l1.3.fts   624.13 506.88 332.92   0.01  639.50 511.50   -NaN   0.00
20220613.022911.ucomp.1079.l1.3.fts   625.43 506.97 332.83   0.01  639.50 511.50   -NaN   0.00
20220613.023142.ucomp.1079.l1.3.fts   625.47 506.98 332.87   0.01  639.50 511.50   -NaN   0.00
20220613.031207.ucomp.1079.l1.3.fts   628.85 507.57 332.84   0.01  626.34 505.98 333.37   0.01
20220613.031438.ucomp.1079.l1.3.fts   629.32 507.63 332.86   0.02  626.80 506.03 333.38   0.01
20220613.033935.ucomp.1079.l1.3.fts   634.77 508.47 332.87   0.02  632.27 506.87 333.42   0.01
20220613.034206.ucomp.1079.l1.3.fts   634.79 508.44 332.88   0.02  632.29 506.85 333.43   0.01
20220613.040703.ucomp.1079.l1.3.fts   634.90 508.29 332.79   0.02  632.34 506.68 333.37   0.01
20220613.040934.ucomp.1079.l1.3.fts   634.91 508.30 332.80   0.02  632.36 506.68 333.39   0.01
mgalloy commented 1 year ago

There are a bunch of bad frames added recently for this day:

badframes$ ll 20220612.ucomp.badframes.csv
-rw-rw-r--. 1 berkey cordyn 1.8K Aug 28 12:13 20220612.ucomp.badframes.csv
badframes$ wc -l 20220612.ucomp.badframes.csv
41 20220612.ucomp.badframes.csv

But there are more files with TCAM centering issues than files with bad frames. Some of them could be flats/darks that affect many science files? I am reprocessing day without the bad frames removal to test.

mgalloy commented 1 year ago

20220613.020759.ucomp.637.l1.3.fts has no bad frames and doesn't use flats/darks that have bad frames, but fails to find the TCAM center when bad frames are used and doesn't fail when bad frames are not used.

mgalloy commented 1 year ago

For some reason, it is the bad frames in the dark files that are causing the problem. If I remove the dark files from 20220612.ucomp.badframes.csv, then everything works.

mgalloy commented 1 year ago

In ucomp_average_darkfile.pro, there is no /NAN keyword in the mean call:

averaged_ext_data[*, *, *, *, g] = size(d, /n_dimensions) lt 5 ? d : mean(d, dimension=5)

ucomp_average_flatfile.pro doesn't have it either.