in developing for #23 and #24, we have definitely found non-linear behavior in weights and their associated delta-costs. so now we have to devise another plan, and we are reverting back to a parabolic/quadratic fit.

Screen Shot 2023-03-07 at 9 40 09 AM

Screen Shot 2023-03-07 at 9 40 32 AM

Details

``` 0%| | 0/30 [00:00() 35 # end scaleWeight loop 37 coObj0 = DCP(coObjNew) ---> 38 coObjNew, bandCosts, dCostNew = MODRED.coModSetupNextIter(coObj0, dCostRC) 39 prevWinCost = coObjNew.winnerCost 41 with open('LW_mod-cost-optimize_for_iter{:03d}.pickle'.format(coObjNew.iCombine), 'wb') as fp: pickle.dump(coObjNew, fp) File /global/u1/p/pernak18/RRTMGP/test_abs_val/modified_reduction.py:423, in coModSetupNextIter(inObj, dCostDict) 419 outObj.cost0[comp].append( 420 outObj.costComp0[comp].sum().values * scale) 421 outObj.dCost0[comp].append( 422 outObj.dCostComps0[comp].sum().values * scale) --> 423 # end comp loop 425 outObj.iCombine += 1 426 return outObj, np.array(bandCosts), dCostDict IndexError: list index out of range ```

Details

``` Iteration 95 0%| | 0/1 [00:00

Details

``` Iteration 94 band11_coefficients_LW_g04-05_iter094_regr094.nc, Trial: 113, Cost: 100.439062, Delta-Cost: 0.0000 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.4319, 99.3800, 101.8991, 103.2171, 96.2623, 100.4869, 107.0325, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 95 band05_coefficients_LW_g11-12_iter094_regr095.nc, Trial: 64, Cost: 100.439027, Delta-Cost: -0.0000 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.3408, 99.4929, 103.1911, 102.5234, 96.2623, 100.4869, 106.4900, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 96 band09_coefficients_LW_g09-10_iter094_regr096.nc, Trial: 101, Cost: 100.439114, Delta-Cost: 0.0001 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.2858, 99.4730, 101.8316, 104.3618, 96.3561, 98.1801, 107.0325, 100.0000, 83.2970, 101.2200, 101.4471, 100.4610, 99.9564, 99.2261, 98.1497, 101.5869, 102.0604 Iteration 97 band13_coefficients_LW_g02-03_iter094_regr097.nc, Trial: 127, Cost: 100.439154, Delta-Cost: 0.0000 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.3488, 99.4517, 102.0339, 103.3033, 97.0526, 100.4869, 107.3482, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 98 band02_coefficients_LW_g12-13_iter094_regr098.nc, Trial: 25, Cost: 100.439236, Delta-Cost: 0.0001 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.4581, 99.3829, 101.6312, 103.3544, 96.2623, 100.4869, 107.0325, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 99 band06_coefficients_LW_g04-05_iter094_regr099.nc, Trial: 69, Cost: 100.439332, Delta-Cost: 0.0001 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.2382, 99.3434, 102.1626, 103.3746, 96.2623, 100.4869, 108.7238, 100.0000, 83.1221, 101.1640, 101.4471, 100.6398, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 100 band15_coefficients_LW_g02-03_iter094_regr100.nc, Trial: 134, Cost: 100.439696, Delta-Cost: 0.0004 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.4060, 99.4504, 102.0450, 103.3110, 96.2036, 100.4869, 106.6611, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 101 band01_coefficients_LW_g10-11_iter094_regr101.nc, Trial: 10, Cost: 100.439725, Delta-Cost: 0.0000 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.3664, 99.4566, 101.6194, 103.8041, 96.2623, 100.4869, 107.0325, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 102 band07_coefficients_LW_g09-10_iter094_regr102.nc, Trial: 79, Cost: 100.439970, Delta-Cost: 0.0002 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.3810, 99.4602, 103.1680, 102.1803, 96.2623, 100.4869, 107.0419, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 103 band03_coefficients_LW_g12-13_iter094_regr103.nc, Trial: 38, Cost: 100.440198, Delta-Cost: 0.0002 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.3808, 99.4384, 101.9940, 103.3628, 96.2623, 100.4869, 107.0461, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 104 band04_coefficients_LW_g10-11_iter094_regr104.nc, Trial: 47, Cost: 100.441182, Delta-Cost: 0.0010 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.3784, 99.4156, 99.7356, 105.5849, 96.2623, 100.4869, 107.2387, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 105 band08_coefficients_LW_g08-09_iter094_regr105.nc, Trial: 85, Cost: 100.438471, Delta-Cost: -0.0027 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.4891, 99.1869, 101.7154, 103.2352, 96.2696, 100.4869, 106.9543, 100.0000, 83.2970, 101.0233, 101.3446, 100.4604, 99.9510, 98.5047, 98.2133, 101.6962, 102.0847 Iteration 106 band12_coefficients_LW_g04-05_iter094_regr106.nc, Trial: 114, Cost: 100.437452, Delta-Cost: -0.0010 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.3942, 99.4964, 102.0596, 103.3360, 96.2623, 100.4869, 106.6020, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 107 band10_coefficients_LW_g02-03_iter094_regr107.nc, Trial: 95, Cost: 100.432598, Delta-Cost: -0.0049 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.3770, 99.5488, 102.0035, 103.2767, 96.2623, 100.4869, 107.0325, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 108 band04_coefficients_LW_g03-04_iter105_regr108.nc, Trial: 40, Cost: 100.425926, Delta-Cost: -0.0067 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.0299, 100.1923, 97.3903, 104.2521, 97.0830, 98.1801, 108.3009, 100.0000, 83.1221, 101.1640, 101.4471, 100.6404, 99.9564, 99.2261, 98.1497, 101.5869, 102.0604 Iteration 109 band01_coefficients_LW_g03-04_iter102_2p109.nc, Trial: 3, Cost: 100.412020, Delta-Cost: -0.0139 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 98.9995, 98.6779, 103.0242, 104.2173, 97.0830, 98.1801, 108.1256, 100.0000, 83.1221, 101.1640, 101.4471, 100.6404, 99.9564, 99.2261, 98.1497, 101.5869, 102.0604 Iteration 110 band12_coefficients_LW_g05-06_iter107_regr110.nc, Trial: 112, Cost: 100.405250, Delta-Cost: -0.0068 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.6911, 99.5532, 98.9012, 104.5951, 97.0888, 98.1801, 108.0484, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 111 band02_coefficients_LW_g12-13_iter099_regr111.nc, Trial: 23, Cost: 100.399174, Delta-Cost: -0.0061 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.2466, 99.0834, 103.6190, 102.5777, 97.1426, 98.1801, 106.8057, 100.0000, 83.2970, 101.2200, 101.4471, 100.4610, 99.9564, 99.2261, 98.1497, 101.5869, 102.0604 Iteration 112 band07_coefficients_LW_g02-03_iter103_2p112.nc, Trial: 67, Cost: 100.378445, Delta-Cost: -0.0207 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 98.6403, 102.2516, 104.2373, 103.0369, 97.0830, 98.1801, 109.0023, 100.0000, 83.1221, 101.1640, 101.4471, 100.6404, 99.9564, 99.2261, 98.1497, 101.5869, 102.0604 Iteration 113 band15_coefficients_LW_g02-03_iter101_regr113.nc, Trial: 122, Cost: 100.315804, Delta-Cost: -0.0626 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.0906, 99.4466, 102.6016, 103.5490, 97.2201, 98.1801, 106.8230, 100.0000, 83.1221, 101.1640, 101.4471, 100.6404, 99.9564, 99.2261, 98.1497, 101.5869, 102.0604 Iteration 114 band11_coefficients_LW_g09-10_iter095_2p114.nc, Trial: 104, Cost: 100.243048, Delta-Cost: -0.0728 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.4467, 99.2829, 101.0998, 102.3412, 96.2623, 100.4869, 107.0325, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 115 band10_coefficients_LW_g05-06_iter108_regr115.nc, Trial: 94, Cost: 100.213067, Delta-Cost: -0.0300 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.5850, 99.4080, 98.2559, 104.2849, 97.0888, 98.1801, 107.8460, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 116 band15_coefficients_LW_g01-02_iter114_2p116.nc, Trial: 119, Cost: 100.170369, Delta-Cost: -0.0427 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.2861, 102.4525, 98.9298, 103.7787, 97.4222, 98.1802, 107.6322, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 117 band07_coefficients_LW_g08-09_iter113_regr117.nc, Trial: 73, Cost: 100.143083, Delta-Cost: -0.0273 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.3104, 102.5514, 101.9487, 100.0841, 97.0888, 98.1801, 108.5967, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 118 band04_coefficients_LW_g04-05_iter109_2p118.nc, Trial: 39, Cost: 100.133061, Delta-Cost: -0.0100 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.5230, 100.6657, 94.3345, 103.1186, 97.0888, 98.1801, 105.7821, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 119 band06_coefficients_LW_g02-03_iter100_regr119.nc, Trial: 60, Cost: 100.088382, Delta-Cost: -0.0447 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 98.5782, 99.1671, 102.6585, 103.5580, 97.1426, 98.1801, 108.5129, 100.0000, 87.1212, 101.0279, 101.4471, 100.0705, 99.9564, 99.2261, 98.1497, 101.5869, 102.0604 Iteration 120 band05_coefficients_LW_g01-02_iter096_2p120.nc, Trial: 46, Cost: 100.078201, Delta-Cost: -0.0102 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.2158, 100.3631, 103.2926, 102.5448, 96.2623, 100.4869, 98.4677, 106.3440, 83.2970, 101.2200, 92.2028, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 121 band06_coefficients_LW_g01-02_iter120_regr121.nc, Trial: 58, Cost: 100.180244, Delta-Cost: 0.1020 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.0642, 102.1975, 98.1241, 101.2367, 97.4222, 98.1802, 105.7965, 100.0000, 81.5923, 106.2081, 101.3446, 102.5928, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 122 band11_coefficients_LW_g02-03_iter115_regr122.nc, Trial: 91, Cost: 100.308209, Delta-Cost: 0.1280 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.5119, 102.3414, 98.9576, 103.0736, 97.0040, 98.1801, 109.9376, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 123 band05_coefficients_LW_g12-13_iter121_2p123.nc, Trial: 57, Cost: 100.316222, Delta-Cost: 0.0080 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.8097, 104.0444, 98.0912, 101.1166, 97.4222, 98.1802, 97.3895, 106.3440, 86.5594, 100.6405, 92.1081, 99.9759, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 124 band04_coefficients_LW_g10-11_iter119_2p124.nc, Trial: 45, Cost: 100.405875, Delta-Cost: 0.0897 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.9653, 103.3587, 101.3917, 100.4285, 97.4222, 98.1802, 105.0901, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 125 band02_coefficients_LW_g10-11_iter112_2p125.nc, Trial: 21, Cost: 100.446781, Delta-Cost: 0.0409 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.2434, 99.5479, 97.9177, 103.2154, 97.0888, 98.1801, 107.8967, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 126 band16_coefficients_LW_g01-02_iter094_2p126.nc, Trial: 111, Cost: 100.451167, Delta-Cost: 0.0044 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.4085, 99.4544, 102.0439, 103.3115, 96.2623, 100.2082, 107.0325, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 127 band14_coefficients_LW_g02-03_iter094_regr127.nc, Trial: 107, Cost: 100.475754, Delta-Cost: 0.0246 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.2478, 99.8623, 102.9669, 103.5870, 96.2623, 100.4869, 105.9161, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 Iteration 128 band08_coefficients_LW_g08-09_iter106_2p128.nc, Trial: 73, Cost: 100.481975, Delta-Cost: 0.0062 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.7640, 98.7871, 99.2787, 104.7355, 97.0482, 98.1801, 108.2175, 100.0000, 83.1221, 100.7553, 101.2114, 100.6404, 99.9903, 97.6914, 98.2642, 101.7901, 102.0604 Iteration 129 band13_coefficients_LW_g02-03_iter098_regr129.nc, Trial: 101, Cost: 100.483437, Delta-Cost: 0.0015 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.2304, 99.3448, 102.7747, 103.4034, 101.4059, 98.1801, 107.8838, 100.0000, 83.2970, 101.2200, 101.4471, 100.4610, 99.9564, 99.2261, 98.1497, 101.5869, 102.0604 Iteration 130 band02_coefficients_LW_g09-10_iter126_regr130.nc, Trial: 20, Cost: 100.514977, Delta-Cost: 0.0315 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.5943, 104.3798, 99.2183, 97.6282, 97.4222, 98.1802, 97.2861, 106.3440, 80.0950, 105.2316, 92.1081, 102.2632, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 131 band01_coefficients_LW_g04-05_iter110_2p131.nc, Trial: 4, Cost: 100.532320, Delta-Cost: 0.0173 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.8674, 100.4263, 98.3928, 105.1051, 97.0888, 98.1802, 107.7016, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 132 band03_coefficients_LW_g02-03_iter104_regr132.nc, Trial: 23, Cost: 100.582652, Delta-Cost: 0.0503 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 98.9139, 100.7843, 104.1020, 103.1340, 95.7192, 98.1801, 111.9271, 100.0000, 83.1221, 101.1640, 101.4471, 100.6404, 99.9564, 99.2261, 98.1497, 101.5869, 102.0604 Iteration 133 band12_coefficients_LW_g06-07_iter111_2p133.nc, Trial: 96, Cost: 100.991680, Delta-Cost: 0.4090 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.8869, 100.3463, 97.7652, 104.5884, 97.0888, 98.1801, 107.4061, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 134 band09_coefficients_LW_g05-06_iter097_2p134.nc, Trial: 74, Cost: 101.104620, Delta-Cost: 0.1129 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.4683, 98.7629, 102.4386, 103.4513, 97.7351, 100.3201, 106.4900, 100.0000, 83.2970, 101.2200, 101.4471, 97.8693, 99.9828, 99.2261, 98.1497, 102.2423, 101.1621 Iteration 135 band10_coefficients_LW_g03-04_iter116_2p135.nc, Trial: 79, Cost: 101.260047, Delta-Cost: 0.1554 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.7484, 102.6504, 99.9423, 103.7353, 97.0040, 98.1801, 109.9376, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 136 band05_coefficients_LW_g09-10_iter124_regr136.nc, Trial: 49, Cost: 101.390345, Delta-Cost: 0.1303 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.3114, 102.8276, 100.3890, 96.1622, 97.4222, 98.1802, 95.8520, 106.3440, 80.0950, 105.2316, 92.1081, 102.2632, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 137 band08_coefficients_LW_g01-02_iter129_regr137.nc, Trial: 62, Cost: 101.632673, Delta-Cost: 0.2423 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.9907, 103.9119, 103.9540, 100.4397, 97.8375, 97.8966, 96.1458, 106.3440, 80.0950, 105.5763, 92.4259, 102.2632, 102.1161, 104.8259, 97.0580, 101.7105, 102.0604 Iteration 138 band16_coefficients_LW_g01-02_iter127_2p138.nc, Trial: 99, Cost: 102.636790, Delta-Cost: 1.0041 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 104.0451, 102.8735, 102.2087, 100.6091, 97.4222, 97.9332, 97.2861, 106.3440, 80.0950, 105.2316, 92.1081, 102.2632, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 139 band14_coefficients_LW_g01-02_iter128_2p139.nc, Trial: 96, Cost: 102.648169, Delta-Cost: 0.0114 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 104.0359, 103.3882, 103.4624, 100.5022, 97.4222, 97.8966, 93.7719, 106.3440, 80.0950, 105.2316, 92.1081, 102.2632, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 140 band11_coefficients_LW_g08-09_iter123_2p140.nc, Trial: 86, Cost: 102.736134, Delta-Cost: 0.0880 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.5938, 103.9199, 105.5363, 99.8477, 97.4222, 98.1802, 97.6700, 106.3440, 80.0950, 105.2316, 92.1081, 102.2632, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 ```

Details

``` Iteration 141 band04_coefficients_LW_g08-09_iter125_2p141.nc, Trial: 39, Cost: 102.949784, Delta-Cost: 0.2137 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.1593, 102.9810, 98.1031, 111.4592, 97.4222, 98.1802, 97.9330, 106.3440, 80.0950, 105.2316, 92.1081, 102.2632, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 142 band07_coefficients_LW_g06-07_iter118_2p142.nc, Trial: 59, Cost: 103.046622, Delta-Cost: 0.0968 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.2462, 101.8453, 111.7593, 105.2555, 97.4222, 98.1802, 107.8247, 100.0000, 83.1221, 100.9672, 101.3446, 100.6404, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 143 band13_coefficients_LW_g02-03_iter130_2p143.nc, Trial: 90, Cost: 103.271530, Delta-Cost: 0.2249 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 104.5886, 101.0500, 103.5814, 100.2096, 111.1321, 97.8966, 100.6181, 106.3440, 80.0950, 105.0197, 91.9757, 102.2632, 99.9903, 97.6914, 98.2642, 101.7901, 102.0604 Iteration 144 band06_coefficients_LW_g03-04_iter122_2p144.nc, Trial: 52, Cost: 102.438291, Delta-Cost: -0.8332 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 104.1180, 103.2373, 98.4003, 101.3373, 97.4222, 98.1802, 99.7463, 106.3440, 81.6273, 105.4085, 92.1081, 102.4492, 99.9513, 98.5047, 98.2133, 101.6976, 102.0604 Iteration 145 band03_coefficients_LW_g03-04_iter133_regr145.nc, Trial: 24, Cost: 107.473723, Delta-Cost: 5.0354 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 109.9861, 107.6979, 107.5544, 100.5279, 104.7044, 97.8966, 106.7949, 106.3440, 80.0950, 105.0197, 91.9757, 102.2632, 99.9903, 97.6914, 98.2642, 101.7901, 102.0604 Iteration 146 band01_coefficients_LW_g04-05_iter132_regr146.nc, Trial: 4, Cost: 110.645897, Delta-Cost: 3.1722 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 115.5025, 108.8016, 107.9585, 101.9593, 105.8513, 97.8966, 96.4574, 106.3440, 80.0950, 105.0197, 91.9757, 102.2632, 99.9903, 97.6914, 98.2642, 101.7901, 102.0604 Iteration 147 band05_coefficients_LW_g04-05_iter137_regr147.nc, Trial: 41, Cost: 110.850373, Delta-Cost: 0.2045 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 113.3187, 106.4178, 113.0476, 104.6051, 108.4811, 99.9888, 112.8844, 100.9265, 80.0950, 105.0197, 91.4952, 99.7087, 100.0167, 97.6914, 98.2642, 102.4540, 101.1621 Iteration 148 band02_coefficients_LW_g05-06_iter131_2p148.nc, Trial: 14, Cost: 110.974084, Delta-Cost: 0.1237 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 116.4991, 102.6896, 108.0859, 101.6220, 105.8513, 97.8966, 96.4544, 106.3440, 80.0950, 105.0197, 91.9757, 102.2632, 99.9903, 97.6914, 98.2642, 101.7901, 102.0604 Iteration 149 band08_coefficients_LW_g01-02_iter138_2p149.nc, Trial: 55, Cost: 111.335804, Delta-Cost: 0.3617 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 113.7559, 109.0554, 115.1480, 106.9929, 109.9850, 99.9888, 98.6442, 106.3440, 80.0950, 105.8563, 93.5606, 99.7087, 103.8548, 112.6029, 98.3792, 101.9884, 101.1621 Iteration 150 band12_coefficients_LW_g02-03_iter134_2p150.nc, Trial: 79, Cost: 111.888779, Delta-Cost: 0.5530 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 117.3085, 106.5737, 108.5143, 102.0118, 104.6304, 97.8966, 101.1478, 106.3440, 80.0950, 105.0197, 91.9757, 102.2632, 99.9903, 97.6914, 98.2642, 101.7901, 102.0604 Iteration 151 band07_coefficients_LW_g02-03_iter143_regr151.nc, Trial: 50, Cost: 113.512625, Delta-Cost: 1.6238 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 114.9253, 114.8209, 116.9745, 116.0360, 108.9006, 100.0245, 99.7793, 106.3440, 80.0950, 104.1460, 87.1731, 99.7087, 100.7882, 102.8676, 99.6093, 102.6365, 101.1621 Iteration 152 band09_coefficients_LW_g06-07_iter135_2p152.nc, Trial: 64, Cost: 114.431332, Delta-Cost: 0.9187 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 121.6893, 105.8961, 107.9739, 101.8213, 109.4455, 97.3594, 100.9637, 106.3440, 80.0950, 105.0197, 91.9757, 99.4290, 100.0260, 97.6914, 98.2642, 103.1070, 103.3078 Iteration 153 band16_coefficients_LW_g02-03_iter139_regr153.nc, Trial: 86, Cost: 114.542366, Delta-Cost: 0.1110 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 119.6177, 106.9947, 114.5270, 106.5900, 108.9006, 100.0924, 98.6097, 106.3440, 80.0950, 104.1460, 87.1731, 99.7087, 100.7882, 102.8676, 99.6093, 102.6365, 101.1621 Iteration 154 band14_coefficients_LW_g02-03_iter140_2p154.nc, Trial: 84, Cost: 115.486874, Delta-Cost: 0.9445 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 120.3184, 106.6070, 120.4090, 106.1001, 108.9006, 100.0245, 95.9583, 106.3440, 80.0950, 104.1460, 87.1731, 99.7087, 100.7882, 102.8676, 99.6093, 102.6365, 101.1621 Iteration 155 band10_coefficients_LW_g01-02_iter136_2p155.nc, Trial: 65, Cost: 115.887307, Delta-Cost: 0.4004 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 123.5141, 110.5139, 108.6224, 102.3900, 108.4811, 99.9888, 100.9637, 106.3440, 80.0950, 105.0197, 91.9757, 99.7087, 100.0167, 97.6914, 98.2642, 102.4540, 101.1621 Iteration 156 band11_coefficients_LW_g04-05_iter141_regr156.nc, Trial: 71, Cost: 116.147597, Delta-Cost: 0.2603 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 120.5570, 107.7808, 124.2785, 106.0601, 108.9006, 100.0245, 96.2350, 106.3440, 80.0950, 104.1460, 87.1731, 99.7087, 100.7882, 102.8676, 99.6093, 102.6365, 101.1621 Iteration 157 band04_coefficients_LW_g04-05_iter142_2p157.nc, Trial: 32, Cost: 116.743138, Delta-Cost: 0.5955 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 120.1439, 108.0833, 110.6575, 126.9515, 108.9006, 100.0245, 95.2064, 106.3440, 80.0950, 104.1460, 87.1731, 99.7087, 100.7882, 102.8676, 99.6093, 102.6365, 101.1621 Iteration 158 band03_coefficients_LW_g03-04_iter146_2p158.nc, Trial: 22, Cost: 116.879346, Delta-Cost: 0.1362 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 117.7411, 106.7587, 117.6298, 114.7303, 122.4523, 100.0245, 148.0994, 106.3440, 81.6273, 104.3229, 87.1731, 99.8913, 100.7882, 102.8676, 99.6093, 102.6365, 101.1621 Iteration 159 band13_coefficients_LW_g03-04_iter144_2p159.nc, Trial: 78, Cost: 119.080856, Delta-Cost: 2.2015 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 124.3743, 106.1586, 118.4248, 116.5285, 108.8643, 100.0245, 100.0934, 106.3440, 80.0950, 104.1460, 87.1731, 99.7087, 100.7882, 102.8676, 99.6093, 102.6365, 101.1621 Iteration 160 band06_coefficients_LW_g03-04_iter145_regr160.nc, Trial: 46, Cost: 119.143842, Delta-Cost: 0.0630 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 123.9359, 107.1001, 118.0044, 115.9894, 115.6171, 100.0245, 107.5237, 106.3440, 87.0410, 104.3777, 87.1731, 100.2796, 100.7882, 102.8676, 99.6093, 102.6365, 101.1621 Iteration 161 band07_coefficients_LW_g02-03_iter152_2p161.nc, Trial: 47, Cost: 119.815769, Delta-Cost: 0.6719 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 123.5022, 112.7450, 114.7775, 115.4147, 117.5275, 100.0246, 135.5052, 98.5056, 81.6273, 106.0332, 93.0729, 99.8913, 103.8548, 112.6029, 98.3792, 101.9884, 101.1621 Iteration 162 band07_coefficients_LW_g02-03_iter162_regr162.nc, Trial: 47, Cost: 117.095881, Delta-Cost: -2.7199 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 107.0503, 139.4542, 123.3419, 145.5553, 116.7830, 97.5137, 173.7487, 98.5056, 76.8434, 103.8564, 93.0729, 97.3278, 103.8640, 112.6029, 98.3792, 102.6047, 103.3078 Iteration 163 band07_coefficients_LW_g01-02_iter163_regr163.nc, Trial: 46, Cost: 115.957694, Delta-Cost: -1.1382 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.7145, 154.2787, 128.0061, 146.1237, 116.7830, 97.5137, 179.8087, 98.5056, 76.8434, 103.8564, 93.0729, 97.3278, 103.8640, 112.6029, 98.3792, 102.6047, 103.3078 Iteration 164 band01_coefficients_LW_g04-05_iter147_2p164.nc, Trial: 4, Cost: 123.891584, Delta-Cost: 7.9339 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 125.5015, 119.8194, 132.4407, 124.2970, 116.4140, 100.0246, 122.3166, 106.3440, 81.6273, 104.3229, 87.1731, 99.8913, 100.7882, 102.8676, 99.6093, 102.6365, 101.1621 Iteration 165 band01_coefficients_LW_g05-06_iter165_regr165.nc, Trial: 5, Cost: 123.758044, Delta-Cost: -0.1335 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.2326, 158.8006, 173.9548, 171.1095, 116.7830, 97.5137, 179.7210, 98.5056, 76.8434, 103.8564, 93.0729, 97.3278, 103.8640, 112.6029, 98.3792, 102.6047, 103.3078 Iteration 166 band01_coefficients_LW_g02-03_iter166_2p166.nc, Trial: 2, Cost: 123.353178, Delta-Cost: -0.4049 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.7223, 156.2842, 170.7823, 174.2981, 116.7830, 97.5137, 179.7218, 98.5056, 76.8434, 103.8564, 93.0729, 97.3278, 103.8640, 112.6029, 98.3792, 102.6047, 103.3078 Iteration 167 band01_coefficients_LW_g06-07_iter167_2p167.nc, Trial: 6, Cost: 123.800815, Delta-Cost: 0.4476 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.7229, 156.2914, 173.1005, 175.7044, 116.7830, 97.5137, 179.7218, 98.5056, 76.8434, 103.8564, 93.0729, 97.3278, 103.8640, 112.6029, 98.3792, 102.6047, 103.3078 Iteration 168 band01_coefficients_LW_g01-02_iter168_2p168.nc, Trial: 1, Cost: 126.956679, Delta-Cost: 3.1559 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.5871, 157.2506, 178.4651, 181.9976, 116.7830, 97.5137, 179.7241, 98.5056, 76.8434, 103.8564, 93.0729, 97.3278, 103.8640, 112.6029, 98.3792, 102.6047, 103.3078 Iteration 169 band08_coefficients_LW_g01-02_iter150_2p169.nc, Trial: 43, Cost: 127.614046, Delta-Cost: 0.6574 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 133.2251, 111.9194, 124.8933, 121.0091, 120.5579, 100.0246, 131.9725, 98.5056, 81.6273, 110.2917, 101.8725, 99.8913, 112.5662, 137.3378, 97.5137, 101.0286, 101.1621 Iteration 170 band08_coefficients_LW_g02-03_iter170_regr170.nc, Trial: 44, Cost: 127.388649, Delta-Cost: -0.2254 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.0619, 161.8397, 180.2595, 182.8271, 120.3268, 97.5137, 180.0869, 98.5056, 76.8434, 107.7830, 100.8281, 97.3278, 111.1203, 135.2529, 98.0868, 101.0487, 103.3078 Iteration 171 band08_coefficients_LW_g03-04_iter171_2p171.nc, Trial: 45, Cost: 127.625855, Delta-Cost: 0.2372 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.3985, 157.9657, 182.2366, 183.2895, 120.8102, 97.5137, 179.7244, 98.5056, 76.8434, 104.6323, 95.0971, 97.3278, 108.1367, 125.6277, 99.7019, 102.3522, 103.3078 Iteration 172 band07_coefficients_LW_g02-03_iter164_2p172.nc, Trial: 42, Cost: 131.382145, Delta-Cost: 3.7563 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.0079, 152.7916, 205.9122, 200.6683, 116.7830, 97.5137, 180.1545, 98.5056, 76.8434, 103.8564, 93.0729, 97.3278, 103.8640, 112.6029, 98.3792, 102.6047, 103.3078 Iteration 173 band01_coefficients_LW_g04-05_iter169_2p173.nc, Trial: 4, Cost: 133.481162, Delta-Cost: 2.0990 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.6761, 157.6064, 214.1307, 200.1390, 116.7830, 97.5137, 179.7241, 98.5056, 76.8434, 103.8564, 93.0729, 97.3278, 103.8640, 112.6029, 98.3792, 102.6047, 103.3078 Iteration 174 band05_coefficients_LW_g01-02_iter148_2p174.nc, Trial: 29, Cost: 134.619101, Delta-Cost: 1.1379 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 145.9923, 109.9491, 124.8196, 120.8315, 116.4140, 100.0246, 123.0389, 140.8688, 81.6273, 104.3229, 78.5167, 99.8913, 100.7882, 102.8676, 99.6093, 102.6365, 101.1621 Iteration 175 band05_coefficients_LW_g07-08_iter175_regr175.nc, Trial: 35, Cost: 134.089666, Delta-Cost: -0.5294 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 104.0905, 161.6230, 223.4968, 192.8116, 120.8102, 97.5137, 170.4700, 140.8688, 76.8434, 104.6323, 88.4555, 97.3278, 108.1367, 125.6277, 99.7019, 102.3522, 103.3078 Iteration 176 band05_coefficients_LW_g04-05_iter176_regr176.nc, Trial: 32, Cost: 133.466904, Delta-Cost: -0.6228 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.3256, 159.5311, 219.7807, 195.7216, 120.8102, 97.5137, 170.9097, 140.6942, 76.8434, 104.6323, 88.4294, 97.3278, 108.1367, 125.6277, 99.7019, 102.3522, 103.3078 ```

some takeaways from my meeting with Eli today:

we have been talking two different algorithms -- a brute force method i'm using where we sacrifice hard drive space and time for more accurate delta-costs, and a quicker-smaller-but-slightly-less-accurate method of just using the output of the fitted parabola in our winner determination
the brute force method calculates new k-files at iteration 94 for all trials and whenever a winner is selected, which is computationally- and disk-expensive
the method then propagates the scale factors calculated and their associated k-files written at iteration 94 to subsequent iterations, even though after iteration 94 they are obsolete
i am doing everything up to recalibration of fluxes correctly, then Eli and I diverge in methodology directly after the parabola fit in iteration 94; so that means the recalibrated cost function can be used
we should consider roots beyond the [0, 2] scale factor range
with Eli's method, we have many trials with roots and thus many ties; my method picks a single winner -- keep this in mind, but don't worry too much about it

so i think my to-do list for the improvements in modified_reduction.py are:

[ ] find winner based on scaleWeightRegress delta-cost
[ ] only generate k-file for winner trial, then calculate corresponding fluxes
[ ] run diagnostics with winner
[ ] adjust dCostMod using delta-fluxes (trial-reference fluxes) after winner is chosen, then refit parabola, then repeat the previous 3 steps

Refitting parabolas and recalibrating fluxes
Regression delta-costs:
0: 0.6080545229121128 0.05: 0.2972730392647236 0.1: -0.024667268508224538
band11_coefficients_LW_g04-05_iter094_regr094.nc, Trial: 113, Cost: 100.439062, Delta-Cost: 0.0000
    flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.4319, 99.3800, 101.8991, 103.2171, 96.2623, 100.4869, 107.0325, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847

# this process would be more accurate, but it's VERY slow (~10-12 minutes 
# per iteration), blows up the disk space, and produces a 
# "LinAlgError: SVD did not converge in Linear Least Squares" on iter 95

with open('LW_cost-optimize_iter094.pickle', 'rb') as fp: coObjNew = pickle.load(fp)
iniWgt = 0.05

for i in tqdm(range(coObjNew.iCombine, coObjNew.iCombine+3)):
    print('Iteration {}'.format(i))
    coObjNew = MODRED.repeat_mod_redux(coObjNew, doLW=DOLW, iniWgt=iniWgt, 
      fullBandFluxDir=FULLBANDFLUXDIR, fullBandkDir=BANDSPLITDIR)

Iteration 94 plus 2plus Recalibrating band11_coefficients_LW_g04-05_iter094_regr094.nc, Trial: 113, Cost: 100.439062, Delta-Cost: 0.0000 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.4319, 99.3800, 101.8991, 103.2171, 96.2623, 100.4869, 107.0325, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 33%|███▎ | 1/3 [10:32<21:05, 632.85s/it] Iteration 95 plus 2plus 33%|███▎ | 1/3 [16:40<33:21, 1000.82s/it]

Intel MKL ERROR: Parameter 6 was incorrect on entry to DGELSD.

LinAlgError Traceback (most recent call last) Input In [6], in <cell line: 8>() 8 for i in tqdm(range(coObjNew.iCombine, coObjNew.iCombine+3)): 9 print('Iteration {}'.format(i)) ---> 10 coObjNew = MODRED.repeat_mod_redux(coObjNew, doLW=DOLW, iniWgt=iniWgt, 11 fullBandFluxDir=FULLBANDFLUXDIR, fullBandkDir=BANDSPLITDIR)

File /global/cscratch1/sd/pernak18/RRTMGP/test_abs_val/modified_reduction.py:717, in repeat_mod_redux(inObj, doLW, iniWgt, fullBandFluxDir, fullBandkDir) 712 kBandDict = kModInit(inObj.distBands, inObj.iCombine, 713 doLW=doLW, weight=iniWgt, 714 kDir=fullBandkDir, fluxDir=fullBandFluxDir) 716 dCostMod, coObjMod = costModInit(inObj, kBandDict) --> 717 newScales, cross = scaleWeightRegress(dCostMod) 719 coObjMod = whereRecompute( 720 kBand, coObjMod, cross, newScales, weight=iniWgt) 721 coObjRep = recompute(inObj, coObjMod, np.where(cross)[0])

File /global/cscratch1/sd/pernak18/RRTMGP/test_abs_val/modified_reduction.py:120, in scaleWeightRegress(dCostMod, returnCoeffs) 117 ordinates = np.vstack([dCost for dCost in dCostMod.values()]) 118 iMinDelta = np.argmin(np.abs(ordinates), axis=0) --> 120 coeffs = np.polyfit(abscissa, ordinates, 2) 121 newScales = np.array(iMinDelta).astype(float) 122 cross = []

File <__array_function__ internals>:180, in polyfit(*args, **kwargs)

File ~/.conda/envs/g-redux/lib/python3.10/site-packages/numpy/lib/polynomial.py:668, in polyfit(x, y, deg, rcond, full, w, cov) 666 scale = NX.sqrt((lhs*lhs).sum(axis=0)) 667 lhs /= scale --> 668 c, resids, rank, s = lstsq(lhs, rhs, rcond) 669 c = (c.T/scale).T # broadcast scale coefficients 671 # warn on rank reduction, which indicates an ill conditioned matrix

File <__array_function__ internals>:180, in lstsq(*args, **kwargs)

File ~/.conda/envs/g-redux/lib/python3.10/site-packages/numpy/linalg/linalg.py:2300, in lstsq(a, b, rcond) 2297 if n_rhs == 0: 2298 # lapack can't handle n_rhs = 0 - so allocate the array one larger in that axis 2299 b = zeros(b.shape[:-2] + (m, n_rhs + 1), dtype=b.dtype) -> 2300 x, resids, rank, s = gufunc(a, b, rcond, signature=signature, extobj=extobj) 2301 if m == 0: 2302 x[...] = 0

File ~/.conda/envs/g-redux/lib/python3.10/site-packages/numpy/linalg/linalg.py:101, in _raise_linalgerror_lstsq(err, flag) 100 def _raise_linalgerror_lstsq(err, flag): --> 101 raise LinAlgError("SVD did not converge in Linear Least Squares")

LinAlgError: SVD did not converge in Linear Least Squares

after agreeing, in person, to abandon this "shortcut" method and just apply my full modified code every iteration (i.e., refitting delta-cost parabolas, recomputing fluxes, then recomputing the cost function for all remaining trials; very time consuming):

Iteration 94

Details

band02_coefficients_LW_g12-13_iter095_regr095.nc, Trial: 25, Cost: 100.429624, Delta-Cost: -0.0094 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.5127, 99.3384, 101.4064, 103.2407, 96.2623, 100.4869, 107.0325, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 2%|▏ | 1/61 [09:40<9:40:27, 580.46s/it] band15_coefficients_LW_g02-03_iter096_regr096.nc, Trial: 138, Cost: 100.429347, Delta-Cost: -0.0003 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.5361, 99.3517, 101.4106, 103.2428, 96.2038, 100.4869, 106.6575, 100.0000, 83.2970, 101.2200, 101.4471, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 3%|▎ | 2/61 [18:45<9:10:27, 559.79s/it] band05_coefficients_LW_g09-10_iter097_2p097.nc, Trial: 61, Cost: 100.420953, Delta-Cost: -0.0084 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.3144, 98.8593, 96.5181, 100.9869, 96.2038, 100.4869, 101.7104, 99.9996, 83.2970, 101.2200, 101.4470, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 5%|▍ | 3/61 [28:05<9:01:02, 559.70s/it] band01_coefficients_LW_g11-12_iter098_regr098.nc, Trial: 11, Cost: 100.419659, Delta-Cost: -0.0013 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.3176, 98.8472, 99.4563, 98.0261, 96.2038, 100.4869, 101.7104, 99.9996, 83.2970, 101.2200, 101.4470, 100.4604, 99.9562, 99.2261, 98.1497, 101.5854, 102.0847 7%|▋ | 4/61 [37:35<8:55:27, 563.63s/it] band09_coefficients_LW_g09-10_iter099_regr099.nc, Trial: 99, Cost: 100.415114, Delta-Cost: -0.0045 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.2183, 98.8760, 99.3048, 98.9901, 96.3064, 98.2600, 101.7104, 99.9996, 83.2970, 101.2200, 101.4470, 100.4609, 99.9564, 99.2261, 98.1497, 101.5869, 102.0614 8%|▊ | 5/61 [46:43<8:41:04, 558.30s/it] band07_coefficients_LW_g09-10_iter100_regr100.nc, Trial: 80, Cost: 100.415522, Delta-Cost: 0.0004 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.2167, 98.8975, 100.4152, 97.8807, 96.3064, 98.2600, 101.7204, 99.9996, 83.2970, 101.2200, 101.4470, 100.4609, 99.9564, 99.2261, 98.1497, 101.5869, 102.0614 10%|▉ | 6/61 [55:54<8:29:21, 555.66s/it] band08_coefficients_LW_g09-10_iter101_2p101.nc, Trial: 89, Cost: 100.419589, Delta-Cost: 0.0041 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.2752, 98.8443, 100.1914, 97.8719, 96.2974, 98.2600, 101.7137, 99.9996, 83.2970, 101.1966, 101.4315, 100.4609, 99.9635, 99.1235, 98.1566, 101.5814, 102.0614 11%|█▏ | 7/61 [1:05:00<8:17:08, 552.37s/it] band04_coefficients_LW_g11-12_iter102_2p102.nc, Trial: 49, Cost: 100.425244, Delta-Cost: 0.0057 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.2835, 98.8649, 96.3747, 101.6198, 96.2974, 98.2600, 101.9170, 99.9996, 83.2970, 101.1966, 101.4315, 100.4609, 99.9635, 99.1235, 98.1566, 101.5814, 102.0614 13%|█▎ | 8/61 [1:13:57<8:03:49, 547.72s/it] band16_coefficients_LW_g01-02_iter103_2p103.nc, Trial: 134, Cost: 100.437298, Delta-Cost: 0.0121 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.3107, 98.8817, 96.3781, 101.6224, 96.2974, 97.9765, 101.9170, 99.9996, 83.2970, 101.1966, 101.4315, 100.4609, 99.9635, 99.1235, 98.1566, 101.5814, 102.0614 15%|█▍ | 9/61 [1:22:34<7:46:16, 538.02s/it] band08_coefficients_LW_g08-09_iter104_2p104.nc, Trial: 87, Cost: 100.452921, Delta-Cost: 0.0156 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.4407, 98.5998, 96.0600, 101.5825, 96.3052, 97.9765, 101.8322, 99.9996, 83.2970, 100.9806, 101.3147, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 16%|█▋ | 10/61 [1:31:16<7:33:12, 533.18s/it] band02_coefficients_LW_g10-11_iter105_2p105.nc, Trial: 22, Cost: 100.479440, Delta-Cost: 0.0265 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.5768, 98.6862, 95.8132, 101.3414, 96.3052, 97.9765, 101.8322, 99.9996, 83.2970, 100.9806, 101.3147, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 18%|█▊ | 11/61 [1:40:05<7:23:10, 531.81s/it] band07_coefficients_LW_g06-07_iter106_2p106.nc, Trial: 75, Cost: 100.447153, Delta-Cost: -0.0323 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.4865, 97.0185, 92.8537, 99.8329, 96.3052, 97.9765, 102.4512, 99.9996, 83.2970, 100.9806, 101.3147, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 20%|█▉ | 12/61 [1:48:20<7:05:04, 520.49s/it] band10_coefficients_LW_g07-08_iter107_regr107.nc, Trial: 99, Cost: 100.444452, Delta-Cost: -0.0027 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.2664, 96.6933, 94.0050, 99.8676, 96.3052, 97.9765, 102.4512, 99.9996, 83.2970, 100.9806, 101.3147, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 21%|██▏ | 13/61 [1:56:23<6:47:30, 509.38s/it] band13_coefficients_LW_g03-04_iter108_2p108.nc, Trial: 119, Cost: 100.411942, Delta-Cost: -0.0325 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.1633, 96.6714, 93.9952, 99.8610, 97.9358, 97.9765, 102.8486, 99.9996, 83.2970, 100.9806, 101.3147, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 23%|██▎ | 14/61 [2:04:16<6:30:16, 498.21s/it] band11_coefficients_LW_g09-10_iter109_regr109.nc, Trial: 107, Cost: 100.403748, Delta-Cost: -0.0082 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.9602, 97.0733, 94.4428, 100.2267, 97.9358, 97.9765, 102.8486, 99.9996, 83.2970, 100.9806, 101.3147, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 25%|██▍ | 15/61 [2:12:35<6:22:11, 498.50s/it] band05_coefficients_LW_g13-14_iter110_2p110.nc, Trial: 62, Cost: 100.439469, Delta-Cost: 0.0357 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.9584, 97.0758, 94.7215, 100.2474, 97.9358, 97.9765, 102.8677, 99.9996, 83.2970, 100.9806, 101.3147, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 26%|██▌ | 16/61 [2:21:04<6:16:15, 501.67s/it] band16_coefficients_LW_g02-03_iter111_2p111.nc, Trial: 128, Cost: 100.475198, Delta-Cost: 0.0357 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.0181, 97.0651, 94.7241, 100.2481, 97.9358, 97.9728, 102.8677, 99.9996, 83.2970, 100.9806, 101.3147, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 28%|██▊ | 17/61 [2:28:49<5:59:53, 490.76s/it] band15_coefficients_LW_g03-04_iter112_2p112.nc, Trial: 126, Cost: 100.520412, Delta-Cost: 0.0452 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.0860, 97.0339, 94.7213, 100.2502, 98.0642, 97.9728, 102.9814, 99.9996, 83.2970, 100.9806, 101.3147, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 30%|██▉ | 18/61 [2:36:40<5:47:23, 484.74s/it] band12_coefficients_LW_g05-06_iter113_2p113.nc, Trial: 111, Cost: 100.576583, Delta-Cost: 0.0562 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.1856, 97.1723, 94.7012, 100.2350, 98.0642, 97.9728, 102.8589, 99.9996, 83.2970, 100.9806, 101.3147, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 31%|███ | 19/61 [2:44:36<5:37:24, 482.01s/it] band03_coefficients_LW_g12-13_iter114_2p114.nc, Trial: 37, Cost: 100.506553, Delta-Cost: -0.0700 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.1819, 97.1744, 94.0765, 100.2862, 98.0642, 97.9728, 102.8823, 99.9996, 83.2970, 100.9806, 101.3147, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 33%|███▎ | 20/61 [2:52:42<5:30:17, 483.36s/it] band05_coefficients_LW_g06-07_iter115_2p115.nc, Trial: 54, Cost: 100.401735, Delta-Cost: -0.1048 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.5548, 95.3615, 91.8740, 99.8030, 98.0642, 97.9728, 104.8405, 97.8040, 83.2970, 100.9806, 101.0959, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 34%|███▍ | 21/61 [3:00:35<5:20:08, 480.21s/it] band02_coefficients_LW_g04-05_iter116_2p116.nc, Trial: 16, Cost: 100.321213, Delta-Cost: -0.0805 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.4685, 96.1741, 91.6823, 99.4844, 98.0642, 97.9728, 104.8399, 97.8040, 83.2970, 100.9806, 101.0959, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 36%|███▌ | 22/61 [3:08:54<5:15:41, 485.69s/it] band07_coefficients_LW_g08-09_iter117_2p117.nc, Trial: 73, Cost: 100.408325, Delta-Cost: 0.0871 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.6864, 96.2920, 95.2401, 95.5737, 98.0642, 97.9728, 104.6901, 97.8040, 83.2970, 100.9806, 101.0959, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 38%|███▊ | 23/61 [3:16:49<5:05:42, 482.70s/it] band13_coefficients_LW_g02-03_iter118_2p118.nc, Trial: 111, Cost: 100.612580, Delta-Cost: 0.2043 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.9306, 96.1182, 95.1928, 95.5506, 101.6964, 97.9728, 105.6100, 97.8040, 83.2970, 100.9806, 101.0959, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 39%|███▉ | 24/61 [3:24:22<4:52:06, 473.69s/it] band10_coefficients_LW_g06-07_iter119_2p119.nc, Trial: 93, Cost: 100.832628, Delta-Cost: 0.2200 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.7662, 96.5501, 94.3490, 93.9064, 101.6964, 97.9728, 105.6100, 97.8040, 83.2970, 100.9806, 101.0959, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 41%|████ | 25/61 [3:31:58<4:40:56, 468.23s/it] band02_coefficients_LW_g10-11_iter120_2p120.nc, Trial: 22, Cost: 100.801583, Delta-Cost: -0.0310 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.4074, 96.1402, 94.0989, 95.8287, 101.6964, 97.9728, 105.6100, 97.8040, 83.2970, 100.9806, 101.0959, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 43%|████▎ | 26/61 [3:39:33<4:30:56, 464.46s/it] band14_coefficients_LW_g03-04_iter121_regr121.nc, Trial: 114, Cost: 100.800003, Delta-Cost: -0.0016 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.2723, 96.3763, 93.4689, 96.9207, 101.6964, 97.9728, 105.9739, 97.8040, 83.2970, 100.9806, 101.0959, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 44%|████▍ | 27/61 [3:47:18<4:23:18, 464.65s/it] band03_coefficients_LW_g09-10_iter122_regr122.nc, Trial: 32, Cost: 100.760647, Delta-Cost: -0.0394 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.2826, 96.3826, 95.7283, 94.4957, 101.6854, 97.9728, 105.3284, 97.8040, 83.2970, 100.9806, 101.0959, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 46%|████▌ | 28/61 [3:54:55<4:14:15, 462.27s/it] band14_coefficients_LW_g02-03_iter123_regr123.nc, Trial: 112, Cost: 100.757266, Delta-Cost: -0.0034 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.9208, 96.8067, 103.3550, 89.5896, 101.6854, 97.9728, 102.0856, 97.8040, 83.2970, 100.9806, 101.0959, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 48%|████▊ | 29/61 [4:02:42<4:07:13, 463.56s/it] band05_coefficients_LW_g09-10_iter124_2p124.nc, Trial: 54, Cost: 100.585052, Delta-Cost: -0.1722 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.8710, 96.8194, 104.9249, 87.0214, 101.6854, 97.9728, 101.5100, 97.8040, 83.2970, 100.9806, 101.0959, 100.4609, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 49%|████▉ | 30/61 [4:10:15<3:58:00, 460.65s/it] band06_coefficients_LW_g03-04_iter125_regr125.nc, Trial: 58, Cost: 100.527082, Delta-Cost: -0.0580 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.7285, 96.6468, 104.9202, 87.0390, 101.6854, 97.9728, 102.3602, 97.8040, 82.2482, 100.9538, 101.0959, 101.3116, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 51%|█████ | 31/61 [4:17:43<3:48:18, 456.63s/it] band06_coefficients_LW_g06-07_iter126_2p126.nc, Trial: 61, Cost: 100.757410, Delta-Cost: 0.2303 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.1286, 96.7144, 104.8231, 87.0119, 101.6854, 97.9728, 102.3843, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 52%|█████▏ | 32/61 [4:25:19<3:40:35, 456.39s/it] band10_coefficients_LW_g02-03_iter127_2p127.nc, Trial: 84, Cost: 100.502839, Delta-Cost: -0.2546 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.6642, 96.5903, 105.0126, 87.0642, 101.6854, 97.9728, 102.3843, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 54%|█████▍ | 33/61 [4:32:16<3:27:36, 444.86s/it] band11_coefficients_LW_g09-10_iter128_2p128.nc, Trial: 95, Cost: 100.256865, Delta-Cost: -0.2460 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.0681, 97.5400, 107.2173, 85.4738, 101.6854, 97.9728, 102.3843, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 56%|█████▌ | 34/61 [4:40:06<3:23:31, 452.27s/it] band04_coefficients_LW_g10-11_iter129_2p129.nc, Trial: 43, Cost: 100.496248, Delta-Cost: 0.2394 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.0821, 97.5395, 91.7079, 102.6881, 101.6854, 97.9728, 103.0436, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 57%|█████▋ | 35/61 [4:47:11<3:12:29, 444.20s/it] band01_coefficients_LW_g11-12_iter130_2p130.nc, Trial: 11, Cost: 100.483119, Delta-Cost: -0.0131 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.1622, 97.6298, 100.3160, 93.5403, 101.6854, 97.9728, 103.0436, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 59%|█████▉ | 36/61 [4:54:21<3:03:18, 439.94s/it] band11_coefficients_LW_g05-06_iter131_2p131.nc, Trial: 89, Cost: 100.720053, Delta-Cost: 0.2369 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.5352, 97.3272, 100.4313, 93.6355, 101.6854, 97.9728, 103.0436, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 61%|██████ | 37/61 [5:02:06<2:58:53, 447.25s/it] band02_coefficients_LW_g11-12_iter132_2p132.nc, Trial: 22, Cost: 100.978280, Delta-Cost: 0.2582 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.5409, 97.3377, 99.2129, 96.9737, 101.6854, 97.9728, 103.0436, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 62%|██████▏ | 38/61 [5:09:01<2:47:49, 437.81s/it] band04_coefficients_LW_g03-04_iter133_2p133.nc, Trial: 34, Cost: 101.320718, Delta-Cost: 0.3424 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.9112, 98.1743, 96.2671, 95.6711, 101.6854, 97.9728, 102.9585, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 64%|██████▍ | 39/61 [5:15:57<2:38:07, 431.24s/it] band11_coefficients_LW_g03-04_iter134_2p134.nc, Trial: 85, Cost: 101.692460, Delta-Cost: 0.3717 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 104.5617, 97.7959, 96.2365, 95.6730, 101.6854, 97.9728, 102.9585, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 66%|██████▌ | 40/61 [5:22:39<2:27:51, 422.45s/it] band04_coefficients_LW_g10-11_iter135_2p135.nc, Trial: 41, Cost: 101.288785, Delta-Cost: -0.4037 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 104.6670, 97.9418, 92.7859, 95.3188, 101.6854, 97.9728, 102.5555, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 67%|██████▋ | 41/61 [5:29:35<2:20:08, 420.42s/it] band01_coefficients_LW_g06-07_iter136_2p136.nc, Trial: 6, Cost: 100.838027, Delta-Cost: -0.4508 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.5926, 99.2197, 93.4845, 95.8099, 101.6854, 97.9728, 102.5561, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 69%|██████▉ | 42/61 [5:36:36<2:13:11, 420.61s/it] band01_coefficients_LW_g06-07_iter137_2p137.nc, Trial: 6, Cost: 101.069599, Delta-Cost: 0.2316 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.3622, 103.5686, 97.9538, 97.9720, 101.6854, 97.9728, 102.5577, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 70%|███████ | 43/61 [5:43:47<2:07:07, 423.77s/it] band03_coefficients_LW_g05-06_iter138_2p138.nc, Trial: 24, Cost: 100.886524, Delta-Cost: -0.1831 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.0678, 103.2722, 98.9178, 98.6256, 101.9755, 97.9728, 112.7680, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 72%|███████▏ | 44/61 [5:50:25<1:57:53, 416.09s/it] band12_coefficients_LW_g07-08_iter139_2p139.nc, Trial: 91, Cost: 101.415496, Delta-Cost: 0.5290 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 101.9444, 103.7906, 98.9364, 98.6264, 101.9755, 97.9728, 112.2672, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 74%|███████▍ | 45/61 [5:57:04<1:49:31, 410.71s/it] band12_coefficients_LW_g01-02_iter140_2p140.nc, Trial: 85, Cost: 101.954135, Delta-Cost: 0.5386 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.8409, 103.4841, 99.0036, 98.6225, 101.9755, 97.9728, 112.4022, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 75%|███████▌ | 46/61 [6:03:22<1:40:17, 401.16s/it] band14_coefficients_LW_g01-02_iter141_2p141.nc, Trial: 94, Cost: 102.507091, Delta-Cost: 0.5530 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.6958, 103.4391, 99.4329, 99.4424, 101.9755, 97.9728, 109.7005, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 77%|███████▋ | 47/61 [6:09:26<1:30:57, 389.86s/it] band01_coefficients_LW_g03-04_iter142_2p142.nc, Trial: 3, Cost: 101.948100, Delta-Cost: -0.5590 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.8656, 102.7500, 99.1917, 99.4056, 101.9755, 97.9728, 109.7006, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 79%|███████▊ | 48/61 [6:15:48<1:23:59, 387.67s/it] band16_coefficients_LW_g03-04_iter143_2p143.nc, Trial: 98, Cost: 102.503879, Delta-Cost: 0.5558 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.8013, 102.4420, 99.1982, 99.3954, 101.9755, 98.3291, 109.7006, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 8%|▊ | 1/12 [06:06<1:07:14, 366.77s/it] band11_coefficients_LW_g05-06_iter144_2p144.nc, Trial: 82, Cost: 103.071802, Delta-Cost: 0.5679 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 104.8026, 101.8276, 99.1587, 99.3663, 101.9755, 98.3291, 109.7006, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 17%|█▋ | 2/12 [12:13<1:01:06, 366.69s/it] band15_coefficients_LW_g01-02_iter145_2p145.nc, Trial: 93, Cost: 102.450423, Delta-Cost: -0.6214 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.8330, 102.2445, 99.1756, 99.3742, 102.2267, 98.3291, 108.1560, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 25%|██▌ | 3/12 [18:10<54:22, 362.45s/it] band04_coefficients_LW_g04-05_iter146_2p146.nc, Trial: 31, Cost: 103.114907, Delta-Cost: 0.6645 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 104.7081, 102.8367, 97.2956, 102.8511, 102.2267, 98.3291, 106.2575, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 ... band13_coefficients_LW_g03-04_iter151_2p151.nc, Trial: 86, Cost: 105.125170, Delta-Cost: 0.7632 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 106.8802, 104.0238, 97.5369, 103.7645, 102.9103, 98.3291, 119.1113, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 4%|▍ | 1/26 [07:58<3:19:17, 478.31s/it] band01_coefficients_LW_g02-03_iter152_2p152.nc, Trial: 2, Cost: 104.266787, Delta-Cost: -0.8584 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 105.1257, 102.0804, 98.5763, 104.9921, 102.9103, 98.3291, 119.1118, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 8%|▊ | 2/26 [16:50<3:23:54, 509.75s/it] band07_coefficients_LW_g01-02_iter153_2p153.nc, Trial: 48, Cost: 103.519969, Delta-Cost: -0.7468 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.2441, 105.6427, 99.7353, 105.5078, 102.9103, 98.3291, 120.0781, 97.8040, 82.7138, 100.8565, 101.0959, 101.2410, 99.9596, 98.3183, 98.2247, 101.6861, 102.0614 12%|█▏ | 3/26 [25:29<3:17:08, 514.30s/it] band09_coefficients_LW_g05-06_iter154_2p154.nc, Trial: 65, Cost: 103.546749, Delta-Cost: 0.0268 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 103.3802, 104.9370, 99.1839, 105.2428, 107.0453, 100.5275, 120.0781, 97.8040, 82.7138, 100.8565, 101.0959, 98.6493, 99.9860, 98.3183, 98.2247, 102.3461, 101.1630 15%|█▌ | 4/26 [33:41<3:05:20, 505.46s/it] band05_coefficients_LW_g02-03_iter155_2p155.nc, Trial: 34, Cost: 103.152318, Delta-Cost: -0.3944 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.8003, 106.9301, 99.5334, 105.4052, 107.0453, 100.5275, 113.0077, 116.7654, 82.7138, 100.8565, 101.1769, 98.6493, 99.9860, 98.3183, 98.2247, 102.3461, 101.1630 19%|█▉ | 5/26 [41:59<2:55:53, 502.54s/it] band05_coefficients_LW_g03-04_iter156_2p156.nc, Trial: 35, Cost: 103.349609, Delta-Cost: 0.1973 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 98.3140, 107.4574, 99.0940, 104.4097, 107.0453, 100.5275, 192.8489, 88.1032, 82.7138, 100.8565, 99.1445, 98.6493, 99.9860, 98.3183, 98.2247, 102.3461, 101.1630 23%|██▎ | 6/26 [50:25<2:47:59, 503.95s/it] band07_coefficients_LW_g04-05_iter157_regr157.nc, Trial: 49, Cost: 103.295230, Delta-Cost: -0.0544 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.3568, 103.5927, 96.0869, 102.3948, 107.0453, 100.5275, 194.7781, 88.1032, 82.7138, 100.8565, 99.1445, 98.6493, 99.9860, 98.3183, 98.2247, 102.3461, 101.1630 27%|██▋ | 7/26 [58:42<2:38:47, 501.45s/it] band05_coefficients_LW_g01-02_iter158_regr158.nc, Trial: 33, Cost: 103.103306, Delta-Cost: -0.1919 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.6972, 106.0005, 96.5794, 102.3959, 107.0453, 100.5275, 179.8221, 113.9464, 82.7138, 100.8565, 82.6038, 98.6493, 99.9860, 98.3183, 98.2247, 102.3461, 101.1630 31%|███ | 8/26 [1:06:53<2:29:30, 498.34s/it] band09_coefficients_LW_g07-08_iter159_2p159.nc, Trial: 63, Cost: 103.145388, Delta-Cost: 0.0421 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.4104, 106.3334, 97.2757, 104.2859, 103.7200, 96.6367, 179.8221, 113.9464, 82.7138, 100.8565, 82.6038, 98.5827, 100.0021, 98.3183, 98.2247, 102.5580, 101.3109 35%|███▍ | 9/26 [1:15:14<2:21:23, 499.01s/it] band12_coefficients_LW_g02-03_iter160_2p160.nc, Trial: 72, Cost: 103.515040, Delta-Cost: 0.3697 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.0922, 107.0898, 97.1559, 104.4115, 103.7200, 96.6367, 178.0626, 113.9464, 82.7138, 100.8565, 82.6038, 98.5827, 100.0021, 98.3183, 98.2247, 102.5580, 101.3109 38%|███▊ | 10/26 [1:23:36<2:13:20, 500.03s/it] band03_coefficients_LW_g07-08_iter161_2p161.nc, Trial: 23, Cost: 103.998976, Delta-Cost: 0.4839 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 98.3514, 109.1853, 104.5955, 110.2917, 103.7472, 96.6367, 174.2123, 113.9464, 82.7138, 100.8565, 82.6038, 98.5827, 100.0021, 98.3183, 98.2247, 102.5580, 101.3109 42%|████▏ | 11/26 [1:31:52<2:04:42, 498.86s/it] band11_coefficients_LW_g04-05_iter162_regr162.nc, Trial: 69, Cost: 103.986740, Delta-Cost: -0.0122 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.2268, 110.3605, 101.8924, 108.1241, 103.7472, 96.6367, 174.2123, 113.9464, 82.7138, 100.8565, 82.6038, 98.5827, 100.0021, 98.3183, 98.2247, 102.5580, 101.3109 46%|████▌ | 12/26 [1:39:32<1:53:38, 487.05s/it] band08_coefficients_LW_g07-08_iter163_2p163.nc, Trial: 55, Cost: 104.327036, Delta-Cost: 0.3403 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 100.5167, 108.6995, 99.8038, 107.5279, 104.0124, 96.6367, 173.8001, 113.9464, 82.7138, 99.5223, 81.4322, 98.5827, 99.1745, 94.3430, 98.5921, 103.2506, 101.3109 50%|█████ | 13/26 [1:47:30<1:44:54, 484.17s/it] band07_coefficients_LW_g01-02_iter164_regr164.nc, Trial: 44, Cost: 105.059802, Delta-Cost: 0.7328 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 102.0850, 107.4696, 98.4864, 107.0775, 104.0124, 96.6367, 175.1293, 113.9464, 82.7138, 99.5223, 81.4322, 98.5827, 99.1745, 94.3430, 98.5921, 103.2506, 101.3109 54%|█████▍ | 14/26 [1:55:25<1:36:16, 481.39s/it] band03_coefficients_LW_g01-02_iter165_2p165.nc, Trial: 17, Cost: 105.182491, Delta-Cost: 0.1227 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 98.5422, 117.1838, 102.4428, 111.5132, 102.4431, 96.6367, 196.8404, 113.9464, 82.7138, 99.5223, 81.4322, 98.5827, 99.1745, 94.3430, 98.5921, 103.2506, 101.3109 58%|█████▊ | 15/26 [2:03:45<1:29:16, 486.92s/it] band02_coefficients_LW_g02-03_iter166_regr166.nc, Trial: 9, Cost: 105.112573, Delta-Cost: -0.0699 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 97.3482, 125.2466, 105.6777, 110.9781, 102.4431, 96.6367, 196.8398, 113.9464, 82.7138, 99.5223, 81.4322, 98.5827, 99.1745, 94.3430, 98.5921, 103.2506, 101.3109 62%|██████▏ | 16/26 [2:12:17<1:22:24, 494.47s/it] band08_coefficients_LW_g05-06_iter167_2p167.nc, Trial: 50, Cost: 105.795132, Delta-Cost: 0.6826 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 98.4894, 125.6057, 105.6485, 110.9446, 102.8106, 96.6367, 196.9433, 113.9464, 82.7138, 99.1905, 80.2843, 98.5827, 97.7004, 92.2225, 100.5964, 102.9494, 101.3109 65%|██████▌ | 17/26 [2:20:43<1:14:43, 498.17s/it] band08_coefficients_LW_g04-05_iter168_2p168.nc, Trial: 49, Cost: 105.626231, Delta-Cost: -0.1689 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 97.9088, 126.6786, 106.0954, 111.2188, 103.7692, 96.6367, 197.7012, 113.9464, 82.7138, 98.8966, 80.5235, 98.5827, 97.6952, 92.6580, 102.7254, 102.4701, 101.3109 69%|██████▉ | 18/26 [2:28:45<1:05:45, 493.24s/it] band10_coefficients_LW_g03-04_iter169_2p169.nc, Trial: 58, Cost: 106.535664, Delta-Cost: 0.9094 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 99.3197, 127.4774, 106.2160, 111.3562, 103.7692, 96.6367, 197.7012, 113.9464, 82.7138, 98.8966, 80.5235, 98.5827, 97.6952, 92.6580, 102.7254, 102.4701, 101.3109 73%|███████▎ | 19/26 [2:36:43<56:59, 488.50s/it] band08_coefficients_LW_g02-03_iter170_2p170.nc, Trial: 47, Cost: 105.557474, Delta-Cost: -0.9782 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 97.6228, 127.8665, 106.2550, 111.3868, 103.9608, 96.6367, 197.7585, 113.9464, 82.7138, 99.3202, 81.8211, 98.5827, 98.0322, 93.6565, 102.2842, 102.2242, 101.3109 77%|███████▋ | 20/26 [2:44:28<48:09, 481.51s/it] band08_coefficients_LW_g02-03_iter171_2p171.nc, Trial: 47, Cost: 105.205075, Delta-Cost: -0.3524 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 96.1669, 129.9238, 107.3819, 112.0383, 107.9142, 96.6367, 200.3017, 113.9464, 82.7138, 96.6132, 72.5077, 98.5827, 100.2148, 106.9003, 116.5393, 101.3898, 101.3109 81%|████████ | 21/26 [2:52:01<39:25, 473.11s/it] band05_coefficients_LW_g07-08_iter172_2p172.nc, Trial: 36, Cost: 106.225643, Delta-Cost: 1.0206 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 96.2224, 129.8937, 110.4562, 117.0755, 107.9142, 96.6367, 200.6791, 113.9464, 82.7138, 96.6132, 72.5077, 98.5827, 100.2148, 106.9003, 116.5393, 101.3898, 101.3109 85%|████████▍ | 22/26 [3:00:05<31:44, 476.21s/it] band06_coefficients_LW_g01-02_iter173_2p173.nc, Trial: 36, Cost: 105.136911, Delta-Cost: -1.0887 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 94.3788, 129.5359, 110.6267, 117.1887, 107.9142, 96.6367, 200.8772, 113.9464, 75.8906, 99.3546, 72.5077, 100.6228, 100.2148, 106.9003, 116.5393, 101.3898, 101.3109 88%|████████▊ | 23/26 [3:07:53<23:41, 473.96s/it] band12_coefficients_LW_g03-04_iter174_2p174.nc, Trial: 60, Cost: 106.196102, Delta-Cost: 1.0592 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 95.9604, 130.6470, 111.0462, 117.2626, 107.9142, 96.6367, 201.0422, 113.9464, 75.8906, 99.3546, 72.5077, 100.6228, 100.2148, 106.9003, 116.5393, 101.3898, 101.3109 92%|█████████▏| 24/26 [3:15:38<15:42, 471.23s/it] band07_coefficients_LW_g01-02_iter175_regr175.nc, Trial: 40, Cost: 104.998279, Delta-Cost: -1.1978 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 92.1135, 140.7142, 113.3751, 118.4835, 107.9142, 96.6367, 208.0824, 113.9464, 75.8906, 99.3546, 72.5077, 100.6228, 100.2148, 106.9003, 116.5393, 101.3898, 101.3109 96%|█████████▌| 25/26 [3:23:26<07:50, 470.08s/it] band10_coefficients_LW_g03-04_iter176_2p176.nc, Trial: 53, Cost: 105.012555, Delta-Cost: 0.0143 flux_net, band_flux_net, heating_rate, heating_rate_7, flux_net_forcing_5, flux_net_forcing_6, flux_net_forcing_7, flux_net_forcing_9, flux_net_forcing_10, flux_net_forcing_11, flux_net_forcing_12, flux_net_forcing_13, flux_net_forcing_14, flux_net_forcing_15, flux_net_forcing_16, flux_net_forcing_17, flux_net_forcing_18 = 91.8797, 147.6579, 113.2575, 117.5749, 107.9142, 96.6367, 208.0824, 113.9464, 75.8906, 99.3546, 72.5077, 100.6228, 100.2148, 106.9003, 116.5393, 101.3898, 101.3109

note: i'm doing this in cori scratch, which is available only for about 12 more days. i have 40 TB to work with, so even though this process is very disk-heavy, i should have enough space to work with, so long as i finish before cori is retired. my workdirs were copied to /project/projectdirs/e3sm/pernak18/ and my intermediate-but-not-committed code for this issue is in the issue25_attempt directory, so i should be able to continue this work after cori is retired, if needed (but i'd like to not get to that point).

if we successfully get to iteration 176 (80 g-points remaining) at an acceptable cost, i will push the corresponding code.

after that, we will run the pushed code on the SW cost function, then proceed to NWP and LES (large eddy simulation) cost functions for the LW and SW, if we have time on the contract.

we're getting there...iteration 143 was one where the winner was the last trial, but the number of trials gets decremented because of the winner selection, and eventually this led to index errors. i "fixed" this with:

    for weight, comp in zip(outObj.costWeights, outObj.compNameCF):
      scale = weight * 100 / outObj.cost0[comp][0]
      outObj.costComp0[comp] = outObj.costComps[comp][outObj.iOpt-1]
      outObj.dCostComps0[comp] = outObj.dCostComps[comp][outObj.iOpt-1]

in coSetupNextIterMod(), but that means iterations 94-142 are slightly off, i believe. either that, or this fix is incorrect, in which case everything after 143 is incorrect.

at iteration 152, i replaced NaN searches with optBand usage, which should be equivalent. this means i have to reset optBand (and optNC) after coSetupNextIterMod, though, because we use it in doBandTrials, which is called after coSetupNextIterMod.

Archival of Code and Output

modified code for the "full" run (the most recent runs that have gotten us up to 150+ iterations) is in /project/projectdirs/e3sm/pernak18/quadratic_regress_2/ and will be pushed into the repo (master branch) when the iterations complete

the "shortcut" that we have been trying is also archived in /project/projectdirs/e3sm/pernak18/quadratic_regress_1/ (output) and /project/projectdirs/e3sm/pernak18/issue25_attempt/ (code). /project/projectdirs/e3sm/pernak18/workdir_band_* was the starting point for this issue -- even though they have output from > iteration 95, we are using them for everything up to iter 94, which is when the modified combining is triggered in the LW for the cost function we have defined so far.

Update

I've been having problems accessing the project space from cori, and with the system being retired tomorrow, i don't think there will be an urgency to restore the link. FWIW, I also have not seen /project/projectdirs/e3sm/pernak18 or /project/projectdirs/e3sm/ from perlmutter, either. This hinders any further runs because the reference netCDF files are in project space. Scratch that -- see Project Space Reorg.

For now, to keep things archived and accessible from all machines:

Details

% pwd /global/cscratch1/sd/pernak18/RRTMGP/test_abs_val % git status HEAD detached at 9eb2ce3 Changes not staged for commit: (use "git add ..." to update what will be committed) (use "git restore ..." to discard changes in working directory) modified: band-g-point-reduction.ipynb modified: g_point_reduction.py modified: modified_reduction.py Untracked files: (use "git add ..." to include in what will be committed) diagnostics.ipynb no changes added to commit (use "git add" and/or "git commit -a") % cp band-g-point-reduction.ipynb ~/quadratic_regress_complete/ % cp g_point_reduction.py ~/quadratic_regress_complete/ % cp modified_reduction.py ~/quadratic_regress_complete/ % cp diagnostics.ipynb ~/quadratic_regress_complete/ % git commit -a # commit message in emacs % git checkout abs_val Warning: you are leaving 1 commit behind, not connected to any of your branches: fd45923 code that got us up to iteration 176 in the LW. summary: If you want to keep it by creating a new branch, this may be a good time to do so with: git branch fd45923 Switched to branch 'abs_val' Your branch is up to date with 'origin/abs_val'. % git status On branch abs_val Your branch is up to date with 'origin/abs_val'. nothing to commit, working tree clean % git branch quad_regress_abs_val fd45923 % git checkout quad_regress_abs_val % git push -u origin quad_regress_abs_val

and that code is in the latest commit from today

my whole /global/cscratch1/sd/pernak18/RRTMGP/test_abs_val was synced to /pscratch/sd/p/pernak18/RRTMGP/test_abs_val after we completed 176 iterations.

and for perlmutter runs, it looks like i conveniently saved the reference netCDFs i need in /pscratch/sd/p/pernak18/RRTMGP/reference_netCDF/g-point-reduce.

the reduced k-distribution and associated fluxes:

cp rrtmgp-data-LW-g-red.nc ~/quadratic_regress_complete/
cp optimized_LW_fluxes.nc  ~/quadratic_regress_complete/

on perlmutter, i was running into issues with module load cray-netcdf, i think it's because i have to load other dependencies. i went with module load intel-classic/2023.1.0 cray-hdf5/1.12.2.3 cray-netcdf/4.9.0.3 because 4.9.0.3 was the only netCDF4 library that had an Intel build (i know i used ifort to build our executable on cori.

Project Space Reorg

project space has been moved to /global/cfs/projectdirs/e3sm/pernak18

the workdir_band_* are obsolete, so we can replace them with what we have from iter 176 in perlmutter scratch:

Details

cd /global/cfs/projectdirs/e3sm/pernak18 mv quadratic_regress_* obsolete_results/ mv issue23/ obsolete_results/ mv issue25_attempt/ obsolete_results/ rm dcost_parabola_coeffs.txt dcost_root_coeffs.py dcost_root_coeffs.txt rm -rf workdir_band_* du -hs # 1.7 GB cp -r /pscratch/sd/p/pernak18/RRTMGP/test_abs_val/workdir_band_* . du -hs # 92 GB cp -r /pscratch/sd/p/pernak18/RRTMGP/test_abs_val/fullCF_top-layer_redo_abs_parabola/ . mkdir LW_fullCF_parabola_abs_val mv workdir_band_* LW_fullCF_parabola_abs_val/ mv fullCF_top-layer_redo_abs_parabola/ LW_fullCF_parabola_abs_val/

pernak18 / g-point-reduction

New Parabola Implementation #25

Archival of Code and Output

Update

Project Space Reorg