Head/tail classification

sumanager56 commented 1 year ago

[ ] Relevant plots showing different Gravity drainage/ET/Rainfall/Rewetting classes and the transition points from Gravity drainage-ET
[ ] Tables showing average FC values based on head/tail classification

sumanager56 commented 1 year ago

In the beginning, we used Fisher Jenks natural break algorithm to classify our soil moisture pattern into different zones but that didn't work well for our data with the heavy-tailed distribution. We used head-tail classification to identify different Rainfall, Rewetting, ET, and gravity drainage zones. All the plots shown below show transition points that have valid Rainfall/Rewetting-Gravity drainage-ET transitions. FC points summarized below are the average of all these transition points. Results look better for surface soil compared to the deeper sensors. Smoothing the data seems to work well sometimes but makes the classification worse in some sensors.

FC average values based

| Depth | CornFull | CornNon | CornPrec | CottonFull | CottonNon | CottonPrec -- | -- | -- | -- | -- | -- | -- | -- 1 | 4-inch | 24.0835 | 25.95667 | 22.48182 | 16.8675 | 16.94857 | 15.81579 2 | 8-inch | 26.81357 | 28.497 | 25.48125 | 22.235 | 22.115 | 26.064 3 | 12-inch | 29.11667 | 26.44 | NaN | 27.736 | 24.57111 | 21.472 4 | 16-inch | 26.29833 | 27.83 | 25.5875 | 24.26 | 28.425 | 21.4225 5 | 20-inch | 23.2625 | 32.08 | 30.845 | 27.29 | 30.45 | 27.62 6 | 24-inch | 23.04667 | NaN | 30.318 | 30.68 | 30.63 | NaN 7 | 28-inch | 25.682 | NaN | 29.73 | 31.85 | NaN | 29.99 8 | 32-inch | 29.06 | 29.52 | NaN | 29.68609 | NaN | 26.72 9 | 36-inch | 31.33 | NaN | NaN | NaN | NaN | 28.33

FC values with 25th and 75th percentile

| Depth | CornFull | CornNon | CornPrec | CottonFull | CottonNon | CottonPrec -- | -- | -- | -- | -- | -- | -- | -- 1 | 4-inch | 24.0835 | 25.95667 | 22.48182 | 16.8675 | 16.94857 | 15.81579 2 | [25%, 75%] | 20.0425, 26.23 | 24.885, 27.87 | 20.365, 25.925 | 15.095, 18.2075 | 13.03, 20.3 | 13.865, 18.285 3 | 8-inch | 26.81357 | 28.497 | 25.48125 | 22.235 | 22.115 | 26.064 4 | [25%, 75%] | 25.9475, 28.4075 | 26.7875, 29.59 | 24.0375, 26.81 | 21.7575, 22.6375 | 21.2775, 22.9525 | 24.9375, 26.9525 5 | 12-inch | 29.11667 | 26.44 | NaN | 27.736 | 24.57111 | 21.472 6 | [25%, 75%] | 28.415, 29.87 | 26.44, 26.44 | NA, NA | 27.04, 28.13 | 24.11, 25.54 | 21.14, 21.67 7 | 16-inch | 26.29833 | 27.83 | 25.5875 | 24.26 | 28.425 | 21.4225 8 | [25%, 75%] | 25.03, 28.1975 | 27.465, 28.195 | 23.975, 26.5675 | 23.445, 24.94 | 26.985, 29.71 | 21.1675, 21.765 9 | 20-inch | 23.2625 | 32.08 | 30.845 | 27.29 | 30.45 | 27.62 10 | [25%, 75%] | 21.315, 24.5525 | 32.08, 32.08 | 30.8425, 30.8475 | 26.72, 27.86 | 30.45, 30.45 | 27.62, 27.62 11 | 24-inch | 23.04667 | NaN | 30.318 | 30.68 | 30.63 | NaN 12 | [25%, 75%] | 21.855, 23.98 | NA, NA | 29.63, 30.95 | 30.235, 31.125 | 30.46, 30.8 | NA, NA 13 | 28-inch | 25.682 | NaN | 29.73 | 31.85 | NaN | 29.99 14 | [25%, 75%] | 24.6, 26.9 | NA, NA | 29.73, 29.73 | 31.85, 31.85 | NA, NA | 29.645, 30.335 15 | 32-inch | 29.06 | 29.52 | NaN | 29.68609 | NaN | 26.72 16 | [25%, 75%] | 27.09, 32.265 | 29.52, 29.52 | NA, NA | 29.075, 30.4 | NA, NA | 26.72, 26.72 17 | 36-inch | 31.33 | NaN | NaN | NaN | NaN | 28.33 18 | [25%, 75%] | 31.33, 31.33 | NA, NA | NA, NA | NA, NA | NA, NA | 28.33, 28.33

sumanager56 commented 1 year ago

Smoothing is mentioned if applied to the particular sensor.