NodeIntegration

[dmccloskey]

Description

Allow for multiple input integration strategies such as Sum, Product, and Max

TODOs

• [x] NodeIntegration enum class
• [x] Tests and update of all other code for NodeIntegration
• [x] input_ internal parameter with getters/setters
• [x] Tests for input_
• [x] update FP with NodeIntegration options
• [x] Tests for FP with NodeIntegration options
• [x] update BP with NodeIntegration options
• [x] Tests for BP with NodeIntegration options
• [x] update weightUpdate with NodeIntegration options
• [x] Tests for weightUpdate with NodeIntegration options

[dmccloskey]

implementation of dNet_i/dOut_j

• Sum: Error_i weight_i_j dNet_i/dOutput_j = Weight_i_j Output_j + Weight_i_k * Output_k = Weight_i_j
• Product: Error_i (NetInput_i weight_i_j Derivative_j dNet_i/dOutput_j = Weight_i_j Output_j Weight_i_k Output_k = Weight_i_j Weight_i_k * Output_k = NetInput_i / Output_j
• Max: if (NetInput_i_j = Output_j) {Error_i weight_i_j Derivative_j} else {0}
• implement change in BP step dError_total/dOut_j = dError_total/dOut_i dOut_i/dNet_i dNet_i/dOut_j = = Error_i Derivative_j [dNet_i/dOut_j]

implementation of dNet/dW

• Sum: Output_j
• Product: NetInput_i_j / Weight_i_j
• Max: if (NetInput_i_j = Output_j) {Output_j} else {0}
• implement change in updateWeight step