albermax / innvestigate

A toolbox to iNNvestigate neural networks' predictions!
Other
1.25k stars 233 forks source link

Question to the analysis array #185

Closed sirnyls closed 4 years ago

sirnyls commented 4 years ago

analyzer = innvestigate.create_analyzer("deep_taylor", model, neuron_selection_mode="index") analysis = analyzer.analyze(inputs, i)

Do the values of the analysis array refer to the activation of the NN? So, if a value in the array is high, then it means that the pixel this value refers to triggers the output of the NN in a positive manner?

enryH commented 4 years ago

yes, but there are several variants. The final layer (without sigmoid/softmax) is decomposed to the original inputs.