dianna-ai / dianna

Deep Insight And Neural Network Analysis
https://dianna.readthedocs.io
Apache License 2.0
48 stars 13 forks source link

test rise on weather dataset #515

Closed cwmeijer closed 1 year ago

cwmeijer commented 1 year ago

Run rise and see if the results make any sense.

cwmeijer commented 1 year ago

With some hacking, I got the following image out: image The line is the raw data which is a single channel, max daily temp, from the weather dataset. The time series is classified as 'summer' as opposed to 'winter' (I excluded all autumn and spring data). The colors show the values towards the class summer. The values seem opposite of what we would expect. So, not bad. Not good either, but at least a clear pattern.

Here is the one for winter: image Again, good pattern, but opposite of what we expect.

Note that the binary model that I trained did not yield any sensible results and no useful patterns in the saliency maps. This is, I think, because the model, with 28 inputs as time series length, was trained on only 45 instances. In my experiments, the trained model didn't change predictions so easily by masking parts. I can try again later with other masking stategies or with a model that was trained on more data.

The current masking strategy was inputing the mean of the train data. Masking with the mean of the current instance wasn't successful as masking this was hardly changed any predictions by the model.

TL;DR Conclusion is that in the most simple case RISE for time works well, but with opposite values. I'm looking for a bug now.

cwmeijer commented 1 year ago

Bug was found when generating masks. I reversed the binary values for the mask with respect to the original RISE method. I adapted the masking functionality and the saliency maps are now exactly as expected. \o/

cwmeijer commented 1 year ago

See #540