CNN Filter Visualization and Understanding

[Simsso]

We want to understand what the model leans and pursue the following things:

• look at first layer filters directly (maybe increase them in size, e.g. 7x7)
• look at which inputs cause certain units in lower levels to spike
• compute gradients wrt. to the input (heat map)
• investigate how the "NNs dream" images were created and create something of that kind for our classifier

[Simsso]

Relevant links

• Visualizing what ConvNets learn. http://cs231n.github.io/understanding-cnn/
• Inceptionism: Going Deeper into Neural Networks. https://ai.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html

[Simsso]

Script for activation extraction added in this commit: https://github.com/Simsso/Pagerank-Estimation-Deep-Graph-Networks/commit/e00b3acb30def99750c223a21ca296cbd0968614

[Simsso]