Open dralmadani opened 1 year ago
How about trying all the mentioned layers and then checking the visualization result? From my perspective, layer4
is a suitable choice.
I found the problem was that the kind of GPU I used in COLAB did not have enough memory, but when I used the A100, everything worked good, and I got a 32M GIF file for 4 seconds!!
However, there are now two options. Slow_path method: "backbone/slow_path/layer4/2/relu" fast_path method: "backbone/fast_path/layer4/2/relu" What is the last layer that makes the product before the fully convolutional layer (FC)?
There is no last layer to fuse the features from both two paths before the FC. The FC processes the features (a tuple) from the slow path and fast path simultaneously. Check this file for more details.
I am re-implementing grad-cam algorithms for slowfast model, following the gradcam demo provided by MMAction2 (MMAction2 GradCAM utils only).
Here are my codes.
in the example mmaction use
--target-layer-name backbone/layer4/1/relu
for TSM but what layer should I use for slowfast--target-layer-name backbone/fast_path/layer4/1/relu \
--target-layer-name backbone/fast_path/layer4/2/relu \
--target-layer-name backbone/slow_path/layer4/1/relu \
--target-layer-name backbone/slow_path/layer4/2/relu \