search

jacobgil / pytorch-grad-cam

Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.
https://jacobgil.github.io/pytorch-gradcam-book
MIT License
10.66k stars 1.56k forks source link

grad CAM with extra dimension（time）？ #345

Open qingfeng8-8 opened 2 years ago

qingfeng8-8 commented 2 years ago

suppose my input is five-dimensional data which includes time dimension（N,C,T,H,W）. What do you call the CAM module？Or could open source the code about CAM you have adjusted, thanks a lot.

jacobgil commented 2 years ago

Hi, I didn't deal with this use case yet.

But this really depends on the details of the model.

How do the internal activations look like ? Are they images? is every frame processed separately by a model? or are they fused together?