infocusp / tf_cnnvis

CNN visualization tool in TensorFlow
MIT License
781 stars 208 forks source link

3D CNN visualization #40

Open anbai106 opened 6 years ago

anbai106 commented 6 years ago

Hi,

I also have a question, do you plan to implement the 3D version to visualize the activation map and decent???

Thanks in advance

falaktheoptimist commented 6 years ago

We have activation visualization already as part of the functionalities. If you mean for CNNs having 3d inputs as in videos - it would be a cool add on, but we might not be able to come up with that in some near future. Or did you mean something else?

anbai106 commented 6 years ago

@falaktheoptimist , I am talking about some 3D image inputs, like MRI. That could be cool to visualize the activations and deconv for 3D CNN architecture.

For the 3D visualization, I am not sure if this fits in tensorboard. I think this is not that difficult to implement, we can just save the activation maps as an nifti format.

falaktheoptimist commented 6 years ago

It would indeed be a cool new application. This should work, although we haven't run this case explicily. The activation maps would be saved as individual grayscale frames in png format - as we haven't added provision for nifti format. If you add that or compute some results - please do share with us or add a PR with your notebook and we'll incorporate that.

sodaGH commented 6 years ago

@anbai106 Hello, I want to do the visualization work on 3D MRI data as well, in detail, visualizing the feature maps of every conv layers. Have you find any feasible method for that target? Looking forward to your advice. Do thanks a lot!