tensorflow / tensorboard

TensorFlow's Visualization Toolkit
Apache License 2.0
6.71k stars 1.66k forks source link

Feature: ability to show image pixel values #2158

Open zaccharieramzi opened 5 years ago

zaccharieramzi commented 5 years ago

When displaying images in Tensorboard, there is no way to display the value of each pixel. I am interested in knowing the value of each pixel individually (I know I have access to a distro/histo vis), but currently I would have to do it in code. In my specific use case, it's because I want to inspect the values I have in my kernel weights.

I think it would be a nice addition to be able to visualize the pixel value either as overlay, a colorbar or a text next to the cursor when hovering over the pixel.

nfelt commented 5 years ago

Thanks (belatedly) for the feature request. Are you thinking of e.g. a float value between 0.0 and 1.0 for a greyscale image, or the literal RGB value? Also what size of image are you working with?

Showing the value on hover sounds reasonable. Having an overlay seems difficult to fit unless the pixels are shown as very large? And a colorbar seems like it wouldn't be quite as accurate. If you have mockups or references to some of the ideas that would help make this a bit more concrete.

zaccharieramzi commented 5 years ago

Well in my case the images are kernel weights so they are float (with no restriction). The image is therefore 3 x 3 or 5 x 5.

I understand overlay would not be a suit-all solution, so maybe not the one to privileged. The colorbar is inaccurate but it allows a first quick inspection, which is useful, and if the image is too big for displaying particular values on hover then you can look at the distributions anyway.

I unfortunately don't have mockups. I could try to come up with one, although I am not sure exactly what is unclear for the hover solution.