search

tensorflow / tensorboard

TensorFlow's Visualization Toolkit
Apache License 2.0
6.71k stars 1.66k forks source link

Feature Request: The ability to overlay segmentation masks on images #1042

Open neheller opened 6 years ago

neheller commented 6 years ago

For semantic segmentation work, it would be nice to be able to specify image backgrounds and have the serialized data overlay those images as colored masks, maybe with variable opacity.

chihuahua commented 6 years ago

I think this feature could make for a useful TensorBoard plugin, which extends TensorBoard's current capabilities with visualizations.

What would you think about an API that is used like this?

tb.summary.overlay(image, overlay)

where overlay is an image (containing boxes for overlay) that is the same shape as image. What kind of API would you find useful?

neheller commented 6 years ago

I agree that it would make a good plugin. What do you mean by "boxes for overlay"?

I think that being able to specify the opacity of the overlay is important, but maybe that should be controlled on the client side. I'd also like it to be treated as images are where you can look at the history of the overlay with a slider.