tensorflow / tensorboard

TensorFlow's Visualization Toolkit
Apache License 2.0
6.73k stars 1.66k forks source link

Custom scalars that aggregate selected runs #1503

Open danijar opened 6 years ago

danijar commented 6 years ago

Is it possible to use the custom scalar dashboard to aggregate over the currently selected runs? For example, I'd like to show the mean with a shaded standard deviation of the test accuracy. If this is supported, would you be able to provide a quick example for this use case?

nfelt commented 6 years ago

This isn't possible today. The custom scalars dashboard margin charts can show a "shaded region" around a line, but they all currently have to be explicitly constructed from fixed tags - there's no automatic aggregation/stddev computation. https://github.com/tensorflow/tensorboard/blob/c6fc8d1ed9fd1062459cec13688d408d786a1ee6/tensorboard/plugins/custom_scalar/layout.proto#L45-L69

This would definitely be a useful feature to add, though.