Proposal: New UI to show GPU Details

[cvinson830]

We’re looking to extend the TensorBoard user interface to display interesting GPU details for each node in a neural network. The GPU Details that we plan to display focus on the usage of tensor cores. Tensor cores enable deep learning applications to run significantly faster.

Tensorboard GRAPHS tab: When a node is selected, and when the new ‘GPU Details’ radio button is clicked in navigator panel, a new properties panel will appear to the right called GPU details. This new panel will display GPU details for that node:

• Percentage bar showing percentage of kernels using tensor cores
• Percentage bar showing percentage of duration using tensor cores
• Detailed kernel information, including kernel name, call counts, and durations.

Please review two new user interface elements on the GRAPHS tab:

• New radio button in navigator panel on left hand side, and
• New ‘GPU Details’ properties panel on right hand side.

Notes:

• The nodes themselves will be shaded based upon the usage of tensor cores.

Question: Is this in line with your ideas on how to display GPU Details for nodes in TensorBoard? Any guidance here would be appreciated.

[cvinson830]

Hello, here are responses to additional prompts:

Have I written custom code: No
OS Platform and Distribution: Windows, Linux, MAC
TensorFlow installed from: github
TensorFlow version: 1.9
Bazel version: bazel release 0.13.0
CUDA/cuDNN version: V9.0.176/7.0.4
GPU model and memory: TITAN V 
Exact command to reproduce: N/A

[jart]

This type of contribution sounds good to me. I commented in https://github.com/tensorflow/tensorflow/issues/20597