gpu_benchmark_tools

this is collection of gpu benchmark tools

• plan
  • I. Sling
  • II. DeepBench

plan

I. Sling

https://github.com/google/sling

• for provisional tensorflow training

II. DeepBench

https://github.com/baidu-research/DeepBench

types:

• Dense Matrix Multiplies
• Convolutions
• Recurrent Layers
• All-Reduce

requires:

• NVIDIA's NCCL
• Ohio State University (OSU) Benchmarks
• Baidu's Allreduce
• Intel's MLSL