search

pyhf / pyhf-benchmark

Benchmarking of hardware acceleration of pyhf
Apache License 2.0
3 stars 1 forks source link

Investigate TPU benchmark suite #22

Open coolalexzb opened 4 years ago

coolalexzb commented 4 years ago

This issue aims to collect the investigation of TPU benchmark suite.

Google’s Cloud TPU v2/v3 is the most commonly used TPU. From Using Cloud TPU Tools and Cloud TPU Monitoring with Stackdriver, users can use command line to capture profile for static TPU system metrics or use stackdriver to monitor dynamic TPU usage. One simple approach is creating log-based metrics programmatically using the Stackdriver REST API, crawling log-based metrics and plotting the graph we need.

matthewfeickert commented 4 years ago

Can we use stackdriver with the TPUs that are freely available on Colab, or do we need to use the paid TPU service?

@lukasheinrich Do we have any Google Cloud credits yet that we could use for TPU tests?

matthewfeickert commented 4 years ago

This is a low enough priority item that this should get shelved until all other aspects of the project are done.