search

tensorflow / build

Build-related tools for TensorFlow
Apache License 2.0
278 stars 114 forks source link

How easy it is to externalize the visibility of the benchmarks we already run continuously? #10

Open bhack opened 4 years ago

bhack commented 4 years ago

This a pinpoint to not lost the benchmarking subthread started at https://github.com/tensorflow/tensorflow/pull/33945#issuecomment-652471742

Quoting @zongweiz

We have [TF2 benchmarks] (https://github.com/tensorflow/models/tree/master/official/benchmark) from every official model garden model and they continuously running internally, using PerfZero framework. We should be able to select a set of benchmarks and hook it up with github CI (jenkins). Added @sganeshb to this thread for information and we will follow up. Another thought is to start CI tests using a selected set of tf_benchmarks

/cc @alextp @naveenjha123 @sganeshb

bhack commented 4 years ago

Is it ok to track this here?