search

tensorflow / benchmarks

A benchmark framework for Tensorflow
Apache License 2.0
1.14k stars 632 forks source link

What to use as replacement for tf_cnn_benchmark in the official tensorflow models #535

Closed rahulbatra85 closed 1 year ago

rahulbatra85 commented 1 year ago

I see a benchmark branch in Tensorflow official models. Is this suppose to tf_cnn_benchmark replacement? https://github.com/tensorflow/models/tree/benchmark

Also, in an issue in this repo it was mentioned to use officials/vision models as alternative https://github.com/tensorflow/benchmarks/issues/524#issuecomment-1122964694

Which one to use?

Thanks!

tfboyd commented 1 year ago

Things have changed over the years. For official models that also train to the correct accuracy and are maintained models/official is the way to go/. https://github.com/tensorflow/models/tree/master/official. I think it was 4 years ago, when I also moved on from tf_cnn_benchmarks and really pushed models/official because I felt perf code wasn't as interesting as really nice core models that also preformed out of the box with minimal Flags.

The other path are the MLPerf models; but not everyone publishes every model on every platform. I have not been involved in a long time; but MLPerf seems more hardware focused.

I did really enjoy all the fun we had with tf_cnn_benchmarks. Good luck finding what you need.

rahulbatra85 commented 1 year ago

ok, thanks!