Closed brajiang closed 1 year ago
Orbit benchmarks refers to those under this class: https://github.com/tensorflow/models/blob/benchmark/official/benchmark/base_benchmark.py#L62
The new target format will be 'official.benchmark.base_benchmark.BaseBenchmark:benchmark__{benchmark method name}'
This is needed because the benchmark method name may contain the '.' char (e.g. https://github.com/tensorflow/models/blob/benchmark/official/benchmark/benchmark_definitions.py#L20), so the original parsing doesn't work; now we use ':' as the separator.
Orbit benchmarks refers to those under this class: https://github.com/tensorflow/models/blob/benchmark/official/benchmark/base_benchmark.py#L62
The new target format will be 'official.benchmark.base_benchmark.BaseBenchmark:benchmark__{benchmark method name}'
This is needed because the benchmark method name may contain the '.' char (e.g. https://github.com/tensorflow/models/blob/benchmark/official/benchmark/benchmark_definitions.py#L20), so the original parsing doesn't work; now we use ':' as the separator.