ctuning / ck-mlperf

This repository is outdated! Join the open MLPerf workgroup to participate in the development of the next generation of automation workflows for MLPerf benchmarks:
https://bit.ly/mlperf-edu-wg
BSD 3-Clause "New" or "Revised" License
32 stars 23 forks source link

Finalize image classification preprocessing #22

Closed psyhtest closed 4 years ago

psyhtest commented 5 years ago

We should update all image classification clients we support for MLPerf to use new preprocessing (in the order of priority - high to low):

Time-permitting, we should also update non-MLPerf clients:

At the same time, we should also:

psyhtest commented 5 years ago

Preprocessing should change the extension of files to e.g. rgb8 to avoid CK detecting original JPEG files as preprocessed ones.

Update: This required a corresponding change in postprocessing.

psyhtest commented 5 years ago

We should document the --ask flag:

$ ck install package --tags=dataset,imagenet,preprocessed --ask

(and perhaps enable it by default too).

psyhtest commented 5 years ago

For an AWS demo, we may want to use ck-tensorflow:program:image-classification-tf-frozen-py. We should raise its priority then.

psyhtest commented 5 years ago

As I understand, tf-cpp and tf-frozen-py have been updated?

psyhtest commented 4 years ago

With many changes to preprocessing over the last couple of months (and, importantly, finally matching the official code), this issue can be retired.