Open balezz opened 2 years ago
Added model quantization to float16, calculated benchmarks, but not sure, that received some significant and positive impact on speed
@dolmatov2000 Could you quantize model to int8 please? Also remove auc score from table and add inference time. Seems like it normal slower tflite on x86 platform https://github.com/tensorflow/tensorflow/issues/40183#issuecomment-641393739
@balezz Added int8 quantization and it sets all the predictions to 0 class. Edited result table
Now we have tflite model without any optimizations. Please, add some optimizations and corresponding benchmarks for it.