Open shao77622 opened 11 months ago
Firstly, I build the model_b1_gpu0_int8.engine file with calibration, and I got the calib.table file. Then I need to build other batch size of .engine file for different batch inference. Do I need to make calibration every time? thank you!
You don't need to recalibrate. Just keep the calib.table file and it will use the generated calibration.
calib.table
Firstly, I build the model_b1_gpu0_int8.engine file with calibration, and I got the calib.table file. Then I need to build other batch size of .engine file for different batch inference. Do I need to make calibration every time? thank you!