Closed hectormdom closed 3 years ago
All steps till 9 are looking right. For Jetson Nano, it is not supported for int8 mode currently thus, avoiding int8 optimization step. For 10B . you need to change tlt-converter
option -t fp16
Hi, thanks for your quick reply, so I should skip 9A entirely? (sorry I had a typo when I typed it first, it wasn't 10A,10B) thus not generating any calibration files.
If I go this way, the only file I would have to transfer to the nano would be first output of step 9 (--output experiment_dir_final/resnet18_detector_thermal.etlt
)
In order to proceed with 9B should I just remove the -c flag? or would such argument be substituted with something else?
!tlt-converter $USER_EXPERIMENT_DIR/experiment_dir_final/resnet18_detector.etlt \
-k $KEY \
-c $USER_EXPERIMENT_DIR/experiment_dir_final/calibration.bin \
-o output_cov/Sigmoid,output_bbox/BiasAdd \
-d 3,544,960 \
-i nchw \
-m 64 \
-t fp16 \
-e $USER_EXPERIMENT_DIR/experiment_dir_final/resnet18_detector.trt \
-b 4
the only file I would have to transfer to the nano would be first output of step 9
Sounds right.
In order to proceed with 9B should I just remove the -c flag? or would such argument be substituted with something else?
Yes. Calibration is performed in TensorRT to reduce loss of accuracy; you can remove -c
Closing as no update since 10 days, please re-open if any question on similar lines.
Between what I've read, what I've watched, and what's in the jupyter notebook I'm a bit confused regarding the inputs and outputs, I would like to run through you what I think it's correct. I modified this with respect from the original jupyter notebook because I think the default jupyter notebook is doing something like working partially with both unpruned and pruned models, but it doesn't have all the steps to be able to run both. I am doing it so I can run the pruned model in the jetson nano.
[In the x86 system]
(There's like a second step in the notebook which I think was for benchmarking between the pruned and the unpruned model that I think it's safe to ignore if I am just trying to get the pruned model to run in the jetson nano)
-9A. Int8 Optimisation
-second step
[In the jetson nano] -9B. Generate TensorRT engine, using the downloaded tlt-converter
Please let me know if I'm doing anything wrong, cheers!